Holy fuck. This is epic.

Excited to welcome Tri Dao to the Together team! FlashAttention-2 will improve all LLMs everywhere in like <1 week. It’s absolutely brilliant!

The era of sub-quadratic LLMs is about to begin. At Together AI we've been building next gen models with large space state architectures and training them on very long sequences and the results from the recent builds are... incredible. Will share more as we get closer to…

A Lido V2 Audit Update:

Security is a top priority. To this end Lido DAO dedicated significant effort to 9 independent V2 audits.

These audits have uncovered important findings, all of which have been either acknowledged or fixed.

🧵

Share and enjoy!

RedPajama-7B performs better at 440B tokens than all the best models trained on Pile, and continues to get better. More information on experiment design in the blog post and will keep you all posted as this converges further!

Llamas in Red Pajamas will be everywhere soon! In the meantime here’s the inimitable Rae Sremmurd for your weekend listening 😁🦙youtu.be/HqiqVZ8PJ2Q Together AI

The highest earning YouTubers from every country in the world (just on ad dollars)

1. North America:

Today, I decided to do a deep-dive into the age-old gas saving trick:

Using ++i instead of i++.

You may have seen this trick and asked yourself how a change this trivial and inconsequential could result in a difference in gas usage.

Well folks, here's the full explanation 🧵:

Introducing GPT-JT, a 6B parameter open source model that can outperform many 100B+ parameter models and was trained over slow (1Gbps) internet links.

together.xyz/research/relea…

.GitHub @GitHubHelp haven't been able to login to my account for weeks, what's going on: 'There have been several failed attempts to sign in from this account or IP address. Please wait a while and try again later.' Nothing from the support ticket either... Pro user too. :(

gm 😬

Current Alameda borrow on WAVES looks to be 631,763 paying ($30M+) 12.5% APR

api.vires.finance/user/3PHkZUJpS…

While WAVES-PERP on FTX is at -120% APR, Binance at -80% APR

Permissionless means _anyone_ can access the mkts and hold tokens -- incl banks, governments, VCs

A true change and shift in balance and power though is about equal access from start

It’s funny that reactions to web3 tend to follow the ideas of Three Poisons in Buddhism & Kleshas in Hinduism. These predict that humans will react to a challenging new stimulus with one of the following:

1) extreme passion
2) extreme aggression
3) extreme indifference

Wow. Totally blown away by Manjaro+Sway. Desktop Linux is finally here, ladies and gents

wow, unbelievably bad fraud claim experience with Chase ChaseSupport - it’s been 9 months and not a single human being has looked properly at my file, denying without any reason

Hi friendly nerds! Love working on hard technical problems for a ✨magical✨ product with a great (fully remote) team? We're hiring a software engineer to work on our game platform!

twitter.com/hiddendoorco/s…

fascinating afternoon, new iphones are out and raydium grape IDO bots exposed a bug which made solana DDoS itself

“Startup Help Desk“ with Sean Byrnes, @ashrust, Nic Meliones. Tomorrow at 5:00 PM PT / 8pm ET on @clubhouse!

Get answers to all of your startup questions from experienced founders. Open to everyone!

#startup #entrepreneur #founders
clubhouse.com/event/xpjRBp9L