July Papers: All About Scaling

17 minute read

Scaling continues to be a super hot topic of research and our selection of papers for this month all tackle different angles of how to scale models efficient...

Sparser llamas run faster — speed up LLM inference with SparQ Attention

12 minute read

June Papers: Mamba-2 & Matmul-free Models

14 minute read

Improving transformers is now not “just one area” of machine learning research. This is illustrated by the breadth of papers we got excited about this month,...

May Papers: xLSTM, Schedule-Free Optimizers, and Multi-token prediction

12 minute read

May is always an eventful time of year for ML researchers, with final ICML paper decisions and ICLR taking place in early May, and NeurIPS submission deadlin...

April Papers: TriForce, QuaRot & Mixture-of-Depths

13 minute read

For our April selection of AI research papers, there is a clear common thread: efficient LLM inference. But as it happens, ML researchers are showing there a...