Latent Space

Home
Podcast
Discord & Meetups
YouTube
AI for Engineers
About
Llama 2, 3 & 4: Synthetic Data, RLHF, Agents on the path to Open Source AGI
Llama 2 lead and Llama 3 post-training lead Thomas Scialom of Meta/FAIR, on the Chinchilla trap, why Synthetic Data and RLHF works, and how Llama4's…
2
1:05:06
The Winds of AI Winter
Mar-Jun 2024 Recap: People are raising doubts about AI Summer. Here's why AI Engineers are the solution.
2
Benchmarks 201: Why Leaderboards > Arenas >> LLM-as-Judge
Clémentine Fourier of HuggingFace on why you should stop using LLMs as Judges, what comes after MMLU, how prompts formatting sways benchmark results…
58:28
The 10,000x Yolo Researcher Metagame — with Yi Tay of Reka
Becoming PaLM2 co-lead at Google Brain, training frontier LLMs entirely from ground up in the wilderness as a startup, and playing the AI research…
1:44:38

June 2024

State of the Art: Training >70B LLMs on 10,000 H100 clusters
Josh Albrecht, CTO of Imbue, and Jon Frankle, Chief AI Scientist of Databricks, dish on what it takes to train the largest models on the largest…
 • 
Josh Albrecht
 and 
Jon Frankle
6
1:21:49
[High Agency] AI Engineer World's Fair Preview
The AIE World's Fair starts tomorrow! A special guest crosspost with Raza Habib covering the 1 year anniversary of the Rise of the AI Engineer, and…
49:41
How To Hire AI Engineers — with James Brady & Adam Wiggins of Elicit
On Defensive vs Offensive AI Engineering and the ML First mindset: Presenting our ultimate guide to Hiring AI Engineers (and How to Source Them)!
 • 
Adam Wiggins
 and 
James Brady
1
1:03:42
How AI is eating Finance — with Mike Conover of Brightwave
How we can use AI for as a "partner in thought", losing faith in long context windows for improved reasoning, and why we should stop anthropomorphizing…
54:55
ICLR 2024 — Best Papers & Talks (Benchmarks, Reasoning & Agents) — ft. Graham Neubig, Aman Sanger, Moritz Hardt)
1 longform interview, 12 more papers and 3 talks from ICLR 2024, covering Coding Agents like OpenDevin, the Science of Benchmarks, Reasoning and…
 • 
swyx & Alessio
4:29:19

May 2024

How to train a Million Context LLM — with Mark Huang of Gradient.ai
Scaling Llama3 beyond 1M context window with ~perfect utilization, the difference between ALiBi and RoPE, how to use GPT-4 to create synthetic data for…
1
57:29
ICLR 2024 — Best Papers & Talks (ImageGen, Vision, Transformers, State Space Models) ft. Durk Kingma, Christian Szegedy, Ilya Sutskever
14 of the best papers out of the 2260 papers presented at the 2024 ICLR conference, in 4 sections covering Image Generation, Vision Learning, Extending…
3:38:02
Emulating Humans with NSFW Chatbots - with Jesse Silver
Distilling personality into models with open LLMs, using DSPy and mitigating prompt injection, and 2-5xing the income of OnlyFans creators with the most…
4
54:15
© 2024 Latent.Space
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great culture