All Episodes
Interconnects — 164 episodes · page 2 of 2
Interviewing Finbarr Timbers on the "We are So Back" Era of Reinforcement Learning
(Voiceover) OpenAI's o1 using "search" was a PSYOP
(Voiceover) OLMo 2 and building effective teams for training language models
(Voiceover) Tülu 3: The next era in open post-training
(Voiceover) Scaling realities
(Voiceover) Saving the National AI Research Resource & my AI policy outlook
Interviewing Tim Dettmers on open-source AI: Agents, scaling, quantization and what's next
Interviewing Andrew Carr of Cartwheel on the State of Generative AI
(Voiceover) Why I build open language models
(Voiceover) Claude's agentic future and the current state of the frontier models
Interviewing Arvind Narayanan on making sense of AI hype
(Voiceover) Building on evaluation quicksand
Interviewing Andrew Trask on how language models should store (and access) information
How scaling changes model behavior
[Article Voiceover] AI Safety's Crux: Culture vs. Capitalism
Interviewing Riley Goodside on the science of prompting
[Article Voiceover] Llama 3.2 Vision and Molmo: Foundations for the multimodal open-source ecosystem
[Article Voiceover] Reverse engineering OpenAI's o1
Futures of the data foundry business model
A post-training approach to AI regulation with Model Specs
OpenAI's Strawberry, LM self-talk, inference scaling laws, and spending more on inference
OLMoE and the hidden simplicity in training better foundation models
On the current definitions of open-source AI and the state of the data commons
Nous Hermes 3 and exploiting underspecified evaluations
Interviewing Ross Taylor on LLM reasoning, Llama fine-tuning, Galactica, agents
A recipe for frontier model post-training
Interviewing Sebastian Raschka on the state of open LLMs, Llama 3.1, and AI education
GPT-4o-mini changed ChatBotArena
Llama 3.1 405b, Meta's AI strategy, and the new open frontier model ecosystem
SB 1047, AI regulation, and unlikely allies for open models
Switched to Claude 3.5
Interviewing Dean Ball on AI policy: CA SB 1047, upcoming AI disaster response, Llama 3 405B, Chinese open-source AI, and scaling laws
RLHF Roundup: Trying to get good at PPO, charting RLHF's impact, RewardBench retrospective, and a reward model competition
Frontiers in synthetic data
Text-to-video AI is already abundant
AI for the rest of us
A realistic path to robotic foundation models
We aren't running out of training data, we are running out of open training data
Name, image, and AI's likeness
OpenAI chases Her
OpenAI's Model (behavior) Spec, RLHF transparency, and personalization questions
RLHF: A thin line between useful and lobotomized
Phi 3 and Arctic: Outlier LMs are hints
AGI is what you want it to be
Llama 3: Scaling open LLMs to AGI
Stop "reinventing" everything to "solve" alignment
The end of the "best open LLM"
Why we disagree on what open-source AI should be
DBRX: The new best open LLM and Databricks' ML strategy
Evaluations: Trust, performance, and price (bonus, announcing RewardBench)
Model commoditization and product moats
The koan of an open-source LLM
Interviewing Louis Castricato of Synth Labs and Eleuther AI on RLHF, Gemini Drama, DPO, founding Carper AI, preference data, reward models, and everything in between
How to cultivate a high-signal AI feed
Google ships it: Gemma open LLMs and Gemini backlash
10 Sora and Gemini 1.5 follow-ups: code-base in context, deepfakes, pixel-peeping, inference costs, and more
Releases! OpenAI’s Sora for video, Gemini 1.5's infinite context, and a secret Mistral model
Why reward models are still key to understanding alignment
Alignment-as-a-Service: Scale AI vs. the new guys
Open Language Models (OLMos) and the LLM landscape
Model merging lessons in The Waifu Research Department
Local LLMs, some facts some fiction
Multimodal blogging: My AI tools to expand your audience
Multimodal LM roundup: Unified IO 2, inputs and outputs, Gemini, LLaVA-RLHF, and RLHF questions
Where 2024’s “open GPT4” can’t match OpenAI’s
Interviewing Tri Dao and Michael Poli of Together AI on the future of LLM architectures