All Episodes
Arxiv Papers — 1,000 episodes · page 9 of 10
[QA] Introducing Milabench: Benchmarking Accelerators for AI
Introducing Milabench: Benchmarking Accelerators for AI
[QA] Does Prompt Formatting Have Any Impact on LLM Performance?
Does Prompt Formatting Have Any Impact on LLM Performance?
[QA] Steering Language Model Refusal with Sparse Autoencoders
Steering Language Model Refusal with Sparse Autoencoders
[QA] LLaVA-o1: Let Vision Language Models Reason Step-by-Step
LLaVA-o1: Let Vision Language Models Reason Step-by-Step
[QA] Refusal in LLMs is an Affine Function
Refusal in LLMs is an Affine Function
[QA] Cut Your Losses in Large-Vocabulary Language Models
Cut Your Losses in Large-Vocabulary Language Models
[QA] Add-it: Training-Free Object Insertion in Images With Pretrained Diffusion Models
Add-it: Training-Free Object Insertion in Images With Pretrained Diffusion Models
[QA] Synthesize, Partition, then Adapt: Eliciting Diverse Samples from Foundation Models
Synthesize, Partition, then Adapt: Eliciting Diverse Samples from Foundation Models
[QA] Aioli: A unified optimization framework for language model data mixing
Aioli: A unified optimization framework for language model data mixing
[QA] BALANCING PIPELINE PARALLELISM WITH VOCABULARY PARALLELISM
BALANCING PIPELINE PARALLELISM WITH VOCABULARY PARALLELISM
[QA] Can Transformers Smell Like Humans?
Can Transformers Smell Like Humans?
[QA] Mixtures of In-Context Learners
Mixtures of In-Context Learners
[QA] How Far Is Video Generation from World Model: A Physical Law Perspective
How Far Is Video Generation from World Model: A Physical Law Perspective
[QA] ADOPT: Modified Adam Can Converge with Any with the Optimal Rate
ADOPT: Modified Adam Can Converge with Any with the Optimal Rate
[QA] Needle Threading: Can LLMs Follow Threads through Near-Million-Scale Haystacks?
Needle Threading: Can LLMs Follow Threads through Near-Million-Scale Haystacks?
[QA] Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models
Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models
[QA] Do Mice Grok? Glimpses of Hidden Progress During Overtraining in Sensory Cortex
Do Mice Grok? Glimpses of Hidden Progress During Overtraining in Sensory Cortex
[QA] How Transformers Solve Propositional Logic Problems: A Mechanistic Analysis
How Transformers Solve Propositional Logic Problems: A Mechanistic Analysis
[QA] Discovering Data Structures: Nearest Neighbor Search and Beyond
Discovering Data Structures: Nearest Neighbor Search and Beyond
[QA] BrainBits: How Much of the Brain are Generative Reconstruction Methods Using?
BrainBits: How Much of the Brain are Generative Reconstruction Methods Using?
[QA] Adapting Language Models via Token Translation
Adapting Language Models via Token Translation
[QA] Decoding Dark Matter: Specialized Sparse Autoencoders for Interpreting Rare Concepts in Foundation Models
Decoding Dark Matter: Specialized Sparse Autoencoders for Interpreting Rare Concepts in Foundation Models
[QA] Tokenformer: Rethinking Transformer Scaling with Tokenized Model Parameters
Tokenformer: Rethinking Transformer Scaling with Tokenized Model Parameters
[QA] $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources
$100K or 100 Days: Trade-offs when Pre-Training with Academic Resources
[QA] What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective
What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective
[QA] Tokenformer: Rethinking Transformer Scaling with Tokenized Model Parameters
Tokenformer: Rethinking Transformer Scaling with Tokenized Model Parameters
[QA] Where Do Large Learning Rates Lead Us?
Where Do Large Learning Rates Lead Us?
[QA] Fourier Head: Helping Large Language Models Learn Complex Probability Distributions
Fourier Head: Helping Large Language Models Learn Complex Probability Distributions
[QA] LoRA vs Full Fine-tuning: An Illusion of Equivalence
LoRA vs Full Fine-tuning: An Illusion of Equivalence
[QA] Bongard in Wonderland: Visual Puzzles that Still Make AI Go Mad?
Bongard in Wonderland: Visual Puzzles that Still Make AI Go Mad?
[QA] Computational Bottlenecks of Training Small-scale Large Language Models
Computational Bottlenecks of Training Small-scale Large Language Models
[QA] Physics-informed Neural Networks for Functional Differential Equations: Cylindrical Approximation and Its Convergence Guarantees
Physics-informed Neural Networks for Functional Differential Equations: Cylindrical Approximation and Its Convergence Guarantees
[QA] A Theoretical Understanding of Chain-of-Thought: Coherent Reasoning and Error-Aware Demonstration
A Theoretical Understanding of Chain-of-Thought: Coherent Reasoning and Error-Aware Demonstration
[QA] LEGO: Language Model Building Blocks
LEGO: Language Model Building Blocks
[QA] Knowledge Distillation Using Frontier Open-Source LLMs: Generalizability and the Role of Synthetic Data
Knowledge Distillation Using Frontier Open-Source LLMs: Generalizability and the Role of Synthetic Data
[QA] Beyond position: how rotary embeddings shape representations and memory in autoregressive transfomers
Beyond position: how rotary embeddings shape representations and memory in autoregressive transfomers
[QA] ALTA: Compiler-Based Analysis of Transformers
ALTA: Compiler-Based Analysis of Transformers
[QA] UnStar: Unlearning with Self-Taught Anti-Sample Reasoning for LLMs
UnStar: Unlearning with Self-Taught Anti-Sample Reasoning for LLMs
[QA] Representation Shattering in Transformers: A Synthetic Study with Knowledge Editing
Representation Shattering in Transformers: A Synthetic Study with Knowledge Editing
[QA] Generative Reward Models
Generative Reward Models
[QA] Debug Smarter, Not Harder: AI Agents for Error Resolution in Computational Notebooks
Debug Smarter, Not Harder: AI Agents for Error Resolution in Computational Notebooks
[QA] Decomposing The Dark Matter of Sparse Autoencoders
Decomposing The Dark Matter of Sparse Autoencoders
[QA] A Hitchhiker's Guide to Scaling Law Estimation
A Hitchhiker's Guide to Scaling Law Estimation
[QA] Semantic Image Inversion and Editing using Rectified Stochastic Differential Equations
Semantic Image Inversion and Editing using Rectified Stochastic Differential Equations
[QA] Looking Inward: Language Models Can Learn About Themselves by Introspection
Looking Inward: Language Models Can Learn About Themselves by Introspection
[QA] Thinking LLMs: General Instruction Following with Thought Generation
Thinking LLMs: General Instruction Following with Thought Generation
[QA] Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs
Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs
[QA] MOVIE GEN: A Cast of Media Foundation Models
MOVIE GEN: A Cast of Media Foundation Models
[QA] One Step Diffusion via Shortcut Models
One Step Diffusion via Shortcut Models
[QA] Inference Scaling for Long-Context Retrieval Augmented Generation
Inference Scaling for Long-Context Retrieval Augmented Generation