All Episodes
Arxiv Papers — 1,000 episodes · page 10 of 10
[QA] What Matters in Transformers? Not All Attention is Needed
What Matters in Transformers? Not All Attention is Needed
[QA] Language Models Encode Numbers Using Digit Representations in Base 10
Language Models Encode Numbers Using Digit Representations in Base 10
[QA] Don't Transform the Code, Code the Transforms: Towards Precise Code Rewriting using LLMs
Don't Transform the Code, Code the Transforms: Towards Precise Code Rewriting using LLMs
[QA] Do Unlearning Methods Remove Information from Language Model Weights?
Do Unlearning Methods Remove Information from Language Model Weights?
[QA] MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
[QA] Pixtral 12B
Pixtral 12B
[QA] Differential Transformer
Differential Transformer
[QA] GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models
GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models
[QA] Efficient Dictionary Learning with Switch Sparse Autoencoders
Efficient Dictionary Learning with Switch Sparse Autoencoders
[QA] Visual Scratchpads: Enabling Global Reasoning in Vision
Visual Scratchpads: Enabling Global Reasoning in Vision
[QA] RL, but don't do anything I wouldn't do
RL, but don't do anything I wouldn't do
[QA] Restructuring Vector Quantization with the Rotation Trick
Restructuring Vector Quantization with the Rotation Trick
[QA] EnsemW2S: Can an Ensemble of LLMs be Leveraged to Obtain a Stronger LLM?
EnsemW2S: Can an Ensemble of LLMs be Leveraged to Obtain a Stronger LLM?
[QA] Density estimation with LLMs: a geometric investigation of in-context learning trajectories
Density estimation with LLMs: a geometric investigation of in-context learning trajectories
[QA] Teaching Transformers Modular Arithmetic at Scale
Teaching Transformers Modular Arithmetic at Scale
[QA] What Matters for Model Merging at Scale?
What Matters for Model Merging at Scale?
[QA] Depth Pro: Sharp Monocular Metric Depth in Less Than a Second
Depth Pro: Sharp Monocular Metric Depth in Less Than a Second
[QA] Were RNNs All We Needed?
Were RNNs All We Needed?
[QA] OOD-CHAMELEON: Is Algorithm Selection for OOD Generalization Learnable?
OOD-CHAMELEON: Is Algorithm Selection for OOD Generalization Learnable?
[QA] Training Language Models on Synthetic Edit Sequences Improves Code Synthesis
Training Language Models on Synthetic Edit Sequences Improves Code Synthesis
[QA] Automated Red Teaming with GOAT: the Generative Offensive Agent Tester
Automated Red Teaming with GOAT: the Generative Offensive Agent Tester
[QA] Not All LLM Reasoners Are Created Equal
Not All LLM Reasoners Are Created Equal
[QA] Law of the Weakest Link: Cross Capabilities of Large Language Models
Law of the Weakest Link: Cross Capabilities of Large Language Models
[QA] Realistic Evaluation of Model Merging for Compositional Generalization
Realistic Evaluation of Model Merging for Compositional Generalization
[QA] Emu3: Next-Token Prediction is All You Need
Emu3: Next-Token Prediction is All You Need
[QA] MIO: A Foundation Model on Multimodal Tokens
MIO: A Foundation Model on Multimodal Tokens
[QA] A Preliminary Study of o1 in Medicine: Are We Closer to an AI Doctor ?
A Preliminary Study of o1 in Medicine: Are We Closer to an AI Doctor ?
[QA] Logic-of-Thought: Injecting Logic into Contexts for Full Reasoning in Large Language Models
Logic-of-Thought: Injecting Logic into Contexts for Full Reasoning in Large Language Models
[QA] Making Text Embedders Few-Shot Learners
Making Text Embedders Few-Shot Learners
[QA] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale
Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale
[QA] Infer Human's Intentions Before Following Natural Language Instruction
Infer Human's Intentions Before Following Natural Language Instruction
[QA] MaskLLM: Learnable Semi-Structured Sparsity for Large Language Models
MaskLLM: Learnable Semi-Structured Sparsity for Large Language Models
[QA] Counterfactual Token Generation in Large Language Models
Counterfactual Token Generation in Large Language Models
[QA] Characterizing stable regions in the residual stream of LLMs
Characterizing stable regions in the residual stream of LLMs
[QA] Watch Your Steps: Observable and Modular Chains of Thought
Watch Your Steps: Observable and Modular Chains of Thought
[QA] Seeing Faces in Things: A Model and Dataset for Pareidolia
Seeing Faces in Things: A Model and Dataset for Pareidolia
[QA] Rule Extrapolation in Language Models: A Study of Compositional Generalization on OOD Prompts
Rule Extrapolation in Language Models: A Study of Compositional Generalization on OOD Prompts
[QA] Style over Substance: Failure Modes of LLM Judges in Alignment Benchmarking
Style over Substance: Failure Modes of LLM Judges in Alignment Benchmarking
[QA] LLM Surgery: Efficient Knowledge Unlearning and Editing in Large Language Models
LLM Surgery: Efficient Knowledge Unlearning and Editing in Large Language Models
[QA] Embedding Geometries of Contrastive Language-Image Pre-Training
Embedding Geometries of Contrastive Language-Image Pre-Training
[QA] Kolmogorov–Arnold Transformer
Kolmogorov–Arnold Transformer
[QA] Fine-Tuning Image-Conditional Diffusion Models is Easier than You Think
Fine-Tuning Image-Conditional Diffusion Models is Easier than You Think
[QA] Re-Introducing LayerNorm: Geometric Meaning, Irreversibility and a Comparative Study with RMSNorm
Re-Introducing LayerNorm: Geometric Meaning, Irreversibility and a Comparative Study with RMSNorm
[QA] Is Tokenization Needed for Masked Particle Modelling?
Is Tokenization Needed for Masked Particle Modelling?
[QA] Finetuning Language Models to Emit Linguistic Expressions of Uncertainty
Finetuning Language Models to Emit Linguistic Expressions of Uncertainty
[QA] To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoning
To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoning
[QA] On the limits of agency in agent-based models
On the limits of agency in agent-based models
[QA] Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models
Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models
[QA] Finetuning CLIP to Reason about Pairwise Differences
Finetuning CLIP to Reason about Pairwise Differences
[QA] Think Twice Before You Act: Improving Inverse Problem Solving With MCMC
Think Twice Before You Act: Improving Inverse Problem Solving With MCMC