Data Mixing Can Induce Phase Transitions in Knowledge Acquisition

In this episode: • The Finicky Diet of Large Language Models: Linda introduces a paper about how LLMs learn from mixtures of web data and high-quality data. Professor Norris expresses his initial intuition that more data is always better, setting the stage for the paper's surprising findings. • It's Not a Slope, It's a Cliff: Unveiling Phase Transitions: The hosts discuss the paper's core finding: knowledge acquisition isn't gradual but exhibits sudden 'phase transitions'. Linda explains how, below a critical model size or data mixing ratio, models learn almost nothing from specialized datasets, a result Professor Norris finds both fascinating and counter-intuitive. • The Knapsack Theory of Knowledge: To explain the 'why', Linda and Professor Norris explore the paper's theoretical model of 'capacity allocation'. They use a knapsack analogy to describe how a model with finite capacity strategically decides which data is 'worth' learning to minimize overall loss. • Learning More by Training on Less?: Linda and Professor Norris discuss the practical implications, including the paradoxical strategy of throwing away data to improve learning. They cover the paper's proposed solutions, like random subsampling and Compact Knowledge Mixing, and what this means for data curation. • Final Thoughts and Critical Points: The hosts summarize the paper's key insight: data mixing recipes are not one-size-fits-all, and the relationship between model size, data, and knowledge is sharp and discontinuous. They wrap up by emphasizing the importance of understanding these dynamics for efficient model training.