EPISODE · Jun 17, 2026 · 8 MIN
EP252: Optimal Data Scheduling
from Learning GenAI via SOTA Papers - Video · host Yun Wu
Title: How Should LLMs Consume High-Quality Data? Optimal Data Scheduling via Quality-Aware Functional Scaling LawsSource: http://arxiv.org/abs/2605.25698v1Summary:This paper establishes foundational quality-aware functional scaling laws that provide the first theoretical closed-form solution for scheduling high-quality data during LLM training. The introduced 'Drop-Stable-Rampup' schedule optimizes training dynamics across noise-limited and signal-limited regimes, yielding significant breakthroughs in mathematical reasoning performance.
What this episode covers
Title: How Should LLMs Consume High-Quality Data? Optimal Data Scheduling via Quality-Aware Functional Scaling LawsSource: http://arxiv.org/abs/2605.25698v1Summary:This paper establishes foundational quality-aware functional scaling laws that provide the first theoretical closed-form solution for scheduling high-quality data during LLM training. The introduced 'Drop-Stable-Rampup' schedule optimizes training dynamics across noise-limited and signal-limited regimes, yielding significant breakthroughs in mathematical reasoning performance.
NOW PLAYING
EP252: Optimal Data Scheduling
No transcript for this episode yet
Similar Episodes
Apr 21, 2026 ·13m
Apr 19, 2026 ·16m
Apr 17, 2026 ·13m
Apr 13, 2026 ·11m
Apr 11, 2026 ·16m