Skip to content
How Learning Rate Decay Wastes Your Best Data in Curriculum-Based LLM Pretraining-v3 episode artwork

Jan 6, 2026 20 min

How Learning Rate Decay Wastes Your Best Data in Curriculum-Based LLM Pretraining-v3

from Mechanical Dreams Hosted by Mechanical Dirk

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

How Learning Rate Decay Wastes Your Best Data in Curriculum-Based LLM Pretraining-v3

0:00 20:02

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of Mechanical Dreams?

This episode is 20 minutes long.

When was this Mechanical Dreams episode published?

This episode was published on January 6, 2026.

Can I download this Mechanical Dreams episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.