Skip to content
(Voiceover) OLMo 2 and building effective teams for training language models episode artwork

Nov 26, 2024 10 min

(Voiceover) OLMo 2 and building effective teams for training language models

from Interconnects Hosted by Nathan Lambert

Full post: https://www.interconnects.ai/p/olmo-2-and-building-language-model-training OLMo 2 demo: https://playground.allenai.org/ OLMo 2 artifacts: https://huggingface.co/collections/allenai/olmo-2-674117b93ab84e98afc72edc Chapters 00:00 Building AI Teams 06:35 OLMo 2 Figures Fig 1, pretrain plot: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/olmo2/pretrain.webp Fig 2, pretrain table: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/olmo2/pretrain-table.webp Fig 3, post-train table: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/olmo2/postrain-table.webp This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.interconnects.ai/subscribe

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

(Voiceover) OLMo 2 and building effective teams for training language models

0:00 10:26

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of Interconnects?

This episode is 10 minutes long.

When was this Interconnects episode published?

This episode was published on November 26, 2024.

Can I download this Interconnects episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.