Skip to content
Northeastern University: Foundations of Large Language Models episode artwork

Jan 27, 2025 23 min

Northeastern University: Foundations of Large Language Models

from ibl.ai Hosted by ibl.ai

Summary of https://arxiv.org/pdf/2501.09223 Detail foundational concepts and advanced techniques in large language model (LLM) development. It covers pre-training methods, including masked language modeling and discriminative training, and explores generative model architectures like Transformers. The text also examines scaling LLMs for size and context length, along with alignment strategies such as reinforcement learning from human feedback (RLHF) and instruction fine-tuning. Finally, it discusses prompting techniques, including chain-of-thought prompting and prompt optimization methods to improve LLM performance and alignment with human preferences.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Northeastern University: Foundations of Large Language Models

0:00 23:11

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of ibl.ai?

This episode is 23 minutes long.

When was this ibl.ai episode published?

This episode was published on January 27, 2025.

Can I download this ibl.ai episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.