747: Technical Intro to Transformers and LLMs, with Kirill Eremenko

Attention and transformers in LLMs, the five stages of data processing, and a brand-new Large Language Models A-Z course: Kirill Eremenko joins host Jon Krohn to explore what goes into well-crafted LLMs, what makes Transformers so powerful, and how to succeed as a data scientist in this new age of generative AI.This episode is brought to you by Intel and HPE Ezmeral Software Solutions, and by Prophets of AI, the leading agency for AI experts. Interested in sponsoring a SuperDataScience Podcas...

An episode of the Super Data Science: ML & AI Podcast with Jon Krohn podcast, hosted by Jon Krohn, titled "747: Technical Intro to Transformers and LLMs, with Kirill Eremenko" was published on January 9, 2024 and runs 126 minutes.

January 9, 2024 ·126m · Super Data Science: ML & AI Podcast with Jon Krohn

0:00 / 0:00

Summary

Attention and transformers in LLMs, the five stages of data processing, and a brand-new Large Language Models A-Z course: Kirill Eremenko joins host Jon Krohn to explore what goes into well-crafted LLMs, what makes Transformers so powerful, and how to succeed as a data scientist in this new age of generative AI.This episode is brought to you by Intel and HPE Ezmeral Software Solutions, and by Prophets of AI, the leading agency for AI experts. Interested in sponsoring a SuperDataScience Podcast episode? Visit passionfroot.me/superdatascience for sponsorship information.In this episode you will learn:• Supply and demand in AI recruitment [08:30]• Kirill and Hadelin's new course on LLMs, “Large Language Models (LLMs), Transformers & GPT A-Z” [15:37]• The learning difficulty in understanding LLMs [19:46]• The basics of LLMs [22:00]• The five building blocks of transformer architecture [36:29]- 1: Input embedding [44:10]- 2: Positional encoding [50:46]- 3: Attention mechanism [54:04]- 4: Feedforward neural network [1:16:17]- 5: Linear transformation and softmax [1:19:16]• Inference vs training time [1:29:12]• Why transformers are so powerful [1:49:22]Additional materials: www.superdatascience.com/747

Episode Description

Attention and transformers in LLMs, the five stages of data processing, and a brand-new Large Language Models A-Z course: Kirill Eremenko joins host Jon Krohn to explore what goes into well-crafted LLMs, what makes Transformers so powerful, and how to succeed as a data scientist in this new age of generative AI.This episode is brought to you by Intel and HPE Ezmeral Software Solutions, and by Prophets of AI, the leading agency for AI experts. Interested in sponsoring a SuperDataScience Podcast episode? Visit passionfroot.me/superdatascience for sponsorship information.In this episode you will learn:• Supply and demand in AI recruitment [08:30]• Kirill and Hadelin's new course on LLMs, “Large Language Models (LLMs), Transformers & GPT A-Z” [15:37]• The learning difficulty in understanding LLMs [19:46]• The basics of LLMs [22:00]• The five building blocks of transformer architecture [36:29]- 1: Input embedding [44:10]- 2: Positional encoding [50:46]- 3: Attention mechanism [54:04]- 4: Feedforward neural network [1:16:17]- 5: Linear transformation and softmax [1:19:16]• Inference vs training time [1:29:12]• Why transformers are so powerful [1:49:22]Additional materials: www.superdatascience.com/747

Share this episode

Similar Episodes

Episode 505: Brittney Valles on Getting out of the Suffering Olympics and Embracing Motherhood

Apr 7, 2026 ·44m

Episode 504: Keeping Up with the Super Mamás, Two Weddings and La Samaritana

Mar 24, 2026 ·36m

Episode 503: Keeping Up with the Super Mamás; Practicing Self Love

Mar 10, 2026 ·43m

Episode 502: Dr. Cam Teaches us to Parent with Influence, not Control

Mar 3, 2026 ·58m

Episode 501: Keeping Up with the Super Mamás; Taking Care of Ourselves and Paulina’s trip to Oaxaca

Feb 24, 2026 ·47m

Episode 500: Cindy Canek is Leading us Toward the Light

Feb 17, 2026 ·57m

Similar Podcasts

Super Mamás Paulina and Bricia Lopez Top-rated podcast, hosted by sisters Paulina and Bricia Lopez. Super Mamas is a judgment-free space where new, expecting and experienced mothers come together to learn from one another. Laugh and cry along with the Super Mamas every week as they share stories with friends, experts and each other. Welcome to the Super Mamas Sisterhood! New episode every Tuesday. Featured on Oprah Daily, Parents Latina, Girlboss, Univision, Telemundo and NPR Super Literário Podcast Super Literário Podcast O podcast do Super Literário para discutir cinema, literatura e cultura pop Super Down Super Down Podcast More than 15% of people in the US are affected by Major Depressive Disorder, aka depression. Beyond the stigma and the black and white photos on tumblr, depression exists as a daily reality for many of us. Yet there are few voices discussing what daily life with depression is really like. We are here to change that, with consistent discussion, supportive & hopeful joy, and jokes. Lots of jokes. Join Will and Lauren as they discuss their experiences surviving day to day life, talk about current events in the world of depression, and offer up healthy activities for coping. The goal: hope for the depressed and knowledge for those who aren't. Always real, often relevant, occasionally preachy - This is Super Down. Super TRUEper TRUE Network Let’s spread a little #TRUElove.Get to know folks from all parts of TRUE Network on a deeper level. In typical TRUE style, we talk work, family, share personal stories and have a great time. We promise a little laughter and a dose of positivity. TRUE Love

URL copied to clipboard!