Video Short: Tokenization & Multilinguality

from AI Bites: The Academic Series Hosted by Jack Lakkapragada

A bite-sized, visual breakdown of CS224N Lecture 14! In this new NotebookLM Video Short, we pull back the curtain on the invisible preprocessing layer of modern AI: Tokenization. Key Topics: The "Strawberry" Problem: A visual look at why ChatGPT can't count letters or spell backwards due to opaque token chunks. The Multilingual Tax: A direct comparison showing how English-biased tokenizers shatter non-English prompts (like Thai or Somali) into dozens of inefficient fragments, forcing global users to pay more money for worse AI performance. The Return to Bytes: A quick look at next-generation architectures (like Google's CANINE and MrT5) that dynamically drop bytes to fix this massive inequality. Note: This is an AI-generated visual discussion created using Google's NotebookLM, based on publicly available Stanford University course material (specifically CS224N) and personal study notes from my learning journey.

Episode details come from the podcast's RSS feed.

Embed this episode

Attribution link and audio player

Ready to play

Video Short: Tokenization & Multilinguality

0:00 1:43

No transcript yet.

Requests help us decide what to transcribe next.

Share this episode

Similar podcasts

French Your Way Jessica: Native French teacher founder of French Your Way Boost your French listening skills and test your comprehension with this one of a kind series of podcasts. Get the chance to listen to a real conversation between native speakers talking at normal speed AND customise your learning experience through carefully designed sets of questions (2 levels of difficulty) available for download at www.frenchvoicespodcast.com. All interviews also come with the transcript. French teacher Jessica interviews native speakers of French from around the world who share a bit of their life and passion. Where else would you meet in one same place a French yoga teacher based in Melbourne, a soap manufacturer from Provence, or a couple cycling around the world?

Frequently asked questions

How long is this episode of AI Bites: The Academic Series?

This episode is 1 minute long.

When was this AI Bites: The Academic Series episode published?

This episode was published on July 2, 2026.

Can I download this AI Bites: The Academic Series episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.