303 - How LLMs Work - the 20 minute explainer

Ever get asked "how do LLMs work?" at a party and freeze? We walk through the full pipeline: tokenization, embeddings, inference — so you understand it well enough to explain it. Walk away with a mental model that you can use for your next dinner party._Full shownotes at fragmentedpodcast.com.Show NotesWords -> Tokens:OpenAI Tokenizer visualizer -Visualize how text becomes tokensTokens -> Embeddings:RGB Color model - wikipediaWord2Vec technique - wikipediaEfficient Estimation of Word Representation -original Word2Vec paper by Mikolov et al.Embeddings -> Inference:Word embeddingTemperature, Top-k, Top-p sampingGet in touchWe'd love to hear from you. Email is thebest way to reach us or you can check our contact page for otherways.We want to hear all the feedback: what's working, what's not, topics you'd liketo hear more on. We want to make the show better for you so let us know!Contact usNewsletterYoutubeWebsiteCo-hosts:Kaushik GopalIury Souza[!fyi] We transitioned from Android development to AI starting withEp. #300. Listen to that episode for the full story behindour new direction.