EPISODE · Oct 23, 2025 · 9 MIN
Transformers: The Discovery That Sparked the AI Revolution
from Y Combinator Startup Podcast · host Y Combinator
Nearly every modern AI model, from ChatGPT and Claude to Gemini and Grok, is built on the same foundation: the Transformer.In this video, YC's Ankit Gupta traces how AI learned to understand language — from early RNNs and LSTMs to attention mechanisms and the breakthrough 2017 paper Attention Is All You Need — the discovery that unlocked the modern AI era.
Embed this episode
NOW PLAYING
Transformers: The Discovery That Sparked the AI Revolution
No transcript for this episode yet
Similar Episodes
No similar episodes found.
Similar Podcasts
No similar podcasts found.