“The biggest breakthrough was obviously the Transformers…” — The Knowledge Project at 44:46
“The biggest breakthrough was obviously the Transformers model. Attention is all you need. That paper from Google that sort of led to where we are now. But there's been a number of really important papers since then from the idea of chain of thought reasoning into what at OpenAI, what we did with the O1 model, which…”
0:00
2:08:14