“The first phase of their training is basically here's a…” — The Joe Rogan Experience at 58:31
“The first phase of their training is basically here's a humongous dump of internet data, basically the whole internet, and you just brutally learn to predict the next token, the next piece of text as you basically read the whole corpus.”
0:00
2:24:05