“So transformers end up becoming the algorithm that he…” — Azeem Azhar's Exponential View at 20:21
“So transformers end up becoming the algorithm that he said, OK, this is the algorithm that we should use because it can scale. But the belief that it would come down to rapid scaling of data and compute came before the discovery of the transformer or the invention of the transformer. So the discussions around it…”
0:00
45:47