“Listen, you know, GPT-4 already costs like 50 million or…” — Dwarkesh Podcast at 28:53
“Listen, you know, GPT-4 already costs like 50 million or 100 million or whatever it was. Even if we have greater effective compute from hardware increases and better models, it's hard to imagine how we could sustain like four or five more orders of magnitude, greater size, effective size than GPT-4, unless we're…”
0:00
2:44:16