“by Stanford lab, right? And this was about distilling data…” — Practical AI at 5:34
“by Stanford lab, right? And this was about distilling data from bigger models like GPT-3, ChatGPT, GPT-4, and being able to train smaller models on that distilled synthetic data, something they call the instruction data. So that alpaca format really opened up the playing field for everybody to start making these…”
0:00
46:39