“First, we had kind of really good autocomplete models…” — Practical AI at 27:19
“First, we had kind of really good autocomplete models because that was a meta task for people training language models. Then people figured out, oh, I kind of want to use these as general instruction following models. And so they developed specific prompt formats and prompt data sets to fine tune LLMs for…”
0:00
45:00