“But a soft prompt basically takes like massive prompt and…” — Practical AI at 39:07
“But a soft prompt basically takes like massive prompt and compresses it down to like way less tokens. So you can give your model like a huge prompt, a huge system prompt or huge amount of information and use like way less tokens. So soft prompting is cool. It's not going to be too difficult to like update it for like…”
0:00
46:39