“You don't need to hit GPT-4. You don't need the most…” — Practical AI at 28:59
“You don't need to hit GPT-4. You don't need the most expensive model. If you have some kind of open source model that is cheap, then let the simple query go to that 7B model. And so I've been hearing people call it an AI gateway. Others, I think, have called it like a LLM proxy, maybe, or a router. Yeah, that's…”
0:00
55:09