Skip to content

“Overall, what we do on our performance optimization is…” — Practical AI at 8:23

Practical AI Large models on CPUs

“Overall, what we do on our performance optimization is skip all the compute to get even and then use that cache hierarchy as efficiently as possible on the CPUs so we can get faster memory access than even you can get on a GPU. And we pay a little bit more by doing a little bit more compute by doing that. But…”

0:00 38:28