EPISODE · Jan 7, 2025 · 12 MIN
PowerInfer-2: Fast Large Language Model Inference on a Smartphone
from AI Podcast · host weedge
A podcast discussion about PowerInfer-2, a framework for running large language models on smartphones, focusing on its neuron cluster design, adaptive computation strategies, and I/O optimizations.
NOW PLAYING
PowerInfer-2: Fast Large Language Model Inference on a Smartphone
No transcript for this episode yet
Similar Episodes
Mar 26, 2026 ·1m
Jan 2, 2026 ·47m
Dec 21, 2025 ·46m