Solving the Memory Wall: A Deep Dive into AI Inference with Sandra Rivera
from Amelia's Weekly Fish Fry Hosted by EEJournal.com
This week, I'm excited to welcome Sandra Rivera from VSORA! We dive into a discussion on why AI inference is essential for deployment at scale, specifically focusing on how VSORA’s patented software architecture addresses the "memory wall" by collapsing memory layers. We explore their recent tape-out, which promises approximately 3X the performance at half the power of leading GPUs. We also chat about deployment use cases, the need for low latency and high determinism, future plans for OEM modules and MLPerf benchmarking, and even get a brief look into Sandra’s family llama farm.
Embed this episode
Chapters
- 0:00 Episode intro & welcome
- 0:10 Show name & host introduction
- 0:26 Guest introduction — Sandra Rivera
- 1:10 What attracted Sandra to Visora
- 1:24 Visora’s differentiation and team experience
- 2:57 Why inference matters for AI proliferation
- 5:55 Inference challenges and market differentiation
- 6:11 Addressing the memory wall — Visora’s approach
- 7:58 Visora tape-out update and performance claims
- 10:07 Family story — the llama farm
- 12:24 Host’s favorite episodes playlist (recommendations)
- 15:26 Social media, links, and listener contact
- 16:30 Sign-off and episode date
No transcript yet.