EPISODE · Apr 21, 2026 · 1H 17M
Getting Started with Local AI
from vBrownBag · host vBrownBag
Join us for Part 1 of a 3-part series as Du'An Lightfoot (Senior AI Engineer at Akamai) breaks down everything you need to know to get started running AI models locally on your own hardware. Du'An walks through the fundamentals of local AI - from understanding why you'd want to run models privately (data ownership, air-gapped environments, IP protection) to the hardware concepts that make it possible. You'll learn how inference actually works under the hood, why GPUs matter for AI workloads, how to choose and quantize models for your hardware, and how to get up and running with tools like Ollama. This is Part 1 of a 3-part series - future episodes cover serving models via API and distributing inference at the edge with Kubernetes. Timestamps 0:00 Cold Open: Why Local AI? 0:26 Welcome & Introduction 1:30 Following Up on the Frontier Models Episode 2:25 Du'An's Background & AI Inference at Akamai 3:49 What If You Wanted to Own Your Data? 5:00 Local AI vs Cloud AI: A Different Layer of the Stack 5:47 Why GPUs Matter: The Nvidia Story 7:03 CPU vs GPU: Serial vs Parallel Processing 8:28 Model Weights & Quantization Explained 12:45 Choosing the Right Model for Your Hardware 18:22 Getting Started with Ollama 24:16 Live Demo: Running Your First Local Model 30:41 Hardware Recommendations & Requirements 36:52 Hugging Face & Finding Models 42:18 Performance Tips & Benchmarking 48:35 Use Cases: When to Go Local vs Cloud 1:01:30 Live Demo: Claude Put-in-Work Repo 1:11:17 Bonus: Building a Deck with Co-work Live 1:16:36 Preview: Episodes 2 & 3 1:17:17 Wrap-up How to find Du'An: https://www.duanlightfoot.com/ https://github.com/labeveryday/ Links from the show: https://ollama.com/ https://apxml.com/ https://localllm.in/ https://huggingface.co/ https://github.com/labeveryday/claude-put-in-work https://claude.ai/
What this episode covers
Join us for Part 1 of a 3-part series as Du'An Lightfoot (Senior AI Engineer at Akamai) breaks down everything you need to know to get started running AI models locally on your own hardware. Du'An walks through the fundamentals of local AI - from understanding why you'd want to run models privately (data ownership, air-gapped environments, IP protection) to the hardware concepts that make it possible. You'll learn how inference actually works under the hood, why GPUs matter for AI workloads, how to choose and quantize models for your hardware, and how to get up and running with tools like Ollama. This is Part 1 of a 3-part series - future episodes cover serving models via API and distributing inference at the edge with Kubernetes. Timestamps 0:00 Cold Open: Why Local AI? 0:26 Welcome & Introduction 1:30 Following Up on the Frontier Models Episode 2:25 Du'An's Background & AI Inference at Akamai 3:49 What If You Wanted to Own Your Data? 5:00 Local AI vs Cloud AI: A Different Layer of the Stack 5:47 Why GPUs Matter: The Nvidia Story 7:03 CPU vs GPU: Serial vs Parallel Processing 8:28 Model Weights & Quantization Explained 12:45 Choosing the Right Model for Your Hardware 18:22 Getting Started with Ollama 24:16 Live Demo: Running Your First Local Model 30:41 Hardware Recommendations & Requirements 36:52 Hugging Face & Finding Models 42:18 Performance Tips & Benchmarking 48:35 Use Cases: When to Go Local vs Cloud 1:01:30 Live Demo: Claude Put-in-Work Repo 1:11:17 Bonus: Building a Deck with Co-work Live 1:16:36 Preview: Episodes 2 & 3 1:17:17 Wrap-up How to find Du'An: https://www.duanlightfoot.com/ https://github.com/labeveryday/ Links from the show: https://ollama.com/ https://apxml.com/ https://localllm.in/ https://huggingface.co/ https://github.com/labeveryday/claude-put-in-work https://claude.ai/
NOW PLAYING
Getting Started with Local AI
No transcript for this episode yet
Similar Episodes
Mar 27, 2017