How Netflix, Uber, and YouTube Handle Scale
from Deep Dive Hosted by Deep Dive
Four companies. Billions of users. Same underlying problem, completely different answers. And one shared set of building blocks underneath it all. Netflix. 325M subscribers. 1,000+ microservices on AWS. In 2008, a monolithic database corruption took down DVD shipping for 3 days. That triggered a 7-year cloud migration. In 2011 they built Chaos Monkey — software that randomly kills production servers, on purpose, every business day. Open Connect, their CDN, serves 73 terabits per second at a 98% cache hit rate. And they open-sourced almost all of it — Zuul, Eureka, Hystrix, Chaos Monkey, EVCache. Compete on content, not on plumbing. Uber. 36-42M trips per day. 202M MAU. The problem isn't bits, it's physical space. They built H3 — a hexagonal hierarchical geospatial index. Hexagons because every neighbor is equidistant (squares have diagonals 41% farther than edges). Finding nearby drivers is effectively O(1). Matching uses a bipartite-graph Hungarian-style algorithm that minimizes total wait across all riders. The closest driver isn't always your driver — because that might leave someone else with a 20-minute wait. Plus hot path / cold path / surge as real-time supply-and-demand code. YouTube. 500 hours of new video every minute. 2.7B MAU. ~1B viewing hours per day. ~15% of global internet traffic. Transcoding into H.264 / VP9 / AV1 — AV1 is 10-100X slower to encode but 30% smaller files. Google built a custom ASIC, the VCU, because general CPUs couldn't keep up. Maybe 5 companies on Earth can justify designing their own silicon. Spotify. 751M MAU, 290M premium. The real product isn't music — Apple, Amazon, YouTube Music have the same songs. It's recommendations. Hybrid engine: collaborative filtering + content-based audio analysis + NLP on lyrics. Discover Weekly is part exploration, part exploitation. Then the four universal building blocks — consistent hashing, cache-aside with TTL, Kafka vs RabbitMQ vs SQS, and Raft consensus (the algorithm designed specifically to be understandable enough to implement correctly, now under every Kubernetes cluster via etcd). Closes with three predictions for 2026-2028. RELATED EPISODES System Design Interview: What Interviewers Actually Look For — the building-block vocabulary applied How LLM Inference Actually Works — the infrastructure / hardware layer underneath all of this Platform Engineering Goes AI-Native — what comes next after the microservices era RAG in Production — the recommendation-engine analog for AI applications CHAPTERS 00:00 Cold open — 4 companies, billions of users, same problems solved differently 01:18 Netflix — 325M subs, 1,000+ microservices, the 2008 outage that triggered the cloud migration 07:25 Chaos Monkey — breaking production on purpose, every business day 09:21 Open Connect CDN — 73 Tbps at 98% cache hit, 400 Gbps per box on FreeBSD 12:43 Uber — 36-42M trips/day, the physical-space problem 13:44 H3 hexagonal geospatial index — why hexagons beat squares, O(1) proximity 15:55 Bipartite-graph Hungarian matching — minimize total wait, not just yours 18:35 Surge pricing as real-time supply-and-demand across 10,000+ cities 20:13 YouTube — 500 hours/min, 2.7B MAU, ingest + transcoding pipeline 21:37 Codec wars — H.264 vs VP9 vs AV1 (10-100X slower encoding for 30% smaller files) 24:20 The VCU custom ASIC — when designing silicon saves money 28:15 Spotify — 751M MAU, hybrid recommendation engine, explore-exploit 35:53 Four building blocks — consistent hashing, cache-aside, queues, Raft 42:40 Three predictions for 2026-2028 SOURCES Netflix Open Connect engineering blog + Q4 2025 earnings Chaos Monkey / Simian Army — Netflix Tech Blog (2011) Uber H3 — open-source Engineering blog + GitHub YouTube VCU — Google Research ASIC paper Spotify Discover Weekly — Spotify Engineering Raft consensus — Ongaro + Ousterhout, USENIX 2014 Karger consistent hashing — MIT, 1997
Embed this episode
No transcript yet.