Reinventing Kafka on object storage
from Changelog Interviews
Ryan Worl, Co-founder and CTO at WarpStream, joins us to talk about the world of Kafka and data streaming and how WarpStream redesigned the idea of Kafka to run in modern cloud environments directly on top of object storage. Last year they posted a blog titled, "Kafka is dead, long live Kafka" that hit the top of Hacker News to put WarpStream on the map. We get the backstory on Kafka and why it's so widely used, who created it and for what purpose, and the behind the scenes on all things WarpStream.
Embed this episode
Chapters
- 0:00 This week on The Changelog
- 1:37 Sponsor: Speakeasy
- 5:09 Start the show!
- 6:28 What is Kafka?
- 8:11 Kafka use cases
- 10:39 Long live Kafka!
- 12:45 Kafka on prem?
- 15:01 What makes it hard to run?
- 17:45 A margin of haters
- 23:18 We met at Percona Live
- 28:14 Sponsor: Supabase
- 31:39 Object Storage sercrets
- 36:20 Kafka brokers
- 46:13 Downsides besides latency
- 49:38 Could you R2?
- 50:21 Very good demo
- 53:08 $ warpstream playground
- 1:00:10 The path for greenfield
- 1:02:37 Why not open source?
- 1:16:54 Sponsor: Paragon
- 1:19:50 Sponsor: Unblocked
- 1:21:52 Why not bootstrap?
- 1:32:40 Let's talk pricing
- 1:35:57 Deep into pricing
- 1:40:21 A good next step?
- 1:42:04 Closing thoughts and stuff
No transcript yet.
Frequently asked questions
How long is this episode of Changelog Interviews?
This episode is 1 hour and 44 minutes long.
When was this Changelog Interviews episode published?
This episode was published on August 29, 2024.
Can I download this Changelog Interviews episode?
Yes. Use the download control on the episode player to save the publisher-provided media file.