Building Scalable Data-Streaming Cloud Services

Addison Huddy (@addisonhuddy, Sr Dir of PM @Confluentinc) talks about the evolution of cloud-based Kafka platforms, and how this might reshape how all OSS software moves into the cloud. SHOW: 737 CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw NEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS" SHOW SPONSORS: Equinix Global Data Centers and Networking Learn more and signup at https://deploy.equinix.com/. Datadog Security Solution: Modern Monitoring and Security Start investigating security threats before it affects your customers with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt. GCore - Global Hosting, CDN, Edge and Cloud Services Use promocode “CLOUDCAST” to receive a €100 credit on Gcore services SHOW NOTES: Cloud-native Service for Apache Kafka (Confluent) Apache Kafka - Open Source Event Streaming Platform Kora: The Cloud-Native Engine for Apache Kafka Kora Engine - 10x Better than Apache Kafka Topic 1 - Welcome to the show. Tell us a little bit about your background, and what you focus on at Confluent. Topic 2 - Let’s start with Confluent Cloud. What happens when you take an open source project and make it a cloud service? Topic 3 - After many years of learning, Confluent decided to build Kora. Walk us through that design process and the goals of this new 10x Kafka-compatible service. Topic 4 - As I’m looking through the capabilities of Kora (see below), can you give us a sense of how these compare to the previous Confluent Cloud? Topic 5 - Kora remains compatible with existing Kafka. How did you go about essentially maintaining the API/protocol while essentially re-writing the entire backend of the system? Topic 6 - Obviously you can’t speak for other open source projects, but given what Confluent has learned with Kora, do expect to see other companies potentially trying to build cloud-specific versions? (e.g. Kubernetes) Topic 7 - What sort of feedback do you get from users of the Kora system vs. the previous Confluent Cloud? FEEDBACK? Email: show at the cloudcast dot net Twitter: @thecloudcastnet FEEDBACK? Email: show @ the enterprise ai show dot com Bluesky: @TheEntAIShow.bsky.social Twitter/X: @TheEntAIShow Instagram: @TheEntAIShow