Ion Stoica — Spark, Ray, and Enterprise Open Source

Ion Stoica is co-creator of the distributed computing frameworks Spark and Ray, and co-founder and Executive Chairman of Databricks and Anyscale. He is also a Professor of computer science at UC Berkeley and Principal Investigator of RISELab, a five-year research lab that develops technology for low-latency, intelligent decisions.Ion and Lukas chat about the challenges of making a simple (but good!) distributed framework, the similarities and differences between developing Spark and Ray, and how Spark and Ray led to the formation of Databricks and Anyscale. Ion also reflects on the early startup days, from deciding to commercialize to picking co-founders, and shares advice on building a successful company.The complete show notes (transcript and links) can be found here: http://wandb.me/gd-ion-stoica---Timestamps: 0:00 Intro0:56 Ray, Anyscale, and making a distributed framework11:39 How Spark informed the development of Ray18:53 The story behind Spark and Databricks33:00 Why TensorFlow and PyTorch haven't monetized35:35 Picking co-founders and other startup advice46:04 The early signs of sky computing49:24 Breaking problems down and prioritizing53:17 Outro---Subscribe and listen to our podcast today!👉 Apple Podcasts: http://wandb.me/apple-podcasts​​👉 Google Podcasts: http://wandb.me/google-podcasts​👉 Spotify: http://wandb.me/spotify​