ML Scalability Challenges // Waleed Kadous // MLOps Podcast # 154

MLOps Coffee Sessions #154 with Waleed Kadous, ML Scalability Challenges, co-hosted by Abi Aryan.// AbstractDr. Waleed Kadous, Head of Engineering at Anyscale, discusses the challenges of scalability in machine learning and his company's efforts to solve them. The discussion covers the need for large-scale computing power, the importance of attention-based models, and the tension between big and small data.// BioDr. Waleed Kadous leads engineering at Anyscale, the company behind the open-source project Ray, the popular scalable AI platform. Prior to Anyscale, Waleed worked at Uber, where he led overall system architecture, evangelized machine learning, and led the Location and Maps teams. He previously worked at Google, where he founded the Android Location and Sensing team, responsible for the "blue dot" as well as ML algorithms underlying products like Google Fit. // MLOps Jobs board jobs.mlops.community// MLOps Swag/Merchhttps://mlops-community.myshopify.com/// Related LinksWebsite: anyscale.comhttps://www.youtube.com/watch?v=hzW0AKKqew4https://www.anyscale.com/blog/WaleedKadous-why-im-joining-anyscaleRay Summit: https://raysummit.anyscale.com/Anyscale careers: https://www.anyscale.com/careersLearning Ray O'Reilly's book. It's free to anyone interested. https://www.anyscale.com/asset/book-learning-ray-oreilly--------------- ✌️Connect With Us ✌️ -------------Join our Slack community: https://go.mlops.community/slackFollow us on Twitter: @mlopscommunitySign up for the next meetup: https://go.mlops.community/registerCatch all episodes, blogs, newsletters, and more: https://mlops.community/Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/Connect with Abi on LinkedIn: https://www.linkedin.com/in/goabiaryan/Connect with Waleed on LinkedIn: https://www.linkedin.com/in/waleedkadous/Timestamps:[00:00] Waleed's preferred coffee[00:38] Takeaways[07:37] Waleed's background[13:16] Nvidia investment with Rey[14:00] Deep Learning use cases[17:52] Infrastructure challenges[22:01] MLOps level of maturity[26:42] Scale overloading[29:21] Large Language Models[32:40] Balance between fine-tuning forces prompts engineering[35:51] Deep Learning movement[42:05] Open-source models have enough resources[44:11] Ray[47:59] Value add for any scale from Ray[48:55] "Big data is dead" reconciliation[52:43] Causality in Deep Learning[55:16] AI-assisted Apps[57:59] Ray Summit is coming up in September! [58:49] Anyscale is hiring![59:25] Wrap up