MLOps at the Age of Generative AI // Barak Turovsky // #169

MLOps Coffee Sessions #169 with Barak Turovsky, MLOps at the Age of Generative AI.Thanks to Weights & Biases for sponsoring this episode. Check out their new course on evaluating and fine-tuning LLMs at wandb.me/genai-mlops.course// AbstractThe talk focuses on MLOps aspects of developing, training, and serving Generative AI/Large Language models// BioBarak is an Executive in Residence at Scale Venture Partners, a leading Enterprise venture capital firm. Barak spent 10 years as Head of Product and User Experience for Languages AI and Google Translate teams within the Google AI org, focusing on applying cutting-edge Artificial Intelligence and Machine Learning technologies to deliver magical experiences across Google Search, Assistant, Cloud, Chrome, Ads, and other products. Previously, Barak spent 2 years as a product leader within the Google Commerce team. Most recently, Barak served as Chief Product Officer, responsible for product management and engineering at Trax, a leading provider of Computer Vision AI solutions for the Retail and Commerce industries. Prior to joining Google in 2011, Barak was Director of Products in Microsoft’s Mobile Advertising, Head of Mobile Commerce at PayPal, and Chief Technical Officer at an Israeli start-up. He lived more than 10 years in 3 different countries (Russia, Israel, and the US) and speaks three languages. Barak earned a Bachelor of Laws degree from Tel Aviv University, Israel, and a Master’s of Business Administration from the University of California, Berkeley.// MLOps Jobs board jobs.mlops.community// MLOps Swag/Merchhttps://mlops-community.myshopify.com/// Related LinksBio and links about Barak's work: https://docs.google.com/document/d/1E4Yrmt_Y57oTEYHQQDvt71XzSJ8Ew5WvscAQbHV4K3U/editFramework for evaluating Generative AI use cases: https://www.linkedin.com/pulse/framework-evaluating-generative-ai-use-cases-barak-turovsky/?trackingId=%2BMRxEZ9WTPCNH2JscILTeg%3D%3DThe Great A.I. Awakening: https://www.nytimes.com/2016/12/14/magazine/the-great-ai-awakening.html--------------- ✌️Connect With Us ✌️ -------------Join our Slack community: https://go.mlops.community/slackFollow us on Twitter: @mlopscommunitySign up for the next meetup: https://go.mlops.community/registerCatch all episodes, blogs, newsletters, and more: https://mlops.community/Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/Connect with Barak on LinkedIn: https://www.linkedin.com/in/baraktur/Timestamps:[00:00] Barak's preferred coffee[00:23] Barak Turovsky's background[03:10] Please like, share, and subscribe to our MLOps channels![04:09] Getting into tech[08:39] First wave of AI[12:39] Building a product at scale and the challenges[15:59] Framework for evaluating Generative AI use cases[24:33] Machine trust adoption[29:13] Wandb's new course[31:10] Focus on achievable use cases for LLMs[36:36] User feedback[38:23] Disruption of entertainment and customer interactions [46:14] Get new tools or work with your own distribution?[47:57] Importance of data engineers[53:28] ML Engineers Collaborate with Product[56:13] Wrap up