Product Management in Machine Learning // Laszlo Sragner // MLOps Meetup #54

MLOps community meetup #54! Last Wednesday, we talked to Laszlo Sragner, Founder, Hypergolic.Join the Community: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://go.mlops.community/YTJoinIn⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Get the newsletter: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://go.mlops.community/YTNewsletter// Abstract:How my experience in quant finance and software engineering influenced how we ran ML at a London Fintech Startup. How to solve business problems with incremental ML? What's the difference between academic and industrial ML?// Bio:Laszlo worked as a quant researcher at multiple investment managers and as a DS at the world's largest mobile gaming company. As Head of Data Science at Arkera, he drove the company's data strategy, delivering solutions to Tier 1 investment banks and hedge funds. He currently runs Hypergolic (hypergolic.co.uk), an ML Consulting company helping startups and enterprises bring the maximum out of their data and ML operations.// TakeawaysContinuous evaluation and monitoring are indistinguishable in a well-set-up product team. Separation of concerns (SE, ML, DevOps, MLOps) is very important for smooth operation, and low-friction team coordination/communication is key.To be able to iterate business features into models, you need a modeling framework that can express these, which is usually a DL package.DS-es are well motivated to go more technical because they see the rewards of it. All well-run (from the DS perspective) startups in my experience do the same.// Related LinksFree eBook about MLPM: https://machinelearningproductmanual.com/Lightweight MLOps Python package: https://hypergol.ml/Blog: laszlo.substack.com----------- Connect With Us ✌️-------------   Join our Slack community: https://go.mlops.community/slackFollow us on Twitter: @mlopscommunitySign up for the next meetup: https://go.mlops.community/register  Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/Connect with Laszlo on LinkedIn: https://www.linkedin.com/in/laszlosragner/Timestamps:[00:00] Introduction to Laszlo Sranger[02:15] Laszlo's Background[09:18] Being a Quant, then influenced what you were doing with the Investment Banks?[12:24] Do you think this can be applied in different use cases or specific to what you are doing?[14:41] Do you have any thoughts of a potentially highly opinionated person?[16:54] Product management in Machine Learning[24:59] You have to be at a large company, or you have to have a large team? [26:38] What are your thoughts on MLOps products helping with product management for ML? Is it an overreach or scope creep?[32:00] In the messy world of startups, due to the high cost of an MVP for NLP, is RegEx, which means to incorporate user feedback, it's incorporated by tweaking RegEx?[33:04] Do the ensemble recent models more than older models? If so, what is the decay rate of weights for older models?[35:40] Since the iterative management model is generic enough for most ML projects, which component of it can be easily generalized, and what tools are built for version control?[36:38] Topic Extraction: What type of model do you train for that task?[52:55] Thoughts on Notebooks[53:34] "I don't hate notebooks. Let's be clear about that. I put it this way: notebooks are whiteboards. You don't want your whiteboards to be your output because they're a sketch of your solution. You want the purest solution."