Monzo Bank - An MLOps Case Study // Neal Lathia // MLOps Coffee Sessions #20

Coffee Sessions #20 with Neal Lathia of Monzo Bank, talking about Monzo Bank - An MLOps Case StudyJoin the Community: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://go.mlops.community/YTJoinIn⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Get the newsletter: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://go.mlops.community/YTNewsletter⁠⁠⁠//BioNeal is currently the Machine Learning Lead at Monzo in London, where his team focuses on building machine learning systems that optimise the app and help the company scale. Neal's work has always focused on applications that use machine learning - this has taken him from recommender systems to urban computing and travel information systems, digital health monitoring, smartphone sensors, and banking.//Talk TakeawaysMonzo Bank has a small but very impactful team continuously learning new things. Optimistically do their utmost to avoid “throwing problems over the wall,” and so they build systems, iterate on machine learning models, and collaborate very closely with each other and with many folks across the business.Hopefully, all of that paints a picture of a team that aims to bring real and valuable machine learning systems to life. Monzo does not spend time trying to advance the state-of-the-art in machine learning or tweak models to absolute perfection.//Other links you can check Neal onPersonal Website: http://nlathia.github.io/Research: http://nlathia.github.io/research/Press & Speaking: http://nlathia.github.io/public/http://nlathia.github.io/2020/06/Customer-service-machine-learning.html http://nlathia.github.io/2020/10/ML-and-rule-engines.html http://nlathia.github.io/2020/10/Monzo-ML.html http://nlathia.github.io/2019/09/Large-NLP-in-prod.html http://nlathia.github.io/2020/07/Shadow-mode-deployments.html  https://github.com/operatorai--------------- ✌️Connect With Us ✌️ -------------Join our Slack community: https://go.mlops.community/slackFollow us on Twitter: @mlopscommunitySign up for the next meetup: https://go.mlops.community/registerConnect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/Connect with David on LinkedIn: https://www.linkedin.com/in/aponteanalytics/Connect with Neal on LinkedIn: https://www.linkedin.com/in/nlathia/Timestamps: [00:00] Intro to Neal Lathia  [02:48] Background of Monzo Bank [05:06] Problems you're solving with Machine Learning at Monzo?  [08:36] Why do you think it's fairly easy to frame a lot of problems using Machine Learning?  [11:56] How do you decide on rule-based or Machine learning?  [15:33] Team Structure  [19:18] What are some challenges, like size, latency, and the like? [21:52] How have you addressed learning skills/challenges in your team?  [26:17] Do you have something that connects your team with all the metadata you have? [27:14] Are you also having the monitoring models in your dashboard, or is that something else? [28:51] Why should I bring another tool that the company is not familiar with when we already have one?  [31:43] Do you feel like there will be a point in time where you need to buy a tool because one problem is taking so much of your time? [38:30] Engineering optimization teams for machine learning?  [40:34] Take us through the idea to production? [46:29] How do you deal with reproducibility? [49:48] Do you have ethics people on the team? [54:12] Why are you using GCP and AWS? [56:09] What are these different use cases, and how do they differ? [57:57] How do you address applications that don't work?