Adventures in Building CLIP & Other (Largeish) LMs // Sachin Abeywardana // #180

MLOps podcast #180 with Sachin Abeywardana, Deep Learning Engineer at Canva AI, Adventures in Building CLIP and Other (Largeish) Language Models sponsored by Prem AI.// AbstractSachin takes us on an adventure, sharing insights on the pitfalls of not understanding the broader product and the importance of incorporating AI and machine learning capabilities. From the use of AI models for grammar correction and code generation to the fascinating Clip model and the challenges of balancing work and family life, this episode promises to be both informative and thought-provoking.// BioSachin is the father of two beautiful children. He completed his PhD in Bayesian Machine Learning at the University of Sydney in 2015. In 2016, he discovered Deep Learning and hasn't looked back. He currently works as a Senior Machine Learning Engineer at Canva and is mainly focusing on NLP problems. // MLOps Jobs board jobs.mlops.community// MLOps Swag/Merchhttps://mlops-community.myshopify.com/// Related LinksSachin Blogs: https://sachinruk.github.io/blog.htmlhttps://sachinruk.github.io/blog/Graph ML link: http://web.stanford.edu/class/cs224w/⁠--------------- ✌️Connect With Us ✌️ -------------Join our Slack community: https://go.mlops.community/slackFollow us on Twitter: @mlopscommunitySign up for the next meetup: https://go.mlops.community/registerCatch all episodes, blogs, newsletters, and more: https://mlops.community/Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/Connect with Sachin on LinkedIn: https://www.linkedin.com/in/sachinabeywardana/Timestamps:[00:00] Sachin's preferred beverage[00:26] Takeaways[02:30] Chat GPT user[05:58] Understanding of reliable Agents[08:10] Sachin's background[12:45] Staying at Deep Learning [16:17] Recommendation or Lead Scoring [17:36] Vector database[19:00] Sachin's blogs[23:26] The cap people [26:10] Pursuing a business case[27:33] Canva[31:16] Incorporating AI and Machine Learning [32:17] Sponsor Ad[38:22] Eliminating unnecessary steps[39:00] Interacting with the product team[43:04] Criticisms of the current architecture limitations[45:58] Insufficient exploration of Transformers[47:42] Explaining GraphML[52:35] Fine-tuning ChatGPT2[57:54] Leading ML Engineers and teams[59:40] Being practical with Math[1:05:52] Wrap up