Episode 28: Beyond Supervised Learning: The Rise of In-Context Learning with LLMs

Hugo speaks with Alan Nichol, co-founder and CTO of Rasa, where they build software to enable developers to create enterprise-grade conversational AI and chatbot systems across industries like telcos, healthcare, fintech, and government.What's super cool is that Alan and the Rasa team have been doing this type of thing for over a decade, giving them a wealth of wisdom on how to effectively incorporate LLMs into chatbots - and how not to. For example, if you want a chatbot that takes specific and important actions like transferring money, do you want to fully entrust the conversation to one big LLM like ChatGPT, or secure what the LLMs can do inside key business logic?In this episode, they also dive into the history of conversational AI and explore how the advent of LLMs is reshaping the field. Alan shares his perspective on how supervised learning has failed us in some ways and discusses what he sees as the most overrated and underrated aspects of LLMs.Alan offers advice for those looking to work with LLMs and conversational AI, emphasizing the importance of not sleeping on proven techniques and looking beyond the latest hype. In a live demo, he showcases Rasa's Calm (Conversational AI with Language Models), which allows developers to define business logic declaratively and separate it from the LLM, enabling reliable execution of conversational flows.LINKSThe livestream on YouTube (https://www.youtube.com/live/kMFBYC2pB30?si=yV5sGq1iuC47LBSi)Alan's Rasa CALM Demo: Building Conversational AI with LLMs (https://youtu.be/4UnxaJ-GcT0?si=6uLY3GD5DkOmWiBW)Alan on twitter.com (https://x.com/alanmnichol)Rasa (https://rasa.com/)CALM, an LLM-native approach to building reliable conversational AI (https://rasa.com/docs/rasa-pro/calm/)Task-Oriented Dialogue with In-Context Learning (https://arxiv.org/abs/2402.12234)'We don’t know how to build conversational software yet' by Alan Nicol (https://medium.com/rasa-blog/we-don-t-know-how-to-build-conversational-software-yet-a18301db0e4b)Vanishing Gradients on Twitter (https://twitter.com/vanishingdata)Hugo on Twitter (https://twitter.com/hugobowne)Upcoming LivestreamsLessons from a Year of Building with LLMs (https://lu.ma/e8huz3s6?utm_source=vgan)VALIDATING THE VALIDATORS with Shreya Shanker (https://lu.ma/zz3qic45?utm_source=vgan) Get full access to Vanishing Gradients at hugobowne.substack.com/subscribe