Real LLM Success Stories: How They Actually Work // Alex Strick van Linschoten // #287

A software engineer based in Delft, Alex Strick van Linschoten, recently built Ekko, an open-source framework for adding real-time infrastructure and in-transit message processing to web applications. With years of experience in Ruby, JavaScript, Go, PostgreSQL, AWS, and Docker, I bring a versatile skill set to the table. I hold a PhD in History, have authored books on Afghanistan, and currently work as an ML Engineer at ZenML.Real LLM Success Stories: How They Actually Work // MLOps Podcast #287 with Alex Strick van Linschoten, ML Engineer at ZenML.// AbstractAlex Strick van Linschoten, a machine learning engineer at ZenML, joins the MLOps Community podcast to discuss his comprehensive database of real-world LLM use cases. Drawing inspiration from Evidently AI, Alex created the database to organize fragmented information on LLM usage, covering everything from common chatbot implementations to innovative applications across sectors. They discuss the technical challenges and successes in deploying LLMs, emphasizing the importance of foundational MLOps practices. The episode concludes with a call for community contributions to further enrich the database and collective knowledge of LLM applications.// BioAlex is a Software Engineer based in the Netherlands, working as a Machine Learning Engineer at ZenML. He was previously awarded a PhD in History (specialism: War Studies) from King's College London and has authored several critically acclaimed books based on his research work in Afghanistan.// MLOps Swag/Merchhttps://shop.mlops.community/// Related LinksWebsite: https://mlops.systemshttps://www.zenml.io/llmops-databasehttps://www.zenml.io/llmops-databasehttps://www.zenml.io/blog/llmops-in-production-457-case-studies-of-what-actually-workshttps://www.zenml.io/blog/llmops-lessons-learned-navigating-the-wild-west-of-production-llmshttps://www.zenml.io/blog/demystifying-llmops-a-practical-database-of-real-world-generative-ai-implementationshttps://huggingface.co/datasets/zenml/llmops-database --------------- ✌️Connect With Us ✌️ -------------Join our Slack community: https://go.mlops.community/slackFollow us on Twitter: @mlopscommunitySign up for the next meetup: https://go.mlops.community/registerCatch all episodes, blogs, newsletters, and more: https://mlops.community/Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/Connect with Alex on LinkedIn: https://www.linkedin.com/in/strickvlTimestamps:[00:00] Alex's preferred tea[00:15] Takeaways[00:55] LLM Database Creation Insights[03:26] Hidden Gems and LLMs[07:04] Chatbot Governance Challenges[15:16] AI Agents and IPOs[19:51] AI Interface Evolution[23:56] LLMs as Product Guides[26:57] RAG with User Context[30:29] User Experience Friction Points[36:20] ROI and Engineering Insights[41:09] Agent Debugging and Flows[45:28] Data Viz Ideas LLM[47:41] Wrap up