Generative AI, LLMs, & the Evolution of Product Teams w/ Dr. Thársis Souza | The New Barbarians #005

In this episode of The New Barbarians, hosts Bill Mann, Mark Connors, and producer Christopher Rosa sit down with Dr. Thársis Souza, a computer scientist, former SVP of Product Management at Two Sigma Investments, and author of Taming LLMs. Together, they explore the transformative role of AI in product management, examining how AI is driving innovation, reshaping team dynamics, and challenging traditional approaches to prioritizing and solving problems. Dr. Souza dives into the strengths and shortcomings of large language models (LLMs), showcasing their potential for creativity and idea generation while addressing critical risks such as hallucinations, non-determinism, and factuality issues. The discussion highlights strategies for improving LLM reliability, including sampling techniques, retrieval-augmented generation (RAG), and the use of grounded data. The episode concludes with Dr. Souza’s personal reflection on his 600-mile Camino de Santiago journey, emphasizing the importance of re-evaluating priorities, building resilience, and fostering personal growth. Takeaways - AI won't replace humans, but humans augmented by AI will replace those who ignore AI's evolution. - The price of intelligence is rapidly decreasing, leading to commoditization of AI tools. - Anthropomorphization of AI products enhances user experience and accessibility. - Human judgment will become increasingly valuable in evaluating AI-generated outputs. - Generative AI serves as a powerful tool for idea generation and creativity. - Understanding the non-deterministic nature of LLMs is crucial for effective use. - Sampling strategies can help manage risks associated with LLM outputs. Open source AI development may accelerate without government regulations. - The Camino de Santiago offers a unique opportunity for personal reflection and growth. - Product managers will need to adapt to the changing landscape of AI and technology. Links: 📖 Taming LLMs by Tharsis Souza - https://www.tamingllms.com/markdown/toc.html 🌐 More about podcastify.ai - https://github.com/souzatharsis/podcastfy 🌐 The GenAI Product Manager - https://www.souzatharsis.com/writing/aipm/ 💡 Subscribe for more insights on AI, digital assets, and innovation! Chapters 00:00 Introduction to the New Barbarians Podcast 02:01 Market Overview and Recent Events 09:27 Introduction to Tharsis Souza and His Work 10:30 Technical Insights on LLMs and Financial Services 17:48 Understanding Generative AI and Non-Determinism 25:46 Sampling Strategies and Risk Management in LLMs 31:33 Addressing Factuality in AI Responses 34:11 The Evolution of AI Models and Human Perception 38:59 The Future of AI: Agents and Human Agency 41:29 The Role of Product Managers in the Age of AI 49:06 The Camino de Santiago: A Journey of Reflection #AI #Bitcoin #DigitalAssets #LLMs #CaminoDeSantiago