E38: OpenAI Grant Winner: Building AI That Actually Understands What Matters to People

In this episode of Polyweb, host Sara Landi Tortoli interviews Oliver Klingefjord, the co-founder and technical lead at the Meaning Alignment Institute.The Institute won an OpenAI grant to explore "democratic fine-tuning" as an approach that differs from Constitutional AI. During the conversation, Oliver and Sara discuss the process of creating a "moral graph" based on people's discussions of values, the potential risks of personalized AI models, and the broader implications of their work in aligning technology with human meaning and purpose.00:00 Intro04:42 How the Meaning Alignment Institute won the OpenAI grant to explore democratic AI alignment08:13 Comparing democratic fine-tuning to RLHF and Constitutional AI12:33 Institute's process of surfacing underlying values through moral dilemmas16:00 Creating a "moral graph" to capture wisdom and agreements22:04 Risks of personalized AI models and the need for shared human values26:25 Using the moral graph to guide and evaluate AI model outputs32:12 Potential applications of the moral graph36:07 Challenges of scaling to superintelligent AI39:55 Broader implications and the need for people to articulate their values43:55 Where to find more information about the Meaning Alignment Institute👉 CHECK OUT THE MEANING ALIGNMENT INSTITUTE: https://www.meaningalignment.org/📚 OTHER RESOURCES MENTIONED: Meaning Alignment Institute Substack: https://meaningalignment.substack.com/Introducing Democratic Fine-Tuning: https://meaningalignment.substack.com/p/introducing-democratic-fine-tuningValue Discovery GPT: https://chat.openai.com/g/g-TItg5klMA-values-discovery🔗 CONNECT WITH OLIVER:👥 Linkedin - https://www.linkedin.com/in/oliver-klingefjord-45b662105/🐦 Twitter - https://twitter.com/klingefjord🔗 CONNECT WITH SARA:📸 Instagram - https://bit.ly/saralanditortoli-instagram🐦 Twitter - https://twitter.com/Sara_LandiTor👥 Linkedin - https://bit.ly/saralanditortoli-linkedin💌 Newsletter - https://polyweb.beehiiv.com/🪢 ABOUT POLYWEB:Polyweb navigates through the intricate nexus of technology, product innovation, and human creativity. Engage with leading entrepreneurs and experts in uncovering how we can forge impactful companies and lead lives enriched with purpose in the Technology Era.📺 Subscribe to our YouTube channel: https://www.youtube.com/@polywebhq Hosted on Acast. See acast.com/privacy for more information.