AI in Healthcare: Real-World Testing and Global Governance

Explore the groundbreaking MedHELM framework that evaluates AI models using real clinical data, challenging the status quo of AI testing in healthcare. Discover the U.S.-led UN resolution on AI, aiming for global cooperation and safe AI practices. Delve into the rise of AI-driven election disinformation and Europe's pioneering AI Act, setting a global standard for AI regulation. This episode highlights the intersection of AI technology, ethics, and international policy, offering insights into the future of AI in healthcare, governance, and democracy. Sources: https://www.marktechpost.com/2025/03/02/medhelm-a-comprehensive-healthcare-benchmark-to-evaluate-language-models-on-real-world-clinical-tasks-using-real-electronic-health-records/ https://apnews.com/article/un-artificial-intelligence-resolution-rules-governance-goals-b442f2701139780526b34ba0527e9425 https://apnews.com/article/artificial-intelligence-elections-disinformation-chatgpt-bc283e7426402f0b4baa7df280a4c3fd https://apnews.com/article/ai-act-european-union-chatbots-155157e2be2e42d0f1acca33983d8c82 Outline: (00:00:00) Introduction (00:00:38) MedHELM: A Comprehensive Healthcare Benchmark to Evaluate Language Models on Real-World Clinical Tasks Using Real Electronic Health Records (00:04:22) US spearheads first UN resolution on artificial intelligence (00:07:57) AI-created election disinformation is deceiving the world (00:10:51) Europe's AI Act: How does it work and what happens next?