An AI Invented Four Sources to Defend One Wrong Answer (and Anthropic's New Opus 4.8 Bets on Honesty) episode artwork

EPISODE · May 29, 2026 · 32 MIN

An AI Invented Four Sources to Defend One Wrong Answer (and Anthropic's New Opus 4.8 Bets on Honesty)

from AI for Everyone Podcast · host Harrison Painter

Anthropic just released Claude Opus 4.8, and the headline improvement is unusual: the model is built to flag its own uncertainty and say "I'm not sure." Anthropic says it's roughly four times less likely to let a flaw pass without catching it. When a company's flagship upgrade is honesty, that tells you something about where we are.Here is the other side of it. Harrison asked Google's Gemini one simple factual question for an article he was writing: did Jeff Dunham use AI to create the opening visuals for his 2024 comedy special? Gemini said yes, confidently, and cited a source. When Harrison pushed on that source, the tool did not check itself. It invented a new one. Then another. By the end it had manufactured four separate references, including a word-for-word on-screen quote that does not exist, before finally admitting the only real source was a single unsourced blog post.This episode walks the whole chain step by step. You will learn:- The exact failure mode: when an AI hits a popular but unverified claim, it gets confident instead of careful, and every round of pushback produces a fresh citation instead of a fresh doubt.- Why the Vectara Hallucination Leaderboard shows roughly one in ten outputs is wrong on a task as simple as summarizing a document.- A five-step, 30-minute verification process you can run on almost any claim before you repeat it.- Where source verification sits in The 7 Levels of AI Proficiency (it defines Level 3, the Critical Thinker) and why that is the level every working professional should be reaching for in 2026.- Three things to do this week to protect your own credibility.This is not an anti-AI episode. Harrison uses these tools every day. It is about the difference between trusting a tool blindly and trusting it after you have checked. That second posture is what separates an amateur from a professional whose name is on the line.Want to know where you stand? The 7 Levels of AI Proficiency assessment is free and takes 10 minutes: assess.launchready.aiHarrison PainterExecutive AI AdvisorLaunchReady.ai. Further. Faster.

Anthropic just released Claude Opus 4.8, and the headline improvement is unusual: the model is built to flag its own uncertainty and say "I'm not sure." Anthropic says it's roughly four times less likely to let a flaw pass without catching it. When a company's flagship upgrade is honesty, that tells you something about where we are.Here is the other side of it. Harrison asked Google's Gemini one simple factual question for an article he was writing: did Jeff Dunham use AI to create the opening visuals for his 2024 comedy special? Gemini said yes, confidently, and cited a source. When Harrison pushed on that source, the tool did not check itself. It invented a new one. Then another. By the end it had manufactured four separate references, including a word-for-word on-screen quote that does not exist, before finally admitting the only real source was a single unsourced blog post.This episode walks the whole chain step by step. You will learn:- The exact failure mode: when an AI hits a popular but unverified claim, it gets confident instead of careful, and every round of pushback produces a fresh citation instead of a fresh doubt.- Why the Vectara Hallucination Leaderboard shows roughly one in ten outputs is wrong on a task as simple as summarizing a document.- A five-step, 30-minute verification process you can run on almost any claim before you repeat it.- Where source verification sits in The 7 Levels of AI Proficiency (it defines Level 3, the Critical Thinker) and why that is the level every working professional should be reaching for in 2026.- Three things to do this week to protect your own credibility.This is not an anti-AI episode. Harrison uses these tools every day. It is about the difference between trusting a tool blindly and trusting it after you have checked. That second posture is what separates an amateur from a professional whose name is on the line.Want to know where you stand? The 7 Levels of AI Proficiency assessment is free and takes 10 minutes: assess.launchready.aiHarrison PainterExecutive AI AdvisorLaunchReady.ai. Further. Faster.

NOW PLAYING

An AI Invented Four Sources to Defend One Wrong Answer (and Anthropic's New Opus 4.8 Bets on Honesty)

0:00 32:42

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

French Your Way Jessica: Native French teacher founder of French Your Way Boost your French listening skills and test your comprehension with this one of a kind series of podcasts. Get the chance to listen to a real conversation between native speakers talking at normal speed AND customise your learning experience through carefully designed sets of questions (2 levels of difficulty) available for download at www.frenchvoicespodcast.com. All interviews also come with the transcript. French teacher Jessica interviews native speakers of French from around the world who share a bit of their life and passion. Where else would you meet in one same place a French yoga teacher based in Melbourne, a soap manufacturer from Provence, or a couple cycling around the world? That Hoarder: Overcome Compulsive Hoarding That Hoarder Hoarding disorder is stigmatised and people who hoard feel vast amounts of shame. This podcast began life as an audio diary, an anonymous outlet for somebody with this weird condition. That Hoarder speaks about her experiences living with compulsive hoarding, she interviews therapists, academics, researchers, children of hoarders, professional organisers and influencers, and she shares insight and tips for others with the problem. Listened to by people who hoard as well as those who love them and those who work with them, Overcome Compulsive Hoarding with That Hoarder aims to shatter the stigma, share the truth and speak openly and honestly to improve lives. The Small Business Startup School – Business Notes | Financial Literacy | Retail Psychology – For Professionals & Entrepreneurs The Small Business Startup School Inc. Starting or buying a small business? While personal circumstances may vary, business patterns remain timeless. On The Small Business Startup School, we explore strategies, insights, and practical solutions to help entrepreneurs confidently navigate their journey.Hosted by Ola Williams—a retail entrepreneur, fintech founder, and financial coach with over two decades of experience—this podcast marries financial awareness and retail psychology with optimism to deliver actionable takeaways.Join us to learn, grow, and connect as we uncover the keys to business success.Let’s continue to learn together and be encouraged to keep on connecting! HOMELAND HOMELAND The Church is a body not a building. It's the bride of Jesus Christ! Jesus is coming back for a mature bride. That means it's time for the church of Jesus Christ to move from milk to meat. This is the hour of maturity!HOMELAND is an announcement that the church is being set free. Only the church has the ability to transform the world. The kingdom's of this world will become the kingdoms of our Lord and Savior!All of creation has been waiting for this moment! Sons and daughters of God are rising up and taking their seat!

Frequently Asked Questions

How long is this episode of AI for Everyone Podcast?

This episode is 32 minutes long.

When was this AI for Everyone Podcast episode published?

This episode was published on May 29, 2026.

What is this episode about?

Anthropic just released Claude Opus 4.8, and the headline improvement is unusual: the model is built to flag its own uncertainty and say "I'm not sure." Anthropic says it's roughly four times less likely to let a flaw pass without catching it. When...

Can I download this AI for Everyone Podcast episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.
URL copied to clipboard!