🏃‍➡️ The AI Olympics: How Meta Secretly Rigged the Game! episode artwork

EPISODE · Jun 14, 2025 · 21 MIN

🏃‍➡️ The AI Olympics: How Meta Secretly Rigged the Game!

from A Beginner's Guide to AI

Ever wondered if AI leaderboards are as fair as they seem? In today's episode of A Beginner's Guide to AI, Professor GePhardT digs into the explosive controversy known as the "Leaderboard Illusion." With the crowdsourced AI ranking platform LM Arena securing a jaw-dropping $100 million investment and skyrocketing its valuation to $600 million, AI evaluation has become serious business. But recent revelations accuse big players like Meta of secretly gaming the rankings—testing multiple hidden versions of their AI models to artificially inflate their scores. Join us as we unravel this juicy saga, discuss why fairness and transparency matter, and explore how these leaderboards can impact the AI landscape.Tune in to get my thoughts, don't forget to ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠subscribe to our Newsletter⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠!Want to get in contact? Write me an email: [email protected] podcast was generated with the help of ChatGPT and Mistral . We do fact-check with human eyes, but there still might be hallucinations in the output. And, by the way, it's read by an AI voice from ElevenLabs.Music credit: "Modern Situations" by Unicorn Heads Hosted on Acast. See acast.com/privacy for more information.

Ever wondered if AI leaderboards are as fair as they seem? In today's episode of A Beginner's Guide to AI, Professor GePhardT digs into the explosive controversy known as the "Leaderboard Illusion." With the crowdsourced AI ranking platform LM Arena securing a jaw-dropping $100 million investment and skyrocketing its valuation to $600 million, AI evaluation has become serious business. But recent revelations accuse big players like Meta of secretly gaming the rankings—testing multiple hidden versions of their AI models to artificially inflate their scores. Join us as we unravel this juicy saga, discuss why fairness and transparency matter, and explore how these leaderboards can impact the AI landscape.Tune in to get my thoughts, don't forget to ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠subscribe to our Newsletter⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠!Want to get in contact? Write me an email: [email protected] podcast was generated with the help of ChatGPT and Mistral . We do fact-check with human eyes, but there still might be hallucinations in the output. And, by the way, it's read by an AI voice from ElevenLabs.Music credit: "Modern Situations" by Unicorn Heads Hosted on Acast. See acast.com/privacy for more information.

NOW PLAYING

🏃‍➡️ The AI Olympics: How Meta Secretly Rigged the Game!

0:00 21:00

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

Frequently Asked Questions

How long is this episode of A Beginner's Guide to AI?

This episode is 21 minutes long.

When was this A Beginner's Guide to AI episode published?

This episode was published on June 14, 2025.

What is this episode about?

Ever wondered if AI leaderboards are as fair as they seem? In today's episode of A Beginner's Guide to AI, Professor GePhardT digs into the explosive controversy known as the "Leaderboard Illusion." With the crowdsourced AI ranking platform LM Arena...

Can I download this A Beginner's Guide to AI episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.
URL copied to clipboard!