EP 129 : AI Benchmarks Questioned: Study Claims Tech Bias + Microsoft Phi Models, Decentralized AI

from AI Brief · host MonPod

Today, we dive deep into a new study questioning the leading AI benchmark, LMArena, with claims that it might give unfair advantages to major tech companies like Meta, Google, and OpenAI. Are AI model rankings being distorted? Plus, we explore Microsoft's impressive new small reasoning models in the Phi family, designed for efficiency on phones and laptops. Get updates on Claude's new research upgrades and integrations, FutureHouse's 'AI scientist' agents, and an ambitious experiment building the world's first user-owned, decentralized LLM. We also cover other key AI news and highlight some trending AI tools you need to know about. Tune in for your essential daily dose of AI updates!

Episode metadata supplied by the publisher feed · Published May 3, 2025

Embed this episode

Attribution link and audio player

NOW PLAYING

EP 129 : AI Benchmarks Questioned: Study Claims Tech Bias + Microsoft Phi Models, Decentralized AI

0:00 8:39

1×

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

Share this episode

Similar Episodes

No similar episodes found.

Similar Podcasts

CISO Perspectives (public) N2K Networks This season on CISO Perspectives, host Kim Jones explores some of the challenges of leading through uncertainty. We explore the complexity of the changing nature of regulation and working with the federal government, the evolution of privacy and fraud, and how emerging technologies like AI and quantum computing are changing cyber. When you don’t know what questions to ask, you’re afraid to ask, or don’t know who to ask, CISO Perspectives provides the foundation for learning in this brave new world.

Frequently Asked Questions

How long is this episode of AI Brief?

This episode is 8 minutes long.

When was this AI Brief episode published?

This episode was published on May 3, 2025.

Can I download this AI Brief episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.

URL copied to clipboard!