その評価は測りたいものを測れているか? | EP00

点数が高ければ、本当に能力が高いと言えるのでしょうか。視力2.0なのに黒板が読めない子のたとえから、LLMベンチマークとAgent Skillの評価を考えます。445件のベンチマーク論文を調べた研究を紹介しながら、課題の選び方、採点、データ汚染、評価者の偏りを整理します。評価で大事なのは、点数をつけることではなく、その点数が何の根拠になるのかを説明できることです。Measuring what Matters: Construct Validity in Large Language Model Benchmarksホスト：kagaya(⁠⁠@ry0_kaga⁠⁠)

Episode metadata supplied by the publisher feed · Published Aug 12, 2026

Embed this episode

Attribution link and audio player

Ready to play

その評価は測りたいものを測れているか? | EP00

0:00 23:09

1×

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

Share this episode

Similar Episodes

No similar episodes found.

Similar Podcasts

CISO Perspectives (public) N2K Networks This season on CISO Perspectives, host Kim Jones explores some of the challenges of leading through uncertainty. We explore the complexity of the changing nature of regulation and working with the federal government, the evolution of privacy and fraud, and how emerging technologies like AI and quantum computing are changing cyber. When you don’t know what questions to ask, you’re afraid to ask, or don’t know who to ask, CISO Perspectives provides the foundation for learning in this brave new world.

Frequently Asked Questions

How long is this episode of AIエンジニアリングの現場?

This episode is 23 minutes long.

When was this AIエンジニアリングの現場 episode published?

This episode was published on August 12, 2026.

Can I download this AIエンジニアリングの現場 episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.

URL copied to clipboard!