“Control protocols don’t always need to know which models are scheming” by Fabien Roger episode artwork

EPISODE · Apr 26, 2026 · 10 MIN

“Control protocols don’t always need to know which models are scheming” by Fabien Roger

from LessWrong (30+ Karma)

These are my personal views. To detect if an agent is taking a catastrophically dangerous action, you might want to monitor its actions using the smartest model that is too weak to be a schemer. But knowing what models are weak enough that they are unlikely to scheme is difficult, which puts you in a difficult spot: take a model too strong and it might actually be a schemer and lie to you, take a model too weak and it might fail just because it's too dumb to notice the danger. So instead you can just use all models as monitors at once and block actions if any of the monitors flag it as dangerous[1]. In some situations, this lets you build protocols that you can implement without knowing which models are scheming and that get the same level of safety as if you perfectly knew which models were scheming (though it doesn’t let you know what level of safety you actually have). This post presents some toy models illustrating the benefits of ensembling monitors of various trustedness and explains what consequences it might have in practice to be using protocols that are somewhat agnostic about which of the [...] ---Outline:(01:30) Toy models(01:33) The n=2 case(03:52) Continuum of models(04:50) Ensembling monitors in practice The original text contained 1 footnote which was omitted from this narration. --- First published: April 26th, 2026 Source: https://www.lesswrong.com/posts/WiYDawNhFp5cM7uqF/control-protocols-don-t-always-need-to-know-which-models-are --- Narrated by TYPE III AUDIO.

NOW PLAYING

“Control protocols don’t always need to know which models are scheming” by Fabien Roger

0:00 10:35

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

Accidental Accountant Regan Williams Hi, I'm Regan! I'm a CPA of 30+ years helping "accidental accountants" navigate tax & accounting issues with confidence! Here, we find solutions to common challenges bookkeepers, accountants and CPAs face. Don't see an answer to your question? Then ask! I'm here to help people like you. Two Recruiters: Zero Filter Two Recruiters At Two Recruiters: Zero Filter, we're on a mission to demystify the hiring process, share insider tips, and empower you to maneuver through the professional world with confidence. With more than 30 years of combined experience navigating the intricate web of job markets, talent acquisition, and career development, we're here to spill the tea on everything career related. But wait, there’s more! We will dive into many life topics that are interesting to us as well.  Get ready for a rollercoaster of insights, stories, and no-holds-barred advice!Join us for conversations that matter – where work, life, and authenticity collide in the most unexpected and rewarding ways. Capital Ideas Podcast Capital Group Want to learn how professional investors do it? The Capital Ideas podcast brings you the latest investment thinking from Capital Group, one of the world's largest investment management organizations. Each week we'll get inside the minds of portfolio managers, analysts and economists to break down market trends, macroeconomic forces, investing approaches and lessons learned from personal experience. Take 30 minutes and tap into the intellectual capital of Capital Group. Capital Client Group, Inc.All Capital Group trademarks mentioned are owned by The Capital Group Companies, Inc., an affiliated company or fund. All other company and product names mentioned are the property of their respective companies.For full disclosures go to capitalgroup.com/global-disclosures. My Take On It with Your Angelic Karma® Your Angelic Karma Here we take a look at how the United States measures alongside other First World Nations. + taking a deep dive into the science -The Report

Frequently Asked Questions

How long is this episode of LessWrong (30+ Karma)?

This episode is 10 minutes long.

When was this LessWrong (30+ Karma) episode published?

This episode was published on April 26, 2026.

What is this episode about?

These are my personal views. To detect if an agent is taking a catastrophically dangerous action, you might want to monitor its actions using the smartest model that is too weak to be a schemer. But knowing what models are weak enough that they are...

Can I download this LessWrong (30+ Karma) episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.
URL copied to clipboard!