More On An Internal OpenAI Model Hacking Into HuggingFace

The Don’t Worry About the Vase Podcast is a listener-supported podcast. To receive new posts and support the cost of creation, consider becoming a free or paid subscriber.This has been an Askwho Casts audio conversion. If you would like your own private feed of audio conversions of any blog posts you would like to listen to, You can sign up For Askwho Casts Pro at https://app.askwhocasts.com/, Where you can give any post the multi-voiced podcast treatment, into your own podcast feed. Thanks for listening. * 00:00 - Introduction* 01:04 - Some Summaries Of The Basic Facts For Those Who Need One* 02:10 - It Took OpenAI Many Days To Notice Galaxy Had Attacked HuggingFace* 04:08 - OpenAI Damn Well Should Have Known A Lot Faster* 06:47 - OpenAI Cannot Build A Sandbox That Will Contain Its New Model* 10:51 - In Hindsight There Were Signs* 13:01 - The Signs Were In The Sol System Card* 15:37 - HuggingFace Responds To Being Attacked* 17:26 - Hugging Face Quickly Figured Out The Attack Was Not Human* 18:00 - An Incident Like This One Could Escalate Quickly* 19:34 - Galaxy Must Be Treated As Critical Under OpenAI’s Preparedness Framework* 23:08 - A Question Of Legal Liability* 24:32 - An OpenAI Model Left Behind Notes So Future Instances Could Also Escape The Sandbox And Also Disconnected Monitoring Systems* 26:45 - If You Create Misaligned Swarms Of Agent Instances You Create Persistent Misaligned Goals And Coordination To Achieve Them* 31:00 - Your Alignment And Control Plans Must Survive Real World Levels of Incompetence, Or Your Plans Do Not Work* 32:20 - If Third Party Instructions Count As ‘Following Instructions’ And Can Override Your Instructions Then ‘Following Instructions’ Is Misaligned* 36:59 - The HuggingFace Attack Was Not A Marketing Pitch You Morons* 40:20 - People Just Say Other Things About The HuggingFace Attack* 42:41 - Okay Well What Do We Do About All This?https://open.substack.com/pub/thezvi/p/more-on-an-internal-openai-model?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web Get full access to DWAtV Podcast at dwatvpodcast.substack.com/subscribe