OpenAI is looking for a new head of preparedness, someone that can help the chat GPT maker avoid a lot of the catastrophic events we worry about with AI. Now, this is an interesting story because they previously had a head of preparedness who left many people from their safety team have left. And a lot of people say this is due to Sam Altman not prioritizing that part of the company and basically just pushing out models without doing all of the red teaming. This is a multi-billion dollar company.
So I don't think that's 100% the full story here. Today on the show, we're going to get into what they're looking for, how much Sam Altman is personally willing to pay for this new head of preparedness, why now is the time and everything he's been saying about this on X. We're going to get into all of that. Before we do, I want to say a big thank you to the sponsor of today's episode, which is Delve.
If compliance is something that's slowing down your deals, whether that's SOC 2, HIPAA, GPR, I know that it's a ton of work with the screenshots and the spreadsheets and all the endless back and forth. And that is why this episode is brought to you by Delve. Delve uses AI agents to automate compliance end to end. They collect evidence, they fill out security questionnaires, and they customize controls to your actual business so you can get compliant in days and not months.
You also get one on one Slack support from real security experts who respond fast. Over 1,000 fast-growing companies trust Delve to close deals faster and stay compliant as they scale. I'll leave a link in the description to Delve.com if you're interested in learning more or booking a demo. What's going on with OpenAI?
Sam Altman himself has personally posted on X saying that, quote, we are hiring ahead of preparedness. This is a critical role and an important time. Models are improving quickly and are now capable of many great things, but they're also starting to present some real challenges. The potential impact of models on mental health was something we saw a preview of in 2025.
We are just now seeing models get so good at computer security, they're beginning to find critical vulnerabilities. Okay, there's a lot going on here and I'll read more of his tweet. He said a couple of other things about this role, but essentially what they're looking for is someone that can help prevent all of the catastrophic events we've been terrified that AI could pose a risk in the future. I think this is interesting because there are a bunch of things happening with security where we see OpenAI has said that they actually basically fine-tune and train models to try to breach security.
Then they use those and to try harden their models and put in safeguards so that people can't use OpenAI models to become hackers and breach security. What's interesting to me in this is that they are actually going and training AI to be able to do this in the first place, which is kind of crazy, but maybe you need to be able to do that, to be able to control it. One shocking thing they found while they were doing this is that AI is getting so good, it's discovering security vulnerabilities, it's discovering ways to engineer social engineer situations, to be able to get data, to be able to get information, to be able to hack and to crack into things that humans weren't able to do. In other words, they had a literal red team of hackers that are trying to use AI and chat GPT to hack into things.
Then they had these real people going up against actually just training AI model to be a hacker. The AI that was trained to be a hacker was doing better than the actual people. When I say better, it was essentially thinking of new vulnerabilities, really elaborate, complex, multi-step ways to get data into hacking into things that people were not coming up with. This is definitely part of the big concern that Samalman is pointing out here and he's worried about it.
We have a strong foundation of measuring growing capabilities, but we are entering a world where we need more nuanced understanding and measurement of how those capabilities could be abused and how we can limit those downsides both in our products and in the world. In a way that lets us all enjoy the tremendous benefits, these questions are hard and there is a little precedent, a lot of ideas that sound good, have some real edge cases. The thing that I do think is interesting here and it's a great point is we obviously all love chat GPT, we obviously all want this technology to get better, it's helping us a lot of work, saving us a lot of time on a number of tasks and meanings that I'm not having to do anymore that I used to do. At the same time, there are real risks.
We have to figure out a way to balance some of the risks and if we want the AI models to get better, they're also going to get better at areas of concern. How do we mitigate that? That's who they're hiring for. Sam Altman finished off this tweet by saying, if you want to help the world figure out how to enable cyber security defenders with cutting edge capabilities while ensuring attackers can't use them or harm, ideally by making all systems more secure and similarly for how we release biological capabilities and even gain confidence in the safety of running systems that can self-improve, please consider applying.
This will be a stressful job and you'll jump into the deep end pretty much immediately. This job is not for the think-up heart, but if you go over to their careers page and you look at the give-you-out line about the team and the role and they say what you're going to be doing in the role, one thing that is interesting is the compensation for this particular job here is $555,000 a year and they also have equity along with that. So I mean, it's a very generous pay package, but it is obviously very stressful and entails a lot. When they say what you'll actually be doing in the role, they said, own opening eyes, prepare a strategy end-to-end by building capability evaluations, establishing threat models and building and coordinating mitigations, lead the development of frontier capability evaluations ensuring that they are precise, robust and scale across rapid product cycles.
You'll see mitigation design across major risk areas, ensuring safeguards are technically sound effective and aligned with underlying threat models. So one thing that I do think is interesting here with this role is, I mean, very publicly Sam Almond is going out saying, look, we're going to pay over half a million dollars a year plus compensation, which I would imagine this is like a million dollar a year, maybe $700, $800, a million a year, maybe more with the compensation package or the stock options, probably over a million, if I'm being honest. So great compensation for this role, but what does that mean? I think because of this is so publicly being posted, you could say one of two things.
Sam Almond is like, you know, signaling to everyone, look, I'm very serious about this, we really want to hire the best person. Also, it's going to be a very public-facing person, I would imagine, just given the nature of the world, and if anything goes wrong at opening eye, if any of these systems are used for safety, you know that like whoever gets this role is going to be pointed out, like, oh my gosh, XYZ person didn't do their job because this is what they were supposed to do. Now, one thing that I do think is interesting here is they already had a head of preparedness. They first announced that they were creating kind of this role in 2023.
They said that it was going to be responsible for studying potential catastrophic risks, whether they were immediate, like phishing attacks or more speculative, like nuclear threats. So that was kind of when it was first when it first came out. But less than a year later, they reassigned their head of preparedness who was Alexander Madry to a job focused on AI reasoning. So the person that was in charge of that, they reassigned them less than a year later.
And now they're trying to fill the role again. And it's interesting, like, I'm not sure if this was because Alexander himself requested to move something different, or if they just needed help over there and he had a lot of experience. I think there's definitely other safety executives opening eye that have left the company, or they've taken new roles outside of preparedness and safety and kind of moved it around as I think that got a little bit deprioritized last year. Google Gemini was putting on a lot of updates.
You know, they were concerned about meta, they were concerned about grok, they were concerned about like a lot of other players, including Claude. And it felt like they definitely kind of put this on the background because they didn't want to spend all their time on safety when they were, it felt like they were kind of falling behind on some of the model features and they were just focusing on getting the model out as fast as possible. Now if they're going to bring someone in and that's going to be their role, but that person is going to take a lot of like personal, I wouldn't say personal liability because obviously everything at the end of the day is opening eyes, you know, responsibility, but that person is going to be very public-facing. If anything goes wrong, they will 100% feel a lot of the heat on that.
They also recently updated their preparedness framework saying that it might, and they said that they're going to adjust it. It's, you know, and some of their safety requirements could be adjusted if a lab released a high-risk model without similar protections. So they're like, look, we're making our models really safe, but like Gemini or Grock come out and their model is crushing it, but they don't have the same protections. And we'll just like dial back the safety on it so that we can be competitive with them, which is definitely a very interesting point and a lot of people will find concerning.
Right now I think Sam Altman, he alluded to this in his post, but a lot of his gender and AI chatbots have faced a lot of scrutiny around specifically mental health. There's a bunch of recent lawsuits that allege that chat GPT enforces users' delusions, it increased their social isolation and even led some to suicide. So opening eye is definitely at a critical moment where they have to get this right. I think it's, you know, not an easy thing.
I think that the chat GPT, their opening eye did say that they're continuing to work on improving chat GPT's ability to recognize signs of emotional distress and to connect users to real world support. I think this is amazing. Obviously this is one of these situations where you have to learn and figure out what can go like, well, as you see things that go wrong, you have to fix them and try to improve them. I think that that is the exact right approach I would like to see more and more from opening eye.
So this is going to be interesting to see how this rolls out and hopefully to see that their safety platforms robust, but also doesn't slow down the innovation that a lot of us are using in our day-to-day lives. Thank you so much for tuning into the podcast today. As always make sure to go check out aibox.ai, my own startup to get access to all of the latest models and build incredible tools if you're not a coder, and also go check out the sponsor of today's episode, which is delve.com. There's a link in the description to Delve and I'll see you in the next episode.