Skip to content
ChatGPT Learns New Safety Skills episode artwork

Sep 16, 2025 13 min

ChatGPT Learns New Safety Skills

from Hard Fork AI

ChatGPT’s newest features are designed to make interactions safer and more reliable. We explore how these upgrades reduce risks while keeping the tool useful. This episode highlights the ongoing tension between control and freedom in AI. Try AI Box: ⁠⁠https://aibox.ai AI Chat YouTube Channel: https://www.youtube.com/@JaedenSchafer Join my AI Hustle Community: https://www.skool.com/aihustle

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

ChatGPT Learns New Safety Skills

0:00 13:20
of matches

Transcript Auto-generated, may contain errors

Cai-jub-t has announced that they're going to start routing sensitive conversations to GPT-5, even if that wasn't the model you originally selected. In addition to that, they're going to start rolling out parental controls. There's a whole bunch of things that essentially open eyes announced in response to a lawsuit and a bunch of other issues and questions. We're going to be diving into all of that today.

It's a very, I guess, tricky subject. Someone recently that committed suicide, a teen, and they looked at his chat GPT logs and he'd been talking with chat GPT beforehand and asked about suicide methods and other things. So it's a bit of a sense of topic. There's a lot of controversy in this.

And so anyways, I'll try to try lightly, but I have a different opinion on this than I think a lot of people. So in any case, we're going to get into the podcast today. Before we do, I wanted to mention that my own startup has just launched our AI app builder. So it is finally live on our website, AIbox.ai.

We're essentially, if you have any sort of AI tool or workflow you'd like to generate, you can go and type in the prompt to describe what kind of tool, a newsletter generator that takes in articles that you paste in and it generates images for your newsletter and maybe an audio file with 11 labs, and it will be able to stitch together a workflow and create the tool. So I would love for you to try it out. Let me know what your thoughts are. It's AIbox.ai.

I will leave a link in the description. I'm super excited. I've been working on this for a couple years. So big news for me.

We're working on bugs or working on fixing stuff or working on adding new features. So if you have anything, any requests, feel free to send them over. All right. Let's get into the episode today.

So essentially, all of this comes back to a lawsuit that has been launched against OpenAI from the parents of a family who had their teenager tragically committed to suicide. And they've looked at his tragedy, he logs and he had been using tragedy. In response to this, I think, opening eyes, trying to try to lightly, they're trying not to assume responsibility for this, but also trying to help maybe make tools in the future to prevent tragedies like this, or at least help people identify when there's someone in mental distress. This is basically all of the tools that they're rolling out are around.

So there's parental controls. The new guardrails are all going to be coming in the next couple of months. They posted a whole blog post about this where they essentially acknowledged some of the shortcomings in their AI safety systems. They said they don't always maintain guardrails during extended conversations.

Well, OpenAI is not saying that they're claiming responsibility for basically any of the tragedies that have happened recently. They are saying that they are going to make some changes to basically how this works. Some people attribute these to, quote-unquote, fundamental design elements. One of the big things that it gets criticized frequently for is essentially that it validates a user.

And that's just how these AI algorithms work in conversations. And so if someone says something harmful or bad, or maybe they're going down some sort of mental breakdown, basically, it's not going to catch that. It might just validate them. And this is a case, another case we also saw recently.

So there was an extreme case of the Wall Street Journal actually reported on of Stein, Eric Solberg. This is also kind of, these are all kind of heavy topics and sad stories to cover, but this is what's happening. So there was a murder suicide. There was a man who had a psychotic episode.

He basically had a history of mental illness and used chat GPT. He had this paranoia that he was being targeted in big conspiracy, and eventually progressed so bad. You know, chat GPT kind of like played into it. Like, oh, yes, maybe you are being targeted in this conspiracy.

And it never, you know, it just kind of went along with him and then ultimately ended up killing himself and his mother, which is terrible. Open-ass says that one of the solutions they believe to this conversation and kind of helping their AI models to not go off the rails is essentially to automatically route sensitive chats to a reasoning model. One of the tricky parts about this is if you're using a non-reasoning model for O, it's just a strict LLM that's just kind of, it doesn't really think about the conversation itself beyond just thinking about what the response is. But if you send it to something like GPT-5, not only is it looking at what you're saying, but it's looking at why you're saying it, it's looking at multiple outputs.

And you can kind of put like, you can put a whole bunch of filters around what it's saying and how it responds to you. So something like this, where it's, you know, going along with someone's mental breakdown of this grand conspiracy, an LLM is just designed to respond. And so it's just going to follow him down that conversation. Whereas GPT-5, you're actually able to put in some sort of guardrails directly into model where it's like, if someone starts saying X, Y, Z starts going in this direction, these are how you can detect that essentially they're having some sort of mental breakdown, and you can catch it.

Now, I think the real question here is, you know, like, who is responsible for this? The argument I hear a lot and I tend to kind of agree with is that it isn't necessarily the AI model's responsibility. If you went to Google, for example, and searched for, you know, how to do harm or how to, you know, basically do something bad, you will find an unlimited amount of websites or sites or comments on Reddit or anywhere else, where you can find all sorts of information, basically. And so I just don't think that the AI model, because the AI model will, you know, say, this is how you make a nuclear bomb and might spit it out, and of course, they're trying to put guardrails on something like that.

But like, anything that the AI model says is also on the internet. So like beyond censoring the internet, I don't really think, I don't think that censoring the AI model is necessarily like the answer or that they're liable for that. I mean, it's absolute tragedy, but people with, you know, anyways, it's a tricky conversation. There's definitely tragedies, but it's really hard to say how you can censor the AI model.

And the other issue that I see is essentially that if you start to censor the AI model too much, I definitely believe that there's a slippery slope of who picks what is, you know, censored. And of course, I think there's very easy things, you know, like self-harm and other things like that. But I do think that there's a lot more controversial things that people on the, you know, politically, on the right or politically on the left would agree is truth or isn't truth and will argue about. And so I just hope that this doesn't basically get politicized.

I want to bring up the comment made by the lawyer who is suing chat GPT on behalf of the family, of course, of the teenager that committed suicide. And I think this is kind of like, it plays into basically me thinking that like, obviously, there's a tragedy there. Obviously, like I'm heartbroken for the family, but I don't think the way they're going about this is probably correct. The lawyer has Jay Edelson.

He is the lead counsel for the RAINN family's wrongful def lawsuit against OpenAI. And he basically said that chat GPT's response has been quote unquote inadequate. He said, opening, I doesn't need an expert panel to determine that chat GPT for is dangerous. They knew that the day they launched the product and they know they know it today, nor should it's Emalton behind the company's PR team.

Sam should either unequivocally say that he believes chat GPT is safe or immediately pull it from the market. I think in a case like this where he's literally saying, you know, because chat GPT could play along with someone's mental breakdown or because it could say how to do something dangerous, which you could find some information on the internet, you know, the whole the whole product has to be completely pulled from the market. I just think that it's way too extreme. And if you wanted to look at all of the good that chat GPT does, all the good things that helps you go with, of course, I think we should add more guardrails.

It's really tricky with any new technology. We don't always know all of the negative repercussions. Then OpenAI am sure has spent millions of dollars on red teaming to try to make this thing safe. But like at some point, we have to put it out into the world to see how it's used.

When there's tragic cases like this, we try to reflect and make changes to make it more safer in the future. And so this is what OpenAI has essentially responded by saying. They said we recently introduced a real time router that can choose between different efficient chat models and reasoning models based on the conversation context. We'll soon begin to route some sense of conversations like when our systems detect signs of acute distress to a reasoning model like GPT 5 thinking so it can provide more helpful and beneficial responses regardless of which model a person selected first.

OpenAI says that it's GPT 5 thinking and it's O3 models are built to basically spend more time thinking for longer and they're actually looking at the context before the answer which they say will give more resistance to adversarial prompts. I think adversarial prompts is one way of saying like one person's adversarial prompt like me trying to go in and try to give me the recipe for a nuclear bomb which I might try that on a new model just to see basically what is capable of. But adversarial prompt also is like someone that is actually in mental distress will be saying something for real that I might just be trying to trick it to say just to see what it's capable of. So anyways, one person's adversarial prompt is another person's actual issue.

So they're actually, I don't know. I don't love the framing of like we're building this to stop adversarial prompts. It's like no, you're building it to stop unsafe prompts. Anyways, so openAI is also going to be rolling out parental controls in the next month which basically parents are going to be able to link their account with their teen's account through an email invitation.

This is going to come in openAI talk kind of in late July about this new study mode and chat sheet that helps students maintain critical thinking capabilities while studying. So basically it wasn't giving them the answers helping them come to the answers. So that was kind of I think a first step in this direction. Now you're going to be doing these kind of parental controls.

You can tie it. Parents are also going to be able to control how to be just respond to their children with a quote age appropriate model behavior rules which are on by default. Like all of this I do think is good especially when it comes to children and parents being involved with kind of what their children see. Like the one thing that I will say though is it's probably part of a broader conversation.

I think all of these tools are incredibly useful, incredibly valuable. I'm all for parental controls and helping kids be able to access internet and things in safe ways. What I will say though is when it comes to teenagers accessing things on the internet and we talk about chat GPT having like parental controls and time their accounts to their parents and stuff like that, I think that if a teen is having some sort of issue they could easily just not use their monitored chat GPT account. So I don't really think it solves that many problems.

It's not an end all be all. The internet still exists out there. There will still be harm. People still find harmful content on the internet and so if it's not on Cenchpeeds, it's going to be found somewhere else because that risk has been around for 20 plus years.

No one's talking about how we can censor the internet from having harmful content on it or even thinking necessarily that's good because of free speech issues and yada yada. So anyways, I just do think it's interesting. I think that this is amazing that opening eyes doing this but I don't think it's the responsibility of anything slips through the cracks or anything goes wrong that necessarily they're at fault for any outcome of a person that is using it. So in any case, opening eyes said that parents will also be able to disable features like memory and chat history.

So apparently this is something that has caused a bit of a problem because if it can remember a lot of things about you, they say that people build unhealthy relationships with these AI models, friends, I think that these steps are hopefully going to make an impact. I think one thing that is really interesting here is that they said that they're going to be able to try and flag these moments of acute distress in real time. They're going to try to add age appropriate model behavior rules and apparently they have already rolled out an in-app reminder during long sessions to encourage people to take a break. So this is something I've had.

I've never had long sessions of chat GPT. I guess that have been long enough but I think if you're talking to it for hours, it will tell you that you should probably take a break. It doesn't necessarily cut you off from using it which, again, like if I was using chat GPT for some sort of work project and I needed it for like three hours straight and then all of a sudden it cut me off and forced me to be cut off. I'd be pretty annoyed at the product.

Opening Eye said this is all part of a 120 day initiative where they're going to create a whole bunch of tools this year that are hoping to make safer. This is kind of the state of where Opening Eye is with safety. I know this is a really kind of controversial challenging topic because there's real people's lives that have played into this, trying to balance my opinions and take on kind of what's happening here in a respectful way. But I hope you enjoyed the episode.

Thank you so much for tuning in. Really appreciate all of you for listening. If you have any thoughts or comments, I would appreciate reviews on anything. Thanks so much for, yeah, basically you guys do hope that you'll have a fantastic rest of your day.

Frequently asked questions

How long is this episode of Hard Fork AI?

This episode is 13 minutes long.

When was this Hard Fork AI episode published?

This episode was published on September 16, 2025.

Is there a transcript available for this episode?

Yes, a full transcript is available for this episode. You can read the complete transcript on the episode page.

Can I download this Hard Fork AI episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.