Skip to content
Breaking Down AI Detectors: Evading Detection in the Digital Age episode artwork

Mar 18, 2024 7 min

Breaking Down AI Detectors: Evading Detection in the Digital Age

from Hard Fork AI

In this episode, we break down the functionalities of AI detectors, discussing how individuals navigate through various loopholes to evade detection in the digital age. Get on the AI Box Waitlist: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://AIBox.ai/⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ Join our ChatGPT Community: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://www.facebook.com/groups/739308654562189/⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ Follow me on Twitter: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://twitter.com/jaeden_ai⁠⁠⁠⁠⁠⁠⁠⁠⁠

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Breaking Down AI Detectors: Evading Detection in the Digital Age

0:00 7:18
of matches

Transcript Auto-generated, may contain errors

are chat GPT detectors accurate. That's a question a lot of people are asking right now as chat GPT has come out specifically for teachers that are looking at if their students use an AI model like chat GPT to write an essay or not. So this has a lot of actually applications beyond just education as well. Google specifically said that they have an AI detection software that is able to detect if content online is written by AI and they demote that content in their search algorithm.

So theoretically speaking, if you wrote articles using chat GPT posted them on your blog in hopes of having your pages on your website show up on Google, Google is supposed to demote those and devalue those because they were written by AI. Now people have different opinions on that, but today what we're gonna talk about is how to detect AI writing, how accurate those tools are, and things that people are doing to get around them because listen, there's obvious incentives to have your content look human generated. And when there's incentives, it's always gonna be a cat in mouse game of people trying to go back and forth, touching them and then people trying to evade their safeguards. So what's good to know or what's important to know on this is that the advancement of technology is really accelerating right now, we know.

And so what's first important to understand is how AI writing tools work or AI writing detectors work. So these tools typically use machine learning algorithms to analyze text for features that are indicative of AI generated content. So for example, some AI writing detectors look for patterns in the word use and also sentence structure that are typical of AI generated text. And others use deep learning techniques to analyze the text and compare it to a large database of known AI generated text to make a determination.

So what this actually looks like in real life is, for example, this is what opening I did with their recent tool, they just launched, they went and had it trained on a massive set of AI written content, right, they obviously can just pull that from their own data set of Jatt GPT. And they compare that to content written online. Now, that being said, there is a loophole or I guess an issue with this, they say, they don't know if all the content they trained on online, if people have already used AI content and published it there and they trained it on that, right? So like, for example, a big data set they used was Wikipedia.

They trained, they told the AI and they fed all these Wikipedia pages through a neural network and said, this is what a human rights like. Then they took all their AI content, fed it through a neural network and said, this is what an AI looks like when it writes. And so it had their AI detect differences between the two. But the problem is, a lot of people could have edited those Wikipedia pages using this AI technology.

Well, Jatt GPT is relatively new. The technology that is presented in there, which is on AI open AI's DaVinci model, has been available for over two years. So a lot of content that on Wikipedia or other places that they trained their models from can technically be, I guess you could say, compromised by AI content. And that would actually make these tools a lot less effective.

In fact, I think Jatt GPT says that their AI detection tool is only 40% to 60% accurate. So it's really not that great. I've seen other ones online that seem to nail Jatt GPT content pretty well. But that being said, what a lot of people are doing is they're using tools like Quillbot to get around this.

If you take a Jatt GPT written article or essay, throw it into Quillbot, it will rewrite it in a more human way and it will evade AI detectors. So teachers don't like that because when they're trying to get students to write essays, they have plagiarism checkers. But if they're unable to detect if a student just used AI to write it, then that's difficult for them. It kind of brings up this whole conversation of what is the role of Jatt GPT?

What is the role of these AI writing models in education today? Because I'm sure back in the day, math classes were very mad or upset when calculators were invented and students could bring a calculator to class to calculate something and all of a sudden the teacher is upset because that used to have previously just been mental math or what else they did back then. So eventually in math classes, they just decided, they just made rules for what types of calculators you could use, how advanced they could be, and when you could use them, what tests and whatnot. And so I personally think that for Jatt GPT and these other language models, it's going to get incorporated into education.

I mean, it's a very powerful tool for business and for people's jobs. And that's kind of the purpose of education in a way. So yeah, so I honestly think that it's just going to come down to people deciding when it's appropriate to use Jatt GPT, when it's appropriate to use these AI writing models and how much they can use them. And it's not going to be a thing where they can just completely ban it.

Like a lot of them are New York, I think, has made some rules trying to outright ban it. So one other thing I will say on OpenAI's training of these AI detection models is another interesting thing they did is they did the whole Wikipedia page thing, but they also went and they would take half a Wikipedia page or they take a thousand words for a Wikipedia page, then they would go to Jatt GPT and say, continue writing this Wikipedia page. So it was really powerful because they would have this article that was half human written, half AI written, but it was all on the same topic. So not only are they able to say, this is what an AI writes, this is what a human writes like, but it's on a specific topic, a very specific, similar topic.

This is how each of them write, and they have a neural network that can be fed this data back and forth and identify patterns and little using algorithms, identify patterns in the writing. So AI is typically very perfect in its grammar, very perfect in its punctuation, very perfect in its spelling, humans make a little mistakes here and there, that's one easy giveaway, which is kind of interesting. And so yeah, there's a lot of different things like that that go into this, but to date, there are some powerful AI detection softwares.

Frequently asked questions

How long is this episode of Hard Fork AI?

This episode is 7 minutes long.

When was this Hard Fork AI episode published?

This episode was published on March 18, 2024.

Is there a transcript available for this episode?

Yes, a full transcript is available for this episode. You can read the complete transcript on the episode page.

Can I download this Hard Fork AI episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.