When it's time to scale your business, it's time for Shopify. Get everything you need to grow the way you want, like all the way. Stack more sales with the best converting checkout on the planet. Track your jichings from every channel, right in one spot.
And turn real-time reporting into big-time opportunities. Take your business to a whole new level. Switch to Shopify. Start your free trial today.
Happy Monday. I hope you are all doing fantastic. I'm finally back in Arizona after being out of town for around a month, so it feels good to be back in the studio. And today we have a juicy topic.
And that is why OpenAI is specifically as it's training for chat, GPT4, and beyond, is currently not working on GPT5, the reason for that, and also the reason why that might be a little bit of a deception, and why they say they are no longer going to be making bigger AI models. So let's kick the podcast off today. A bunch of the stuff we're going to be talking about today is coming from some interviews, Sam Altman, the CEO of OpenAI did recently at MIT. And he said that in this recent interview, he said that he thinks we're at the end of an era where it's going to be like these giant, giant models, and that they're going to find ways to make them better in other ways.
This is really interesting. We're going to dive into what that means. But essentially what he's saying is that this might be the end of when we just keep seeing these models get bigger and bigger. And this is interesting because they actually have not released how many parameters are in the GPT4 model.
When they came out with the first GPT2, it was around 1.7 billion parameters. And when it came out with GPT3, which is the regular chat GPT version that they launched for mass production that everyone got first used back in December, January, that one had a whopping 175 billion parameters. So this thing went from like, this thing got massively bigger. And then when GPT4 came out, they didn't actually announce how big it got.
And my opinion on this is that, well, a couple things. Number one, they're probably trying to protect a little bit of their intellectual property. So not announcing how big the model is. It could be like they just don't want people to know how big it is because it's so ginormous.
And the reason for that might be, you know, competitors, my question, how did you get that much data? You know, there's been recent recent things. For example, when Elon bought Twitter, he shut off the Twitter API that was directly feeding into opening eyes. They were scraping like all the Twitter data in the universe.
And so I think that they may just have a really insane amount of data and they don't want people to know how big it is or perhaps how small it is and how they're able to effectively work on that. And then the other interesting thought is perhaps it didn't actually get that much bigger than GPT3. They just figured out ways to fine tune it. But for all of these different cases, they just don't want people to know what they're doing.
They don't want their competitors to know what they're doing because there has been a handful of really big competitors that have come out with a lot of money. There's anthropic. Elon Musk is rumored to be working on something with Twitter to create some AI models. There's obviously Google and a lot of different people are focusing on making these big AI models.
And so I think they just don't want people to know how many parameters they have, how they're able to make it so effective. And there's also the possibility that maybe they just have such an insane amount of data that people would be mad that how did you gather all that data and yada yada. So really interesting. But apparently these things are not going to get any bigger, aka opening eye probably hit the max for how much sheer data they can suck into their vacuum beyond just getting new data.
So as we know, everything got cut off in 2021. And beyond that, it's probably not a big deal if they're not updating things live because now they just plug the internet into it. And for anything newer than that, you'll just use internet to scrape and do searches and pull in relevant stuff like Google and Bing are currently doing. So it's going to be really interesting.
I think Altman, you know, his statement pretty much suggests that chat GPM might be the last major advance to emerge from just beating these models more and more data. And other and the what the actual advancements we're going to start seeing now, because apparently you're just getting diminishing returns as you scale up to more data, or maybe they already have so much that there isn't actually that much more to do. So I think the new ways we're going to start to see this progress is just from how we're using these transformers. So Nick Frost, who's a co-founder at co-here, he previously worked at AI or worked on AI at Google, he says that when he like listening to Altman talking about this, he thinks that this is true and that he believes that the progress on these transformer models that run that are, you know, the backbone of a chat GPT and that type of thing that it really that what's really going to make these things scale, he says there's a lot of ways of making transformers way, way better and more useful.
And lots of them don't involve adding parameters to the model. He also says that he just thinks that the architecture and further tuning based on human feedback are really promising directions that researchers are probably looking at right now to make these things more effective. And if you think about it, OpenAI and chat GPT already have pretty much the biggest use case, user case on this, right? And Tesla was kind of in the same thing with their self-driving because they had all of these cars out on the road with self-driving and they're able to capture all of this data and see pretty much every time, you know, for example, in the case of Tesla, if you've got autopilot on and a user has to grab the steering wheel and take over, Tesla would be able to look at what was happening leading up to that like manual takeover and that's essentially using human feedback to help tune the model and say, oh, it was doing something wrong, therefore the human had to take over.
And so, you know, I've been saying this for a long time with cars, like Tesla, it's going to be hard for other people to catch up with the same level of self-driving because they just have such a massive user base feeding it data and chat GPT is in the exact same position where they launched, you know, chat GPT, they had over 100 million monthly active users probably way up from there. And all of those users, you know, there's thumbs up, thumbs down, every single message that came out of chat GPT. And so people were telling it bad answer, good answer. And so that was helping tune it.
And in addition, you know, someone asks a question and they rephrase it and ask it again, it also knows, hey, the first answer wasn't good. So they have all of these things kind of built in that they can use to fine tune it just from all of the users that they currently have. And so it might not actually be necessary for them to just keep scaling up with bigger and bigger datasets. In addition to other fine tuning things with the users, you know, literal human saying this was good or bad answer is one of the best ways that they can train these things.
And they just have the most, they have the biggest user base. And it's going to be pretty hard for a lot of these other companies to catch up based off of that. So it's pretty interesting, obviously, when GPT-4 was about to come out, there was all these memes and tech people, you know, speculating and posting these like graphs of like GPT-4 or three was trained on, you know, 1.7 billion parameters. GPT-4 is going to be like, is a trillion parameters or something.
We don't really know what GPT-4 is that. And it doesn't seem like it really matters at this point. So one other thing that is pretty interesting given all of this is that, you know, Sam Alman also said that the company isn't going to be training GPT-5. They said we are not working on this for some time.
And it's interesting because it all comes on the back of, you know, Elon Musk and a lot of other tech people signing an open letter to, you know, the government, but really, and like the public at large, we're really obviously aimed at opening eye who's got the lead on this thing. No AI models beyond a GPT-4 capability should be trained. Yada yada. Opening eye obviously didn't say, okay, sure, we're not going to do this because, you know, it's viewed Elon Musk for example, is now starting to, it would appear starting an AI company.
So it would appear that, you know, a lot of these companies calling for no more advancements or maybe trying to catch up anyways. So all it would do is benefit them. But what's really interesting is, you know, Sam Alman obviously doesn't want the bad PR and, you know, doesn't want to be viewed as the guy that like ran blindfolded straight into some giant AI disaster. So he obviously wants to appear to be, you know, taking things in a measured and deliberate manner.
So I mean, kudos to him on this, but he said, you know, we're not working on GPT-5 at the moment. We're just working on training or like improving GPT-4 and boom, I think that's the big, that's the big, that's the elephant in the room kind of, or I guess the big surprise, big secret, whatever you want to call it, like improving GPT-4 is like essentially working on the next version of AI. I'm not saying that's a bad thing. I'm just saying it's funny that people are like, Oh, God, he's not working on GPT-5.
But it's like, what's the difference of GPT-4.5, GPT-4.6? Like you could just keep calling it a GPT-4.something and essentially it could be what other people would have called GPT-5, seminary. It's kind of funny. I mean, you see the same thing with the iPhone, right?
It's like this misconception that if the number got better, the model got better. And it must be like so much better. Like, you know, when the iPhone 10 comes out and then the iPhone 11 comes out or whatever, it's like a lot of the times, you know, these iPhones aren't actually that different. And the reverse seems to be true where you just don't have to label it a bigger number with like GPT-4, GPT-5.
And all of a sudden, you know, people are like, Oh, cool, you're not going to GPT-5 when, you know, it's, there's no different, right? You already connected internet to GPT-4 and created plugins are creating all this crazy stuff that might be GPT-10, but we're just calling it a lower thing. So I think that's a, I mean, good job for PR control, you know, damage control for open AI. And personally, I think, you know, improving it obviously has to be done for a lot of different things, making sure that it's safe and capable, but I think it's just a misconception that like people are celebrating if they cared about AI advancement, you know, the GPT-5 isn't in the works.
So I think it's not really, it's not really saying much by that statement, but it is interesting. And it is interesting to note that given the previous conversation, it would appear that GPT-5, even when they do start working on it, probably isn't going to be much bigger as far as parameters and data goes than GPT-4. So really interesting to see what's going on with all of this advancements in AI in tech, it's going to be an interesting space to watch and to see what exactly these improvements in GPT-4 are in the future.