Welcome to the AI chat podcast. Today on the podcast room, we're talking about some breaking news out of Grock, AKA XAI, and there's been a ton of beef going on between OpenAI and Elon Musk, and all that kind of stuff. And today, the new flagship model, Grock 3, has just launched. Actually, last night, I had to stay up, watch the live stream.
It was actually pretty interesting. They unveiled a bunch of new metrics that pretty much have Grock 3 beating chat GPT and every other model, not by an insane leap, but by some significant numbers, I'll be breaking down all of that, and also showing you a live demo because I have XAI premium or whatever that you need to have Grock 3. So I'll be breaking down all of that. Before we get into the episode, I wanted to mention, if you've ever wanted to start an online business or use AI tools to grow and scale your current company, I have an exclusive school community called AI Hustle, where every single week I record videos that I don't post anywhere else, I essentially show you the AI tools that I'm using to grow and scale my companies and different side hustles that I'm doing.
And my co-host Jamie has made over $25,000 last year doing a side hustle with Amazon. He's using AI this year to scale that up. We break that down, along with dozens of other videos in a classroom section, over 300 members that I'll talk and kind of show their ideas. So I'd love to have you as a member of the community.
It's $19 a month in the past. We had a 100. So it's at a discount right now. And if you lock that in, it won't be raised on you.
But the link's in the description. If you want to check that out, I'd love to help you take your business to the next level using AI. All right, let's get into the episode. So what's happening with Grock?
This is, of course, the latest flagship model. They did this whole live stream last night, which, OK, this is just a side tangent. But whenever they do these live streams, they always say they started a specific time. I just noticed with Elon Musk and all of his companies.
And literally for the Tesla live stream, I know they had some sort of issues, but I waited on the live stream for like 50 minutes before it actually started. And for this one, I think I only had to wait an extra 20 minutes beyond when they actually started. But it always drives me crazy. I will say, maybe it's a good marketing thing because the number of viewers on the stream was like 100,000 and 200,000 and 400,000.
And I'm like 20 minutes in. There's like a million people watching this live stream that hasn't even started yet. So I guess maybe there's a marketing strategy involved in all that. But anyways, that's my only criticism of the whole thing.
So this thing is really impressive. A bunch of new capabilities. The big one that I think they pushed back a little bit for was to get reasoning and some of these deep learning models. And of course, when DeepSeek came out and totally swamped the whole field like a month ago, then you had OpenAI and Google Gemini both really quickly within like two weeks released their own kind of updates to the reasoning models and their deep research models.
And so Grock obviously couldn't launch without that with all the other top players. So they've actually launched that as well, which has been pretty interesting. Now, if you go over to grock.com or on the mobile app, these are the two places where it's updated first, you will literally see a dropdown where you can switch to Grock 3. This is their latest model.
And they have something called think. They're going to be releasing their deep research, I believe later. But I actually was testing out Grock 3 today. And I will admit I had mixed results with it.
Now, I'll show you if I have my history here. I'll show you it does some pretty impressive things. So I was like, I got to test this out. I was going to Walmart this morning and getting some new stuff from my car because my wife got pulled over last night.
So I'm going to break lights, I guess, on our truck is out. And so, you know, traumatic experience, where it's actually the first time she's been pulled over in her life, which is hilarious, because she's driving my truck. So, you know, go figure. So I was testing it out.
And I was asking it, what kind of like blades do I need for my windshield wipers on my truck? And it told me, and I was like, I'm just going to trust whatever it says. And I'm going to go. I was like, for two thousand, 200, you'll need 19 inch windshield wiper blades.
All right, I took it at faith. And guess what? It lied to me. I bought them.
I came back to the car. They were way too short. I needed 26 inches. So this thing was definitely off on that.
And the annoying thing was I was like, when I was in the store, so I actually also asked it for like the bulb, but then I needed it. I was like, what type of brake light bulb do I need? And it gave me one. And when I was in the store, I was kind of doubting it because I was like, this random bulb that says 7443 on it.
And I'm like, I don't know. It's like Google it. And I'm like, OK, it was right about the bulb. It was probably right about the blades.
I picked the wrong one to verify on Google it. So it turns out I needed to go back and get different blades. OK, the thing that I did think was quite impressive with this though, first of all, I'm like, OK, I have this truck, what kind of blades do I need? And then I just said, what type of brake lights do I need?
It automatically jumps the assumptions. Like, I'm assuming you're talking about the same truck that you just referred to. So this is what you need. It tells me the bulb type.
It also tells me what wattage and voltage I needed to look for, which was pretty useful. Then also told me, look, you're going to probably want to get two of these because the passenger one also needs it. It also goes and tells me common brands, which was useful because I think I actually ended up buying a Sylvania. And I knew because of what it was saying that it was probably the right one.
So anyway, then it goes and gives me a bunch of information on like, if you want to replace it, these are all the steps. You want to replace it. This was cool because these weren't questions I was even asking. It's like, what bulb do I need?
You know, guess what kind of truck because of my last question? And then it's like, and if you're doing this, you probably want to change it. So like, I guess I got to change my prompt to be like, only tell me the name of the bulb, no other information. I probably got a fast response.
But like for me, as someone that's actually using it, this was very useful to get kind of all this additional details in it. And by the way, if you're just listening on Apple, I'm explaining everything. But if you're on Spotify or YouTube, I'm breaking down this and sharing my screen with a video to break it all down. So anyways, I wanted to give you the antidote of me actually testing this thing out so you know.
One other thing that I did with it, I tried to like image upload and how in Walmart and there's these two different windshield wipers. And I never know if I'm getting scammed by these companies, anything in auto mechanics, I swear there's like a gimmick. So there's two kind of windshield wipers from the same brand. One was like 15 bucks, almost seven bucks.
One was optimum plus. And I'm like, is there any difference between these in reality? And Grock was a pretty good salesman and told me that apparently the op that one of them has equal pressure throughout the whole blade and it's less likely to get wrecked and blah, blah, blah. So I end up buying the more expensive one because Grock told me it was good.
But I mean, it's kind of useful. I was able to just like snap a photo while in Walmart on my phone, have it upload and then like it actually was really quick. I don't think the internet was like super fast in Walmart. So anyways, this was my actual use case test test of Grock.
Let's go into what the updates were and why I think this is an impressive thing. You guys are probably all sick of like, okay, that's enough of your like stupid trip to Walmart for your car. What is this thing actually capable of? So I'll break all of this down for you.
So the first thing that was really impressive about this is how they actually trained this. They said they wanted to start with first principles, which is something that XAI's been really good at. And they essentially went to like, they're like, they're like, I've got to build like a facility to have enough GPUs to train this AI model. They go to all of these people that could build facilities like how long it's going to take you to like build a data center, all these data center companies.
And they're like, yeah, we can build you a data center. It's going to take us about 24 months. And they're like, okay, well, we'll be screwed because in 24 months, we definitely like that's two years. If that's how long takes us to the data center, then we got to train on top of that.
Like where's Chachi? We're going to be in two years. They'd be completely smoked. So they said, screw it.
We're just going to buy a pre-built factory. So this wasn't something built for a data center. They literally went and found I think like a they said had to find a factory that was like new enough that it was still good, but someone just went out of business and it's kind of hard. And it was like, I found some like electrical company just went out of business or moved locations, they grabbed their factory.
It wasn't big enough. So I think they actually had to add on to it, but they grabbed it and they were doing every hack in the book, like trying to essentially hack and get this thing built faster. So the first thing that they did was they wanted to put 100,000 GPUs. Everyone said this was impossible with some engineering feeds.
They did some crazy stuff. They were able to attach 100,000 GPUs. And halfway through the training, they were able, I think that took them about 120 days, like three months, halfway through the training. They added another 100,000 GPUs, which was like took them another 90 days.
So really like three to six months that this entire thing happened running. And people are like, how the heck did you get this factory that was not built for data centers? Those are notorious for a bunch of reasons. Number one, absolute power hogs, like 200,000 GPUs.
When you think of a GPU, this isn't a little one in your computer, like you're talking about a brick, like just this massive hunken thing and 200,000 of those, there's a complete power hog. In addition, cooling out many GPUs is insanity. So what they said they ended up doing was they didn't have enough power from the grid. They were getting it hooked up.
And in the meantime, they just bought thousands and thousands of generators and lined them up on an entire side of the factory, had all of these generators going. On the other side of the factory, they said they literally purchased 25% of the entire United States cooling remote cooling capacity. So pretty much like these trucks, all these have to be liquid cool. They're like waters going through pipes and circulating through pretty much.
And so people have like trucks to do liquid cooling for like big events or concerts or like things. But there's like not that many of us. They literally had to get 25% of the capacity of the entire United States. I'm sure all that was a great business to be in to cool this entire thing.
They said they had so many problems with like one cable would be disconnected because what they did that was different was they actually connected all 200,000 GPUs together and they had to make redundant so that one cable got pulled out of one or there's an issue with one, then all the rest of them keep working. There's a lot of like really impressive things that they were able to pull off of this. All of this to say, Grock 3, this current model they had was trained on 10 times more compute than Grock 2 the earlier one. And it might be like one of the most one of the biggest most compute used in any AI model.
So what was the output? And I know like you heard at the beginning, I'm like complaining that it told me the wrong length of my windshield wipers or something like that, which the trajectory or any other model probably could also do that. I'll go and like research why that was. But like overall, the other questions I've asked this and tested out, it's very thorough.
It's very in depth. It shows you it's reasoning processes. It could do a lot of really impressive things. So what are the benchmarks?
How did this actually perform for the math benchmark? Math Aim 24. It scored 52. Grock Mini, which is like their smaller version was 40.
This is like really impressive. The only model that got close was Claude at like 39. And that's like still worse than their mini model. It's still completely beating GPT 4.0 and which scored I think the worst and deep-seek.
So Gemini, I guess, also did fairly good. So anyways, they completely beat everyone on the map one by like a long shot 52. So then Science, they scored 75. The next runner up was 65.
A bunch of models scored 65. So they're solid 10 ahead. And then when it comes to coding, they completely crushed again, scoring 52 on coding and the next best model that wasn't from Grock was like 40. So they really, really crushed it on math, science, and coding.
And it seems like Chate Chate Chate, I've heard from a lot of people notoriously like sort of struggles in this area. Claude does really good most of the developers I talk to use Claude even though they haven't come up with an update in like forever because they just say it's better at coding. And so sometimes you find these use cases that these models had better training data or were trained better or fine-tuned better on. And it seems like Grock might be the winner now with code.
So in the livestream I watched last night, they literally had it. They said like build a game for us that's across between Bejeweled and Tetris. And it literally like wrote all the code. They ran it and it was an actual functioning game where you had like these Tetris blocks that were each thing was a different color and if you got three of them in a row, it was like Bejeweled, it would like destroy the line or the blocks or whatever.
So it was interesting and it was able to spit it out pretty quick. So this was pretty impressive. Reasoning test time compute, it crushed it and you essentially are able to tell it think longer about this prompt. And if you just put that in your prompt, there's a button that you can also do.
If you tell it to think longer, it bumps up its response from like 78 to 93. So if you tell it like use more compute, think longer about this. I'm kind of saying the same thing with chat GPT. They ran some similar experiments with similar results.
But if you tell it to think longer and use more compute, it'll essentially try to solve the same problem like 10 or 15 or 100 times. And then it's like, what is the average of all 100 times? So if I had said, what windshield blade do I need for my truck? Think as long as you want about this, it probably, instead of just going and searching and grabbing like the first couple of results from Google, it probably would have like looked at like 100 results and then try to solve it 100 times and then realize, oh, actually, you need the 26 inch blade.
So I mean, maybe as a user error on my fault, I need to ask, I need to tell to do that. So the one thing that did not come with chat GPT because subscribers to the premium tier, which is like 50 bucks a month, get Groc three first. Although I think I'm paying like $17 a month. Maybe I'm grandfathered in because I've been paying it for a couple of years, but like in $17 a month tier, I'm getting Groc three.
But the one thing that did not release was the voice. So Elon Musk said the voice is a little spot. He should come out in about a week. That's where you can talk to it.
And apparently just like opening eyes, voice thing, which is phenomenal where it's like really dynamic and you're like, talk really fast, like you're running on a treadmill, talk like you're singing, like talk like you're yodeling, like you can tell it to all these crazy stuff. The voice mode should be good. And but that's not going to be coming for a little bit. In the next few weeks, Groc three models also available via their API, which I'm stoked about because I can then integrate it into AI box, my software startup.
So a lot of really cool things. The biggest thing. Okay. This is the biggest W of the entire night.
And that is Elon Musk said once Groc three is fully rolled out and everyone can use it, everyone's like, what happens to Groc two? Because they took a Q and A on Twitter and people responding. And he said the older version once the new one is fully rolled out, the older version will get completely open source so anyone can use it. This is amazing.
And I think opening eye could solve all of their controversial problems of going from a nonprofit to a for profit and everyone hating them and stuff. If they did this, Sam Altman was like, he did like a, he did a sneaky poll in my opinion. On Twitter yesterday where he was like, what do you guys want? Do you want like the best O three, like the best O three model, open source, because they're about to come up with a new model, or do you guys want us to make the best phone model we possibly can?
And like the way he phrased it, everyone, I even said like, oh, I want the best phone model. Cause I was like, I was supposed to be cool to have like an open source on my phone. But what I'm realizing is people can take the best model and make phone model versions for like we could do that after really what we want is the best model possible. That's open source, which they're not going to do their flagship model because I tell them make their money, but they can do their older model because like now they Groc three is out as a consumer.
So I think the biggest win of this entire announcement, other than, okay, they made a model that beat everyone in the benchmarks. That is cool. But I think the biggest win is that they're saying they're going to set a precedent where the older model will always be open source. So just giving that for free to everyone to the public.
So that's really cool. I would love to see opening I do that since that was the purpose of the company was to be an open source AI company and other close source. I would love to see them follow suit. And I think that this will put some pressure on them to potentially do that.
And I think that's a good thing to do. And I think that's a good thing to do. I think that's a good thing to do is to make sure that they're not going to be able to do that. And I think that's a good thing to do.