A lot of attention is given to NVIDIA's chip dominance in the current AI landscape. They are making insane amounts of money. And it seems like they are one of these unstoppable forces for training AI models and becoming the most valuable company in the world just further pushed that narrative. But it feels like cracks are appearing in their monopoly on the chip market.
And the Jassy who is the CEO of Amazon said that their competitive chip to NVIDIA is already a multi billion dollar business. And it seems like this is something that is going to continue to grow. So today on the show, we're going to be diving into what AWS has unveiled, what the numbers are on it, which I thought was actually quite impressive. Before we get into all of that, if you want to try all of the models that I talk about on the show, make sure that you go check out AI box.ai is my own startup and you essentially get access to over 40 of the top AI models, Google, opening, and I am through Epic, deep-seek, Claude, Grok, 11 labs for audio, a ton of really cool image generation models, including open eyes and generation model flex, which is what powers Grok.
All of that in one platform for $20 a month and the ability to make apps by describing them. So a lot of really cool stuff to check out AI box.ai. All right. So the big question is, can anybody stop in videos AI chip dominance?
Most would say no, because they are so ingrained. They have been pushed to the front. But I think AWS and Amazon definitely have a big, a big competitive advantage here, which is beyond the chips because of AWS Amazon web servers, a lot of people are using their cloud for powering their AI model training. So Amazon will go and buy NVIDIA chips, right?
The H100s or 200s or whatever, put them onto the put them into AWS and people can go and use them and rent them from AWS now to train their AI model. So once Amazon goes and creates their own chips, theoretically, it should be able to have a massive distribution advantage where they're going to probably promote their own, maybe give a discount and have people use their chips. I think this is my bullish case for Amazon and AWS competing at a high level with NVIDIA now will be able to make the chips better than NVIDIA and technologically and hardware wise. I think that's a completely different discussion, but I do think that they have the distribution and what it takes to compete at a high level if they can get that hardware.
So with all of that said, they are in the space and they are creating chips. There are hundreds of billions of dollars in revenue for any company that can peel off even a little bit of this massive industry that NVIDIA is tackling. So Amazon CEO Andy J.C. This week was saying that their company, and by the way, he said all this other AWS re-invent conference, but he said that the next generation of their NVIDIA competitor AI chips is called the Trainium 3.
It's about four times faster and uses less power than the current Trainium 2. And apparently these have seen some quote unquote substantial traction. He said it is a multi-billion dollar revenue run rate business. They have one million over a million chips in production and they have a hundred thousand companies using them as a majority of bedrock usage today.
This is absolutely crazy because obviously NVIDIA still absolutely dominates the market. So even by just taking a small percentage of this, they have a multi-billion dollar business. Batterock is Amazon's AI development tool. It essentially lets companies pick and choose what AI models they want to use inside of their stack.
J.C. Said that Amazon's AI chip right now is winning among a bunch of different companies. There's a whole bunch on their cloud customer base. And he said the main reason why people are picking it is because it quote has price performance advantages over the GPU options that are compelling.
So basically he thinks that it costs less to train AI models. And so I think because of this, a lot of people are using them. I think that is, of course, Amazon's classic kind of directive. They give their own homegrown tech at lower prices.
I mean, this is basically the same strategy Amazon uses with Amazon basics, where you can go and buy an HDMI cord or a USB-C cord or a broom or a mop or like some basic item in Amazon has created the cheapest version of it. They put it on Amazon. It's a few dollars cheaper and they just try to make it up in the margins where people buy a ton of it. They're kind of applying the same strategy where they're like, look, tons of people are using NVIDIA's chips to train models on AWS.
What if we just made some sort of compute that was a little bit cheaper? People could still get their models trained. They'll just use our chips because they're a little bit cheaper. Maybe they're not the fastest or the shiniest object in the room.
The most powerful, but they are less money. And a lot of people I think will go for that option. I think in addition to that, the CEO of AWS, that's Matt Garbin. Was talking in an interview with CRN about this about one customer response for a big chunk of those billions of dollars in revenue.
And he said that was entropic. Now, this is not a big shocker. Entropic is a company that has been heavily invested in by AWS. So Amazon has put, I think, like about over $4 billion into entropic in different investments.
A lot of these are essentially get them over to AWS. And it's not really big shocker to say, look, like, hey, we gave entropic $4 billion and shocker, shocker, they spent that money on us and they used it on our chips. Because it's kind of the way these deals work. If you're giving someone that much money, you're going to try to dictate how they spend money back to you.
They obviously had rules in there. Like we'll give you this money, but you don't need to use it on AWS. You got to use the chip stack that we use. And so I think this is kind of interesting.
Yes, it are making billions of dollars back, but it's almost like a forced contract. Like people didn't have a choice other than to use them. And maybe it was a better option because it was cheaper, but it is an interesting place to be for sure. Here's something that Garbin, the CEO of AWS said, he said, we've seen more enormous traction from training, too, particularly from our partners at entropic who've announced Project Rainier, where there's over 50 or 500,000 training, two chips helping them build the next generation of models for Claude.
Project Rainier, I think, is Amazon's most ambitious AI cluster of servers. They have this spread out across a whole bunch of different data centers in the US. And it's basically built to four entropic, right? Entropic has this massive skyrocketing need.
They're training the latest Claude models. I think it came online in October. So this is very recent and Amazon, of course, is a huge investor in entropic. And so that's why they're using this in exchange for all of their investments.
Entropic has made AWS the primary model training partner, even though entropic is also offered on Microsoft's cloud via the Nvidia chips. So opening is now also using AWS in addition to Microsoft's cloud, but the opening eye partnership, I think, couldn't have contributed a lot to the training revenue because AWS is running on Nvidia's chips and systems. And so I don't think that that's where a lot of that came from. I think mostly this is coming from entropic.
Only a few US companies, right? Google, Microsoft, Amazon, Meta have all of the engineering pieces, the silicon chip design expertise, kind of the home grown high inner or high speed interconnect and the networking technology to even try to be a trick better to Nvidia, right? Because Nvidia basically cornered the market on, you know, one major high performance networking tech in 2019 when their CEO, a bit Intel and Microsoft to buy InfiniBand, which was a hardware maker of Melanox. Something that I think is important to mention on top of all of this is that any of the AI models that are kind of built to be served up on Nvidia's chips, they're also going to rely on Nvidia's proprietary compute unified devices, architecture or CUDA.
And that's kind of a software. So CUDA essentially lets different apps use the GPUs for parallel processing compute. There's a bunch of other tasks, but it's basically kind of like Intel versus, you know, the sparks chip war that happened in the past. It's not a small thing to rewrite an AI app for non CUDA chips.
It's there's a lot goes into it. So typically these AI models are just going to keep using Nvidia, but there are a couple of players that are trying to do this home grown Amazon, Microsoft, Google, even Meta are trying to build their own chips to get away from exclusively relying on Nvidia. But even with all of that, I think Amazon has a plan as I have talked about in the past, the next generation of its AI chips, which is going to be the training for is going to be built to with essentially be able to work with both Nvidia's GPUs and have that in the same system as AWS's chips, the training and for chips. So I think whether that helps peel more business away from Nvidia or it's going to simply kind of reinforce their dominance, but keep it on AWS as cloud.
I'm not really sure which is going to happen. Either way, it's good for Amazon and AWS. I think it might not matter to Amazon a lot because it's already on track to make multiple, you know, multi billion dollars from training. And to the already on training three and now we're working on training for chips.
I think the next generation is going to be a lot better and that alone just might be enough to make AWS the winner. All right. Thank you so much for joining us on the podcast today. If you learned anything new about the wild world of AI and chips and the competition for Nvidia, it would mean the world to me if you could leave a rating and review and also make sure to go check out AI box.ai.
I'll leave a link in the description. Hope you have a fantastic rest of your day.