01-08-2025
Amazon.com CEO says will continue to have very deep partnership w/ Nvidia
CEO Jassy says: 'Today, so much of the cost is in training because customers are really training their models and trying to figure out how get applications into production. But in at scale, know, 80 to 90% of the cost will be an inference. Because you only train periodically, but you're spitting out predictions and and inferences all the time. And so what they're gonna care a lot about is they're gonna care about the compute and the hardware they're using. And, you know, we have a very deep partnership with NVIDIA (NVDA) and and will for as long as I can foresee, but we we we saw this movie in the CPU space with Intel where are hankering for better price performance. And so, you know, we built just like in in the CPU space where we built our own custom silicon and building Graviton, which is about 40% more price performance than the other leading x86 processors. We've done the same thing on the custom silicon side in AI with trading And our second version of Tranium two is really you know, it's it's become the backbone of Anthropix, you know, next cloud models they're trading on top of. And it's become the the backbone of of Bedrock and the inference that we do. I think a lot of the inference is about 3040% better price performance than the other GPU providers out there right now. And we're already working on our third version of trading as well. So, I think a lot of the you know, compute and the inference is gonna ultimately be run on top of Trainium two. And I think that that price performance will matter to people as they get to scale.' Comments taken from Q2 earnings conference call Q/A.
Elevate Your Investing Strategy:
