Amazon Web Services is building equipment to cool Nvidia GPUs as AI boom accelerates
Nvidia's GPUs, which have powered the generative AI boom, require massive amounts of energy. That means companies using the processors need additional equipment to cool them down.
Amazon considered erecting data centers that could accommodate widespread liquid cooling to make the most of these power-hungry Nvidia GPUs. But that process would have taken too long, and commercially available equipment wouldn't have worked, Dave Brown, vice president of compute and machine learning services at Amazon Web Services, said in a video posted to YouTube.
"They would take up too much data center floor space or increase water usage substantially," Brown said. "And while some of these solutions could work for lower volumes at other providers, they simply wouldn't be enough liquid-cooling capacity to support our scale."
Rather, Amazon engineers conceived of the In-Row Heat Exchanger, or IRHX, that can be plugged into existing and new data centers. More traditional air cooling was sufficient for previous generations of Nvidia chips.
Customers can now access the AWS service as computing instances that go by the name P6e, Brown wrote in a blog post. The new systems accompany Nvidia's design for dense computing power. Nvidia's GB200 NVL72 packs a single rack with 72 Nvidia Blackwell GPUs that are wired together to train and run large AI models.
Computing clusters based on Nvidia's GB200 NVL72 have previously been available through Microsoft or CoreWeave. AWS is the world's largest supplier of cloud infrastructure.
Amazon has rolled out its own infrastructure hardware in the past. The company has custom chips for general-purpose computing and for AI, and designed its own storage servers and networking routers. In running homegrown hardware, Amazon depends less on third-party suppliers, which can benefit the company's bottom line. In the first quarter, AWS delivered the widest operating margin since at least 2014, and the unit is responsible for most of Amazon's net income.
Microsoft, the second largest cloud provider, has followed Amazon's lead and made strides in chip development. In 2023, the company designed its own systems called Sidekicks to cool the Maia AI chips it developed.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
2 hours ago
- Yahoo
Broadcom is no longer the 'poor man's Nvidia' in the AI race
Artificial intelligence (AI) continues to be a key theme of Big Tech earnings, as Alphabet (GOOG, GOOGL) kicked off "Magnificent Seven" earnings with very high additional AI capital expenditure (CapEx), a positive sign for AI chipmakers. Nancy Tengler, CEO and chief investment officer of Laffer Tengler Investments, and Stacy Rasgon, managing director and senior analyst at Bernstein, share their thoughts on two major AI chip players: Nvidia (NVDA) and Broadcom (AVGO). To watch more expert insights and analysis on the latest market action, check out more Market Catalysts here. I think you guys are on the same page when it comes to Nvidia. You've got a buy equivalent rating on it, Stacey. Nancy likes that one. Let's talk about Broadcom for a minute because Nancy, this is one that you've liked for a while. Um, do you still like it? What are you going to be looking for from Broadcom, Nancy, going forward? Yeah, we do, Julie. I mean, it's our largest holding across all of our large cap equity strategies, member of our 12 best, our five for 25. I think, uh, and it's outperformed Nvidia pretty handily over the last year, almost double the returns for Nvidia on a trailing one year. We've always called it the poor man's Nvidia. I think we're going to have to come up with a new name. But one of the things that we're going to be paying attention to is, of course, um, the AI revenues. We we've we've seen those compound at 60 plus percent. They've announced new partnerships. We want to hear more about that. Um, it seems that the rest of the business, the rest of the chip business may have bottomed. We'd like to hear some some information and and confirmation about that. And then I just think, you know, it's just going to be about the future guidance. And Hock Tan has demonstrated he can acquire companies, make them accretive quickly. We bought the stock when, uh, it sold off on the computer associates that used to be the name of the company they acquired. Wall Street didn't like it. They turned it around, made it a very positive acquisition. So we we'll be listening for that, too. Are there any acquisitions they're they're planning to make? And I certainly hope one of them is not Intel. Yeah, that would be something. Uh, Stacey, um, along with Nvidia, is Broadcom sort of, are those the sort of must-owns in the chip space? Yeah, I frankly, in in chips, it hasn't been great outside of AI, right? I mean, AI's been super strong. The analog, more diversified guys, like the people who were playing those on cyclical recovery, some of those prints so far this earning season have not not been so great. There's worries about pull forward and everything else. Again, you got companies like Intel which which frankly are a basket case. I mean, if it wasn't for AI, this space would not be doing very well. So I I do like the AI names. We cover Nvidia and Broadcom. I like them both. Um, Broadcom is is just more expensive than it used to be. That's the only only, you know, it was Right. I guess hence Nancy's comment that they're going to have to rename it from the poor man's video. Yeah, and look, you know, you got to remember Broadcom like not all that long ago was like 16 times earnings, like now it's like the multiple's like like doubled, right? Um, they are showing a lot of AI upside. A lot of that comes next year, but they they're clearly, I mean even the last earnings call a couple of months ago, they're clearly calling for upside in their AI revenues next year on more inference demand. They're a massive player on AI networking, right? So there's there there's a a big play there. And and and Nancy, I think, is right, they have the core semi business which admittedly has been lousy. They're not the only ones. Everybody in though in those kinds of markets has has been lousy. It it doesn't look like getting any worse at least. I we can we can argue about when it's going to start getting better. I don't know yet, but at least it isn't getting worse. Um, you know, if you're looking in in into the near term, I mean you could argue, again, we we like both stocks. Nvidia is cheaper. And you know, you know, they just they just got their China licenses, um, reinstated, so there's probably more upside to their AI numbers this year for Nvidia versus Broadcom. I think the Broadcom AI upside comes next year and Broadcom's a little more expensive. Um, and then there's a whole ASIC versus, you know, GPU debate. But I I think you can own them both. Like I I I like them both. And again, AI is the only thing in semis right now that fundamentally is really working.
Business Insider
2 hours ago
- Business Insider
Alibaba (BABA) vs. Amazon (AMZN): Which E-Commerce Stock Has More Upside Ahead of Q2 Earnings?
The second-quarter earnings season is in full swing, and investors are closely watching global e-commerce leaders like Amazon (AMZN) and Alibaba (BABA) to assess the strength of consumer demand, the outlook for digital retail, and their growing role in artificial intelligence. Using TipRanks' Stock Comparison Tool, we will compare these two tech-powerhouse stocks to find the better pick ahead of the upcoming earnings results, according to Wall Street analysts. Elevate Your Investing Strategy: Take advantage of TipRanks Premium at 50% off! Unlock powerful investing tools, advanced data, and expert analyst insights to help you invest with confidence. Alibaba (NYSE:BABA) Stock Alibaba is China's largest e-commerce and cloud services company, operating platforms like Taobao, Tmall, and AliCloud. The stock has climbed over 39% so far this year, driven by strong gains in its AI-powered cloud services and growing demand for instant delivery. The company is doubling down on artificial intelligence, aiming to use it to transform online shopping and cloud services. It is using AI across its apps and cloud platform to improve customer experience and stay ahead of the competition. Looking ahead, the company is set to report its Q1 FY26 earnings next month. Wall Street expects Alibaba to report earnings of $2.22 per share for Q1, down 3% from the year-ago quarter. The decline could be due to the company's heavy investment in logistics and delivery. Meanwhile, analysts project Q1 revenues at $35.46 billion, up 6% year-over-year. Is Alibaba Stock a Good Buy Right Now? Ahead of the Q1 results, Benchmark's Top analyst Fawne Jiang reiterated her Buy rating with a $176 price target, implying a 47% gain from current levels. The analyst sees recent share weakness as a 'buying opportunity' and encourages investors to 'build exposure on dips,' confident in Alibaba's strong long-term growth outlook. Nevertheless, she expects Alibaba's margins and profits to come under pressure in the near term due to increased spending. As a result, Benchmark has cut its EBITDA forecast to RMB44 billion for Q1 FY26 and RMB208 billion for the full FY26, 'reflecting near-term margin pressure.' Overall, Wall Street has a Strong Buy consensus rating on Alibaba stock based on 14 Buys and one Hold rating. The average Alibaba price target of $151.08 implies about 26% upside potential from current levels. Amazon (NASDAQ:AMZN) Stock E-commerce and cloud computing giant Amazon is proving the resilience of its business model despite macro challenges and tariff woes. The stock has climbed over 5% so far this year. Several analysts remain bullish on Amazon's high-margin cloud unit, Amazon Web Services (AWS), which is expected to benefit from growing AI demand. In Q1 2025, AWS accounted for just 19% of revenue but delivered an impressive 63% of total operating profit. Meanwhile, Amazon's fast-expanding advertising segment is also emerging as a key growth engine. Looking ahead, Amazon is scheduled to announce its second-quarter results on July 31. Wall Street projects a 9% growth in Amazon's revenue to $162 million. Meanwhile, analysts expect the company to report earnings per share of $1.32 compared to $1.26 in the prior-year quarter. Is Amazon a Buy, Hold, or Sell? Ahead of the Q2 print, BofA Securities analyst Justin Post raised his price target to $265, up from $248, while maintaining a Buy rating. Post expects Amazon's Q2 retail performance to be strong, helped by positive credit card spending data and an extended Prime Day. He also believes AWS is picking up pace, with a strong order backlog and rising cloud demand. The analyst now predicts Q2 revenue of $164 billion, above Wall Street's estimate of $162.1 billion. Turning to Wall Street, AMZN stock has a Strong Buy consensus rating based on 44 Buys and one Hold assigned in the last three months. At $258.27, the average Amazon stock price target implies an 11.59% upside potential. Conclusion Ahead of earnings, Wall Street remains bullish on both Alibaba and Amazon stocks. However, analysts see greater upside potential in Alibaba, supported by its strong fundamentals, expanding AI initiatives, and solid recovery in e-commerce business. Meanwhile, Amazon is gaining from steady growth in cloud and advertising, two high-margin areas set to benefit from AI. While its upside may be smaller than Alibaba's, Amazon's stable growth and strong cash flow continue to earn Wall Street's confidence.
Yahoo
2 hours ago
- Yahoo
5 Reasons to Buy Nvidia Stock Like There's No Tomorrow
Key Points AI spending continues to grow robustly, creating greater demand for Nvidia's GPUs. Nvidia continues to dominate the AI chip market. New markets and technological advances present tremendous growth opportunities for Nvidia. 10 stocks we like better than Nvidia › Why should you not invest in Nvidia (NASDAQ: NVDA) right now? You'd definitely be late to the party buying shares of a company with a market cap of $4.2 trillion. Other stocks could have better growth prospects. Nvidia is also expensive, with a forward earnings multiple of over 38. I'm not going to focus on the bear case for Nvidia, though. The bull case looks even more compelling. Here are five reasons to buy Nvidia stock like there's no tomorrow. 1. AI spending is growing Any concerns that spending on artificial intelligence (AI) by cloud service providers and other customers would slow have evaporated. Alphabet gave more proof in its second-quarter update. The company raised its full-year capital expenditure guidance by $10 billion. This increase is due to Google Cloud investing in servers and data centers to meet rapidly growing demand. We haven't heard Amazon's and Microsoft's quarterly updates yet. However, I'd be surprised if their stories aren't similar to Google's. And when these cloud titans are investing more in servers and data centers, you can bet that a lot of the money will go to buy chips from Nvidia. 2. Continued GPU dominance There's a simple reason why customers are still turning to Nvidia: Its graphics processing units (GPUs) continue to dominate the AI market. Even with Google developing its tensor processing units (TPUs) and Amazon deploying its Inferentia and Trainium chips, Nvidia's seat on the throne remains secure. Blackwell, Nvidia's newest GPU architecture, has delivered the fastest commercial ramp-up in the company's history. In the first quarter of fiscal 2026, Blackwell GPUs generated almost 70% of Nvidia's data center compute revenue. Keep in mind that these chips began shipping in significant volumes just earlier this year. 3. The CUDA moat Can Nvidia sustain its grip on the AI chip market? It seems likely, thanks to what some refer to as the company's "CUDA moat." CUDA (which stands for Compute Unified Device Architecture) is Nvidia's proprietary platform that allows programmers to use its GPUs. This architecture has been around for years, with millions of programmers using it. There's also an extensive library of code that's optimized for Nvidia's GPUs. The bottom line is that Nvidia's competitive advantage in AI chips probably won't disappear as long as the CUDA ecosystem remains strong. 4. Expanding into new markets Nvidia has a successful track record of expanding into new markets. The company started out making chips for gaming systems before recognizing that its GPUs were ideal for powering AI models. It continues to move into new markets. For example, Nvidia's Omniverse platform, which enables the creation of 3D simulations and digital twins, is already used by multiple major corporations. I suspect it could be a bigger growth driver in the future than meets the eye. The company's Drive platform should also enable it to profit as autonomous vehicles become more widely adopted. Nvidia CEO Jensen Huang recently told shareholders that robotics represents the company's largest opportunity after AI. And while Huang seemed to pour cold water on expectations for quantum computing earlier this year, he stated at a conference in June that the technology "is reaching an inflection point." Unsurprisingly, Nvidia is investing heavily in quantum computing. 5. Tomorrow will be more exciting than today Perhaps the most important reason to buy Nvidia stock like there's no tomorrow is that there will be a tomorrow -- and it will almost certainly be more exciting than today. The advancement of AI over the next few years, including the advent of AI agents and potentially artificial general intelligence (AGI), could turbocharge the demand for Nvidia's GPUs. So could the proliferation of humanoid robots. Huang told analysts on Nvidia's Q1 earnings call, "The age of AI is here. From AI infrastructures, inference at scale, sovereign AI, enterprise AI, and industrial AI, Nvidia Corporation is ready." I think he was right. Do the experts think Nvidia is a buy right now? The Motley Fool's expert analyst team, drawing on years of investing experience and deep analysis of thousands of stocks, leverages our proprietary Moneyball AI investing database to uncover top opportunities. They've just revealed their to buy now — did Nvidia make the list? When our Stock Advisor analyst team has a stock recommendation, it can pay to listen. After all, Stock Advisor's total average return is up 1,041% vs. just 183% for the S&P — that is beating the market by 858.71%!* Imagine if you were a Stock Advisor member when Netflix made this list on December 17, 2004... if you invested $1,000 at the time of our recommendation, you'd have $636,628!* Or when Nvidia made this list on April 15, 2005... if you invested $1,000 at the time of our recommendation, you'd have $1,063,471!* The 10 stocks that made the cut could produce monster returns in the coming years. Don't miss out on the latest top 10 list, available when you join Stock Advisor. See the 10 stocks » *Stock Advisor returns as of July 21, 2025 Keith Speights has positions in Alphabet, Amazon, and Microsoft. The Motley Fool has positions in and recommends Alphabet, Amazon, Microsoft, and Nvidia. The Motley Fool recommends the following options: long January 2026 $395 calls on Microsoft and short January 2026 $405 calls on Microsoft. The Motley Fool has a disclosure policy. 5 Reasons to Buy Nvidia Stock Like There's No Tomorrow was originally published by The Motley Fool
