Latest news with #MI300X


Business Wire
6 days ago
- Business
- Business Wire
MangoBoost Sets New Benchmark for Multi-Node LLM Training on AMD GPUs in MLPerf Training v5.0
BELLEVUE, Wash.--(BUSINESS WIRE)--MangoBoost, a provider of cutting-edge system solutions for maximizing compute efficiency and scalability, has validated the scalability and efficiency of large-scale AI training on AMD Instinct™ MI300X GPUs through its MLPerf Training v5.0 submission. Tailored for enterprise data centers prioritizing performance, flexibility, and cost-efficiency, this milestone demonstrates that state-of-the-art LLM training is now viable beyond traditional vendor-locked GPU platforms. This showcases how the AMD Instinct™ MI300X GPUs and ROCm™ software stack synergize with MangoBoost's LLMBoost™ AI Enterprise software and GPUBoost™ RoCEv2 NIC. Share Using 32 AMD Instinct™ MI300X GPUs across four nodes, MangoBoost fine-tuned the Llama2-70B-LoRA model in just 10.91 minutes, setting the fastest multi-node MLPerf benchmark on AMD GPUs to date. The system achieved near-linear scaling efficiency (95–100%), proving that MangoBoost's stack can support practical and scalable LLM training in production environments. Scalability and Efficiency for Enterprise Data Centers The result showcases more than just benchmark success—it underscores how enterprises can reliably scale LLM training across clusters without network bottlenecks or rigid infrastructure dependencies. Mango LLMBoost™: A full-featured MLOps software platform for large language models, supporting model parallelism, automatic tuning, batch scheduling, and advanced memory management. Mango GPUBoost™ RoCEv2 RDMA: Inter-GPU communication hardware optimized for low-latency, high-throughput node-to-node communication, sustaining line-rate performance across thousands of concurrent QPs. These technologies together deliver predictable and efficient multi-node training, ideal for organizations operating their own AI infrastructure or deploying on public cloud. Industry-First MLPerf Training on AMD MI300X GPUs This is the first-ever MLPerf Training submission on AMD GPUs spanning multiple nodes. MangoBoost's platform demonstrated robust performance with a 4-node, 32-GPU cluster and confirmed compatibility with additional model sizes and structures—including Llama2-7B and Llama3.1-8B—in internal benchmarks. These results validate the generalizability of MangoBoost's platform beyond benchmarks to diverse production-scale use cases. " I'm excited to see MangoBoost's first MLPerf Training results, pairing their LLMBoost AI Enterprise MLOps software with their RoCEv2-based GPUBoost DPU hardware to unlock the full power of AMD GPUs, demonstrated by their scalable performance from a single-node MI300X to 2- and 4-node MI300X results on Llama2-70B LoRA. Their results underscore that a well-optimized software stack is critical to fully harness the capabilities of modern AI accelerators." — David Kanter, Founder, Head of MLPerf, MLCommons Vendor-Neutral AI Infrastructure Enabled by AMD Collaboration The achievement was made possible through deep collaboration with AMD and seamless integration with the ROCm™ software ecosystem, enabling full utilization of MI300X's compute, memory bandwidth, and capacity. Enterprises are now empowered to choose infrastructure based on business needs—not vendor constraints. " We congratulate MangoBoost on their MLPerf 5.0 training results on AMD GPUs and are excited to continue our collaboration with them to unleash the full power of AMD GPUs. In this MLPerf Training submission, MangoBoost has achieved a key milestone in demonstrating training results on AMD GPUs across 4 nodes (32 GPUs). This showcases how the AMD Instinct™ MI300X GPUs and ROCm™ software stack synergize with MangoBoost's LLMBoost™ AI Enterprise software and GPUBoost™ RoCEv2 NIC." — Meena Arunachalam, Fellow, AI Performance Design Engineering, AMD "At MangoBoost, we've shown that software-hardware co-optimization enables scalable, efficient LLM training without vendor lock-in. Our MLPerf result is a key milestone proving our technology is ready for enterprise-scale AI training with superior efficiency and flexibility," said CEO Jangwoo Kim. MangoBoost continues to develop innovations in communication optimization, hybrid parallelism, topology-aware scheduling, and domain-specific acceleration to further scale performance in distributed AI workloads. About MangoBoost MangoBoost is a provider of cutting-edge, full-stack system solutions for maximizing compute efficiency and scalability. At the heart of the solutions is the MangoBoost Data Processing Unit (DPU), which ensures full compatibility with general-purpose GPUs, accelerators, and storage devices, enabling cost-efficient, standardized AI infrastructure. Founded in 2022 on a decade of research, MangoBoost is rapidly expanding its operations in the U.S., Canada, and Korea.
Yahoo
14-05-2025
- Business
- Yahoo
1 Super Stock Down 76% You'll Regret Not Buying on the Dip in 2025
DigitalOcean provides cloud services exclusively to small and mid-sized businesses (SMBs). The company is expanding into artificial intelligence (AI) services, and revenue from this part of its business surged by 160% in the recent quarter. DigitalOcean stock is down significantly from its 2021 high, but its valuation is starting to look extremely attractive. 10 stocks we like better than DigitalOcean › The cloud computing industry is dominated by giants like Amazon, Microsoft, and Alphabet, but those providers typically focus on the largest and highest-spending enterprises. Tailoring their cloud services to small and medium-sized businesses (SMBs) wouldn't be an economical strategy, because those customers wouldn't contribute enough revenue to move the needle. DigitalOcean (NYSE: DOCN), on the other hand, focuses exclusively on providing cloud services to SMB customers. Plus, it has a growing portfolio of artificial intelligence (AI) services that are helping even the smallest businesses adopt this revolutionary technology. DigitalOcean stock is down 76% from its record high, which was set during the tech frenzy in 2021. The stock was undeniably overvalued then, but it's starting to look very attractive, especially in light of the company's accelerating revenue growth and soaring profits. Here's why investors might regret not buying the dip. DigitalOcean provides a range of cloud services to more than 600,000 customers, from simple data storage and website hosting to complex software development tools. It differentiates itself from the larger cloud platforms by offering cheap and transparent pricing, highly personalized support, and simple deployment processes. These attributes are suited to SMBs, especially those without in-house technical expertise. DigitalOcean is now helping SMBs access the power of AI. It operates data center infrastructure fitted with graphics processing units (GPUs) from top suppliers like Nvidia and Advanced Micro Devices. In order to keep prices down, DigitalOcean doesn't use the latest GPU variants, but it does offer Nvidia's H200 and AMD's MI300X, which can deliver more than enough computing power for moderate AI workloads. Plus, DigitalOcean offers fractional capacity, meaning SMBs can access between one and eight GPUs at a time. This is ideal for small businesses that might want to deploy an AI chatbot on their website to handle customer service inquiries, for example. That kind of workload doesn't require thousands of Nvidia's latest Blackwell GPUs, which is what the bigger cloud platforms are focused on providing. In January this year, DigitalOcean also launched a new platform called GenAI which allows SMBs to create custom AI agents to serve customers, onboard new employees, and even generate business insights from internal data. These agents are built on the latest large language models (LLMs) from top developers like OpenAI, Anthropic, and Meta Platforms, which are among the most complex in the world. The GenAI platform is still in beta mode, but DigitalOcean says 5,000 customers have already used it to deploy over 8,000 AI agents so far. DigitalOcean generated $210.7 million in total revenue during the first quarter of 2025 (ended March 31), which was a 14% increase from the year-ago period. That growth rate accelerated for the second consecutive quarter, which is a sign that momentum is building, and AI is a key reason why. Although DigitalOcean doesn't disclose exactly how much revenue its AI services generate, the company said it grew by an eye-popping 160% year over year during Q1. But it gets better -- management says demand for GPU capacity continues to outstrip supply, so investors should expect rapid growth from the AI business for the foreseeable future. DigitalOcean's Q1 results were even more impressive when you consider that it slashed its total operating expenses by 6% to improve its bottom line. In other words, the company could be growing its revenue even faster by investing more aggressively in costs like marketing, which would attract more customers. But the strategy worked like a charm. DigitalOcean's net income (profit) soared by a whopping 171% to $38.2 million during the quarter, which translated to $0.39 in earnings per share (EPS). When DigitalOcean stock peaked in 2021, it was trading at a lofty price-to-sales (P/S) ratio of around 30, which was unsustainable. The 76% decline in the stock since then, combined with the company's consistent revenue growth, has pushed its P/S ratio down to just 3.7. That's actually a 34% discount to its three-year average of 5.6, which excludes the 2021 period. Now that DigitalOcean is consistently profitable, we can also measure its valuation using the price-to-earnings (P/E) ratio. Based on the company's trailing 12-month EPS of $1.11, its stock trades at a P/E ratio of 27.6, which is near its cheapest level since it went public four years ago. The Nasdaq-100 index trades at a P/E ratio of 29.3, so DigitalOcean is cheaper than a basket of the world's biggest technology stocks (which includes many of the top providers of cloud and AI services). DigitalOcean values its addressable market at $400 billion this year, so it hasn't even scratched the surface of its opportunity. Considering the rapid growth of its AI revenue, its soaring earnings, and its valuation, investors might regret not buying the stock today when they look back on this moment in a few years' time. Before you buy stock in DigitalOcean, consider this: The Motley Fool Stock Advisor analyst team just identified what they believe are the for investors to buy now… and DigitalOcean wasn't one of them. The 10 stocks that made the cut could produce monster returns in the coming years. Consider when Netflix made this list on December 17, 2004... if you invested $1,000 at the time of our recommendation, you'd have $598,613!* Or when Nvidia made this list on April 15, 2005... if you invested $1,000 at the time of our recommendation, you'd have $753,878!* Now, it's worth noting Stock Advisor's total average return is 922% — a market-crushing outperformance compared to 169% for the S&P 500. Don't miss out on the latest top 10 list, available when you join . See the 10 stocks » *Stock Advisor returns as of May 12, 2025 John Mackey, former CEO of Whole Foods Market, an Amazon subsidiary, is a member of The Motley Fool's board of directors. Suzanne Frey, an executive at Alphabet, is a member of The Motley Fool's board of directors. Randi Zuckerberg, a former director of market development and spokeswoman for Facebook and sister to Meta Platforms CEO Mark Zuckerberg, is a member of The Motley Fool's board of directors. Anthony Di Pizio has no position in any of the stocks mentioned. The Motley Fool has positions in and recommends Advanced Micro Devices, Alphabet, Amazon, DigitalOcean, Meta Platforms, Microsoft, and Nvidia. The Motley Fool recommends the following options: long January 2026 $395 calls on Microsoft and short January 2026 $405 calls on Microsoft. The Motley Fool has a disclosure policy. 1 Super Stock Down 76% You'll Regret Not Buying on the Dip in 2025 was originally published by The Motley Fool Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
Yahoo
13-05-2025
- Business
- Yahoo
Advanced Micro Devices, Inc. (AMD) – MI300X, EPYC Chips Fuel AMD Growth Despite China Export Headwinds
We recently published a list of . In this article, we are going to take a look at where Advanced Micro Devices, Inc. (NASDAQ:AMD) stands against other AI stocks surging on news and ratings. According to Daniel Ives, global head of technology research at Wedbush Securities, the US- China agreement is once again creating a bull market environment for tech. 'If you are a tech investor, this is a dream scenario,' Ives noted on CNBC's 'Worldwide Exchange.' On Monday, the U.S. and China announced that they would temporarily reduce tariffs on each other for 90 days. Following the news, Wall Street's three major indexes surged sharply on the same day, with the S&P 500 marking its highest level since early March. READ ALSO: and The U.S. said it will cut tariffs imposed on Chinese imports to 30% from 145% while China said it would cut duties on U.S. imports to 10% from 125%. Investors saw this as a big positive surprise. 'It's a relief rally because there was a lot of anxiety and angst about tariffs between the U.S. and China. They are going to scale it down to much more reasonable levels so the fall-out from tariffs will probably be more manageable and limited.' Unfortunately, the rally in US stock futures paused as investors focused on a key inflation report and lingering economic concerns. 'The challenges are not over. The de-escalation was a lot stronger than even the best hopes, but you have to remember that the US economy still faces average of effective tariffs of more than 13%.' For this article, we selected AI stocks by going through news articles, stock analysis, and press releases. These stocks are also popular among hedge funds. The hedge fund data is as of Q4 2024. Why are we interested in the stocks that hedge funds pile into? The reason is simple: our research has shown that we can outperform the market by imitating the top stock picks of the best hedge funds. Our quarterly newsletter's strategy selects 14 small-cap and large-cap stocks every quarter and has returned 373.4% since May 2014, beating its benchmark by 218 percentage points (). A close up of a complex looking PCB board with several intergrated semiconductor Micro Devices, Inc. (NASDAQ:AMD) develops and sells semiconductors, processors, and GPUs for data centers, gaming, AI, and embedded applications. On May 13, Yik Ban Chong from Phillip Securities maintained a 'Buy' rating on the stock with a price target of $120.00. Yik Ban Chong's buy rating is a reflection of AMD's strong potential and resilience despite the challenges that it is facing. The company's robust sales of MI300X chips, EPYC server CPUs, and Ryzen CPUs have led to revenue and profit figures in line with expectations for the first quarter of 2025. Its client PC segment has also demonstrated remarkable growth, maintaining over 50% year-over-year revenue growth for four consecutive quarters. This growth can largely be attributed to record average selling prices for client CPUs and market share gains in AI PC chips. The company's second quarter guidance for 2025 also remains strong despite potential revenue impacts from recent U.S. export controls on AI chips to China. Moreover, with major tech companies ramping up their capital expenditure to expand data centers, AMD's EPYC CPUs and MI325X GPUs are expected to see a boost in demand. Together with AMD's stabilizing gaming and embedded businesses, all these factors contribute toward a positive outlook for the stock. Overall, AMD ranks 7th on our list of AI stocks surging on news and ratings. While we acknowledge the potential of AMD as an investment, our conviction lies in the belief that some AI stocks hold greater promise for delivering higher returns and doing so within a shorter time frame. There is an AI stock that went up since the beginning of 2025, while popular AI stocks lost around 25%. If you are looking for an AI stock that is more promising than AMD but that trades at less than 5 times its earnings, check out our report about this . READ NEXT: 20 Best AI Stocks To Buy Now and 30 Best Stocks to Buy Now According to Billionaires. Disclosure: None. This article is originally published at Insider Monkey. Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
Yahoo
01-05-2025
- Business
- Yahoo
Better Semiconductor Stock: AMD vs. Nvidia
The negative stock market sentiment has weighed on shares of AMD and Nvidia this year. However, both companies have been delivering healthy growth thanks to catalysts such as AI. It won't be surprising to see these chip stocks regain their mojo on account of recent tariff-related developments. The PHLX Semiconductor Sector index has been under duress this year and lost over 14% of its value thanks to the tariff-fueled economic uncertainty that has raised the potential of a global recession, which explains why some of the major names in this sector have performed poorly on the stock market in 2025. Shares of both Advanced Micro Devices (NASDAQ: AMD) and Nvidia (NASDAQ: NVDA) are down close to 20% so far this year. However, the recent tariff-related developments suggest that these semiconductor stocks could see a solid comeback, especially considering their impressive results in recent quarters. From pausing reciprocal tariffs for 90 days to exempting duties on imports of semiconductors and other equipment from China to starting trade talks, there are signs of the trade war easing. Where to invest $1,000 right now? Our analyst team just revealed what they believe are the 10 best stocks to buy right now. Continue » China has reportedly rolled back retaliatory tariffs on certain semiconductor components made in the U.S. So, there is a good chance that the cloud of uncertainty hovering over companies such as Nvidia and AMD that have been caught in the trade war could clear and help these semiconductor stocks regain their mojo. But if you have to buy one of these two chip stocks for your portfolio, which one should it be? Let's find out. AMD manufactures chips that go into applications such as data centers, personal computers (PCs), and gaming consoles, among others. The demand for AMD's chips that go into data centers and PCs has been picking up in recent quarters thanks to artificial intelligence (AI). Specifically, AMD's revenue from data center chip sales shot up 69% year over year in the fourth quarter of 2024 to $3.9 billion. The company credited this impressive growth to a ramp-up in sales of its data center graphics cards and server processors. While Nvidia is the dominant player in the AI GPU market, AMD has been gradually gaining ground over here. On its February earnings conference call, CEO Lisa Su remarked that the deployment of its MI300X AI accelerators "expanded with our largest cloud partners." The likes of Meta Platforms, Microsoft, IBM, and DigitalOcean are powering their AI models with AMD's chips, which is why the company has decided to accelerate the launch of its upcoming MI350 AI chips based on the CDNA 4 architecture. AMD points out that the CDNA 4 architecture delivers a 35x jump in AI compute performance as compared to the previous generation CDNA 3. The company has received positive customer feedback and believes that the MI350 family of AI chips could drive "deeper and broader customer engagements with both existing and net new hyperscale customers." AMD will begin shipments of the MI350 chips in the middle of 2025. So, there is a good chance that its data center revenue will continue to grow at a healthy pace thanks to AI. However, this is not the only AI-focused opportunity that the company is sitting on. The adoption of AI PCs is giving AMD's client processor business a nice boost. Its revenue from this segment rose 58% year over year in the fourth quarter of 2024, thanks to the strong demand for its Ryzen processors. AMD reported record sell-through of its desktop processors in the fourth quarter of 2024 and exceeded 70% share at several major retailers. The company is also pushing the envelope in the laptop space with the launch of 22 new mobile processors equipped with AI capabilities. AMD believes that its solid portfolio of laptop and desktop CPUs should help it grab a bigger share of the PC market in 2025. It is worth noting that AMD's overall CPU market share increased in the fourth quarter of 2024 to almost 25%, according to Mercury Research, and the points discussed above suggest that it can make a bigger dent in this market. So, the robust demand for chips used in servers and computers should remain a tailwind for AMD in 2025 and beyond, driving healthy growth in the company's top and bottom lines. Nvidia's dominant position in the market for AI chips helped the company deliver impressive growth in recent quarters. Nvidia ended fiscal 2025 with $130.5 billion in revenue, up by 114% from the previous year. Its revenue guidance of $43 billion for the current quarter points toward a potential jump of 65% in its top line, suggesting that its healthy pace of growth is here to stay. That's not surprising, as Nvidia reportedly controls a whopping 90% of the data center GPU market. This is also the reason why its data center revenue growth of 93% in the last reported quarter was higher than AMD's, even though Nvidia has a much larger revenue base. Looking ahead, Nvidia's technological advantage over AMD could help it remain the leading player in AI chips, and that puts the company in a terrific position to keep growing at a solid pace. After all, the market for AI chips is expected to jump by 2.5x by 2029, generating an annual revenue of $311 billion. Nvidia's data center revenue of $115 billion in the previous quarter indicates that it still has a lot of room for growth in this space, and it may be able to corner a significant chunk of the end-market opportunity thanks to its massive share of this space. Nvidia also has additional catalysts coming into play, such as the automotive market, where it is expecting its revenue to nearly triple this year following a 55% increase in the previous fiscal year. So, it is easy to see why analysts are forecasting Nvidia's earnings to increase by 48% in the current fiscal year, though don't be surprised to see the company doing better than that, as its margin profile should start improving once the production of its Blackwell AI processors ramps up. So, just like AMD, even Nvidia is thriving on solid semiconductor demand. But is it a better buy than its peer? Let's find out. We have seen that Nvidia is on track to clock healthy earnings growth this year. A similar scenario is expected to unfold at AMD, with an estimated earnings jump of 33% in 2025. Importantly, AMD's bottom-line growth is expected to grow to 36% in 2026. However, Nvidia expects a slowdown as its bottom line is projected to grow 28% in the next fiscal year. AMD's stronger growth forecast next year can be attributed to the company's diversified business, while the potential slowdown in Nvidia's earnings growth could be a result of intensifying competition in AI chips. What's more, AMD's price/earnings-to-growth ratio (PEG ratio) of just 0.44 indicates that it is undervalued after accounting for its annual projected earnings growth for the next five years, according to Yahoo! Finance. Nvidia seems overvalued right now, with a PEG ratio of 1.57, which can be attributed to a potential drop in its pace of earnings growth. So, AMD seems like the better semiconductor growth stock to buy right now, considering the points discussed above, though investors cannot go wrong by choosing Nvidia either, as the latter's massive addressable opportunity could ensure years of solid growth and stock upside. Before you buy stock in Advanced Micro Devices, consider this: The Motley Fool Stock Advisor analyst team just identified what they believe are the for investors to buy now… and Advanced Micro Devices wasn't one of them. The 10 stocks that made the cut could produce monster returns in the coming years. Consider when Netflix made this list on December 17, 2004... if you invested $1,000 at the time of our recommendation, you'd have $598,818!* Or when Nvidia made this list on April 15, 2005... if you invested $1,000 at the time of our recommendation, you'd have $666,416!* Now, it's worth noting Stock Advisor's total average return is 872% — a market-crushing outperformance compared to 160% for the S&P 500. Don't miss out on the latest top 10 list, available when you join . See the 10 stocks » *Stock Advisor returns as of April 28, 2025 Randi Zuckerberg, a former director of market development and spokeswoman for Facebook and sister to Meta Platforms CEO Mark Zuckerberg, is a member of The Motley Fool's board of directors. Harsh Chauhan has no position in any of the stocks mentioned. The Motley Fool has positions in and recommends Advanced Micro Devices, DigitalOcean, International Business Machines, Meta Platforms, Microsoft, and Nvidia. The Motley Fool recommends the following options: long January 2026 $395 calls on Microsoft and short January 2026 $405 calls on Microsoft. The Motley Fool has a disclosure policy. Better Semiconductor Stock: AMD vs. Nvidia was originally published by The Motley Fool Sign in to access your portfolio


Globe and Mail
01-05-2025
- Business
- Globe and Mail
AMD Chips Away at Nvidia's AI Lead as Super Micro Stumbles
AMD stock (AMD) is creeping into territory long ruled by Nvidia (NVDA), and this week's market action hints it's no fluke. As Super Micro Computer's (SMCI) weak outlook spooked investors and Nvidia's momentum wobbled, AMD suddenly found itself in the right place at the right time. Protect Your Portfolio Against Market Uncertainty Super Micro Weakness Shakes Confidence in Nvidia Super Micro Computer, one of the biggest names in AI server hardware, just missed the mark. The company warned investors that revenue would fall short due to 'delayed customer platform decisions,' a nod to hesitations around deploying Nvidia's latest Blackwell chips. These delays are giving customers pause — and for Nvidia, that's bad news. When a major Nvidia-dependent player like Super Micro stumbles, it sends a message. Wall Street read it loud and clear. Nvidia stock slipped 1.7% in early trading. Super Micro dropped more than 3%. Both stocks are still up big this year, but the market is watching for signs the AI frenzy may be slowing — or diversifying. AMD Grabs Attention With Competitive AI Chips Meanwhile, AMD is starting to look like the real alternative. Its MI300X chip — a direct rival to Nvidia's H100 — is gaining ground fast. CEO Lisa Su said earlier this month that demand for the chip has been 'very strong,' and the company has already booked over $3.5 billion in AI accelerator revenue for 2024. According to Wells Fargo, AMD may take share with its more flexible pricing and broader product lineup. They noted that 'AMD is positioned well for enterprise AI buildouts' especially as companies look to diversify beyond Nvidia. Investors Brace for Meta and Microsoft Earnings Now the focus shifts to Meta (META) and Microsoft (MSFT), who both report earnings this week. These companies are two of Nvidia's biggest customers, so any changes to their AI capital spending could tip the scales. If Meta or Microsoft scale back server investments or signal a move toward multiple chip suppliers, AMD could benefit directly. The MI300X might not just be an option — it could become the hedge. Is AMD Stock a Good Buy? Analysts seem cautiously optimistic. On TipRanks, AMD holds a Moderate Buy consensus based on 34 analyst ratings—22 Buys and 12 Holds, with no Sells in sight. The average AMD price target is $139.13, suggesting a potential upside of 48.2% from current levels. The most bullish forecast sees AMD hitting $225, while the lowest sits at $95. That wide range shows there's still plenty of debate over how well AMD can compete in the AI chip race. But for now, Wall Street clearly isn't counting it out. See more AMD analyst ratings Disclaimer & Disclosure Report an Issue This article contains syndicated content. We have not reviewed, approved, or endorsed the content, and may receive compensation for placement of the content on this site. For more information please view the Barchart Disclosure Policy here.