Latest news with #AMDInstinctMI300XGPUs
Techday NZ
21-05-2025
- Business
- Techday NZ
Red Hat & AMD extend AI & virtualisation for hybrid cloud
Red Hat and AMD have announced a strategic collaboration aimed at expanding customer options for artificial intelligence (AI) and virtualisation across hybrid cloud environments. The partnership integrates Red Hat's open-source expertise with AMD's high-performance computing hardware. The companies state that the collaboration will allow organisations to deploy optimised, efficient, and production-ready environments for AI-enabled workloads, while also providing tools for efficiently modernising traditional virtual machines (VMs). A core component of the collaboration involves full enablement of AMD Instinct GPUs on Red Hat OpenShift AI. This means that customers deploying AI across hybrid cloud environments can take advantage of AMD's processing power without requiring extensive resources. AMD Instinct MI300X GPUs, when paired with Red Hat Enterprise Linux AI, have demonstrated success in AI inferencing for both small and large language models (SLMs and LLMs). Testing conducted with Microsoft Azure ND MI300X v5 showed that these models could be deployed across multiple GPUs within a single VM. This approach may reduce the need to deploy across multiple VMs and potentially lower performance-related costs. Red Hat and AMD are also collaborating in the upstream vLLM community, an effort aimed at delivering increased inference performance and improved support for multi-GPU applications on AMD hardware. This collaboration includes technical contributions such as upstreaming the AMD kernel library and optimisations to the Triton kernel and FP8 support, allowing for faster and more efficient execution of vLLM workloads on AMD Instinct MI300X GPUs. Enhanced collective communication and workload optimisation for multi-GPU environments are also being targeted, which could offer scalability and improved energy efficiency for AI deployments dependent on distributed computing. Collaborative efforts between Red Hat, AMD, and other industry parties such as IBM are intended to accelerate development within the vLLM project and benefit users relying on AMD hardware for AI inference and training. The companies indicate that AMD Instinct GPUs will provide out-of-the-box support for Red Hat AI Inference Server, a distribution of vLLM designed for enterprise-grade requirements. As the primary commercial contributor to the vLLM project, Red Hat emphasises its commitment to compatibility across various hardware platforms, including those from AMD. The collaboration also extends to AMD EPYC CPUs, which have been validated for Red Hat OpenShift Virtualization. This capability supports the running of VM workloads in an environment that aims to unify VMs and containerised applications, whether on-premises, in public clouds, or across a hybrid cloud setup. Red Hat OpenShift Virtualization's validation for AMD EPYC processors allows the leveraging of these CPUs' performance and power efficiency characteristics, with support for leading server platforms including Dell PowerEdge, HPE ProLiant, and Lenovo ThinkSystem. The aim is to achieve higher infrastructure consolidation ratios, which could result in a reduced total cost of ownership (TCO) relating to hardware, software licensing, and energy. Ashesh Badani, Senior Vice President and Chief Product Officer at Red Hat, said: "Fully realizing the benefits of AI means that organizations must have the choice and flexibility to optimize their IT footprint for the rigors of scaling demand. Our extended collaboration with AMD expands the spectrum of options for organizations seeking to ready their IT environments for an ever-evolving future, from modernizing existing investments on a high-performing CPU architecture and virtualization platform to preparing for production AI with next-generation hardware accelerators and open source AI technologies." Philip Guido, Executive Vice President and Chief Commercial Officer at AMD, said: "As enterprise customer workloads grow more diverse and demanding, they require solutions that can scale. By combining Red Hat's industry-leading open source platforms with world-class AMD Instinct GPUs and AMD EPYC CPUs, we're delivering the performance and efficiency customers demand to accelerate AI, virtualization and hybrid-cloud innovation." The companies are aiming to provide customers with a comprehensive platform capable of supporting both traditional workloads and demanding AI applications across the hybrid cloud.
Globe and Mail
21-03-2025
- Business
- Globe and Mail
AMD Stock Drops 44%, Is a Big Comeback Coming?
Shares of Advanced Micro Devices (AMD) have witnessed a notable decline, trading approximately 44% lower than their 52-week high of $187.28. This downturn largely reflects AMD's challenges in capturing a significant share of the rapidly expanding artificial intelligence (AI) market, where Nvidia (NVDA) holds a dominant position. In addition to AI, macroeconomic and competitive headwinds in the CPU market added further pressure. The company's full-year (2025) revenue forecast has also disappointed investors, exacerbating concerns and weighing on its stock performance. Despite these setbacks, AMD has bright spots. The company anticipates robust growth in its data center AI segment, which could serve as a key driver for recovery. Looking ahead to 2025, AMD's leadership is optimistic about improving demand across all business segments, particularly in data centers and client services, with moderate gains expected in gaming and embedded solutions. Against this backdrop, let's explore AMD's prospects and opportunities that could spark a rebound in its stock price. AMD's Data Center Boom: A Catalyst for Stock Growth AMD's data center business is growing rapidly, delivering record revenue. Moreover, the company is focused on offering a wide range of high-performance adaptive hardware and software solutions in the AI space to capture demand and accelerate its growth. Further, it is expanding its partnerships to accelerate the deployments of AMD-based AI solutions at a significant scale. Demand for AMD's AI accelerators, particularly the AMD Instinct MI300X GPUs, is surging as large hyperscalers, original equipment manufacturers (OEMs), and original design manufacturers (ODMs) integrate them into their operations. AMD has unveiled an accelerated roadmap for its AI accelerators to maintain its competitive edge, committing to an annual release cycle of cutting-edge solutions. Furthermore, the launch of its 5th Gen AMD EPYC server processors is set to redefine performance benchmarks in data center workloads. The company's financial performance reflects its strong position in the market. AMD reported $12.6 billion in data center revenue for 2024, marking a staggering 94% increase from the previous year's $6.5 billion. This surge was driven by the robust adoption of AMD Instinct GPUs and EPYC CPUs, solidifying its foothold in the AI and cloud computing sectors. Further, to enhance its AI capabilities, AMD completed the acquisition of Silo AI, a leading AI lab in Finland. This acquisition strengthens AMD's ability to develop and deploy advanced AI models on its hardware. On the product front, AMD has ramped up volume production of the MI325X GPUs, which have been well-received. The company has secured several high-profile deals with customers deploying AMD Instinct solutions at scale for both inferencing and training AI models. Looking ahead, AMD's next-generation MI350 series is set to deliver significant improvement in AI compute performance over its predecessor. This could lead to solid demand, and the company plans to ramp up production by mid-year. Furthermore, the development of the MI400 series is well underway, promising even more significant advancements in AI and networking integration. Besides hardware, AMD is also investing heavily in software capabilities and expanding its open ecosystem. It continues to enhance its ROCm software stack, optimizing AI workloads and simplifying the developer experience. As the company strengthens its leadership in AI and data center solutions, it is poised to deliver significant growth, which will drive its share price higher. AMD's Competitive Edge in CPUs While AMD's AI and data center business drives significant growth, its CPU segment will likely complement its growth. The company's EPYC processors continue to gain momentum in the server market, helping AMD expand its market share. As businesses seek high-performance computing solutions, AMD's combination of strong performance and cost efficiency gives it a distinct edge. The PC market is also showing signs of recovery, with AMD projecting mid-single-digit growth in 2025. Additionally, as AI-powered PCs become more prevalent, AMD's leadership in AI-enabled CPUs further solidifies its competitive position. Is AMD Stock Set for a Comeback? Wall Street analysts have a 'Moderate Buy' consensus rating on AMD stock, suggesting that the stock is well-positioned for a rebound. Overall, AMD is an attractive investment for investors seeking exposure to a stock with a reasonable valuation and strong growth potential led by AI-driven demand.
