Latest news with #CXL
Techday NZ
23-05-2025
- Business
- Techday NZ
PEAK:AIO unveils platform to tackle AI memory bottlenecks
PEAK:AIO has introduced a dedicated solution designed to unify KVCache acceleration and GPU memory expansion for large-scale artificial intelligence workloads, focusing on addressing memory bottlenecks in large language model inference and model development. The company's new platform, powered by CXL memory and integrated with Gen5 NVMe and GPUDirect RDMA, is positioned to provide up to 150 GB/sec sustained throughput with latency below five microseconds. This solution aims to support the growing demands of inference tasks, agentic systems, and model creation processes in AI deployments. Eyal Lemberger, Chief AI Strategist and Co-Founder of PEAK:AIO, described the current landscape of AI memory requirements as evolving beyond static prompts toward more complex workloads: "Whether you are deploying agents that think across sessions or scaling toward million-token context windows, where memory demands can exceed 500GB per model, this appliance makes it possible by treating token history as memory, not storage. It is time for memory to scale like compute has." As artificial intelligence models, particularly transformer-based architectures, increase in size and context, AI pipelines are encountering two main barriers: inefficiency with KVCache and saturation of GPU memory resources. According to the company, other vendors have attempted to adapt existing storage technologies or extend NVMe use to delay these limitations. The platform from PEAK:AIO, referred to as the 1U Token Memory Platform, adopts a token-centric architecture built specifically for scalable artificial intelligence. The company states that this approach allows KVCache reuse across multiple sessions, models, and nodes, along with expanded context windows for longer model history, GPU memory offload using CXL, and low latency access by means of RDMA over NVMe-oF. This platform diverges from traditional NVMe-based storage solutions by providing infrastructure that treats token memory as a primary resource rather than storing it as files. Teams are thus able to cache token history, attention maps, and streaming data at memory-like latency, which the company says is consistent with the performance requirements of advanced AI deployments. PEAK:AIO's system is designed to align specifically with NVIDIA's KVCache reuse and memory management frameworks, providing direct support for users employing TensorRT-LLM or Triton, which the company claims results in accelerated inference speeds with minimal integration work. Leveraging CXL for memory-class performance, the platform delivers token memory operations with characteristics similar to RAM. Lemberger commented further on the design philosophy behind the platform: "While others are bending file systems to act like memory, we built infrastructure that behaves like memory, because that is what modern AI needs. At scale, it is not about saving files; it is about keeping every token accessible in microseconds. That is a memory problem, and we solved it at embracing the latest silicon layer." The solution is fully software-defined and can be deployed on off-the-shelf servers. The company anticipates entering production by the third quarter. PEAK:AIO will be making early access and technical consultations available for organisations interested in integrating the platform within their own AI infrastructure. Mark Klarzynski, Co-Founder and Chief Strategy Officer at PEAK:AIO, highlighted the technical approach adopted by the company: "The big vendors are stacking NVMe to fake memory. We went the other way, leveraging CXL to unlock actual memory semantics at rack scale. This is the token memory fabric modern AI has been waiting for."
Yahoo
16-05-2025
- Business
- Yahoo
Join AIC at Computex 2025 to Experience Breakthroughs in AI Storage and Computing
TAIPEI, Taiwan, May 16, 2025 /PRNewswire/ -- AIC, a global leader in AI Storage and Computing solutions, is excited to announce its participation in Computex 2025, one of the world's largest technology exhibitions. Together with its esteemed partners, AIC will unveil cutting-edge innovations designed to empower a wide range of AI applications. Visitors to AIC's booth will experience demonstrations and previews of the company's latest technologies, including: Next Generation AI Storage: A first look at future-ready advancements, including PCIe Gen6, CXL technologies, and next-generation storage controllers for AI workloads. AI Storage Solutions: Advanced storage systems integrating DPUs with Bluefield-based platforms, engineered for efficient AI data processing. GPU Integration with Remote Storage: Innovations combining GPUs with AIC's storage servers, optimizing micro-services and enabling remote storage capabilities. S3 RDMA: Utilizes RDMA technology to provide NVIDIA BlueField storage systems, supporting BlueField cards or F2026 and F2032 storage subsystems, enabling high-performance AI data management. "AIC is committed to helping customers overcome their daily challenges by delivering innovative, scalable AI solutions," said Michael Liang, CEO and President of AIC Inc. "We are thrilled to showcase our latest developments at Computex 2025 and look forward to connecting with industry leaders, partners, and customers." Event Details:Date: May 20 – 23, 2025Time: 09:30 – 17:30Venue: 4F, TaiNEX 1, Taipei, TaiwanAIC Booth Number: M1119a Join AIC at Computex 2025 to explore how the future of AI storage and computing is being shaped today. For more information, please visit About AIC AIC Inc. is a global leader in the design and manufacturing of high-performance server and storage solutions. With nearly 30 years of expertise, AIC is renowned for its high-density storage servers, storage server barebones, and AI storage solutions. The company operates globally, with offices in the United States, Asia, and Europe, and is dedicated to driving innovation across various industries. Follow AIC on LinkedIn and Facebook to receive the latest news. Media ContactJessie LiuGlobal Marketing, AIC 395325@ #8300 View original content to download multimedia: SOURCE AIC Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
Yahoo
23-04-2025
- Automotive
- Yahoo
What's Going On With Marvell Technology Stock On Wednesday?
Marvell Technology, Inc (NASDAQ:MRVL) on Wednesday announced the successful interoperability of the Marvell Structera portfolio of Compute Express Link (CXL) devices with Advanced Micro Devices, Inc (NASDAQ:AMD) EPYC CPUs and 5th Gen Intel Corp (NASDAQ:INTC) Intel Xeon platforms. The move marks Marvell's progress towards an open and interoperable CXL ecosystem, which will address the growing demands for memory bandwidth and capacity in next-generation cloud data centers. Marvell tapped AMD and Intel to extensively test Structera CXL products with AMD EPYC and 5th Gen Intel Xeon Scalable platforms across various configurations, workloads, and operating conditions. Rising Tide Of AI Is So Strong That Semiconductor Optical Industry Projects $30 Billion Total Addressable Market By 2029 The results demonstrated seamless interoperability, delivering stability, scalability, and high-performance memory expansion that cloud data center providers need for mass deployment. The first-quarter semiconductor earnings procession kicked off with ASML Holding (NASDAQ:ASML) last Wednesday and Taiwan Semiconductor Manufacturing Co (NYSE:TSM) on Thursday. For U.S. chip vendors, BofA Securities analysts Vivek Arya and Duksan Jang expect first-quarter results to beat as their original outlook was likely conservative and tariff-related pull-ins created a better demand environment. However, the second-quarter outlook could be in line as companies could widen the guidance range. Marvell stock plunged over 55% year-to-date. Marvell's exit from the auto space follows its October quarter restructuring, where it began shifting investments away from enterprise networking, carrier infrastructure, and automotive. The company is now focused on AI and accelerated computing, a theme JPMorgan's Harlan Sur sees as key to unlocking long-term value. Price Action: MRVL stock closed higher by 6.22% to $53.77 on Wednesday. Read Next:Photo by JHVEPhoto via Shutterstock Up Next: Transform your trading with Benzinga Edge's one-of-a-kind market trade ideas and tools. Click now to access unique insights that can set you ahead in today's competitive market. Get the latest stock analysis from Benzinga? MARVELL TECH (MRVL): Free Stock Analysis Report This article What's Going On With Marvell Technology Stock On Wednesday? originally appeared on © 2025 Benzinga does not provide investment advice. All rights reserved.
Yahoo
23-04-2025
- Business
- Yahoo
SK hynix Completes Customer Validation of CXL 2.0-based DDR5
Completion of customer qualification of 96GB product to help customers reduce costs when applied to server systems 128GB product of improved performance, equipped with 1bnm 32Gb DDR5, also in customer validation process Company to provide value unmatched by others through "Optimal Innovation" SEOUL, South Korea, April 22, 2025 /PRNewswire/ -- SK hynix Inc. (or "the company", announced today that it has completed customer validation of 96GB CMM(CXL[1] Memory Module)-DDR5, a DRAM solution product based on CXL 2.0. 1 Compute eXpress Link (CXL): A next-generation interface that efficiently connects CPU, GPU, memory, and other components in high-performance computing systems to support massive, ultra-fast computation. Based on PCIe interface, CXL allows fast data transfer and has pooling capability to efficiently utilize memory The company said that it can process 36GB/s due to a 50% increase in capacity when the product is applied to the server systems and a 30% improvement in the bandwidth compared to previous DDR5 modules. This can contribute to drastically reducing the total cost of ownership[2] by customers in building and operating data centers. 2 Total cost of ownership: Total cost of owning a product or service, from purchase to disposal. It also includes costs for deployment, maintenance, operations and upgrades Following the 96GB product validation, the company is proceeding with the validation process for 128GB product with another customer. This product, equipped with 32Gb DDR5 DRAM using the 1bnm process, or the fifth-generation of the 10-nanometer technology, has high performance per watt[3]. The company plans to complete the ongoing 128GB validation as soon as possible to establish a CXL product portfolio to support customers in a timely manner. 3 Performance per watt: Indicator of data capacity per second that can be processed per unit of power SK hynix is making efforts to expand the CXL ecosystem along with the development of CXL DRAM. The company developed HMSDK[4], software optimized for CMM-DDR5 and integrated it on Linux, the world's largest open-source operating system, in September, improving the performance of CXL applied systems. 4 Heterogeneous Memory S/W Development Kit (HMSDK): SK hynix's unique development kit for heterogeneous memory software. It improves performance by expanding bandwidth through efficient crossbar array and rearranging data with appropriate memory device in accordance with data use frequency. "We are developing various solution products to fulfill Optimal Innovation[5] in order to overcome the limitation of high cost and scalability of the existing system," said Uksong Kang, Head of Next Gen PP&E. "We will provide optimized value to customers by dramatically improving the scalability and the flexibility of memory while meeting customers' different needs." 5 Optimal Innovation: One of the product orientations unveiled by SK hynix at the SK AI Summit 2024, meaning product innovation optimized for AI era systems such as CXL and PIM About SK hynix Inc. SK hynix Inc., headquartered in Korea, is the world's top tier semiconductor supplier offering Dynamic Random Access Memory chips ("DRAM") and flash memory chips ("NAND flash") for a wide range of distinguished customers globally. The Company's shares are traded on the Korea Exchange, and the Global Depository shares are listed on the Luxembourg Stock Exchange. Further information about SK hynix is available at View original content: SOURCE SK hynix Inc. Sign in to access your portfolio
Korea Herald
23-04-2025
- Business
- Korea Herald
SK hynix Completes Customer Validation of CXL 2.0-based DDR5
SEOUL, South Korea, April 23, 2025 /PRNewswire/ -- SK hynix Inc. (or "the company", announced today that it has completed customer validation of 96GB CMM(CXL [1] Memory Module)-DDR5, a DRAM solution product based on CXL 2.0. The company said that it can process 36GB/s due to a 50% increase in capacity when the product is applied to the server systems and a 30% improvement in the bandwidth compared to previous DDR5 modules. This can contribute to drastically reducing the total cost of ownership [2] by customers in building and operating data centers. Following the 96GB product validation, the company is proceeding with the validation process for 128GB product with another customer. This product, equipped with 32Gb DDR5 DRAM using the 1bnm process, or the fifth-generation of the 10-nanometer technology, has high performance per watt [3]. The company plans to complete the ongoing 128GB validation as soon as possible to establish a CXL product portfolio to support customers in a timely manner. SK hynix is making efforts to expand the CXL ecosystem along with the development of CXL DRAM. The company developed HMSDK [4], software optimized for CMM-DDR5 and integrated it on Linux, the world's largest open-source operating system, in September, improving the performance of CXL applied systems. "We are developing various solution products to fulfill Optimal Innovation [5] in order to overcome the limitation of high cost and scalability of the existing system," said Uksong Kang, Head of Next Gen PP&E. "We will provide optimized value to customers by dramatically improving the scalability and the flexibility of memory while meeting customers' different needs." About SK hynix Inc. SK hynix Inc., headquartered in Korea, is the world's top tier semiconductor supplier offering Dynamic Random Access Memory chips ("DRAM") and flash memory chips ("NAND flash") for a wide range of distinguished customers globally. The Company's shares are traded on the Korea Exchange, and the Global Depository shares are listed on the Luxembourg Stock Exchange. Further information about SK hynix is available at
