Latest news with #MangoBoost
Yahoo
5 days ago
- Business
- Yahoo
MangoBoost Sets New Benchmark with Record-Breaking DPU-Based AI Training Storage Solution in MLPerf Storage v2.0
BELLEVUE, Wash., August 04, 2025--(BUSINESS WIRE)--MangoBoost, a provider of cutting-edge system solutions for maximizing compute efficiency and scalability, has delivered record-breaking performance in the latest MLPerf Storage v2.0 with its Mango StorageBoost™ solution. This achievement marks a major milestone for DPU-accelerated NVMe/TCP storage systems, showcasing industry-leading performance, efficiency, and scalability for AI training workloads. MangoBoost's submission, comprising the Mango StorageBoost™ NVMe/TCP Initiator (NTI) and Target (NTT), demonstrated line-rate throughput over a 400G Ethernet fabric, providing near-local SSD performance for distributed AI workloads such as 3D-UNet on both NVIDIA A100 and H100 GPUs. Best-in-Class Results Across the Board In MLPerf Storage v2.0's Fabric-attached Block Storage category, Mango StorageBoost™ delivered: 6.2x GPU scalability over alternative solutions for 3D-UNet on A100, and 1.25x to 7.5x on H100 1.57x higher throughput per 400G bandwidth on A100 and up to 2.05x on H100 Near-local SSD performance when compared to local Solidigm D7-PS1030 drives Superior performance-to-cost versus NVIDIA's BlueField-3 DPU, with significantly lower TCO Unlocking New Possibilities in AI Storage Architecture MangoBoost's submission deployed its NTI on the host and NTT on the storage server, connected via a 400G Ethernet switch. This configuration allowed the system to emulate demanding AI workloads across multiple GPUs with near-zero CPU overhead and maximum bandwidth utilization. Furthermore, MangoBoost's performance outpaced even BlueField-3 systems running both NVMe/TCP and NVMe/RDMA in equivalent test conditions. The Mango StorageBoost DPU architecture not only outperformed on throughput but also delivered significant reductions in cost of ownership as systems scale. The Technology Behind the Results Mango StorageBoost™ consists of three tightly integrated solutions: NVMe/TCP Initiator (NTI): Offloads the entire NVMe/TCP stack to hardware, delivering full-duplex line-rate performance with no CPU consumption. NVMe/TCP Target (NTT): Fully accelerates TCP/IP and NVMe-oF processing, enabling storage disaggregation over standard Ethernet with zero CPU involvement. GPU Storage Boost (GSB): Enables direct DMA transfers between GPU memory and local or remote storage, bypassing CPU and significantly improving I/O efficiency. Designed for Real-World Deployment Mango StorageBoost™ offers seamless integration with standard server platforms and GPUs. Its DPU-based architecture ensures maximum performance while reducing CPU utilization and total infrastructure cost. The solution is available today and can be deployed in existing data center environments without modification to hardware or software stacks. About MangoBoost MangoBoost is a provider of cutting-edge, full-stack system solutions for maximizing compute efficiency and scalability. At the heart of the solutions is the MangoBoost Data Processing Unit (DPU), which ensures full compatibility with general-purpose GPUs, accelerators, and storage devices, enabling cost-efficient, standardized AI infrastructure. Founded in 2022 on a decade of research, MangoBoost is rapidly expanding its operations in the U.S., Canada, and Korea. View source version on Contacts Minwoo SonStrategy & Operations Sign in to access your portfolio
Business Wire
5 days ago
- Business
- Business Wire
MangoBoost Sets New Benchmark with Record-Breaking DPU-Based AI Training Storage Solution in MLPerf Storage v2.0
BELLEVUE, Wash.--(BUSINESS WIRE)--MangoBoost, a provider of cutting-edge system solutions for maximizing compute efficiency and scalability, has delivered record-breaking performance in the latest MLPerf Storage v2.0 with its Mango StorageBoost™ solution. This achievement marks a major milestone for DPU-accelerated NVMe/TCP storage systems, showcasing industry-leading performance, efficiency, and scalability for AI training workloads. MangoBoost's submission, comprising the Mango StorageBoost™ NVMe/TCP Initiator (NTI) and Target (NTT), demonstrated line-rate throughput over a 400G Ethernet fabric, providing near-local SSD performance for distributed AI workloads. MangoBoost's submission, comprising the Mango StorageBoost™ NVMe/TCP Initiator (NTI) and Target (NTT), demonstrated line-rate throughput over a 400G Ethernet fabric, providing near-local SSD performance for distributed AI workloads such as 3D-UNet on both NVIDIA A100 and H100 GPUs. Best-in-Class Results Across the Board In MLPerf Storage v2.0's Fabric-attached Block Storage category, Mango StorageBoost™ delivered: 6.2x GPU scalability over alternative solutions for 3D-UNet on A100, and 1.25x to 7.5x on H100 1.57x higher throughput per 400G bandwidth on A100 and up to 2.05x on H100 Near-local SSD performance when compared to local Solidigm D7-PS1030 drives Superior performance-to-cost versus NVIDIA's BlueField-3 DPU, with significantly lower TCO Unlocking New Possibilities in AI Storage Architecture MangoBoost's submission deployed its NTI on the host and NTT on the storage server, connected via a 400G Ethernet switch. This configuration allowed the system to emulate demanding AI workloads across multiple GPUs with near-zero CPU overhead and maximum bandwidth utilization. Furthermore, MangoBoost's performance outpaced even BlueField-3 systems running both NVMe/TCP and NVMe/RDMA in equivalent test conditions. The Mango StorageBoost DPU architecture not only outperformed on throughput but also delivered significant reductions in cost of ownership as systems scale. The Technology Behind the Results Mango StorageBoost™ consists of three tightly integrated solutions: NVMe/TCP Initiator (NTI): Offloads the entire NVMe/TCP stack to hardware, delivering full-duplex line-rate performance with no CPU consumption. NVMe/TCP Target (NTT): Fully accelerates TCP/IP and NVMe-oF processing, enabling storage disaggregation over standard Ethernet with zero CPU involvement. GPU Storage Boost (GSB): Enables direct DMA transfers between GPU memory and local or remote storage, bypassing CPU and significantly improving I/O efficiency. Designed for Real-World Deployment Mango StorageBoost™ offers seamless integration with standard server platforms and GPUs. Its DPU-based architecture ensures maximum performance while reducing CPU utilization and total infrastructure cost. The solution is available today and can be deployed in existing data center environments without modification to hardware or software stacks. About MangoBoost MangoBoost is a provider of cutting-edge, full-stack system solutions for maximizing compute efficiency and scalability. At the heart of the solutions is the MangoBoost Data Processing Unit (DPU), which ensures full compatibility with general-purpose GPUs, accelerators, and storage devices, enabling cost-efficient, standardized AI infrastructure. Founded in 2022 on a decade of research, MangoBoost is rapidly expanding its operations in the U.S., Canada, and Korea.
Business Wire
04-06-2025
- Business
- Business Wire
MangoBoost Sets New Benchmark for Multi-Node LLM Training on AMD GPUs in MLPerf Training v5.0
BELLEVUE, Wash.--(BUSINESS WIRE)--MangoBoost, a provider of cutting-edge system solutions for maximizing compute efficiency and scalability, has validated the scalability and efficiency of large-scale AI training on AMD Instinct™ MI300X GPUs through its MLPerf Training v5.0 submission. Tailored for enterprise data centers prioritizing performance, flexibility, and cost-efficiency, this milestone demonstrates that state-of-the-art LLM training is now viable beyond traditional vendor-locked GPU platforms. This showcases how the AMD Instinct™ MI300X GPUs and ROCm™ software stack synergize with MangoBoost's LLMBoost™ AI Enterprise software and GPUBoost™ RoCEv2 NIC. Share Using 32 AMD Instinct™ MI300X GPUs across four nodes, MangoBoost fine-tuned the Llama2-70B-LoRA model in just 10.91 minutes, setting the fastest multi-node MLPerf benchmark on AMD GPUs to date. The system achieved near-linear scaling efficiency (95–100%), proving that MangoBoost's stack can support practical and scalable LLM training in production environments. Scalability and Efficiency for Enterprise Data Centers The result showcases more than just benchmark success—it underscores how enterprises can reliably scale LLM training across clusters without network bottlenecks or rigid infrastructure dependencies. Mango LLMBoost™: A full-featured MLOps software platform for large language models, supporting model parallelism, automatic tuning, batch scheduling, and advanced memory management. Mango GPUBoost™ RoCEv2 RDMA: Inter-GPU communication hardware optimized for low-latency, high-throughput node-to-node communication, sustaining line-rate performance across thousands of concurrent QPs. These technologies together deliver predictable and efficient multi-node training, ideal for organizations operating their own AI infrastructure or deploying on public cloud. Industry-First MLPerf Training on AMD MI300X GPUs This is the first-ever MLPerf Training submission on AMD GPUs spanning multiple nodes. MangoBoost's platform demonstrated robust performance with a 4-node, 32-GPU cluster and confirmed compatibility with additional model sizes and structures—including Llama2-7B and Llama3.1-8B—in internal benchmarks. These results validate the generalizability of MangoBoost's platform beyond benchmarks to diverse production-scale use cases. " I'm excited to see MangoBoost's first MLPerf Training results, pairing their LLMBoost AI Enterprise MLOps software with their RoCEv2-based GPUBoost DPU hardware to unlock the full power of AMD GPUs, demonstrated by their scalable performance from a single-node MI300X to 2- and 4-node MI300X results on Llama2-70B LoRA. Their results underscore that a well-optimized software stack is critical to fully harness the capabilities of modern AI accelerators." — David Kanter, Founder, Head of MLPerf, MLCommons Vendor-Neutral AI Infrastructure Enabled by AMD Collaboration The achievement was made possible through deep collaboration with AMD and seamless integration with the ROCm™ software ecosystem, enabling full utilization of MI300X's compute, memory bandwidth, and capacity. Enterprises are now empowered to choose infrastructure based on business needs—not vendor constraints. " We congratulate MangoBoost on their MLPerf 5.0 training results on AMD GPUs and are excited to continue our collaboration with them to unleash the full power of AMD GPUs. In this MLPerf Training submission, MangoBoost has achieved a key milestone in demonstrating training results on AMD GPUs across 4 nodes (32 GPUs). This showcases how the AMD Instinct™ MI300X GPUs and ROCm™ software stack synergize with MangoBoost's LLMBoost™ AI Enterprise software and GPUBoost™ RoCEv2 NIC." — Meena Arunachalam, Fellow, AI Performance Design Engineering, AMD "At MangoBoost, we've shown that software-hardware co-optimization enables scalable, efficient LLM training without vendor lock-in. Our MLPerf result is a key milestone proving our technology is ready for enterprise-scale AI training with superior efficiency and flexibility," said CEO Jangwoo Kim. MangoBoost continues to develop innovations in communication optimization, hybrid parallelism, topology-aware scheduling, and domain-specific acceleration to further scale performance in distributed AI workloads. About MangoBoost MangoBoost is a provider of cutting-edge, full-stack system solutions for maximizing compute efficiency and scalability. At the heart of the solutions is the MangoBoost Data Processing Unit (DPU), which ensures full compatibility with general-purpose GPUs, accelerators, and storage devices, enabling cost-efficient, standardized AI infrastructure. Founded in 2022 on a decade of research, MangoBoost is rapidly expanding its operations in the U.S., Canada, and Korea.
Yahoo
30-05-2025
- Business
- Yahoo
MangoBoost and AIC Sign MoU to Explore Collaboration on DPU-Based Server and Storage Solutions
BELLEVUE, Wash., May 30, 2025--(BUSINESS WIRE)--MangoBoost, a provider of cutting-edge system solutions for maximizing compute efficiency and scalability, and AIC Inc., a global leader in enterprise server and storage solutions, announced the signing of a Memorandum of Understanding (MoU) to explore potential collaboration in developing and promoting advanced computing technologies. The MoU sets the framework for both companies to engage in discussions focused on integrating MangoBoost's cutting-edge Data Processing Unit (DPU) technologies with AIC's server and storage expertise and market access. The collaboration aims to unlock new possibilities in next-generation data center solutions through joint exploration and innovation. "This MoU marks a meaningful step toward our mission to deliver more intelligent, efficient, and scalable computing platforms to the market," said Jangwoo Kim, CEO of MangoBoost. "We look forward to working closely with AIC to explore new opportunities and innovative applications for our DPU technologies in the enterprise space." David Huang, VP of Sales and Marketing at AIC stated, "Partnering with MangoBoost allows us to push the boundaries of what's possible in server and storage innovation. We believe our combined strengths can pave the way for high-performance solutions that meet evolving market demands." About MangoBoost MangoBoost is a provider of cutting-edge, full-stack system solutions for maximizing compute efficiency and scalability. At the heart of the solutions is the MangoBoost Data Processing Unit (DPU), which ensures full compatibility with general-purpose GPUs, accelerators, and storage devices, enabling cost-efficient, standardized AI infrastructure. Founded in 2022 on a decade of research, MangoBoost is rapidly expanding its operations in the U.S., Canada, and Korea. About AIC AIC Inc. is a global leader in the design and manufacturing of high-performance server and storage solutions. With nearly 30 years of expertise, AIC is renowned for its high-density storage servers, storage server barebones, and AI storage solutions. The company operates globally, with offices in the United States, Asia, and Europe, and is committed to driving innovation across various industries. View source version on Contacts Minwoo SonStrategy & Operations
Business Wire
30-05-2025
- Business
- Business Wire
MangoBoost and AIC Sign MoU to Explore Collaboration on DPU-Based Server and Storage Solutions
BELLEVUE, Wash.--(BUSINESS WIRE)--MangoBoost, a provider of cutting-edge system solutions for maximizing compute efficiency and scalability, and AIC Inc., a global leader in enterprise server and storage solutions, announced the signing of a Memorandum of Understanding (MoU) to explore potential collaboration in developing and promoting advanced computing technologies. Partnering with MangoBoost allows us to push the boundaries of what's possible in server and storage innovation. We believe our combined strengths can pave the way for high-performance solutions that meet evolving market demands. Share The MoU sets the framework for both companies to engage in discussions focused on integrating MangoBoost's cutting-edge Data Processing Unit (DPU) technologies with AIC's server and storage expertise and market access. The collaboration aims to unlock new possibilities in next-generation data center solutions through joint exploration and innovation. 'This MoU marks a meaningful step toward our mission to deliver more intelligent, efficient, and scalable computing platforms to the market,' said Jangwoo Kim, CEO of MangoBoost. 'We look forward to working closely with AIC to explore new opportunities and innovative applications for our DPU technologies in the enterprise space.' David Huang, VP of Sales and Marketing at AIC stated, 'Partnering with MangoBoost allows us to push the boundaries of what's possible in server and storage innovation. We believe our combined strengths can pave the way for high-performance solutions that meet evolving market demands.' About MangoBoost MangoBoost is a provider of cutting-edge, full-stack system solutions for maximizing compute efficiency and scalability. At the heart of the solutions is the MangoBoost Data Processing Unit (DPU), which ensures full compatibility with general-purpose GPUs, accelerators, and storage devices, enabling cost-efficient, standardized AI infrastructure. Founded in 2022 on a decade of research, MangoBoost is rapidly expanding its operations in the U.S., Canada, and Korea. About AIC AIC Inc. is a global leader in the design and manufacturing of high-performance server and storage solutions. With nearly 30 years of expertise, AIC is renowned for its high-density storage servers, storage server barebones, and AI storage solutions. The company operates globally, with offices in the United States, Asia, and Europe, and is committed to driving innovation across various industries.
