Latest news with #RodrigoLiang
Channel Post MEA
3 days ago
- Business
- Channel Post MEA
SambaNova Launches Its AI Platform in AWS Marketplace
SambaNova has announced that its AI platform is now available in AWS Marketplace, a digital catalog that helps you find, buy, deploy, and manage software, data products, and professional services from thousands of vendors. This availability allows organizations to seamlessly purchase and deploy SambaNova's fast inference services alongside their existing infrastructure in AWS. This new availability marks a significant milestone in SambaNova's mission to make private, production-grade AI more accessible to enterprises, removing traditional barriers like vendor onboarding and procurement delays. By leveraging existing AWS relationships, organizations can now begin using SambaNova's advanced inference solutions with a few simple clicks — accelerating time to value while maintaining trusted billing and infrastructure practices. 'Enterprises face significant pressure to move rapidly from AI experimentation to full-scale production, yet procurement and integration challenges often stand in the way,' said Rodrigo Liang, CEO and co-founder of SambaNova. 'By offering SambaNova's platform in AWS Marketplace, we remove those obstacles, enabling organizations to access our industry leading inference solutions instantly, using the procurement processes and a cloud environment they already trust.' Accelerating Access to High-Performance Inference SambaNova's listing in AWS Marketplace gives customers the ability to: Procure through existing AWS billing arrangements — no new vendor setup required. Leverage SambaNova's inference performance — fast and efficiently, running open source models like Llama 4 Maverick and DeepSeek R1 671B. Engage securely via private connectivity — possible through AWS PrivateLink for low-latency, secure integration between AWS workloads and SambaNova Cloud. 'With the SambaNova platform running in AWS Marketplace, organizations gain access to secure, high-speed inference from the largest open-source models. Solutions like this will help businesses move from experimentation to full production with AI,' said Michele Rosen, Research Manager, Open GenAI, LLMs, and the Evolving Open Source, IDC. This tight integration enables customers to deploy high-performance, multi-tenant inference solutions without the need to purchase or manage custom hardware — expanding SambaNova's reach into enterprise environments where time-to-value and IT friction have historically limited adoption. Making High-Performance Inference More Accessible With this listing in AWS Marketplace, SambaNova is meeting enterprise customers where they already are — within their trusted cloud environments and procurement frameworks. By removing onboarding friction and offering seamless integration, SambaNova makes it easier than ever for organizations to evaluate, deploy, and scale high-performance inference solutions. 'This makes it dramatically easier for customers to start using SambaNova — no new contracts, no long onboarding — just click and go,' said Liang. 0 0
Zawya
3 days ago
- Business
- Zawya
SambaNova launches its AI Platform in AWS Marketplace
Dubai, United Arab Emirates — SambaNova, the AI inference company delivering fast, efficient AI chips and high-performance models, today announced that its AI platform is now available in AWS Marketplace, a digital catalog that helps you find, buy, deploy, and manage software, data products, and professional services from thousands of vendors. This availability allows organizations to seamlessly purchase and deploy SambaNova's fast inference services alongside their existing infrastructure in AWS. This new availability marks a significant milestone in SambaNova's mission to make private, production-grade AI more accessible to enterprises, removing traditional barriers like vendor onboarding and procurement delays. By leveraging existing AWS relationships, organizations can now begin using SambaNova's advanced inference solutions with a few simple clicks —accelerating time to value while maintaining trusted billing and infrastructure practices. 'Enterprises face significant pressure to move rapidly from Ai experimentation to full-scale production, yet procurement and integration challenges often stand in the way,' said Rodrigo Liang, CEO and co-founder of SambaNova. 'By offering SambaNova's platform in AWS Marketplace, we remove those obstacles, enabling organizations to access our industry leading inference solutions instantly, using the procurement processes and cloud environment they already trust. Accelerating Access to High-Performance Inference SambaNova's listing in AWS Marketplace gives customers the ability to: Procure through existing AWS billing arrangements — no new vendor setup required. Leverage SambaNova's inference performance — fast and efficiently, running open source models like Llama 4 Maverick and DeepSeek R1 671B. Engage securely via private connectivity — possible through AWS PrivateLink for low-latency, secure integration between AWS workloads and SambaNova Cloud. 'With the SambaNova platform running in AWS Marketplace, organizations gain access to secure, high-speed inference from the largest open-source models. Solutions like this will help businesses move from experimentation to full production with AI,' said Michele Rosen Research Manager, Open GenAI, LLMs, and the Evolving Open Source, IDC. This tight integration enables customers to deploy high-performance, multi-tenant inference solutions without the need to purchase or manage custom hardware—expanding SambaNova's reach into enterprise environments where time-to-value and IT friction have historically limited adoption. Making High-Performance Inference More Accessible With this listing in AWS Marketplace, SambaNova is meeting enterprise customers where they already are—within their trusted cloud environments and procurement frameworks. By removing onboarding friction and offering seamless integration, SambaNova makes it easier than ever for organizations to evaluate, deploy, and scale high-performance inference solutions. 'This makes it dramatically easier for customers to start using SambaNova—no new contracts, no long onboarding — just click and go,' said Liang. Availability SambaNova's inference platform is available immediately in AWS Marketplace. Enterprise customers can visit the SambaNova listing in AWS Marketplace to get started. About SambaNova Customers turn to SambaNova to quickly deploy state-of-the-art generative AI capabilities within the enterprise. Our purpose-built enterprise-scale AI platform is the technology backbone for the next generation of AI computing. Headquartered in Palo Alto, California, SambaNova Systems was founded in 2017 by industry luminaries, and hardware and software design experts from Sun/Oracle and Stanford University. Investors include SoftBank Vision Fund 2, funds and accounts managed by BlackRock, Intel Capital, GV, Walden International, Temasek, GIC, Redline Capital, Atlantic Bridge Ventures, Celesta, and several others.
South China Morning Post
20-03-2025
- Business
- South China Morning Post
Open-source AI models may be safer for military use, experts say
As militaries around the world race to make their forces more efficient with artificial intelligence – an area of fierce rivalry between Beijing and Washington – AI experts say open-source models could be safer and more sustainable for defence use. Advertisement Panellists at the Singapore Defence Technology Summit on Wednesday argued against the common assumption that closed-source AI models were safer because they could prevent adversaries from knowing their true capabilities. 'When you talk about bad actors, I think it is an incorrect assumption – just because the model is closed-source – that those bad actors don't have access to it,' said Rodrigo Liang, co-founder and CEO of SambaNova Systems, a California-based AI solutions company. 'I do think that it is important for us to distinguish the fact about commercial licensing of models versus the access of the model,' he said, adding that a different set of private data used to train a model would also make it unique and sovereign. Pascale Fung, chair professor of the Hong Kong University of Science and Technology's electronic and computer engineering department, said that 'we need open source – especially for different kinds of national security and similar applications … [as] they are inspectable'. Advertisement She said that when source codes of large language models were shared, 'we can engage the entire AI community, including academic research, to make this model safer and more robust'.
Yahoo
25-02-2025
- Business
- Yahoo
Should Nvidia be worried? Plucky inference rival replaces 320 Nvidia GPUs with 16 reconfigurable dataflow units
When you buy through links on our articles, Future and its syndication partners may earn a commission. SambaNova runs DeepSeek-R1 at 198 tokens/sec using 16 custom chips The SN40L RDU chip is reportedly 3X faster, 5X more efficient than GPUs 5X speed boost is promised soon, with 100X capacity by year-end on cloud Chinese AI upstart DeepSeek has very quickly made a name for itself in 2025, with its R1 large-scale open source language model, built for advanced reasoning tasks, showing performance on par with the industry's top models, while being more cost-efficient. SambaNova Systems, an AI startup founded in 2017 by experts from Sun/Oracle and Stanford University, has now announced what it claims is the world's fastest deployment of the DeepSeek-R1 671B LLM to date. The company says it has achieved 198 tokens per second, per user, using just 16 custom-built chips, replacing the 40 racks of 320 Nvidia GPUs that would typically be required. 'Powered by the SN40L RDU chip, SambaNova is the fastest platform running DeepSeek,' said Rodrigo Liang, CEO and co-founder of SambaNova. 'This will increase to 5X faster than the latest GPU speed on a single rack - and by year-end, we will offer 100X capacity for DeepSeek-R1.' While Nvidia's GPUs have traditionally powered large AI workloads, SambaNova argues that its reconfigurable dataflow architecture offers a more efficient solution. The company claims its hardware delivers three times the speed and five times the efficiency of leading GPUs while maintaining the full reasoning power of DeepSeek-R1. 'DeepSeek-R1 is one of the most advanced frontier AI models available, but its full potential has been limited by the inefficiency of GPUs,' said Liang. 'That changes today. We're bringing the next major breakthrough - collapsing inference costs and reducing hardware requirements from 40 racks to just one - to offer DeepSeek-R1 at the fastest speeds, efficiently.' George Cameron, co-founder of AI evaluating firm Artificial Analysis, said his company had 'independently benchmarked SambaNova's cloud deployment of the full 671 billion parameter DeepSeek-R1 Mixture of Experts model at over 195 output tokens/s, the fastest output speed we have ever measured for DeepSeek-R1. High output speeds are particularly important for reasoning models, as these models use reasoning output tokens to improve the quality of their responses. SambaNova's high output speeds will support the use of reasoning models in latency-sensitive use cases.' DeepSeek-R1 671B is now available on SambaNova Cloud, with API access offered to select users. The company is scaling capacity rapidly, and says it hopes to reach 20,000 tokens per second of total rack throughput "in the near future". Nvidia and AMD trade blows over who is faster on DeepSeek AI benchmarks A look at the Nvidia GPU that powers DeepSeek's AI global ambition AI phenomenon DeepSeek is officially growing faster than ChatGPT
Argaam
20-02-2025
- Business
- Argaam
SambaNova to invest $140M in Saudi Arabia: CEO
Rodrigo Liang, CEO and Co-Founder of SambaNova Systems, said the company plans to invest up to $140 million (SAR 525 million) in Saudi Arabia, with the aim of developing the domestic technology sector, strengthening infrastructure, and employing competencies. In addition, the company is working with the Saudi National Semiconductor Center to enhance design capabilities within the Kingdom, which aims to support GDP growth, he added. In an interview with Argaam on the sidelines of the LEAP 2025 conference, Liang indicated that the company has a partnership with STC AI to launch the LLM 405 B model as a service, as well as cooperation with the Ministry of Communications and Information Technology to share its expertise in the field of semiconductors. 'The Ministry of Communications and Information Technology continues to be a partner for SambaNova in exploring cooperation in telecommunications and AI connectivity on several levels. This cooperation was expanded to include more fields and capabilities, while promoting knowledge exchange between our institutions,' said the CEO. He noted that the company is working on sharing knowledge and even semiconductor design, with the possibility of transferring design capabilities to the Kingdom and starting to share such knowledge and expertise with specialists within the Kingdom. SambaNova is a computing platform specialized in artificial intelligence, providing its services through technology and computing infrastructure, as well as developing its own chips, according to the top executive. Furthermore, the company is collaborating with the National Semiconductor Center to transfer some chip designs and design capabilities to the Kingdom, as part of its partnership to strengthen technical cooperation, he added.
