logo
SambaNova Launches AI Inference Solution For Datacenters

SambaNova Launches AI Inference Solution For Datacenters

SambaNova has announced SambaManaged, the industry's first inference-optimized datacenter product offering, deployable in just 90 days — dramatically faster than the typical 18 to 24 months. Designed for rapid deployment, this modular product enables existing datacenters to immediately stand up AI inference services with minimal infrastructure modification.
As global AI inference demands soar, traditional datacenters grapple with lengthy deployment timelines of 18–24 months, extensive power requirements, and costly facility upgrades. SambaManaged addresses these critical barriers, enabling organizations to quickly launch profitable AI inference services leveraging existing power and network infrastructure.
'Data centers are struggling with power, cooling, and expertise challenges as AI demand grows,' said Abhi Ingle, Chief Product and Strategy Officer at SambaNova. 'SambaManaged delivers high-performance AI with just 10kW of air-cooled power and minimal infrastructure changes—making rapid deployment simple for any data center.'
Key Advantages for Data Centers and Cloud Providers: Unmatched Efficiency: Sets a new industry benchmark for performance per watt, maximizing return on investment and reducing total cost of ownership.
Sets a new industry benchmark for performance per watt, maximizing return on investment and reducing total cost of ownership. Rapid Deployment: Launch a fully managed AI inference service in as little as 90 days, minimizing integration challenges and accelerating time to value.
Launch a fully managed AI inference service in as little as 90 days, minimizing integration challenges and accelerating time to value. Open Model Flexibility: Achieve lightning-fast inference with leading open-source models, ensuring no vendor lock-in and future-proof operations.
Achieve lightning-fast inference with leading open-source models, ensuring no vendor lock-in and future-proof operations. Modular, Scalable Design: Scale from small to large deployments with ease, including the capability to build a 1 MW 'Token Factory' (100 racks or 1,600 chips) or larger that scales with evolving business needs.
Scale from small to large deployments with ease, including the capability to build a 1 MW 'Token Factory' (100 racks or 1,600 chips) or larger that scales with evolving business needs. Managed or Self-Service Options: Choose a fully managed service or take over operations as internal expertise grows, supported by a customizable developer/enterprise UI and flexible pricing models.
SambaManaged is already being adopted by a major US public company with a large power footprint. The platform will deliver the highest throughput on DeepSeek and similar models, empowering them to maximize inference revenue while optimizing Power Usage Effectiveness (PUE).
'While others talk about the future of AI, we're delivering it — today,' said Rodrigo Liang, CEO and co-founder of SambaNova. 'SambaManaged is a game-changer for organizations that want to accelerate their AI initiatives without compromising on speed, scale, or efficiency. Anywhere you have power and networking, we can bring your AI infrastructure online in record time.'
Orange background

Try Our AI Features

Explore what Daily8 AI can do for you:

Comments

No comments yet...

Related Articles

China's Tencent posts strong Q2 revenue growth as AI race heats up
China's Tencent posts strong Q2 revenue growth as AI race heats up

Al Etihad

time3 days ago

  • Al Etihad

China's Tencent posts strong Q2 revenue growth as AI race heats up

13 Aug 2025 14:22 BEIJING (AFP)Chinese internet giant Tencent on Wednesday reported a third consecutive quarter of double-digit revenue growth, beating forecasts, as it began rolling out AI services in its games and messaging Tencent is the operator of China's multifunctional app WeChat and a major player in the global gaming firm also has a presence in cloud computing, entertainment and AI, with its Yuanbao chatbot one of the most popular AI services in revenue in the three months to June 30 was 184.5 billion yuan ($25.7 billion), a filing to the Hong Kong Stock Exchange showed, up 15 percent compared to the same period last figure exceeded a Bloomberg estimate of an 11 percent for the first half of 2025 was up 14 percent a breakdown of sales, Tencent said that revenue from domestic games increased 17 percent year-on-year in the second quarter, while international games saw a 35 percent firm's net profit for the latest quarter also jumped 17 percent year-on-year to reach 55.6 billion yuan."We delivered double-digit revenue and... operating profit growth on a year-on-year basis, as we invested in, and also benefited from, utilising AI," the firm said in a added that it had "enriched AI features" in its WeChat app, and "deployed AI tools" in fellow domestic tech giants Alibaba and ByteDance, Tencent has been funnelling resources into the competitive field of AI since the release of Chinese company DeepSeek's chatbot in January. The little-known DeepSeek caused a global stir because it appeared to have developed the chatbot at a fraction of the price of Western industry leaders.

OpenAI gives ChatGPT to US government at essentially no cost
OpenAI gives ChatGPT to US government at essentially no cost

Khaleej Times

time07-08-2025

  • Khaleej Times

OpenAI gives ChatGPT to US government at essentially no cost

OpenAI on Wednesday said it was letting the US government use a version of ChatGPT designed for businesses for a year, charging just $1 for the service. Federal workers in the executive branch will have access to ChatGPT Enterprise in a partnership with the US General Services Administration, according to the pioneering San Francisco-based artificial intelligence (AI) company. "By giving government employees access to powerful, secure AI tools, we can help them solve problems for more people, faster," OpenAI said in a blog post announcing the alliance. ChatGPT Enterprise does not use business data to train or improve OpenAI models and the same rule will apply to federal use, according to the company. Earlier this year, OpenAI announced an initiative focused on bringing advanced AI tools to US government workers. The news came with word that the US Department of Defense awarded OpenAI a $200 million contract to put generative AI to work for the military. OpenAI planned to show how cutting-edge AI can improve administrative operations, such as how service members get health care, and also has cyber defense applications, the startup said in a post. OpenAI has also launched an initiative to help countries build their own AI infrastructure, with the US government a partner in projects. The tech firm's move to put its technology at the heart of national AI platforms around the world comes as it faces competition from Chinese rival DeepSeek. DeepSeek's success in delivering powerful AI models at a lower cost has rattled Silicon Valley and multiplied calls for US big tech to protect its dominance of the emerging technology. The OpenAI for Countries initiative was launched in June under the auspices of a drive — dubbed "Stargate" — announced by US President Donald Trump to invest up to $500 billion in AI infrastructure in the United States. OpenAI, in "coordination" with the US government, will help countries build data centers and provide customized versions of ChatGPT, according to the tech firm. Projects are to involve "local as well as OpenAI capital."

China's rebound has a distinct 'cool factor': Taosha Wang
China's rebound has a distinct 'cool factor': Taosha Wang

Zawya

time28-07-2025

  • Zawya

China's rebound has a distinct 'cool factor': Taosha Wang

(The views expressed here are those of the author, a portfolio manager at Fidelity International.) HONG KONG - The first seven months of 2025 have delivered a whirlwind of news on Chinese technology and business, oscillating between anxiety and euphoria, but what has cut through the noise has been the emergence of a "cool factor". In January, TikTok suspended its U.S. services for one day, when the outgoing administration shut down the app due to its ties to China, before the decision was swiftly reversed by the incoming Trump administration. Days later, Chinese artificial intelligence company DeepSeek shocked the world with its cost-effective, high-performance R-1 reasoning model, triggering an intense debate about who will lead the 'AI race'. And then in early May, U.S.-China tensions reached unprecedented heights, as tariffs jumped above 100%, effectively halting bilateral trade, before de-escalation. By summer, however, China was once again exporting critical rare earth to the U.S. and Nvidia had re-started the sales of its AI chips to China, suggesting a burgeoning trade detente between the world's two largest economies. Amid this volatility, China's capital markets have responded favorably. The MSCI China Index has surged around 25% year-to-date through July 25, outpacing the MSCI All-Country World index's 12% gain and the S&P 500 index's 9% rise. Notably, this strong performance has been driven not just by typical business-cycle fluctuations, but also an appeal rooted in innovation, collaboration and youth culture, suggesting China's next growth cycle could look very different from those in the past. IMITATOR TO INNOVATOR China's evolution from low-cost imitator to global innovator is epitomized by its electric vehicle dominance. Chinese EV leader BYD, which began as a battery maker and currently has a market cap of $150 billion, was once dismissed by Elon Musk for its unattractive products and weak technology. However, a decade of development, supported by state-backed infrastructure including China's 10-million-strong charging network, has propelled BYD past Musk's Tesla in global sales. In 2024, one of every five EVs sold globally was from BYD, whose market share is now double that of Tesla's. Moreover, BYD's vehicles, like many other Chinese EVs, now boast the type of sleek designs and novel amenities associated with its U.S. rival. Beyond product innovations, some Chinese companies are also experimenting with new business models and sales strategies. For example, livestream social shopping, which was pioneered by Alibaba, has been adopted by Amazon, Instagram, YouTube and even Walmart (in collaboration with TikTok) in the U.S. to target Gen-Z and millennial shoppers. New players like Chinese toymaker Pop Mart are also experimenting with fresh business models. Its designer toys are sold in mystery boxes, where sealed packages conceal randomized plush "Labubu" figures, which adorn the luxury handbags of many influencers. This strategy seeks to tap into the thrill of uncertainty, creating viral demand beyond the Chinese domestic market. And this appears to be working. Pop Mart's sales from outside mainland China contributed to nearly 40% of its total revenue in 2024, and its profit in the first half of 2025 is expected to soar by at least 350% year-over-year. OPEN-SOURCE ARCHITECT Historically, tensions surrounding intellectual property have dogged China's global trade relationships. Today, however, its embrace of open-source collaboration appears to signal a profound shift. China is now the fastest-growing and second-largest contributor of open-source code on GitHub, the world's leading platform for software collaboration. Moreover, Chinese tech giants like Huawei and Tencent rank among the top corporate sponsors of Apache and Linux foundations, major nonprofit organizations that shape foundational technologies like artificial intelligence and cloud computing. DeepSeek's R-1 model exemplifies this strategy. Released under the permissive MIT license, it grants large-scale commercial reuse rights (unlike Google's Apache 2.0 or Meta's Llama licenses) and has fueled countless derivative models globally. Such openness has the potential to build developer loyalty, influence AI standards, and circumvent geopolitical friction. This shift has been underpinned by a focus on developing scientific prowess. In 2024, China led the world in high-quality research publications, according to Nature, holding the top spot for the second consecutive year. Its advantage in publications extends even to semiconductor design and fabrication, a field where U.S. technological superiority is often assumed, with Chinese scholars authoring over half of the most-cited papers in this field in 2024. STRUCTURAL HEADWINDS However, the outlook for the country's businesses is not all rosy. Industrial profits are still shrinking, falling 1.1% year-to-date, despite various government stimulus measures, including a recently expanded consumer subsidy scheme and a central bank-backed initiative for state-owned enterprises to buy unsold homes. And price wars in sectors such as EVs and food delivery have gotten so brutal that the authorities have stepped in to mediate 'irrational' competition. Another structural issue is the country's stubbornly high youth unemployment rate (16-24-year olds excluding students), which remained at 14.5% - well above the 5% rate for the labor force as a whole. If China's future growth is to be driven more by a 'cool' factor, then the career prospects of its youth need to be strong enough to support their distinct consumption preferences as well as their entrepreneurial endeavors. Regardless of these challenges, innovation and open collaboration still have the potential to reshape China's global identity. Importantly, economic growth driven by these factors may be more evenly distributed and idiosyncratic, and therefore less cyclical, compared to China's old economic engines of real estate, infrastructure and production capacity investments. No longer just the world's factory, China is becoming a source of culturally resonant innovation. And as America's track record over the past decades suggests, no one should underestimate the value of cool. (The views expressed here are those of Taosha Wang, a portfolio manager and creator of the 'Thematically Thinking' newsletter at Fidelity International). Enjoying this column? Check out Reuters Open Interest (ROI), your essential new source for global financial commentary. ROI delivers thought-provoking, data-driven analysis of everything from swap rates to soybeans. Markets are moving faster than ever. ROI, can help you keep up. Follow ROI on LinkedIn, and X. (Writing by Taosha Wang; Editing by Anna Szymanski and Lincoln Feast.)

DOWNLOAD THE APP

Get Started Now: Download the App

Ready to dive into a world of global content with local flavor? Download Daily8 app today from your preferred app store and start exploring.
app-storeplay-store