Cerebras Beats NVIDIA Blackwell in Llama 4 Maverick Inference
Cerebras Breaks the 2,500 Tokens Per Second Barrier with Llama 4 Maverick 400B
SUNNYVALE, Calif., May 28, 2025--(BUSINESS WIRE)--Last week, Nvidia announced that 8 Blackwell GPUs in a DGX B200 could demonstrate 1,000 tokens per second (TPS) per user on Meta's Llama 4 Maverick. Today, the same independent benchmark firm Artificial Analysis measured Cerebras at more than 2,500 TPS/user, more than doubling the performance of Nvidia's flagship solution.
"Cerebras has beaten the Llama 4 Maverick inference speed record set by NVIDIA last week," said Micah Hill-Smith, Co-Founder and CEO of Artificial Analysis. "Artificial Analysis has benchmarked Cerebras' Llama 4 Maverick endpoint at 2,522 tokens per second, compared to NVIDIA Blackwell's 1,038 tokens per second for the same model. We've tested dozens of vendors, and Cerebras is the only inference solution that outperforms Blackwell for Meta's flagship model."
With today's results, Cerebras has set a world record for LLM inference speed on the 400B parameter Llama 4 Maverick model, the largest and most powerful in the Llama 4 family. Artificial Analysis tested multiple other vendors, and the results were as follows: SambaNova 794 t/s, Amazon 290 t/s, Groq 549 t/s, Google 125 t/s, and Microsoft Azure 54 t/s.
Andrew Feldman, CEO of Cerebras Systems, said, "The most important AI applications being deployed in enterprise today—agents, code generation, and complex reasoning—are bottlenecked by inference latency. These use cases often involve multi-step chains of thought or large-scale retrieval and planning, with generation speeds as low as 100 tokens per second on GPUs, causing wait times of minutes and making production deployment impractical. Cerebras has led the charge in redefining inference performance across models like Llama, DeepSeek, and Qwen, regularly delivering over 2,500 TPS/user."
With its world record performance, Cerebras is the optimal solution for Llama 4 in any deployment scenario. Not only is Cerebras Inference the first and only API to break the 2,500 TPS/user milestone on this model, but unlike the Nvidia Blackwell used in the Artificial Analysis benchmark, the Cerebras hardware and API are available now. Nvidia used custom software optimizations that are not available to most users. Interestingly, none of the Nvidia's inference providers offer a service at Nvidia's published performance. This suggests that in order to achieve 1000 TPS/user, Nvidia was forced to reduce throughput by going to batch size 1 or 2, leaving the GPUs at less than 1% utilization. Cerebras, on the other hand, achieved this record-breaking performance without any special kernel optimizations, and it will be available to everyone through Meta's API service coming soon.
For cutting-edge AI applications such as reasoning, voice, and agentic workflows, speed is paramount. These AI applications gain intelligence by processing more tokens during the inference process. This can also make them slow and force customers to wait. And when customers are forced to wait, they leave and go to competitors who provide answers faster—a finding Google showed with search more than a decade ago.
With record-breaking performance, Cerebras hardware and resulting API service is the best choice for developers and enterprise AI users around the world.
For more information, please visit https://www.cerebras.ai/.
View source version on businesswire.com: https://www.businesswire.com/news/home/20250528123694/en/
Contacts
pr@zmcommunications.com
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
35 minutes ago
- Yahoo
Nvidia, Other Chip Stocks Slide Amid Worries About US-China Trade Tensions
Nvidia (NVDA) and other semiconductor stocks slid Friday amid worries about worsening U.S.-China trade tensions. Shares of Nvidia were down nearly 4% in recent trading. Advanced Micro Devices (AMD), Broadcom (AVGO), Micron Technology (MU), and Applied Materials (AMAT) also lost ground, with the PHLX Semiconductor Index (SOX) dropping about 3%. Some of Nvidia's partners, including server maker Super Micro Computer (SMCI), saw their stocks fall as well. (Read Investopedia's full coverage of today's trading here.) President Trump on Friday said China has "totally violated its agreement with us," dampening hopes the countries would soon come to a longer-term agreement after reaching a temporary truce earlier this month. Separately, Bloomberg reported Friday that Trump plans to expand U.S. companies' licensing requirements to make deals with Chinese companies that have ties to sanctioned firms. The development comes after the Trump administration moved earlier this month to rescind the Biden-era AI diffusion rule that would have further curbed sales of American AI hardware to a broader group of countries, but warned it's looking to replace the rule with new restrictions. Analysts at Citi and Deutsche Bank warned at the time that they could turn out to be stricter than Biden's. During Nvidia's earnings call on Wednesday, CEO Jensen Huang said it's "terrific" that Trump rescinded the Biden-era rule, but criticized the administration's other moves to limit its sales to China, saying that "shielding Chinese chipmakers from U.S. competition only strengthens them abroad and weakens America's position." The AI chipmaker took a $4.5 billion charge in its fiscal first quarter associated with new export curbs on the company's H20 chips to China, and said it expects to take an $8 billion hit in the current quarter due to lost revenue. Read the original article on Investopedia
Yahoo
an hour ago
- Yahoo
Super Micro's Stock Slumps Even as NVIDIA Tie-Up Heats Up
May 30 - Super Micro Computer Inc. (NASDAQ:SMCI) shares slid nearly 3% to $39.7 on Friday afternoon, falling 57% back from a 52-week high of $101.40 amid broader tech sector pressure. Warning! GuruFocus has detected 5 Warning Signs with SMCI. Despite trade-tariff uncertainties, SMCI finds support in its link to NVIDIA (NASDAQ:NVDA) and the rising demand for Blackwell chips. As NVDA's new AI solutions gain traction, data centers require advanced servers and cooling, areas where SMCI specializes. SMCI recently shook off past accounting concerns by installing a new auditing team, helping to restore investor confidence. That groundwork set the stage for a major win: the Saudi government tapped SMCI to build AI-focused data centers, signaling faith in its Foundry servers. NVDA's strong quarterly results have left a gap in data-center maintenance, precisely the niche SMCI can fill. With NVDA's Blackwell chips fueling orders, SMCI may see further upside as AI infrastructure spending climbs. For bulls, SMCI's role in supporting NVDA's Blackwell ecosystem offers a clear catalyst, even as tariffs and macro headwinds persist. Based on the one year price targets offered by 15 analysts, the average target price for Super Micro Computer Inc is $40.00 with a high estimate of $70.00 and a low estimate of $15.00. The average target implies a upside of +0.68% from the current price of $39.73. Based on GuruFocus estimates, the estimated GF Value for Super Micro Computer Inc in one year is $67.82, suggesting a upside of +70.72% from the current price of $39.73. This article first appeared on GuruFocus. Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
CNBC
an hour ago
- CNBC
May jobs report, tariffs will rise to top of mind next week after comeback rally
Whether the stock market can sustain its big comeback next week will hinge in large part on the employment picture, with investors counting on resilient consumer spending to prop up an economy that's undergoing a massive upheaval from tariffs. Stocks have staged a rapid turnaround this month, with the S & P 500 rallying nearly 6% and the tech-heavy Nasdaq Composite climbing almost 9%. Tech stocks stocks tied to artificial intelligence especially benefited. Nvidia 's strong results this week added to renewed confidence in the sector, helping to drive up the chipmaker more than 23% in May alone . Still, there is concern that investors may be starting to get too complacent at a time when the S & P 500 looks priced for perfection. The broad market index is now trading at a forward price-to-earnings multiple of roughly 21, about where it was at the start of the year when investors worried that lofty valuations meant a pullback was in the offing. "While our own view is that recession risks have moderated since April, equities could still be getting complacent here considering EPS estimates are still getting marked down, the May rally likely got an assist from systematic/technical tailwinds, rates remain high, jobless claims are rising, and the tariff picture remains uncertain despite some recent risk-on headlines," Venu Krishna, head of U.S. equity-linked strategies at Barclays, said in a note. Ramped up tensions What's more, trade tensions are also ramping up again. The stock rally this month was driven in large part by the preliminary trade deal between the U.S. and China just two weeks ago, which reassured investors the worst of the tariff conflict may be in the past. On Friday, however, President Donald Trump revived fears of an extended trade war, saying China had reneged on their agreement. Nevertheless, Krishna said the stock market has looked past macroeconomic concerns before. In 2023, U.S. equities continued their upward ascent despite surging interest rates that led to a chorus of recession calls sounding from all corners of Wall Street. It was a demonstration of the stock market's "willingness to continue looking through macro distortions in the post-Covid era," Krishna said. Much of the reason investors appear willing to look past the macroeconomic challenges lies in the strength of the consumer, whose spending accounts for two thirds of the economy and which has powered forward even as sentiment tanked around Trump's tariffs. That has put greater attention on the employment data, with investors fearful that upcoming reports will start to show consumers and businesses crumbling under the weight of tariffs. Economists polled by FactSet expect the May jobs report next week will show the U.S. economy added just 125,000 jobs last month, down from the 177,000 jobs added n April. An in-line or stronger-than-expected result could be taken in stride by the stock market, while a miss on the consensus estimate could spook investors. For the time being, many investors remain optimistic. They expect a recession could be averted, even if a slowdown is inevitable, as both consumers and companies have so far weathered the tariff uncertainty better than was expected. Tight labor market "It's still a pretty tight labor market," said Anthony Saglimbene, chief market strategist at Ameriprise Financial. "Employers have been unwilling to shed employees, even if they're uncertain about the future, because they lived through the pandemic, and understood how hard it was to hire back and get qualified workers." "And so, the expectation is that, and we'll see this week, our labor market's holding up," Saglimbene added. Still, economists worry tariffs are slowly making their impact felt. EY-Parthenon chief economist Gregory Daco said that durable goods spending fell in the latest April personal income and outlays data, while the personal savings rate rose. "Tariffs had begun to take hold — but their full impact had yet to materialize," Daco wrote. "With employment growth slowing, income gains moderating and the inflationary effects of tariffs building, households are likely to become more cautious in the months ahead." "The Fed and Chair Powell deserve credit for guiding the economy to this point," Daco added. "But any summer celebration may be premature: a tariff-induced inflation storm is on the horizon." Fresh trade aggression Tariffs will continue to be top of mind for investors in the week ahead, especially after a federal court this week halted the majority of the administration's tariffs, only to be reversed by an appeals court granting a stay that allowed the levies to remain in place until next week. Investors worry the legal concerns only inject further uncertainty into tariff policy, especially if the Trump administration finds workarounds to put levies in place that could spur more trade aggression from the U.S. and retaliation abroad. Others worry that investors betting on the TACO trade, a term coined by the Financial Times standing for "Trump Always Chickens Out" on trade deals, could be a dangerous assumption. "We might actually get aggression where the market was anticipating we wouldn't, because [Trump] can't do exactly what he wanted to do with tariffs in the first place," Ameriprise's Saglimbene said. Week ahead calendar All times ET. Monday, June 2 9:45 a.m. S & P PMI Manufacturing final (May) 10 a.m. Construction Spending (May) 10 a.m. ISM Manufacturing (April) Earnings: The Campbell's Co. Tuesday, June 3 10 a.m. Durable Orders final (April) 10 a.m. Factory Orders (April) 10 a.m. JOLTS Job Openings (May) Earnings: Hewlett Packard Enterprise , CrowdStrike Holdings , Dollar General Wednesday, June 4 9:45 a.m. PMI Composite final (May) 9:45 a.m. S & P PMI Services final (May) 10 a.m. ISM Services PMI (May) 2 p.m. Fed Beige Book Earnings: Dollar Tree Thursday, June 5 8:30 a.m. Continuing Jobless Claims (05/24) 8:30 a.m. Initial Claims (05/31) 8:30 a.m. Unit Labor Costs final (Q1) 8:30 a.m. Productivity final (Q1) 8:30 a.m. Trade Balance (April) Earnings: Broadcom , Brown-Forman , Fastenal Friday, June 6 8:30 a.m. Hourly Earnings preliminary (May) 8:30 a.m. Average Workweek preliminary (May) 8:30 a.m. Manufacturing Payrolls (May) 8:30 a.m. Nonfarm Payrolls (May) 8:30 a.m. Participation Rate (May) 8:30 a.m. Private Nonfarm Payrolls (May) 8:30 a.m. Unemployment Rate (May) 3:00 p.m. Consumer Credit (April)
