Nvidia chips make gains in training largest AI systems, new data shows
Nvidia
's newest chips have made gains in training large artificial intelligence systems, new data released on Wednesday showed, with the number of chips required to train
large language models
dropping dramatically.
MLCommons, a nonprofit group that publishes benchmark performance results for AI systems, released new data about chips from Nvidia and Advanced Micro Devices, among others, for training, in which AI systems are fed large amounts of data to learn from. While much of the stock market's attention has shifted to a larger market for
AI inference
, in which AI systems handle questions from users, the number of chips needed to train the systems is still a key competitive concern. China's DeepSeek claims to create a competitive chatbot using far fewer chips than U.S. rivals.
The results were the first that MLCommons has released about how chips fared at training AI systems such as Llama 3.1 405B, an open-source AI model released by Meta Platforms that has a large enough number of what are known as "parameters" to give an indication of how the chips would perform at some of the most complex training tasks in the world, which can involve trillions of parameters.
by Taboola
by Taboola
Sponsored Links
Sponsored Links
Promoted Links
Promoted Links
You May Like
Access all TV channels anywhere, anytime
Techno Mag
Learn More
Undo
Nvidia and its partners were the only entrants that submitted data about training that large model, and the data showed that Nvidia's new
Blackwell chips
are, on a per-chip basis, more than twice as fast as the previous generation of Hopper chips.
In the fastest results for Nvidia's new chips, 2,496 Blackwell chips completed the training test in 27 minutes. It took more than three times that many of Nvidia's previous generation of chips to get a faster time, according to the data.
Live Events
In a press conference, Chetan Kapoor, chief product officer for CoreWeave, which collaborated with Nvidia to produce some of the results, said there has been a trend in the AI industry toward stringing together smaller groups of chips into subsystems for separate AI training tasks, rather than creating homogenous groups of 100,000 chips or more.
Discover the stories of your interest
Blockchain
5 Stories
Cyber-safety
7 Stories
Fintech
9 Stories
E-comm
9 Stories
ML
8 Stories
Edtech
6 Stories
"Using a methodology like that, they're able to continue to accelerate or reduce the time to train some of these crazy, multi-trillion parameter model sizes," Kapoor said.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Time of India
23 minutes ago
- Time of India
Did you know: THIS Bollywood star purchased Vijay Mallya's Goa pad; paid Rs 73 crore for the luxury mansion
Vijay Mallya was back in the news this past week after his team RCB picked up the IPL trophy this season. The big win coupled with nostalgia swirling, attention once again turned to the high-profile assets he once owned, particularly the villa where Goa's most opulent parties unfolded. Among the many reports that resurfaced on the internet was the sale of his sprawling mansion, the iconic Kingfisher Villa in Goa. After the businessman landed into trouble, his plush pad found a new owner in Bollywood actor and entrepreneur Sachiin Joshi . Renamed King's Mansion, the 12,350 sq. ft. sea-facing estate in Candolim was sold in 2017 for Rs 73.01 crore. Interestingly, this paycheque was significantly lower than its original reserve price of over Rs 90 crore. The off-market sale was reportedly finalised through a private treaty, sources confirmed to PTI. This was reportedly acquired after multiple failed auction attempts by banks trying to recover dues from the businessman. 'Secured creditors have the right to go for a private treaty if the auction route fails,' a person familiar with the matter told PTI. Sprawled across a lush three-acre plot, the estate includes landscaped gardens, open-air dance floors, artificial ponds, and private swimming pools. by Taboola by Taboola Sponsored Links Sponsored Links Promoted Links Promoted Links You May Like Windows Users Don't Forget To Do This Before Sunday Read More Undo 'Today is the day I open the gates to the world,' Joshi said in a statement, officially unveiling the property under its new name - King's Mansion. 'The brand connection from King's Beer and the inherent grandeur of the property made the choice clear.' Joshi, who rose to prominence through films like Azaan and Jackpot, is also a businessman with interests in alcohol, hospitality, wellness, and entertainment. His business ventures include King's Beer, a local favourite in Goa—creating a fitting brand extension in the rechristened mansion. Check out our list of the latest Hindi , English , Tamil , Telugu , Malayalam , and Kannada movies . Don't miss our picks for the best Hindi movies , best Tamil movies, and best Telugu films .
Time of India
23 minutes ago
- Time of India
Panchayat officials must improve efficiency: ZP CEO
Mandya: Taluk panchayat executive officers and panchayat development officers (PDOs) must perform their duties with efficiency, discipline, and integrity—earning recognition while avoiding public complaints, said zilla panchayat chief executive officer KR Nandini. Addressing a grievance redressal meeting for PDOs at Ambedkar Bhavan, Nandini emphasised the importance of self-satisfaction in public service and noted that several PDOs in the district were recognised for their exemplary work. To further encourage performance, she announced that PDOs' health will be assessed every six months, and those demonstrating exceptional work will receive awards in the presence of their families. 17,500 register for summer camp Citing the successful registration of 17,500 children for summer camps organised across all gram panchayats in the district, Nandini attributed the achievement to effective coordination between taluk panchayat executive officers and PDOs. She underscored the need for continued teamwork to serve the public efficiently. PDOs and panchayat staff were encouraged to openly share administrative concerns. by Taboola by Taboola Sponsored Links Sponsored Links Promoted Links Promoted Links You May Like Giao dịch vàng CFDs với mức chênh lệch giá thấp nhất IC Markets Đăng ký Undo Nandini directed that taluk panchayat executive officers should conduct monthly two-to-three-hour meetings with PDOs to listen to and resolve issues. She clarified the grievance escalation protocol: unresolved complaints at the taluk level should be forwarded to the district authorities. Additionally, PDO association office bearers have been tasked with organising regular meetings at both taluk and district levels. Nodal officers assigned to each taluk will be available every Monday and Thursday from 3 to 4pm at the district headquarters to hear public grievances. The IAS officer raised serious concerns over violations of Karnataka Transparency in Public Procurements (KTPP) rules in gram panchayats. She instructed PDOs to strictly follow the 60:40 ratio policy in planning and ensure that financial transactions during general meetings adhere to the financial code and KTPP norms. Prashanth Babu, president of Mandya district unit of the Karnataka State Panchayat Development Officers' Welfare Association (R), Bengaluru, commended the district CEO for initiating a platform to address PDOs' challenges. He mentioned delayed salary payments across taluks.
Time of India
26 minutes ago
- Time of India
Centre okays Rs 24,000 cr projects for Delhi, includes 5 km tunnel from Mahipalpur to Vasant Kunj
Delhi Chief Minister Rekha Gupta on Sunday said the Centre has approved several projects worth Rs 24,000 crore to streamline traffic and reduce pollution in Delhi and its adjoining areas, including a five-km tunnel between Shiv Murti-Mahipalpur (Dwarka Expressway) and Nelson Mandela Road (Vasant Kunj). The tunnel will be constructed by the National Highways Authority of India (NHAI) at an estimated cost of Rs 3,500 crore, she said, adding that the projects were approved during a recent meeting with Union Minister of Road Transport and Highways, Nitin Gadkari. Gupta said that the work on the project will likely commence early next year. It will comprise of two underground tubes, with each tube having three lanes -- totalling to six lanes, which will offer a signal-free alternate route between South Delhi and Dwarka/Gurugram. by Taboola by Taboola Sponsored Links Sponsored Links Promoted Links Promoted Links You May Like Semua yang Perlu Anda Ketahui Tentang Limfoma Limfoma Pelajari Undo The tunnel will also be equipped with modern facilities such as electro-mechanical systems, ventilation, fire safety, CCTV surveillance, control rooms, emergency exits, and cross-passages. She explained that the tunnel will significantly ease traffic congestion on Rangpuri, Dhaula Kuan, Rao Tula Ram Marg, and National Highway 48 (NH-48). Live Events It will also serve as a key connector between Central/East Delhi and multiple major expressways and highways including the Delhi Expressway (NE-5), NH-44, NH-10, Delhi-Jaipur Highway (NH-48), and Delhi-Dehradun Expressway (NH-709B) via the Urban Extension Road (UER) and Dwarka Expressway, she added. Calling this project, the "foundation for the Delhi of the future," the chief minister said the tunnel will give a new direction to infrastructure in the national capital and bring relief to millions of citizens.
