Nvidia software aims to create marketplace for AI computing power
By Stephen Nellis and Max A. Cherney
SAN FRANCISCO/TAIPEI:
Nvidia
announced a new software platform on Monday that will create a marketplace for cloud-based
artificial intelligence
chips.
Nvidia's graphics processors, or GPUs, dominate the market for training AI models and a raft of new cloud players called "neoclouds" such as CoreWeave and Nebius Group have emerged to specialize in renting out Nvidia's chips to software developers.
The Santa Clara, California-based company announced the new tool called Lepton that lets
cloud computing
companies sell GPU capacity in one spot.
In addition to CoreWeave and Nebius, other firms joining the Lepton platform are Crusoe, Firmus, Foxconn, GMI Cloud, Lambda, Nscale, SoftBank Corp and Yotta Data Services.
Nvidia cloud vice president Alexis Bjorlin said that despite demand surging for chips at startups and large companies, the process of finding available chips has been "very manual".
"It's almost like everyone's calling everyone for what compute capacity is available," Bjorlin told Reuters in an interview. "We're just trying to make it seamless, because it enables the ecosystem to grow and develop, and it enables all of the clouds - the global clouds and the new cloud providers - access to Nvidia's entire developer ecosystem."
Absent so far from Nvidia's Lepton partner list are major cloud providers such as Microsoft, Amazon Web Services or Alphabet's Google. Bjorlin said the system is designed for them to be able to sell their capacity on the marketplace if they choose.
Lepton will eventually allow developers to search for Nvidia chips located in specific countries to meet data storage requirements, Bjorlin said. It will also allow companies that already own some Nvidia chips to more seamlessly search for more to rent.
"It's a good move for them," said Mario Morales, group vice president at research firm IDC. "Nvidia is close to about 5 million developers. So they want to figure out a way where they can give them (developers) more access to the technology."
Nvidia did not disclose what the business model will be for the new software platform or say whether it would charge commissions or fees to either developers or clouds.
However, Bjorlin said developers will "still retain their own relationship to the underlying compute providers, so they've contracted directly with them."
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
&w=3840&q=100)
Business Standard
16 minutes ago
- Business Standard
Reliance Defence partners Diehl for precision-guided munitions in India
Reliance Defence and Diehl Defence tie up for local production of 155 mm guided munitions in Ratnagiri, with Rs 5,000 crore investment planned over five years Mumbai Anil Ambani's Reliance Defence (R-Defence) has tied up with Germany-based Diehl Defence to produce next-generation terminally guided munitions (TGM) for the Indian armed forces. The partnership with Diehl will drive local production of the Vulcano 155 mm precision-guided munition system, R-Defence stated. As part of the agreement, R-Defence will establish a large, high-tech, greenfield, integrated ammunition and explosive manufacturing facility in Watad Industrial Area in Ratnagiri, Maharashtra. 'This strategic alliance not only accelerates the advancement of India's defence manufacturing capabilities, but also positions Reliance Defence as a pivotal player in the global defence supply chain,' Ambani, founder and chairman of the Reliance Group, said. In May, the company had tied up with another Germany-based defence firm, Rheinmetall AG, to supply the explosives and propellants for medium- and large-calibre ammunition. The facilities for the above-mentioned partnerships in Ratnagiri will be established with an investment of ₹5,000 crore over the next five years, a company source stated. R-Defence is aiming to start manufacturing in the next 18 months, as it has the land and principal approvals for the plant in place. The company aims to fund 30 per cent of the investment via equity and the other 70 per cent via debt. The equity is likely to come from the company's internal cash accruals, the source said. R-Defence aims to be amongst the country's top three private defence exporters in the next 12 to 24 months. It is likely to sign long-term agreements with firms like Diehl and Rheinmetall for 5 to 10 years in the coming months. The partnerships are a part of the company's ammunition-focused strategy, where the products made in India will have 60 per cent indigenous content. It is eyeing the market opportunity to potentially generate ₹10,000 crore in revenue through the development and supply of advanced ammunition systems. This tie-up with Diehl is also Reliance Group's fourth global partnership, expanding upon its established collaborations with Dassault Aviation, Thales Group of France, and Rheinmetall. Additionally, Diehl Defence's product portfolio includes air defence systems, missiles for all branches of the armed forces, and ammunition for the army, air force, and navy, as well as protection systems, generating annual sales of over 2 billion euros.
Time of India
29 minutes ago
- Time of India
Robert Vadra skips ED summons in PMLA case linked to Sanjay Bhandari
Robert Vadra , the businessman husband of Congress MP Priyanka Gandhi Vadra , on Tuesday skipped an ED summons for questioning in a money laundering case linked to UK-based alleged arms consultant Sanjay Bhandari , official sources said. The sources said Vadra sought an adjournment of Tuesday's summons, and he will now be given a fresh date. The ED wants to record Vadra's statement under the Prevention of Money Laundering Act (PMLA) and then file a chargesheet against him before the court, sources said. The federal probe agency had questioned the 56-year-old businessman for three consecutive days in April in a separate money laundering case linked to alleged irregularities in a 2008 land deal in Haryana. Bhandari (63) fled to London in 2016, soon after the Income Tax Department raided him in Delhi. Live Events A UK court earlier this month refused an application filed by the Indian government seeking permission to appeal in Britain's Supreme Court against the discharge of Bhandari in an extradition case , virtually ruling out chances of him being brought to the country to face the law. The ED filed a chargesheet in this case in 2023, alleging that Bhandari acquired the 12, Bryanston Square house in London in 2009 and got it renovated "as per the directions of Robert Vadra, who provided the funds for the renovation". Vadra has denied that he owns any London property directly or indirectly. Terming the charges a "political witch hunt", Vadra said he was being "hounded and harassed" to subserve political ends. The ED is also investigating Vadra in a separate money laundering case linked to alleged financial irregularities in a land deal in Rajasthan's Bikaner. The federal probe agency had previously questioned Vadra and his mother, Maureen, in this case.
&w=3840&q=100)
Business Standard
30 minutes ago
- Business Standard
Robert Vadra skips ED summons in PMLA case linked to Sanjay Bhandari
Robert Vadra, the businessman husband of Congress MP Priyanka Gandhi Vadra, on Tuesday skipped an ED summons for questioning in a money laundering case linked to UK-based alleged arms consultant Sanjay Bhandari, official sources said. The sources said Vadra sought an adjournment of Tuesday's summons, and he will now be given a fresh date. The ED wants to record Vadra's statement under the Prevention of Money Laundering Act (PMLA) and then file a chargesheet against him before the court, sources said. The federal probe agency had questioned the 56-year-old businessman for three consecutive days in April in a separate money laundering case linked to alleged irregularities in a 2008 land deal in Haryana. Bhandari (63) fled to London in 2016, soon after the Income Tax Department raided him in Delhi. A UK court earlier this month refused an application filed by the Indian government seeking permission to appeal in Britain's Supreme Court against the discharge of Bhandari in an extradition case, virtually ruling out chances of him being brought to the country to face the law. The ED filed a chargesheet in this case in 2023, alleging that Bhandari acquired the 12, Bryanston Square house in London in 2009 and got it renovated "as per the directions of Robert Vadra, who provided the funds for the renovation. Vadra has denied that he owns any London property directly or indirectly. Terming the charges a political witch hunt, Vadra said he was being "hounded and harassed" to subserve political ends. The ED is also investigating Vadra in a separate money laundering case linked to alleged financial irregularities in a land deal in Rajasthan's Bikaner. The federal probe agency had previously questioned Vadra and his mother, Maureen, in this case.
