Nvidia software aims to create marketplace for AI computing power
SAN FRANCISCO/TAIPEI: Nvidia announced a new software platform on Monday that will create a marketplace for cloud-based artificial intelligence chips.
Nvidia's graphics processors, or GPUs, dominate the market for training AI models and a raft of new cloud players called 'neoclouds' such as CoreWeave and Nebius Group have emerged to specialize in renting out Nvidia's chips to software developers.
The Santa Clara, California-based company announced the new tool called Lepton that lets cloud computing companies sell GPU capacity in one spot.
In addition to CoreWeave and Nebius, other firms joining the Lepton platform are Crusoe, Firmus, Foxconn, GMI Cloud, Lambda, Nscale, SoftBank Corp and Yotta Data Services.
Nvidia cloud vice president Alexis Bjorlin said that despite demand surging for chips at startups and large companies, the process of finding available chips has been 'very manual'.
'It's almost like everyone's calling everyone for what compute capacity is available,' Bjorlin told Reuters in an interview. 'We're just trying to make it seamless, because it enables the ecosystem to grow and develop, and it enables all of the clouds - the global clouds and the new cloud providers - access to Nvidia's entire developer ecosystem.'
Absent so far from Nvidia's Lepton partner list are major cloud providers such as Microsoft, Amazon Web Services or Alphabet's Google. Bjorlin said the system is designed for them to be able to sell their capacity on the marketplace if they choose.
Lepton will eventually allow developers to search for Nvidia chips located in specific countries to meet data storage requirements, Bjorlin said. It will also allow companies that already own some Nvidia chips to more seamlessly search for more to rent.
Nvidia did not disclose what the business model will be for the new software platform or say whether it would charge commissions or fees to either developers or clouds.
However, Bjorlin said developers will 'still retain their own relationship to the underlying compute providers, so they've contracted directly with them.'
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Malaysian Reserve
4 hours ago
- Malaysian Reserve
Unifor members at DHL Express Canada locked out after refusing to accept concessions
TORONTO, June 8, 2025 /CNW/ – Unifor members at DHL Express Canada were locked out by their employer after midnight on June 8, after the workers refused to accept concessions put forth by the company. 'We will not stand by while DHL locks out our members across the country and threatens to use scabs in an attempt to pressure our members to take concessions. Our members deserve respect and a fair contract,' said Unifor National President Lana Payne. 'We expect DHL to abide by the law on the books, passed unanimously by Parliament, which will come fully into force later this month. A law that bans the use of replacement works in a legal dispute. It is reprehensible that this company thinks they can bust our members' right to fair and free collective bargaining by using scab labour.' Some concessions the company is pushing include change driver pay system resulting in a loss of money, driving 100 km. to get to their routes or pick up their freight with no compensation. Other concessions involve proposing language that will allow the company to refuse accommodation, laying off employees, and proposing reducing drivers' daily guarantee. The company has also rerouted pickups across the whole country while reducing pay for owner operators. Hours before the deadline, the employer added numerous new proposals and concessions. The union's bargaining priorities remain improving working conditions—including access to clean and secure washrooms—securing fair wages, addressing surveillance and automation issues and recognition and respect for workers. The company filed its intention to lock out workers on June 4 – four days before the deadline to reach an agreement. 'By imposing a lockout, DHL is choosing confrontation over negotiation,' said Unifor Quebec Director Daniel Cloutier. 'This is a serious decision that deprives dedicated workers of their livelihoods. But let's be clear: our members will not be intimidated. They are united, standing strong, and determined to obtain the respect and working conditions they deserve.' Unifor DHL members voted 97% for strike action if necessary last month. Unifor represents over 2,100 DHL Express Canada workers who as truck drivers, couriers, warehouse and clerical workers across Canada, at Locals 114 in British Columbia, 700 in Quebec, 755 in Manitoba and Saskatchewan, 4005 in Nova Scotia, 4457 in Ontario and members in DHL Alberta. Unifor's legal department sent a letter to DHL, cautioning them of hiring scabs –– as anti-scab legislation, which the union campaigned diligently for, is set to come in on June 20. The union firmly believes the timing of the lockout notice is tied to the incoming legislation. The German-based parcel delivery giant's annual profit is roughly $3.3 billion Euro ($4.6 billion CDN) and revenue from its significant and growing North American enterprise is worth approximately ($9.4 billion CDN). And yet, the employer is demanding changes and concessions to working conditions that will negatively affect the pay of Unifor DHL members. Customers in Canada will likely be affected if they use other couriers, including UPS and Loomis, because of integrated contracts with other freight companies. DHL Express Canada has 50,000 customers, including Temu, SHEIN, Lululemon and Siemens Canada. The labour dispute could also potentially cause major disruptions to the Canadian Grand Prix in Montreal, June 13 to 15, due to DHL's responsibility for transporting Formula One vehicles. Unifor is Canada's largest union in the private sector, representing 320,000 workers in every major area of the economy. The union advocates for all working people and their rights, fights for equality and social justice in Canada and abroad, and strives to create progressive change for a better future.
New Straits Times
5 hours ago
- New Straits Times
China's rare earth dominance reshapes trade war battlefield
China has signalled for more than 15 years that it was looking to wea-ponise areas of the global supply chain, a strategy modelled on longstanding American export controls Beijing views as aimed at stalling its rise. The scramble in recent weeks to secure export licences for rare earths, capped by Thursday's telephone call between US and Chinese leaders Donald Trump and Xi Jinping, shows China has devised a better, more precisely targeted weapon for trade war. Industry executives and analysts say while China is showing signs of approving more exports of the key elements, it will not dismantle its new system. Modelled on the United States' own, Beijing's export licence system gives it unprecedented insight into supplier chokepoints in areas ranging from motors for electric vehicles to flight-control systems for guided missiles. "China originally took inspiration for these export control methods from the comprehensive US sanctions regime," said Zhu Junwei, a scholar at the Grandview Institution, a Beijing-based think tank focused on international relations. "China has been trying to build its own export control systems since then, to be used as a last resort." After Thursday's call, Trump said both leaders had been "straightening out some of the points, having to do mostly with rare earth magnets and some other things". He did not say whether China committed to speeding up licences for exports of rare earth magnets, after Washington curbed exports of chip design software and jet engines to Beijing in response to its perceived slow-rolling on licences. China holds a near-monopoly on rare earth magnets, a crucial component in EV motors. In April, it added some of the most sophisticated types to an export control list in its trade war with the US, forcing all exporters to apply to Beijing for licences. That put a once-obscure department of China's commerce ministry, with a staff of about 60, in charge of a chokepoint for global manufacturing. Several European auto suppliers shut down production lines last week after running out of supplies. While China's April curbs coincided with a broader package of retaliation against Washington's tariffs, the measures apply globally. "Beijing has a degree of plausible deniability — no one can prove China is doing this on purpose," said Noah Barkin, senior adviser at Rhodium Group, a China-focused US think tank. "But the rate of approvals is a pretty clear signal that China is sending a message, exerting pressure to prevent trade negotiations with the US leading to additional technology control." Even if the pace of export approvals quickens as Trump suggested, the new system gives Beijing unprecedented glimpses of how companies in a supply chain deploy the rare earths it processes, European and US executives have warned. Other governments are denied that insight because of the complexity of supply chain operations. For example, hundreds of Japanese suppliers are believed to need China to approve export licences for rare earth magnets in coming weeks to avert production disruptions, said a person who has lobbied on their behalf with Beijing. "It's sharpening China's scal-pel," said a US-based executive at a company seeking to piece together an alternative supply chain.. As early as 1992, former Chinese leader Deng Xiaoping was quoted as saying, "The Middle East has oil, China has rare earths". Beijing's landmark 2020 Export Control Law broadened curbs to cover any items affecting national security — from critical goods and materials to technology and data. China has since built its own sanctions power while pouring the equivalent of billions of dollars into developing work-arounds in response to US policies. In 2022, the US put sweeping curbs on sales of advanced semiconductor chips and tools to China over concerns the technology could advance Beijing's military power. But the move failed to halt China's development of advanced chips and artificial intelligence, analysts have said. Beijing punched back a year later by introducing export licences for gallium and germanium, and some graphite products. Exports to the US of the two critical minerals, along with germanium, were banned last December. In February, China restricted exports of five more metals key to the defence and clean energy industries.
Free Malaysia Today
12 hours ago
- Free Malaysia Today
Apple under pressure to shine after AI stumble
Rumors include talk that Apple may add GenAI partnerships with Google or Perplexity. (AFP pic) SAN FRANCISCO : Pressure is on Apple to show it hasn't lost its magic despite broken promises to ramp up iPhones with generative artificial intelligence (GenAI) as rivals race ahead with the technology. Apple will showcase plans for its coveted devices and the software powering them at its annual Worldwide Developers Conference (WWDC) kicking off Monday in Silicon Valley. The event comes a year after the tech titan said a suite of AI features it dubbed 'Apple Intelligence' was heading for iPhones, including an improvement of its much criticised Siri voice assistant. 'Apple advertised a lot of features as if they were going to be available, and it just didn't happen,' noted Emarketer senior analyst Gadjo Sevilla. Instead, Apple delayed the rollout of the Siri upgrade, with hopes that it will be available in time for the next iPhone release, expected in the fall. 'I don't think there is going to be that much of a celebratory tone at WWDC,' the analyst told AFP. 'It could be more of a way for Apple to recover some credibility by showing where they're headed.' Industry insiders will be watching to see whether Apple addresses the AI stumble or focuses on less splashy announcements, including a rumored overhaul of its operating systems for its line of devices. 'The bottom line is Apple seemed to underestimate the AI shift, then over-promised features, and is now racing to catch up,' Gene Munster and Brian Baker of Deepwater Asset Management wrote in a WWDC preview note. Rumors also include talk that Apple may add GenAI partnerships with Google or Perplexity to an OpenAI alliance announced a year ago. Infusing its lineup with AI is only one of Apple's challenges. Developers, who build apps and tools to run on the company's products, may be keen for Apple to loosen its tight control of access to iPhones. 'There's still a lot of strife between Apple and developers,' Sevilla said. 'Taking 30% commissions from them and then failing to deliver on promises for new functionality – that's a double black eye.' A lawsuit by Fortnite maker Epic Games ended with Apple being ordered to allow outside payment systems to be used at the US App Store, but developers may want more, according to the analyst. 'Apple does need to give an olive branch to the developer community, which has been long-suffering,' Sevilla said. 'They can't seem to thrive within the restrictive guardrails that Apple has been putting up for decades now.' As AI is incorporated into Apple software, the company may need to give developers more ability to sync apps to the platform, according to Creative Strategies analyst Carolina Milanesi. 'Maybe with AI it's the first time that Apple needs to rethink the open versus closed ecosystem,' Milanesi said. Adding to the WWDC buildup is that the legendary designer behind the iPhone, Jony Ive, has joined with ChatGPT maker OpenAI to create a potential rival device for engaging with AI. 'It puts Apple on the defensive because the key designer for your most popular product is saying there is something better than the iPhone,' Sevilla said. While WWDC has typically been a software-focused event, Apple might unveil new hardware to show it is still innovating, the analyst speculated. And while unlikely to come up at WWDC, Apple has to deal with tariffs imposed by US President Donald Trump in his trade war with China, a key market for sales growth as well as the place where most iPhones are made. Trump has also threatened to hit Apple with tariffs if iPhone production wasn't moved to the US, which analysts say is impossible given the costs and capabilities. 'The whole idea of having an American-made iPhone is a pipe dream; you'd have to rewrite the rules of global economics,' said Sevilla. One of the things Apple has going for it is that its fans are known for their loyalty and likely to remain faithful regardless of how much time it takes the company to get its AI act together, Milanesi said. 'Do people want a smarter Siri? Hell yeah,' Milanesi said. 'But if you are in Apple, you're in Apple and you'll continue to buy their stuff.'
