Nvidia software aims to create marketplace for AI computing power
By Stephen Nellis and Max A. Cherney
SAN FRANCISCO/TAIPEI:
Nvidia
announced a new software platform on Monday that will create a marketplace for cloud-based
artificial intelligence
chips.
Nvidia's graphics processors, or GPUs, dominate the market for training AI models and a raft of new cloud players called "neoclouds" such as CoreWeave and Nebius Group have emerged to specialize in renting out Nvidia's chips to software developers.
The Santa Clara, California-based company announced the new tool called Lepton that lets
cloud computing
companies sell GPU capacity in one spot.
In addition to CoreWeave and Nebius, other firms joining the Lepton platform are Crusoe, Firmus, Foxconn, GMI Cloud, Lambda, Nscale, SoftBank Corp and Yotta Data Services.
Nvidia cloud vice president Alexis Bjorlin said that despite demand surging for chips at startups and large companies, the process of finding available chips has been "very manual".
"It's almost like everyone's calling everyone for what compute capacity is available," Bjorlin told Reuters in an interview. "We're just trying to make it seamless, because it enables the ecosystem to grow and develop, and it enables all of the clouds - the global clouds and the new cloud providers - access to Nvidia's entire developer ecosystem."
Absent so far from Nvidia's Lepton partner list are major cloud providers such as Microsoft, Amazon Web Services or Alphabet's Google. Bjorlin said the system is designed for them to be able to sell their capacity on the marketplace if they choose.
Lepton will eventually allow developers to search for Nvidia chips located in specific countries to meet data storage requirements, Bjorlin said. It will also allow companies that already own some Nvidia chips to more seamlessly search for more to rent.
"It's a good move for them," said Mario Morales, group vice president at research firm IDC. "Nvidia is close to about 5 million developers. So they want to figure out a way where they can give them (developers) more access to the technology."
Nvidia did not disclose what the business model will be for the new software platform or say whether it would charge commissions or fees to either developers or clouds.
However, Bjorlin said developers will "still retain their own relationship to the underlying compute providers, so they've contracted directly with them."
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Time of India
an hour ago
- Time of India
Gas stations are adding EV chargers and reasons to wait around
Gas stations are a lot bigger these days, and there's a new reason for them to keep growing: electric vehicles. As battery-powered cars become more common on roadways, more gas stations are installing chargers alongside old-fashioned pumps. But EV charging takes time, so gas station operators are turning their stores into shopping centers where people can spend time -- and money -- while they wait for cars to charge. Doing so often means supersizing the business. Buc-ee's, which has 51 locations primarily in the South and is working with Mercedes-Benz to offer EV charging, has stations as big as 75,000 square feet. "What you are seeing is retailers preparing for what is to come," said Kevin Hart , chief sales officer at Upside, which works with retailers, including convenience stores and gas stations, to offer customers rewards on their purchases. "The last thing they want is you coming, plugging in your car to an EV charging station and sitting in your car, so they have to create a shopping experience," Hart said. "That is not how they thought 15 years ago." But the sheer size of the businesses has turned off some communities that don't want the heavy traffic, bright lights and 24/7 activity. In southeast Michigan, the City Council in Livonia voted in January against plans to raze a former Rite-Aid building in order to build a Sheetz , a Pennsylvania-based chain with over 700 locations and EV charging stations at 100 of those sites. In 2022, a plan to turn a vacant parcel in Creve Coeur, Missouri, into a QuikTrip, which has over 1,100 stores mostly in the South and is rapidly expanding into the Midwest, went all the way to the state Supreme Court before it was denied. In 2021, Buc-ee's withdrew plans for what would have been a 57,000-square-foot station in Orange County, North Carolina, after community pushback. And this year in Denver, the City Council passed an ordinance banning new gas station construction within a quarter mile of another gas station, saying that the land could be preserved for community needs like affordable housing. The mega gas station versus community battle is taking place more frequently as these fuel centers move into downtowns and residential areas. They used to exist mainly along highways as rest stops where their huge square footage wasn't a problem. But now, they are taking over blighted parcels and cutting into a realm once dominated by fast-food chains. Some of the expansion has accelerated because of tax breaks from local governments eager for sales revenue. And once a gas station is in an area, more will pop up. Wawa , a chain with 1,100 locations mostly in the Northeast and mid-Atlantic regions, for example, tries to open clusters of stores in markets that it is already in. Gas stations weren't always so controversial, but they also weren't always so large. Sheetz's stations have expanded more than 1,000 square feet over the past 20 years, said Travis Sheetz , its chief executive, and are on average 6,000 square feet. QuikTrip's sprawling stores are often over 7,000 square feet and double as restaurants with full kitchens, drive-thru lanes, seating and slushy machines. These stations are "much different" than they used to be, said Forrest Morgeson III, an associate professor of marketing at Michigan State University and the director of research emeritus at the American Consumer Satisfaction Index. "These are big gas stations, often with a few dozen pumps, bigger storefronts, a lot of parking," he added. The transition from fuel sites to the gas-station-restaurant-convenience store model has been underway for decades. Because gas stations do not make much profit from gas itself, and raising its price will just push people to get gas elsewhere, food and drinks are easy ways to make money while also differentiating them from their competition. Many of the biggest gas stations offer food that has almost a cultlike following. At Sheetz, the mozzarella sticks, mac-and-cheese bites and chicken sandwiches are what bring people in -- not gas. Wawa is known for its hoagies. Customers go to Buc-ee's for the beef jerky. And Casey's, a gas station with 2,900 outlets in the Midwest, is the nation's fifth-largest pizza chain by volume and offers specials like pulled pork sandwiches on Hawaiian bread. It started its private-label snack and drinks in 2021 and now has hundreds of products, such as chips with sweet corn or jalapeno cheddar flavor. While some gas chain owners may say food was always part of their business model -- Wawa, which was founded in 1964, didn't start adding gas pumps to its food locations until 1996 -- sales from food at gas stations have more than doubled in 20 years. In 2023, food was nearly 26.7% of in-store sales at gas stations compared with 13.1% in 2003, according to the National Association of Convenience Stores, a trade association (2023 was the last full year of the association's data). "The business has matured to the point where it is a total food service experience -- customers expect seating, drive-thru," Sheetz said. "We are looking ahead, and we are looking far ahead, and we are preparing for a future when gas demand will decline." Sheetz stores have been leading the trend that bigger is better. Aside from the addition of drive-thru lanes and more indoor and outdoor seating, the chain's enhancements include larger restrooms, expanded cooler space and increased kitchen capacity, Sheetz said. (BEGIN OPTIONAL TRIM.) Craig Dunaway, chief operating officer of Penn Station East Coast Subs, said his restaurant chain was fending off gas station businesses like Sheetz. "Convenience store operators have elevated the quality of their food products over the past five to 10 years, and it has the potential, especially as more consumers continue to eat on the go or in a hurry, to take market share from traditional restaurant operators if the traditional operators assume convenient stores are not direct competitors," he said. (END OPTIONAL TRIM.) When communities object to Sheetz's moving in, the company isn't fazed, Sheetz said. It knows there are communities that want its business, and it works with officials to find locations that are a good fit, he added. For example, the City Council in Farmington Hills, Michigan, rejected Sheetz's proposal this year to take over a space once occupied by Ginopolis, a restaurant that called Elizabeth Taylor and Bob and Delores Hope its customers, after several contentious meetings. (BEGIN OPTIONAL TRIM.) "There was tremendous amount of correspondence not wanting that development to take place," said Gary Mekjian, city manager of Farmington Hills. "I have been city manager for over four years and been with the city for 15 years -- that is one of the longest meetings I can remember," Mekjian said, adding that it was past midnight before the council agreed to reject Sheetz's plan. (END OPTIONAL TRIM.) But in nearby Romulus, the chain has gained a foothold and has been welcomed. Jeremy Taylor, 37, who has lived in the city for 20 years and often walks to the store, said he went "all the time." "It's been a long time since we've had something this good in Romulus," he said. "There's nothing out here." This article originally appeared in The New York Times.
&w=3840&q=100)
Business Standard
an hour ago
- Business Standard
SBI to shed exposure to ailing power equipment maker Regen Power
SBI to offload ₹1,550-crore stressed loan exposure in Regen Power to clean up its books; auction reserve price set at ₹240 crore Mumbai State Bank of India (SBI) is offloading a stressed loan exposure of over ₹1,550 crore to Regen Power Private Ltd (RPPL), a South India-based wind turbine generator (WTG) manufacturer, as part of efforts to clean up its balance sheet. The principal outstanding on this account stood at around ₹580 crore at the end of March 2025. The country's largest lender is using the Swiss auction route for price discovery, based on an existing offer in hand, according to a notice on SBI's website. However, the bank did not disclose details of the offer it has received. The reserve
&w=3840&q=100)
Business Standard
an hour ago
- Business Standard
UnitedHealth may sell Latin America arm for $1bn to refocus on US: Report
UnitedHealth Group is weighing multiple bids for its Latin American operations, according to two people with direct knowledge of the matter, as the insurer buckles down after a series of unprecedented missteps that include the ouster of its CEO and a reported criminal accounting probe. The largest US health insurer has been trying to exit Latin America since 2022, but the sale of Banmedica has taken on increasing urgency in recent months as the insurer took hits on multiple fronts, according to one of the people. New CEO Steve Hemsley told shareholders last week that he was determined to earn back their trust after an earnings miss and a Wall Street Journal report that the company was under criminal investigation for alleged Medicare fraud. UnitedHealth has said it was not notified by the Department of Justice and that it stands by the integrity of its operations. Hemsley replaced Andrew Witty just a few months after the murder of the executive Brian Thompson, the CEO of UnitedHealthcare, in New York in December while on his way to a meeting with investors. Witty had been UnitedHealth Group CEO since 2021. The company has four non-binding bids for its Banmedica subsidiary, which operates in Colombia and Chile, for about $1 billion, according to both people, who asked not to be identified because the talks are private. UnitedHealth's shares tumbled 25.5 per cent in May alone, and year-to-date are down 40 per cent. UnitedHealth left Brazil in 2023 and Peru in March. It's aiming to get around $1 billion for Banmedica's operations in Colombia and Chile, the people said. The two people said the company expects to set a deadline for binding proposals as soon as July. UnitedHealth received bids from: Acon Investments (Washington, D.C.-based private equity firm) Patria Investments (São Paulo-based private equity firm) Christus Health (Texas non-profit health firm) Auna (Lima-based healthcare and insurance provider, in talks with a financial partner) Banmedica's annual earnings before income taxes, depreciation and amortisation (EBITDA) is more than $200 million a year. Patria and Christus Health declined to comment. UnitedHealth, Acon, and Auna did not respond to requests for comment. UnitedHealth bought Banmedica in 2018, with then-CEO David Wichmann saying he was 'establishing a foundation for growth in South America for the next decades.' At the time, UnitedHealth paid around 12 times Banmedica's EBITDA, according to one of the people. Three years later, the insurer decided to leave Latin America as it grappled with losses in its largest operation in the region, Brazil's Amil, which had been acquired a decade earlier. It divested from its Brazilian operations in late 2023. Banmedica is currently profitable but is considered too small by UnitedHealth. It serves over 2.1 million consumers through its health insurance programs and handles around 4 million patient visits annually across its network of 13 hospitals and 143 medical centres. UnitedHealth booked an $8.3 billion loss last year related to the sale of its South American operations — $7.1 billion stemming from the Brazil exit and $1.2 billion from Banmedica. 'These losses relate to our strategic exit of South American markets and include significant losses related to foreign currency translation effects,' the company said in a February filing. Brazilian investment bank BTG Pactual is advising UnitedHealth on the sale.
