Latest news with #NvidiaB200
Time of India
04-06-2025
- Business
- Time of India
IndiaAI empanelment drives down prices of GPUs in second round
ETtech Live Events An analysis of the lowest (L1) prices released by the IndiaAI Mission for the second round of the tender for graphics processing units (GPU) shows an up to 10% fall in prices compared with the first first-round bidders will be asked to match these prices, resulting in substantial savings for the users. The GPUs are sourced under a government scheme to provide subsidised compute power to local artificial intelligence decline in the price of the same GPU model from the first round to the second round ranged from just Rs 4 an hour to as high as Rs 1,234 per some companies told ET that the reduced L1 rates will help kickstart artificial intelligence pilot projects in various domains, which previously may have been cost-prohibitive, others warned of a price bloodbath for GPU capacity prices are possibly the lowest in the world for GPU services, helped by the 40% government startups, developers, researchers and corporations exploring and implementing AI would be able to afford GPU capacity by leasing from the identified providers.'All existing empanelled players will be asked to match new L1 prices,' IndiaAI Mission chief executive Abhishek Singh told ET. 'From what we hear from companies, they will mostly match, to retain their priority of allocation of AI workloads.'As many as 53 categories of GPUs have been offered in the second round of the tender, out of which some are new (like Nvidia's B200 GPUs). In 16 categories, prices have reduced compared with the first said assigning AI workloads is an ongoing process and companies have six months to provision the per the IndiaAI website, 4,423 GPUs with a total subsidy of Rs 111.86 crore have been allocated so far. Compute has been allocated to 21 applicants from academia, government entities, early-stage startups, MSMEs and the student startup Sarvam AI , the first startup selected to build an indigenous foundational model under the IndiaAI Mission, has already been allocated 4,000 GPUs, Singh said. Others like Soket, Gnani and Gan are expected to give their estimate on the compute they need.'Allocation is dynamic. Companies have invested heavily in bidding for GPUs. Commitments require significant money and those in the business have done so after their assessments,' he has received the highest subsidy allocated under the programme at Rs 98.68 crore, out of a bill of Rs 246.71 crore for 4,096 Nvidia H100 GPUs, as per the IndiaAI minister Ashwini Vaishnaw on Friday announced the addition of 15,916 GPUs to the existing cluster of 18,417 GPUs under the programme, taking the total to 34,333 include GPUs of Nvidia, AMD, AWS and Intel. The offering comprises 15,100 H100 Nvidia GPUs , 8,192 Nvidia B200 GPUs, 4,812 Nvidia H200 GPUs, and 1,973 Nvidia L40S GPUs.'The combination of reduced L1 rates and government support will help kickstart pilot projects in various domains, enabling more organisations to experiment with and scale AI use cases that previously may have been cost-prohibitive,' said Rishikesh Kamat, senior director, Cloud services division, at NTT Data India , one of the seven empanelled bidders in round Bairathi, chief executive of Cyfuture India, another empanelled bidder in round two, warned of lower prices creating problems for the nascent industry.'It's advantageous for users but is concerning for service providers, as a price bloodbath is on," he said. Moreover, it would be even more fatal for companies if workloads as envisaged by the IndiaAI Mission don't come through, he average L1 hourly GPU price was Rs 612.85 in the first round of empanelment against an average Rs 655.90 in the second round of empanelment. While there has been a decline in price for the same GPUs between the two rounds, the average is higher in the second round because of newer categories of GPUs.
Economic Times
30-05-2025
- Business
- Economic Times
After Sarvam.ai, Soket AI, Gnani.ai, Gan.ai to now build foundation AI models, says IndiaAI Mission
IndiaAI Mission on Friday announced Soket AI, and will be developing foundation artificial intelligence (AI) models apart from that was initially selected. ET had reported this more than a month AI will develop an open source 120 billion parameter foundation model optimised for the country's linguistic diversity targeting sectors such as defence, healthcare and education. will build a 14 billion parameter voice AI foundation model delivering multilingual, real time speech processing with advanced reasoning will create a 70 billion parameter multilingual foundation model targeting superhuman text-to-speech (TTS) model capabilities.'We are working on another PhD programme and a large talent development programme starting from the very basic to a really advanced level so that the foundational research in AI can also be funded out of the AI mission,' said IT minister Ashwini Vaishnaw. 'I hope some of the smart young engineers working on these teams would like to relocate back to India,' he added. He was referring to the three teams selected to build foundation AI models. 'We're proud to lead the way in developing voice-to-voice large language models for India and the world, because we believe transformative AI must speak the language of the people it serves,' said Ganesh Gopalan, co-founder and chief executive of IndiaAI Mission also said there were now 34,333 GPUs available on the IndiaAI Compute portal. These include GPUs of Nvidia, AMD, AWS, and Intel. The offering comprises 15,100 H100 Nvidia GPUs, 8,192 Nvidia B200 GPUs, 4,812 Nvidia H200 GPUs, and 1,973 Nvidia L40S GPUs. The other GPU variants each comprise less than 1,000 or 500 in seven technically qualified bidders in the second round of the GPU tender are empanelled, it said. However, there was no information on how many of these 34,333 GPUs have been assigned AI workloads and are currently being used. The seven empanelled bidders are Cyfuture India, Ishan Infotech, Locuz Enterprise Solutions, Netmagic IT Services (NTT GDC India) Sify Digital Services, Vensysco Technologies, and Yotta Data Services. In all, 367 datasets have been uploaded on AI Kosh, Vaishnaw revealed. AI Kosh is the government's platform that provides a repository of datasets, models and use cases to enable AI innovation. It also features AI sandbox capabilities. IndiaAI Mission said on May 16 it had received 506 foundation AI proposals across the three phases. Given the overwhelming response and continued interest, the mission has decided to extend the deadline for submissions under phase 3 of the call for proposals. The earlier deadline was April 30.'Further dates for submission of proposals, the acceptance of new applications post April 30, will be announced subsequently, as per requirements, once the examination of proposals already submitted has been completed," IndiaAI said on its part of the first phase of approvals, was selected to initiate the development of an indigenous foundational multi-modal, multi-scale model will have 70 billion parameters. It is developing three model variants. These include Sarvam-Large for advanced reasoning and generation, Sarvam-Small for real-time interactive applications, and Sarvam-Edge for compact on-device will get access to 4,096 Nvidia H100 graphics processing units (GPU) for six months from the IndiaAI Mission.
Yahoo
17-02-2025
- Business
- Yahoo
RTX 5090 GPU shortage could soon end if Nvidia adopts this strategy
Nvidia may be close to resolving some of its delay issues and getting the RTX 5090 GPUs ready for consumers in at least a month, with a fortunate workaround. Online leakers noted on X that the shortage began due to scalpers over-purchasing components, but it could soon end if Nvidia adopts this strategy. Leaker @Zed__Wang suggested the component supplier may be able to tackle the challenge it has been having with its RTX 5090 shortage by utilizing Nvidia B200 data center GPUs in the production of its high-end graphics chips. The Nvidia B200 chips have notably dropped in demand and gone into oversupply. If the reports are accurate, Nvidia would be able to use the excess GB100 dies that are within the B200 GPU and incorporate them into the GB202 architecture for the RTX 5090. This could potentially end the shortage. The RTX 5090 isn't the only Nvidia GPU that has been facing delays. The RTX 5080, along with the abovementioned graphics card launched in January in extremely limited quantities. As said, overall demand plus scalper inflation led to low availability of the components. Currently, there is no word on whether the RTX 5080 will receive a supply update. The RTX 50 series, powering laptops and desktops is another notable GPU family that has been delayed until at least March. There have been several unsubstantiated reasons as to why the GPUs may have been delayed, including Nvidia's focus on AI GPUs and internal miscommunication within the company. Notebookcheck also noted some graphics cards may have been experiencing performance and functionality issues. Nvidia will make the GPU available for pre-order starting February 25, despite it not releasing until sometime later. The RTX 60 and RTX 70 GPUs are also facing delays until April. However, the RTX 5070 Ti will see a prompt launch on February 20.
