GPU firms step up their tech stack
Tired of too many ads?
Remove Ads
Tired of too many ads?
Remove Ads
Indian AI cloud and GPU-as-a-service companies such as Neysa JarvisLabs and NeevCloud are altering strategies as AI market dynamics shift. While Neysa continues to invest in advanced GPUs to double down on inferencing , others such as JarvisLabs and NeevCloud are taking a step back and not buying any more GPUs. Instead, they are focusing on building the software stack.The reasons for this range from low utilisation of high-end GPUs, high capital investment required for purchasing them and better and cheaper access to such chips in recent times. In addition GPUs are capital intensive and unless startups have raised enough funds, it is a risky business. While training and fine-tuning of large language models is yet to pick up at scale, companies are also focusing on inferencing, a process in which trained AI models use the data to predict, reason, or solve problems.Vishnu Subramanian, founder of Jarvislabs AI, which offers GPU rental and AI cloud services , explained that one of the reasons they bought GPUs in 2019 was that back then no one else was buying them and costs were exorbitant. Jarvislabs offered the service at an economical price to startups and the student community in the country. But with more companies entering the field in India and globally, costs have plummeted. 'The rental prices and margins at which you can rent has significantly gone down. For example, on-demand H100 (an Nvidia GPU) used to cost $11-12 a year back. Now you can get them for less than $3 from a decent cloud service provider,' he said.India's appetite for spending on high-end GPUs has declined. 'Even within Jarvislabs, we see a bigger chunk of revenue coming from the West,' Subramanian said. As a result, the company stopped buying GPUs a year ago and is partnering with global players to offer processing capacity.In addition, Jarvislabs is also focusing on building the orchestration layer. This refers to systems that manage multiple AI components by streamlining the process, scaling and bringing in efficiency. NeevCloud founder Narendra Sen said it began with a plan to build the CoreWeave of India. It started out renting GPUs and then entered orchestration and application layers. 'But we realised that GPUs are a commodity and you need to build a technology for consumer stickiness and provide value beyond the GPU such as improving chip performance,' he said. As a result, NeevCloud, instead of bulking up on GPUs, is taking a call to buy them based on demand. 'This is only 10-20%,' he added. The firm did not disclose the scale of GPU operations, but this had been a key strategy earlier.Sharad Sanghi, co-founder of Neysa, an AI cloud platform, said some companies are not focusing on GPUs as they are capital intensive and, unless they have money, it is a risky business. Neysa has so far deployed 1,200 GPUs and is in talks to place further orders for advanced chips including Nvidia Blackwells, expected in India later this year. This backs up the company's focus on inferencing-as-a-service.Sanghi said that with (Indic) foundational models such as Sarvam coming, there will be use cases for training and finetuning. While the firm was doing all three earlier—training, finetuning and inferencing, Sanghi said the enterprise space is going to be more of a market focused on the latter.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
India.com
8 minutes ago
- India.com
Bad news for Ratan Tata's TCS after massive layoffs, IT giant loses Rs 5.66 lakh crore due to..., worst phase for company since...
TCS is undergoing its worst crisis since the 2008 recession. (File) TCS market cap: Amidst the backdrop of the controversy surrounding its decision to cut more than 12,000 jobs in the current fiscal year, Tata Consultancy Services (TCS), India's largest IT services exporter, has witnessed a rout of its market cap, which slumped from Rs 16.57 lakh crore to Rs 10.93 lakh crore, a decrease of Rs 5.66 lakh crore. According to market analysts, TCS, the flagship company of the Tata Group, is going through it worst crisis since the 2008 recession, when it shares had fallen by 55 percent. TCS share prices have dipped 25 percent in 2025, and experts predict the current financial could be the worst in company's history if the downfall continues. Why TCS shares are falling? According to analysts, India's stock market has witnessed a turmoil over the past few months as foreign investors are withdrawing from the market in droves amid US President Donald Trump unleashing tariff war against India, and recently announcing 50% import duty on Indian exports. The IT industry, once considered a favorite for FIIs, is now witnessing a decline, with foreign investors reducing their stake in TCS from 12.35% in June 2024 to 11.48% in June 2025, which has resulted in the company's shares falling by over 25 percent in the current financial year. The Nifty IT index has fallen 25% so far this year, making it the worst-performing sector in the market as over half of the Rs 95,600 crore withdrawn from India by FIIs till July 2025 has come from IT stocks alone. Why mutual funds investment increased? Meanwhile, domestic mutual funds have raised their stake in TCS from 4.25% to 5.13%, making fresh purchases worth Rs 400 crore in the company, according to data. TCS' trailing PE declined from 41x to 20x, five-year CAGR stands at 8.5%, while stock CAGR is 6%, the data showed. Notably, India's IT sector has grown at a compounded annual rate of 12.5% over the last two decades, but has underperformed the Nifty over the last three to five years. TCS layoffs According to recent media reports, TCS is mulling to cut about 2 percent of its global workforce, which would result in over 12,000 TCS workers losing their jobs in the current financial year. The company's decision is being investigated, with Jefferies warning that TCS layoffs could result in a slowdown in execution in the near term and an increase in the workforce in the long term.
Time of India
38 minutes ago
- Time of India
INDIA bloc leaders likely to discuss joint Vice-Presidential candidate on Monday
The opposition INDIA bloc leaders are likely to discuss their joint candidate for the post of vice-president at a meeting of floor leaders on Monday morning. Independence Day 2025 Modi signals new push for tech independence with local chips Before Trump, British used tariffs to kill Indian textile Bank of Azad Hind: When Netaji Subhas Chandra Bose gave India its own currency Sources said the INDIA bloc leaders would meet at the office of Mallikarjun Kharge, the leader of opposition in Rajya Sabha, at 10.15 am on Monday. The meeting will be held a day after the ruling National Democratic Alliance (NDA) announced Maharashtra Governor C P Radhakrishnan as its nominee for the post of vice-president, the second-highest constitution position in the country. Radhakrishnan hails from Tamil Nadu, which will go to polls in 2026. While the ruling BJP feels that the nomination of Radhakrishnan, a seasoned BJP leader with an RSS background, will elicit support from the wider opposition, especially the ruling DMK in Tamil Nadu, it remains to be seen what stand the opposition parties take on Monday. Live Events BJP president J P Nadda, while announcing the nomination of Radhakrishnan after a meeting of the party's parliamentary board on Sunday, said the NDA will speak to the opposition parties to reach a consensus for the vice-presidential election. The Congress-led INDIA bloc partners earlier announced their decision to field a joint 'non-political' candidate for the election. The vice-presidential election, necessitated by the sudden resignation of incumbent Jagdeep Dhankhar last month, is scheduled for September 9. The last date for filing nomination is August 21.
Indian Express
40 minutes ago
- Indian Express
Corporate loan growth slows in April-June quarter as firms delay investments, shift to cheaper debt market
Corporate loan growth by domestic banks slowed down in the first quarter of FY26, as companies put off investment decisions. This was largely due to uncertainty around tariffs, weak demand that held back private capital spending, and a shift towards cheaper funding options in the corporate bond market. Additionally, many companies continued to reduce their debt levels, which further dampened loan demand. Between April and June 2025, bank lending to industries grew at the slowest pace in over three years, signalling muted credit demand from the corporate sector. According to RBI data, loans to industries — including micro, small, medium, and large enterprises — rose by 5.49 per cent year-on-year to Rs 39.32 lakh crore, marking the weakest growth since March 2022. In Q1 FY26, the country's largest lender, State Bank of India (SBI), reported a 5.7 per cent Y-o-Y growth in its corporate loan book, but saw a fall of 3 per cent on a Q-o-Q basis. Private sector lenders ICICI Bank and HDFC Bank posted Y-o-Y growth of 7.5 per cent and 1.7 per cent, respectively, in their corporate loan portfolios, but witnessed sequential declines of 1.4 per cent and 1.3 per cent, respectively. A banking analyst noted that this reflects a phase of growth without fresh investment in the economy. The industrial growth as measured by the Index of Industrial Production (IIP) slowed to 2 per cent in April-June 2025, compared to 4 per cent in the previous quarter. According to SBI chairman C S Setty, the tepid growth in the corporate loan book was mainly on account of delay in investment decisions by corporates due to uncertainties caused by the higher tariff announcement by US President Donald Trump in April this year, shift in borrowing from banks to other alternate sources and higher prepayments of loans by corporates. While state-run Bank of Baroda's corporate loan book expanded by 4.2 per cent Y-o-Y , it registered a sharp dip of 10.2 per cent Q-o-Q. Corporate advances of Union Bank of India and Bank of India rose 2.68 per cent and 4.49 per cent y-o-y, respectively, though their books declined 4.83 per cent and 1.5 per cent sequentially in April-June 2025 quarter. Canara Bank and Punjab National Bank's corporate book grew flat at 0.48 per cent and 1.1 per cent, respectively, on a Q-o-Q basis in June 2025 quarter. Bank of Baroda's chief economist Madan Sabnavis attributes weak credit demand from corporates to the slowdown in investments as companies await a revival in demand. The US President had initially announced to impose a 26 per cent tariff on imports of Indian goods, but later declared a 90-day pause, which resulted in corporates holding back on expansions and new investments. He subsequently doubled the tariff on India to 50 per cent. 'An important factor to consider is the uncertainty in terms of how these tariffs are going to play out and how quickly this is going to be addressed. Due to this uncertainty, a lot of investment decisions could be delayed and people will postpone their spending. This is the second order impact of tariffs,' Setty said during a press conference post the declaration of the Q1 FY26 results. Easing rates in the debt market following the Reserve Bank of India's (RBI) 100 basis points (bps) reduction in the repo rate since February has prompted corporates to shift from banks to debt market instruments. 'Some large corporates are accessing the commercial paper (CP) market to replace working capital limits. This is expected because there is a good amount of liquidity (in the CP market). The rates are much more affordable (in the CP market) compared to borrowing from banks,' Setty said. The lender has seen working capital limit utilisation by corporates in his bank falling to 58 per cent from 62 per cent in Q1 FY25. Total funds raised through CP increased to Rs 4.51 lakh crore in April-June 2025 quarter, compared Rs 3.8 lakh crore in same period of FY25, and Rs 4.38 lakh crore in January-March 2025 quarter, according to Besides CPs, companies are also tapping the corporate debt market for cheaper funds compared to bank loans, which has impacted corporate loan growth of banks. In the first quarter of the current fiscal, corporates mobilised Rs 3.42 lakh crore through private placement of bonds, data from showed. 'We believe that funds raised through the bond market are being largely used by corporates to support ongoing business needs rather than for long-term capital investment,' said Saswata Guha, senior director, Financial Institutions (Banks), Fitch Ratings. With access to cheaper funds through CP and corporate bond markets, along with strong cash flows, domestic corporates have continuously reduced their debt, resulting in slower corporate credit growth. 'Corporates having strong cash flows are deleveraging. So, the (credit) demand is not that much because there is a deleveraging happening on the corporate book,' Bank of Baroda's managing director and CEO, Debadatta Chand, said during an analyst meet for the quarter ended June 2025. Lenders have also become prudent in lending to corporates as they do not want to overexpose themselves while expanding their corporate loan book. 'Banks are mindful of risk-return tradeoff and focus on risk-adjusted returns which makes them quite sensitive to pricing. They are also mindful of concentration risk embedded in a corporate exposure,' said Fitch Ratings' Guha. 'While lenders are trying to be more prudent in ensuring that their risk-adjusted returns on corporate exposure are justified, they can do so because retail and small business lending continues to grow healthy,' he said. Banks are hopeful of a stronger growth in corporate advances from the third quarter of the current fiscal. While SBI expects its corporate loan book to grow by 10 per cent in Q3 of FY26, Bank of Baroda is confident of achieving a 9-10 per cent growth in the segment during FY26. 'The shift (for funding from banks to the debt market) has happened, but I think these shifts keep happening. Once the rates stabilize on the bank side, they (corporates) will come back to utilization (of their working capital limits),' the SBI Chairman said. Setty said SBI has a robust visibility on the corporate loan pipeline in terms of proposals under discussion, and on sanctions which are yet to be disbursed. The bank has a total corporate loan book pipeline of Rs 7 lakh crore. For large-scale capex-led funding requirements, corporates will have to return to the banks, as the bond market alone will not be adequate to fulfill those needs, Guha said.
