logo
AI slows down some experienced software developers, study finds

AI slows down some experienced software developers, study finds

Straits Times11-07-2025
Sign up now: Get ST's newsletters delivered to your inbox
The study found that using AI increased task completion time by 19 per cent.
SAN FRANCISCO - Contrary to popular belief, using cutting-edge artificial intelligence tools slowed down experienced software developers when they were working in codebases familiar to them, rather than supercharging their work, a new study found.
AI research nonprofit METR conducted the in-depth study on a group of seasoned developers earlier this year while they used Cursor, a popular AI coding assistant, to help them complete tasks in open-source projects they were familiar with.
Before the study, the open-source developers believed using AI would speed them up, estimating it would decrease task completion time by 24 per cent.
Even after completing the tasks with AI, the developers believed that they had decreased task times by 20 per cent. But the study found that using AI did the opposite: it increased task completion time by 19 per cent.
The study's lead authors, Mr Joel Becker and Mr Nate Rush, said they were shocked by the results: prior to the study, Mr Rush had written down that he expected 'a 2x speed up, somewhat obviously'.
The findings challenge the belief that AI always makes expensive human engineers much more productive, a factor that has attracted substantial investment into companies selling AI products to aid software development.
AI is also expected to replace entry-level coding positions. Mr Dario Amodei, CEO of Anthropic, recently told Axios that AI could wipe out half of all entry-level white collar jobs in the next one to five years.
Prior literature on productivity improvements has found significant gains: one study found using AI sped up coders by 56 per cent, another study found developers were able to complete 26 per cent more tasks in a given time.
But the new METR study shows that those gains don't apply to all software development scenarios. In particular, this study showed that experienced developers intimately familiar with the quirks and requirements of large, established open source codebases experienced a slowdown.
Other studies often rely on software development benchmarks for AI, which sometimes misrepresent real-world tasks, the study's authors said.
The slowdown stemmed from developers needing to spend time going over and correcting what the AI models suggested.
'When we watched the videos, we found that the AIs made some suggestions about their work, and the suggestions were often directionally correct, but not exactly what's needed,' Mr Becker said.
The authors cautioned that they do not expect the slowdown to apply in other scenarios, such as for junior engineers or engineers working in codebases they aren't familiar with.
Still, the majority of the study's participants, as well as the study's authors, continue to use Cursor today. The authors believe it is because AI makes the development experience easier, and in turn, more pleasant, akin to editing an essay instead of staring at a blank page.
'Developers have goals other than completing the task as soon as possible,' Mr Becker said. 'So they're going with this less effortful route.' REUTERS
Orange background

Try Our AI Features

Explore what Daily8 AI can do for you:

Comments

No comments yet...

Related Articles

Britain condemns Hong Kong's reward offers for suspects living in Britain
Britain condemns Hong Kong's reward offers for suspects living in Britain

Straits Times

time34 minutes ago

  • Straits Times

Britain condemns Hong Kong's reward offers for suspects living in Britain

Find out what's new on ST website and app. British Foreign Secretary David Lammy condemned Hong Kong authorities for offering payment in exchange for assisting in the arrest of pro-democracy activists living in Britain. LONDON - Britain on July 25 condemned Hong Kong authorities for offering payment in exchange for assisting in the arrest of pro-democracy activists living in Britain. 'The Hong Kong Police Force's issuing of further arrest warrants and bounties on individuals living in the UK is another example of transnational repression,' Foreign Secretary David Lammy and Home Secretary Yvette Cooper said in a joint statement. Hong Kong authorities announced on July 25 that they are offering cash rewards for information leading to the arrest of 19 pro-democracy activists based abroad, accused of violating the national security law imposed by Beijing in 2020. The bounties range from about US$25,000 (S$32,000) to US$125,000, depending on the individual Hong Kong seeks. This is the fourth time Hong Kong authorities have made this type of appeal, which has already drawn strong criticism from Western countries, which China in turn has denounced as 'interference'. In their statement, Mr Lammy and Ms Cooper called on China to stop targeting opposition voices in Britain. Around 150,000 Hong Kong nationals migrated to the UK under a special visa scheme introduced in 2021. Top stories Swipe. Select. Stay informed. Asia Cambodia calls for ceasefire with Thailand after deadly clashes Asia 'Nothing like this has happened before': At least 16 dead as Thai-Cambodian conflict continues Multimedia Lights dim at South-east Asia's scam hub but 'pig butchering' continues Singapore SMRT to pay lower fine of $2.4m for EWL disruption; must invest at least $600k to boost reliability Business Banking and finance jobs will change but won't disappear as AI becomes the new normal: Accenture Singapore Tipsy Collective sues former directors, HR head; alleges $14m lost from misconduct, poor decisions Asia Hottest 'ticket' in Jakarta? Young Indonesians compete for a slot at singing club Singapore Kopi, care and conversation: How this 20-year-old helps improve the well-being of the elderly But a recent proposal by the British government to reform extradition rules has sparked serious concerns, with some fearing it could pave the way for a resumption of extraditions to Hong Kong, which have been suspended since the 2020 national security law was enacted. In their statement, the two British ministers said 'this Government will continue to stand with the people of Hong Kong, including those who have made the UK their home. We take the protection of their rights, freedoms, and safety very seriously'. AFP

Meta names ChatGPT co-creator as chief scientist of Superintelligence Lab
Meta names ChatGPT co-creator as chief scientist of Superintelligence Lab

CNA

time2 hours ago

  • CNA

Meta names ChatGPT co-creator as chief scientist of Superintelligence Lab

NEW YORK :Meta Platforms has appointed Shengjia Zhao, co-creator of ChatGPT, as chief scientist of its Superintelligence Lab, CEO Mark Zuckerberg said on Friday, as the company accelerates its push into advanced AI. "In this role, Shengjia will set the research agenda and scientific direction for our new lab working directly with me and Alex," Zuckerberg wrote in a Threads post, referring to Meta's Chief AI Officer Alexandr Wang, who Zuckerberg hired from startup Scale AI when Meta took a big stake in it. Zhao, a former research scientist at OpenAI, co-created ChatGPT, GPT-4 and several of OpenAI's mini models, including 4.1 and o3. He is among several researchers who have moved from OpenAI to Meta in recent weeks, part of a broader talent arms race as Zuckerberg aggressively hires from rivals to close the gap in advanced AI. Meta has been offering some of Silicon Valley's most lucrative pay packages and striking startup deals to attract top researchers, a strategy that follows the underwhelming performance of its Llama 4 model. Meta launched the Superintelligence Lab recently to consolidate work on its Llama models and long‑term artificial general intelligence ambitions. Zhao is a co-founder of the lab, according to the Threads post, which operates separately from FAIR, Meta's established AI research division led by deep learning pioneer Yann LeCun. Zuckerberg has said Meta aims to build 'full general intelligence' and release its work as open source — a strategy that has drawn both praise and concern within the AI community.

Tesla gets multiple shareholder proposals related to investment in xAI
Tesla gets multiple shareholder proposals related to investment in xAI

CNA

time2 hours ago

  • CNA

Tesla gets multiple shareholder proposals related to investment in xAI

Tesla said on Friday it has received a number of shareholder proposals regarding the automaker investing in CEO Elon Musk's artificial intelligence startup xAI. Musk earlier in July ruled out a merger between Tesla and xAI but said he plans to hold a shareholder vote on investment in the startup by the automaker. Tesla, which will hold its annual shareholder meeting on November 6, said it will only include one proposal on each topic in its proxy statement, in accordance with SEC rules. Earlier this month, the board set July 31 as the deadline for the submission of shareholder proposals to be included in the proxy statement.

DOWNLOAD THE APP

Get Started Now: Download the App

Ready to dive into a world of global content with local flavor? Download Daily8 app today from your preferred app store and start exploring.
app-storeplay-store