AI slows down some experienced software developers, study finds
AI research nonprofit METR conducted the in-depth study, opens new tab on a group of seasoned developers earlier this year while they used Cursor, a popular AI coding assistant, to help them complete tasks in open-source projects they were familiar with.
Before the study, the open-source developers believed using AI would speed them up, estimating it would decrease task completion time by 24%. Even after completing the tasks with AI, the developers believed that they had decreased task times by 20%. But the study found that using AI did the opposite: it increased task completion time by 19%.
The study's lead authors, Joel Becker and Nate Rush, said they were shocked by the results: prior to the study, Rush had written down that he expected 'a 2x speed up, somewhat obviously.'
The findings challenge the belief that AI always makes expensive human engineers much more productive, a factor that has attracted substantial investment into companies selling AI products to aid software development.
AI is also expected to replace entry-level coding positions. Dario Amodei, CEO of Anthropic, recently told Axios that AI could wipe out half of all entry-level white collar jobs in the next one to five years.
Prior literature on productivity improvements has found significant gains: one study found using AI sped up coders by 56%, opens new tab, another study found developers were able to complete 26% more tasks, opens new tab in a given time.
But the new METR study shows that those gains don't apply to all software development scenarios. In particular, this study showed that experienced developers intimately familiar with the quirks and requirements of large, established open source codebases experienced a slowdown.
Other studies often rely on software development benchmarks for AI, which sometimes misrepresent real-world tasks, the study's authors said.
The slowdown stemmed from developers needing to spend time going over and correcting what the AI models suggested.
'When we watched the videos, we found that the AIs made some suggestions about their work, and the suggestions were often directionally correct, but not exactly what's needed,' Becker said.
The authors cautioned that they do not expect the slowdown to apply in other scenarios, such as for junior engineers or engineers working in codebases they aren't familiar with.
Still, the majority of the study's participants, as well as the study's authors, continue to use Cursor today. The authors believe it is because AI makes the development experience easier, and in turn, more pleasant, akin to editing an essay instead of staring at a blank page.
'Developers have goals other than completing the task as soon as possible,' Becker said. 'So they're going with this less effortful route.'
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
The Sun
a minute ago
- The Sun
How I use the three secret buttons on my iPhone to ‘hack' my sleep, road trips, holidays & save time every day
YOUR iPhone has a bunch of secret buttons – and they'll change the way you use your phone every day. There are clever tricks for road trips, going on holiday, and even there's one time-saving trick you'll wonder how you lived without. 7 7 I've been hunting for hidden iPhone hacks for years, and there are a few that are easily missed. That includes these three secret buttons you might never have even heard of. SECRET BUTTON 1 – ACCESSIBILITY SHORTCUT First up is the Accessibility Shortcut, which is hiding in plain sight on the outside of your iPhone. You know the Side Button? It's the one that you use to lock your iPhone with a click, or to pull up Siri by holding down. Well it has a secret function that you can trigger by clicking it three times. And you can change that function by going into Settings > Accessibility > Accessibility Shortcut. I usually have mine set to one of two things. My main pick is Background Sounds, which makes my iPhone play rain noises. This is great when you need to shut out the outside world. It also works in the background of podcasts too, which is nice. And it's a handy way to get off to sleep, if you struggle with that. iPhone 16e review – I've secretly tested Apple's cheapest mobile and I love the new button but that's not the best bit You can also change the sound that it plays by going into Settings > Accessibility > Audio & Visual > Background Sounds. A second option is setting Accessibility Shortcut to Vehicle Motion Cues. This puts moving dots on the screen to try to help you avoid motion sickness when you're in a car. The dots match the motion of the vehicle to give your eyes a reference point, reducing the effect that triggers the nausea. I tested Vehicle Motion Cues on a road trip earlier this year, and I was impressed with the results. 7 SECRET BUTTON 2 – BACK TAP Another very handy option is Back Tap, which turns the back of your mobile into a button. You choose a function, and then you can trigger it by tapping the back of your phone. Better yet, you can have one function for a double-tap, and then a different one for a triple-tap. 7 To find it, just go to Settings > Accessibility > Touch > Back Tap. There are loads of choices. For double-tap, I've got it set to take a screenshot. You'll use this every day – it's just so handy. And for triple-tap, I have it on Shazam. That's the clever feature that identifies a song that's playing nearby – maybe on the radio or in a shop. 7 SECRET BUTTON 3 – LOCK SCREEN SWAP How often do you use your phone's torch? Probably not enough to need a shortcut on the Lock Screen for constant access. Well in iOS 18 (go to Settings > General > Software Update to see if you've got the update), you can swap out the torch and camera icons for something else. The camera is pretty useful (unless you've got a newer iPhone with the built-in camera button). 7 But you can probably get away with swapping out the torch, as you can access that via the Control Centre or Siri easily enough. Just hold down on the Lock Screen, tap customise, choose Lock Screen, then tap on the torch to replace it. I've got mine set to open my Reminders app, because I use it all the time. But you can have it open almost any app, or perform loads of different functions. If one doesn't exist, you can tap on Shortcuts to create exactly what you want it to do. 7 A good option for holidays is setting it to launch the Translate app, but the choice is totally yours. And if you decide you hate it, you can always go back to the plain old torch. IT'S WORTH IT, I PROMISE! Here's some advice from The Sun's tech editor Sean Keach... These tricks are genuinely useful – but you'll have to stick with them. We've all been using our iPhones the same way for years. So changing a daily habit can be difficult, and might feel awkward at first. Like the screenshot trick above: you've been doing screengrabs one way for an age, so moving to something else might feel weird at first. But having switched to this method, it's so much easier. And by grabbing the new habit, I've found myself using Back Tap to open Shazam a lot more too. It's a similar story for changing your Lock Screen shortcuts. At first, it'll feel totally weird – but after a few weeks, you'll wonder how you lived the old way. Stick with it, and it's worth it. I promise.
Times
a minute ago
- Times
Xi, not Trump, has the most power over Putin. Will he use it?
P resident Trump seems finally to have lost patience with President Putin. On Monday he said that he was 'very disappointed' with the Russian leader and gave him 50 days to declare a ceasefire. But while Putin measures his response to the rhetoric from Washington (and he has given no indication of concern so far) Trump's actions have brought a third figure into the psychodrama — President Xi of China. And Xi is the one with most to gain. The Kremlin had feared Trump would be more forceful and a relieved Moscow stock exchange jumped sharply. Along with a desire to encourage Europeans to buy US-made weapons to support Ukraine (France, Italy and the Czech Republic have already declined), Trump's main initiative was to give Putin 50 days to end the fighting or he would turn to his favourite geopolitical instrument: tariffs.
Daily Mail
a minute ago
- Daily Mail
Woman in Coldplay viral clip is married to a powerful CEO
Kristin Cabot appears to have a taste for powerful men, with confirming that the HR chief is currently married to another CEO – despite being caught canoodling with her boss. Cabot was caught in a moment of intimacy during a Coldplay concert in Boston with Astronomer CEO Andy Byron. The 52-year-old is the Head of People at the company, and the pair tried to hide when the kiss-cam panned to them at Boston's Gillette Stadium on Tuesday night. Speculation has been rife as to whether the couple were in fact desperate to hide from their spouses. The band's frontman Chris Martin did them no favors, joking to the packed stadium of fans: 'They're either having an affair... or are very shy.' But can confirm that Cabot in fact is currently married, and picture her with her CEO husband for the first time. Massachusetts property documents dated in January confirmed that Cabot is currently married to Andrew Cabot, the chief executive of Privateer Rum, a Massachusetts-based booze maker. It is unclear exactly when the pair tied the knot, but the documents confirm that Kristin, whose maiden name is Stanek, was married at the time of selling a $1.8m property in Watertown, Mass., earlier this year. Privateer Rum's website lists Andrew Cabot as its CEO and COO of the company, and public documents show that he has been married at least twice before, in 1993 and 2014. He shares two children with his first wife Maud, who shared a picture of her ex-husband with Kristin looking loved up at his daughter's 25th birthday party on social media in April of last year. Kristin even posed with his son Henry, 30, in the snaps, and was seen wearing a wedding ring at the event – which was missing during her cozy Coldplay date with Byron. The couple are also referred to as 'husband and wife' in New Hampshire property records, buying a $2.2 million two-story, four-bedroom New Englander-style house in Rye, in February. They sold another four-bedroom property nearby for $1.05m in February, after purchasing it in April of last year. Kristin's now-deleted LinkedIn account showed that she has served as an 'advisory board member' at Privateer Rum since September 2020. Cabot filed for divorce from his second wife Julie in 2018, after marrying in 2014, citing irreconcilable differences. Both he and his first wife Maud filed for divorce jointly in 2013, after separating in 2011. Kristin has been married once before, filing for divorce from Ken Thornby in 2018, which was finalized in 2020. Byron is also married, with his wife Megan Byron removing his last name from her social media accounts shortly after the exchange with Chris Martin went viral. Kristin, Cabot, and Byron have not responded immediately to a request for comment by It comes after AI-tech start-up Astronomer said they have launched a formal investigation into the moment of intimacy. 'Our leaders are expected to set the standard in both conduct and accountability,' they said in a statement. 'The Board of Directors has initiated a formal investigation into this matter and we will have additional details to share very shortly.' It remains unclear how much – if anything – Astronomer knew of their closeness. The company has not clarified whether the pair still have jobs, or if they'll be placed on leave. Byron's firm is valued at over $1 billion, with the company experiencing rapid growth since he became CEO in 2023. That year, Astronomer reported a 292% growth in revenue for its 'Astro' platform. Just a week before his unfortunate viral fame, Byron appeared on New York Stock Exchange (NYSE) TV to celebrate the company after it raised $93 million in its Series D round of financing. A beaming Byron described the investment as 'a huge opportunity' and 'very exciting' for the firm. When Cabot joined the firm as HR boss in November 2024, Byron heaped praise on her, saying she would be a 'perfect fit' at his company. 'Kristin's exceptional leadership and deep expertise in talent management, employee engagement, and scaling people strategies will be critical as we continue our rapid trajectory,' he said in a press release at the time. 'She is a proven leader at multiple growth-stage companies and her passion for fostering diverse, collaborative workplaces makes her a perfect fit for Astronomer.'
