Experienced software developers assumed AI would save them a chunk of time. But in one experiment, their tasks took 20% longer
It's like a new telling of the 'Tortoise and the Hare': A group of experienced software engineers entered into an experiment where they were tasked with completing some of their work with the help of AI tools. Thinking like the speedy hare, the developers expected AI to expedite their work and increase productivity. Instead, the technology slowed them down more. The AI-free tortoise approach, in the context of the experiment, would have been faster.
The results of this experiment, published in a study this month, came as a surprise to the software developers tasked with using AI—and to the study's authors, Joel Becker and Nate Rush, technical staff members of nonprofit technology research organization Model Evaluation and Threat Research (METR).
The researchers enlisted 16 software developers, who had an average of five years of experience, to conduct 246 tasks, each one a part of projects on which they were already working. For half the tasks, the developers were allowed to use AI tools—most of them selected code editor Cursor Pro or Claude 3.5/3.7 Sonnet—and for the other half, the developers conducted the tasks on their own.
Believing the AI tools would make them more productive, the software developers predicted the technology would reduce their task completion time by an average of 24%. Instead, AI resulted in their task time ballooning to 19% greater than when they weren't using the technology.
'While I like to believe that my productivity didn't suffer while using AI for my tasks, it's not unlikely that it might not have helped me as much as I anticipated or maybe even hampered my efforts,' Philipp Burckhardt, a participant in the study, wrote in a blog post about his experience.
Why AI is slowing some workers down
So where did the hares veer off the path? The experienced developers, in the midst of their own projects, likely approached their work with plenty of additional context their AI assistants did not have, meaning they had to retrofit their own agenda and problem-solving strategies into the AI's outputs, which they also spent ample time debugging, according to the study.
'The majority of developers who participated in the study noted that even when they get AI outputs that are generally useful to them—and speak to the fact that AI generally can often do bits of very impressive work, or sort of very impressive work—these developers have to spend a lot of time cleaning up the resulting code to make it actually fit for the project,' study author Rush told Fortune.
Other developers lost time writing prompts for the chatbots or waiting around for the AI to generate results.
The results of the study contradict lofty promises about AI's ability to transform the economy and workforce, including a 15% boost to U.S. GDP by 2035 and eventually a 25% increase in productivity.
But Rush and Becker have shied away from making sweeping claims about what the results of the study mean for the future of AI.
For one, the study's sample was small and non-generalizable, including only a specialized group of people to whom these AI tools were brand new. The study also measures technology at a specific moment in time, the authors said, not ruling out the possibility that AI tools could be developed in the future that would indeed help developers enhance their workflow.
The purpose of the study was, broadly speaking, to pump the brakes on the torrid implementation of AI in the workplace and elsewhere, acknowledging more data about AI's actual effects need to be made known and accessible before more decisions are made about its applications.
'Some of the decisions we're making right now around development and deployment of these systems are potentially very high consequence,' Rush said. 'If we're going to do that, let's not just take the obvious answer. Let's make high-quality measurements.'
AI's broader impact on productivity
Economists have already asserted that METR's research aligns with broader narratives on AI and productivity. While AI is beginning to chip away at entry-level positions, according to LinkedIn chief economic opportunity officer Aneesh Raman, it may offer diminishing returns for skilled workers such as experienced software developers.
'For those people who have already had 20 years, or in this specific example, five years of experience, maybe it's not their main task that we should look for and force them to start using these tools if they're already well functioning in the job with their existing work methods,' Anders Humlum, an assistant professor of economics at the University of Chicago's Booth School of Business, told Fortune.
Humlum has similarly conducted research on AI's impact on productivity. He found in a working study from May that among 25,000 workers in 7,000 workplaces in Denmark—a country with similar AI uptake as the U.S.—productivity improved a modest 3% among employees using the tools.
Humlum's research supports MIT economist and Nobel laureate Daron Acemoglu's assertion that markets have overestimated productivity gains from AI. Acemoglu argues only 4.6% of tasks within the U.S. economy will be made more efficient with AI.
'In a rush to automate everything, even the processes that shouldn't be automated, businesses will waste time and energy and will not get any of the productivity benefits that are promised,' Acemoglu previously wrote for Fortune. 'The hard truth is that getting productivity gains from any technology requires organizational adjustment, a range of complementary investments, and improvements in worker skills, via training and on-the-job learning.'
The case of the software developers' hampered productivity points to this need for critical thought on when AI tools are implemented, Humlum said. While previous research on AI productivity has looked at self-reported data or specific and contained tasks, data on challenges from skilled workers using the technology complicate the picture.
'In the real world, many tasks are not as easy as just typing into ChatGPT,' Humlum said. 'Many experts have a lot of experience [they've] accumulated that is highly beneficial, and we should not just ignore that and give up on that valuable expertise that has been accumulated.'
'I would just take this as a good reminder to be very cautious about when to use these tools,' he added.
This story was originally featured on Fortune.com
Solve the daily Crossword
Hashtags

Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
2 minutes ago
- Yahoo
AI Could Replace Millions of Jobs: Robert Kiyosaki Shares How To Stay Safe
As artificial intelligence (AI) continues to advance, it will have a significant impact on the workforce as we know it. According to a recent McKinsey report, 30% of hours currently worked across the U.S. economy could be automated by 2030, and a National University report found that 300 million jobs could be lost to AI globally. Check Out: Read Next: 'Rich Dad Poor Dad' author Robert Kiyosaki views this as a major cause for concern, especially for those who are just entering the workforce. 'AI will cause many 'smart students' to lose their jobs,' he shared on X. 'AI will cause massive unemployment. Many still have student loan debt.' However, all hope is not lost, as Kiyosaki offered his advice on how to prevent AI from eliminating your income. Robert Kiyosaki: AI Can't Take a Job That You Don't Have Kiyosaki isn't personally worried that AI advances will affect his cash flow. 'AI cannot fire me because I do not have a job,' he wrote. Kiyosaki bucked a traditional path to wealth and instead relies on his own business and investments for his income. 'Years ago, rather than listen to my poor dad's advice of 'Go to school, get good grades, get a job, pay taxes, get out of debt, save money, and invest in a well-diversified portfolio of stocks, bonds and mutual funds,' I followed my rich dad's advice,' he said. 'I became an entrepreneur, investing in real estate using debt, and instead of saving fake money, I have been saving real gold, silver and, today, bitcoin.' Learn More: Kiyosaki's Advice for AI-Proofing Your Wealth To avoid losing your income to AI, Kiyosaki advised workers to take action now to diversify their income sources. This means meandering off the typical path to wealth and focusing on earning money through entrepreneurship and investments rather than being reliant on an employer. 'Please take proactive action,' he wrote. 'Please do not be a victim of this time in history. Please take care, invest in your self and think for yourself. These are not ordinary times.' More From GOBankingRates 3 Luxury SUVs That Will Have Massive Price Drops in Summer 2025 How Much Money Is Needed To Be Considered Middle Class in Your State? 7 Things You'll Be Happy You Downsized in Retirement This article originally appeared on AI Could Replace Millions of Jobs: Robert Kiyosaki Shares How To Stay Safe


Newsweek
4 minutes ago
- Newsweek
DOGE AI Tool to Target 100K Federal Rules for Elimination: Report
Based on facts, either observed and verified firsthand by the reporter, or reported and verified from knowledgeable sources. Newsweek AI is in beta. Translations may contain inaccuracies—please refer to the original content. The Department of Government Efficiency (DOGE) is reportedly using a newly developed artificial intelligence (AI) tool to accelerate the rollback of federal regulations, with a stated goal of eliminating 50 percent of all federal rules by the first anniversary of President Donald Trump's second inauguration, according to a Saturday report from The Washington Post. Internal documents reviewed by the newspaper, along with interviews with four government officials familiar with the project, reveal an ambitious timeline and a wide-ranging use of the tool across various agencies. Newsweek has reached out to the White House for comment via email on Saturday. Why It Matters DOGE was created by Trump through an executive order to improve efficiency and reduce waste in the federal government. It was led by billionaire Elon Musk who departed the administration in May. The reported plan represents one of the most aggressive attempts by the Trump administration to overhaul the federal regulatory system. By automating the deregulation process, the administration aims to reduce government spending and compliance burdens significantly. However, the use of AI to interpret complex legal language and determine regulatory necessity raises legal and practical concerns, particularly regarding accuracy, oversight, and the future role of civil servants in shaping public policy, according to the Post. What to Know The "DOGE AI Deregulation Decision Tool," developed by engineers brought into government under Elon Musk's DOGE initiative, is programmed to scan about 200,000 existing federal rules and flag those that are either outdated or not legally required. According to a PowerPoint presentation dated July 1 that was obtained by the newspaper, the tool estimates that approximately 100,000 of those rules could be eliminated, primarily through automation with minimal human input. The projection claims this could save trillions in compliance costs and spark increased external investment. At the Department of Housing and Urban Development (HUD), AI has already reviewed over 1,000 regulatory sections in under two weeks. Similarly, it was responsible for "100% of deregulations" at the Consumer Financial Protection Bureau (CFPB), according to the PowerPoint presentation. The Post, however, reported it was not able to confirm the use of AI at the agency independently. When asked about the use of AI for deregulation, White House spokesman Harrison Fields emphasized to the newspaper that "all options are being explored" to meet the president's deregulation goals. He clarified that no single plan has been finalized, and the effort is still in early, creative stages with ongoing consultation within the White House. DOGE plans to complete agency-specific deregulation lists by September 1 and finish nationwide rollout by January 20, 2026—labeled in internal documents as "Relaunch America." Agencies are currently receiving training on how to integrate the AI tool into their regulatory review process. The presentation claims the tool could save 93 percent of the labor typically required to gut federal rules, reducing what would usually take 3.6 million work hours to just 36. Despite these goals, some federal employees expressed concern about accuracy. One HUD employee told the Post that the AI misinterpreted statutes and flagged legal language as non-compliant when it was accurate. HUD confirmed to the newspaper that while the agency is exploring AI to streamline efficiency, the system is not intended to replace expert judgment. The push to eliminate regulations is not new for Trump. In January, he issued an executive order mandating the repeal of 10 rules for every new one added. Departments like Transportation and Labor have already reported dozens of regulatory cuts. However, experts question whether such repeals will withstand scrutiny under the Administrative Procedure Act, which governs the legal process for rescinding rules. Previous attempts to bypass procedural safeguards—such as Trump's reversal of showerhead regulations—have faced legal scrutiny. DOGE's lawyers have reportedly vetted the tool, but concerns remain about whether its recommendations will be upheld in court or trusted by the private sector. While DOGE initially tried to play a leading role in the deregulation campaign, internal resistance from federal employees has slowed momentum. Agencies questioned DOGE's subject matter expertise and hesitated to outsource rulemaking authority to a third-party system. Moreover, the administration's efforts to downsize the federal workforce have hampered its ability to implement the deregulation strategy. An American flag waves at the U.S. Capitol Building on June 10 in Washington, D.C. An American flag waves at the U.S. Capitol Building on June 10 in Washington, People Are Saying Nicholas Bagley, a law professor at the University of Michigan, told The Washington Post about Trump's unilateral efforts to cut regulations: "There's been some flashy sideshow efforts to avoid the legal strictures, but in general, they don't stick." White House spokesman Harrison Fields wrote in an email obtained by The Washington Post: "The DOGE experts creating these plans are the best and brightest in the business and are embarking on a never-before-attempted transformation of government systems and operations to enhance efficiency and effectiveness." What Happens Next? Over the next several months, agencies will use the DOGE AI tool to select rules for repeal, respond to public comments, and finalize deregulation plans. Whether the courts, the public, and the agencies themselves accept that transformation remains uncertain.
Yahoo
32 minutes ago
- Yahoo
AI Could Replace Millions of Jobs: Robert Kiyosaki Shares How To Stay Safe
As artificial intelligence (AI) continues to advance, it will have a significant impact on the workforce as we know it. According to a recent McKinsey report, 30% of hours currently worked across the U.S. economy could be automated by 2030, and a National University report found that 300 million jobs could be lost to AI globally. Check Out: Read Next: 'Rich Dad Poor Dad' author Robert Kiyosaki views this as a major cause for concern, especially for those who are just entering the workforce. 'AI will cause many 'smart students' to lose their jobs,' he shared on X. 'AI will cause massive unemployment. Many still have student loan debt.' However, all hope is not lost, as Kiyosaki offered his advice on how to prevent AI from eliminating your income. Robert Kiyosaki: AI Can't Take a Job That You Don't Have Kiyosaki isn't personally worried that AI advances will affect his cash flow. 'AI cannot fire me because I do not have a job,' he wrote. Kiyosaki bucked a traditional path to wealth and instead relies on his own business and investments for his income. 'Years ago, rather than listen to my poor dad's advice of 'Go to school, get good grades, get a job, pay taxes, get out of debt, save money, and invest in a well-diversified portfolio of stocks, bonds and mutual funds,' I followed my rich dad's advice,' he said. 'I became an entrepreneur, investing in real estate using debt, and instead of saving fake money, I have been saving real gold, silver and, today, bitcoin.' Learn More: Kiyosaki's Advice for AI-Proofing Your Wealth To avoid losing your income to AI, Kiyosaki advised workers to take action now to diversify their income sources. This means meandering off the typical path to wealth and focusing on earning money through entrepreneurship and investments rather than being reliant on an employer. 'Please take proactive action,' he wrote. 'Please do not be a victim of this time in history. Please take care, invest in your self and think for yourself. These are not ordinary times.' More From GOBankingRates 3 Luxury SUVs That Will Have Massive Price Drops in Summer 2025 How Much Money Is Needed To Be Considered Middle Class in Your State? 7 Things You'll Be Happy You Downsized in Retirement This article originally appeared on AI Could Replace Millions of Jobs: Robert Kiyosaki Shares How To Stay Safe Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data