Does AI Speed Up Coding? New Study Finds Surprising Results
For the study, METR measured the speed of 16 developers, having an average experience of five years, working on complex software projects, both with and without AI assistance. When the use of AI tools was allowed, the developers primarily used Cursor Pro, a popular code editor, and Claude 3.5/3.7 Sonnet.
"Before starting tasks, developers forecast that allowing AI will reduce completion time by 24 per cent. After completing the study, developers estimate that allowing AI reduced completion time by 20 per cent," the study highlighted.
However, the results were surprisingly opposite. The researchers found that when developers use AI tools, they take 19 per cent longer than without -- suggesting AI was making them slower.
The study's authors urged readers not to generalise too broadly from the results. For one, the study only measured the impact of Large Language Models (LLMs) on experienced coders, not new ones, who might benefit more from their help.
"Although the influence of experimental artifacts cannot be entirely ruled out, the robustness of the slowdown effect across our analyses suggests it is unlikely to primarily be a function of our experimental design."
The rapid advancement of artificial intelligence (AI) in recent years has led experts to claim that software engineering jobs could soon be fully outsourced to AI agents. Despite the study suggesting that coding with AI was taking more time, companies are unlikely to stop spending resources on perfecting AI coding.
Last year, during Google's Q3 2024 earnings call, CEO Sundar Pichai revealed that AI systems now generate more than a quarter of new code for its products, with human programmers overseeing the computer-generated contributions.
"Today, more than a quarter of all new code at Google is generated by AI, then reviewed and accepted by engineers. This helps our engineers do more and move faster," said Mr Pichai at the time.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Mint
an hour ago
- Mint
Trump goes to bat for big tech in global trade talks
The Trump administration is using its global trade wars to advance the interests of the U.S. technology industry, seeking to prevent foreign countries from targeting American internet firms. The administration hopes to use the threat of tariffs and access to the U.S. economy to stop multiple countries from imposing new taxes, regulations and tariffs on American tech companies and their products ahead of a self-imposed Aug. 1 deadline, when higher levies are scheduled to take effect for dozens of trading partners. Measures targeting America's internet giants remain a sticking point in discussions with Brazil, South Korea and the European Union, according to people familiar with the discussions. Treasury Secretary Scott Bessent and U.S. Trade Representative Jamieson Greer are scheduled to meet Friday in Washington with South Korea's trade and finance ministers. President Trump's abrupt termination of trade talks with Canada last month over that country's proposed digital-services tax highlighted his administration's focus on the dominance of the American tech sector. Canada quickly rescinded the tax to salvage trade discussions. The emphasis on protecting America's internet companies abroad follows a yearslong campaign by tech companies, which have warned that what they call unfair taxes and regulations overseas could restrict the amount they can invest in the U.S. The U.S. approach to foreign digital taxes represents a win for an industry that nevertheless faces issues with the Trump administration domestically, including antitrust challenges and the impact of tariffs on their businesses. 'The companies have done a very good job at making the big tech agenda America first," said Nu Wexler, a public affairs consultant who previously worked at tech companies including Meta Platforms and Google. Many companies and executives donated millions of dollars to Trump's inauguration. Google CEO Sundar Pichai was among tech leaders in attendance for President Trump's inauguration in January. Tech companies have found allies on digital trade in Commerce Secretary Howard Lutnick, Bessent and Greer. In the deal with Indonesia, U.S. negotiators secured commitments that the Jakarta government would drop plans to tariff electronic goods such as movies or software downloads. Similar commitments have been secured from Vietnam, say people familiar with the plans, though the administration has yet to release documentation of that deal. The administration is committed to delivering on Trump's pledge to defend innovative U.S. companies from unfair practices overseas, White House spokesman Kush Desai said. Brazil is focused on resuming trade talks, not retaliatory measures, a government official said. The European Commission, which is in charge of EU trade policy, declined to comment. The South Korean and Vietnamese embassies didn't respond to requests for comment. Veterans of the first Trump term say the president has long opposed efforts from other countries to tax and regulate U.S. tech companies, even as he often battles them on the home front. Trump 'sees this as a way for other countries to grab revenue unfairly from U.S. companies," said Everett Eissenstat, a former deputy director of the National Economic Council. When the European Union imposed hefty fines on Google and other tech companies in his first term, Trump referred to the bloc's then-competition czar as a 'tax lady" who 'really hates the U.S." The U.S. initiated probes of digital taxes in countries including France in 2019 that stalled during the Biden administration. Countries have long tried to allocate more of Silicon Valley's profits from digital advertising and online activities to their territories. Many are ramping up regulations for taking down misinformation, promoting transparency and keeping minors safe online. Some are trying to strengthen antitrust laws. Vice President JD Vance attended an AI summit in February in Paris. The Biden administration hoped a multilateral process would address digital-services taxes, but that effort stalled. Many tech executives felt former President Biden ignored the rise of overseas regulations. 'The U.S. government has finally acknowledged there is a fire we must put out," said Matt Schruers, chief executive officer of the Computer & Communications Industry Association trade group. Skeptics say the administration is battling for an already thriving industry that doesn't need its support while overlooking other segments of the economy that are more exposed to tariffs. Democrats have criticized Trump's ties to tech and cryptocurrency executives. After Trump was elected the second time, tech leaders including Meta CEO Mark Zuckerberg and Google's Sundar Pichai made pilgrimages to Trump's Mar-a-Lago club in Florida. Curbing what they said were harmful policies overseas consistently came up in the conversations, people familiar with the conversations said. As administration officials threatened eye-watering tariffs on goods from many countries, they also demanded that those governments relax some of their tech restrictions. In March, India withdrew its digital-services tax. India and the U.S. are still negotiating, but Trump has said he thinks a deal is close. Canada's digital tax was seen as a bellwether because it could have encouraged other countries to follow through on similar measures. Ottawa's levy was expected to cost U.S. tech companies about $3 billion and included a retroactive component back to 2022. President Trump and Canadian Prime Minister Mark Carney last month at the G-7 summit in Alberta, Canada. In late June, Trump and Canadian Prime Minister Mark Carney clashed over the digital tax at a Group of Seven summit in Canada. Some tech companies were preparing to make the payments when Trump stepped in just before the deadline. The two sides haven't yet reached a trade deal, and Carney has indicated U.S. tariffs might remain in place even with an agreement. Last week, shortly after Trump said he would impose 50% tariffs on Brazilian goods, Greer initiated a tariff investigation on Brazil under a section of U.S. trade law targeting unfair trade practices. Trump cited the country's legal action against Jair Bolsonaro, Brazil's former president and one his political allies. The investigation includes Brazil's digital-trade and electronic-payments practices, the latest salvo cheered by the tech sector. 'This is a very acute focus right now," CCIA's Schruers said. Write to Amrith Ramkumar at and Gavin Bade at
Time of India
an hour ago
- Time of India
US stocks end mixed; GM slumps as tariffs bite
Wall Street shares ended mixed on Tuesday, with steep losses in General Motors and a gain in Tesla as investors focused on recent and upcoming quarterly reports and watched for signs of progress in U.S. trade discussions . GM tumbled after the automaker reported a $1 billion hit from tariffs to its quarterly results, adding more fuel to investor concerns about U.S. President Donald Trump's global trade policy. Shares of Ford Motor also fell. Tesla climbed a day before its quarterly report, while Alphabet, also reporting on Wednesday, also rose. Optimism about heavy spending on artificial intelligence has underpinned a rally in Wall Street's most valuable companies, with the S&P 500 trading around record highs. Explore courses from Top Institutes in Please select course: Select a Course Category Data Science Data Science Finance healthcare Cybersecurity Others PGDM MBA CXO Public Policy Project Management Product Management Operations Management MCA Digital Marketing Healthcare Artificial Intelligence Management Leadership Degree Design Thinking others Technology Data Analytics Skills you'll gain: Duration: 11 Months E&ICT Academy, Indian Institute of Technology Guwahati CERT-IITG Postgraduate Cert in AI and ML India Starts on undefined Get Details Skills you'll gain: Duration: 10 Months E&ICT Academy, Indian Institute of Technology Guwahati CERT-IITG Prof Cert in DS & BA with GenAI India Starts on undefined Get Details Skills you'll gain: Duration: 11 Months IIT Madras CERT-IITM Advanced Cert Prog in AI and ML India Starts on undefined Get Details Skills you'll gain: Duration: 30 Weeks IIM Kozhikode SEPO - IIMK-AI for Senior Executives India Starts on undefined Get Details Skills you'll gain: Duration: 10 Months IIM Kozhikode CERT-IIMK DABS India Starts on undefined Get Details by Taboola by Taboola Sponsored Links Sponsored Links Promoted Links Promoted Links You May Like Access all TV channels anywhere, anytime Techno Mag Learn More Undo "The market is consolidating recent gains and is in a bit of a holding pattern with some huge catalysts over the next week or two, including the August 1 tariff deadline and a lot of important Magnificent Seven earnings," said Ross Mayfield, an investment strategy analyst at Baird. Other Big Tech stocks lost ground, with Meta Platforms and Microsoft both closing lower. Shares of RTX dropped after the aerospace and defense giant took a hit from Trump's trade war despite strong demand for its engines and aftermarket services. Lockheed Martin tumbled after its quarterly profit plunged by about 80%. U.S. trade policy remains a major point of uncertainty for investors and companies as Trump's self-imposed August 1 deadline for many countries to reach agreements with the White House approaches. U.S. Treasury Secretary Scott Bessent said he would meet his Chinese counterpart next week to discuss an extension to the August 12 deadline set for tariffs on imports from China. Other trade negotiations appeared stalled, with optimism for a breakthrough deal with India waning and EU officials weighing countermeasures against the United States. Live Events According to preliminary data, the S&P 500 gained 4.30 points, or 0.07%, to end at 6,309.90 points, while the Nasdaq Composite lost 81.24 points, or 0.39%, to 20,892.93. The Dow Jones Industrial Average rose 175.77 points, or 0.40%, to 44,498.84. Philip Morris slumped after reporting second-quarter revenue below expectations, as shipments of its ZYN nicotine pouches disappointed investors. Analysts on average expected S&P 500 companies to report a 7% increase in earnings for the second quarter, with technology heavyweights driving much of that gain, according to LSEG I/B/E/S. After last week's mixed economic data, traders have all but ruled out an interest-rate cut from the U.S. Federal Reserve at next week's policy meeting. They now see about a 60% chance of a reduction in September, according to the CME's FedWatch tool.
Economic Times
2 hours ago
- Economic Times
AI will be ready to manage your money in 5 years: Andrew Lo
A year ago, Andrew Lo asked ChatGPT for its opinion on Moderna, a biotech stock that soared during the pandemic era. The advice: sell. He didn't. The stock plunged. ADVERTISEMENT Now Lo, a finance professor at the Massachusetts Institute of Technology and leading AI expert, believes the same kind of technology that nailed the stock call could soon do far more. Not just dispense advice, but manage money, balance risk, tailor strategies-and meet one of finance's highest duties: acting in a client's best interest. Within five years, he predicts, large language models will have the technical capability to make real investment decisions on behalf of clients. Lo, 65, has long bridged the worlds of finance and technology. He co-founded QLS Advisors, a firm that applies machine learning to health care and asset management, and helped pioneer quantitative investing when it was still viewed as fringe. He believes that generative AI, despite its flaws, is fast approaching the capacity to parse complex market dynamics, weigh long-term risks, and earn the kind of trust typically reserved for human advisers. "This could be in the form of the so-called agent AI where we have agents that are working on our behalf and making decisions on our behalf in an automated fashion," Lo said in an interview. "I believe that within the next five years we're going to see a revolution in how humans interact with AI." The idea still sounds radical on Wall Street, where ChatGPT-style tools are mostly confined to junior-level work such as data collection and analysis. Yet Lo's vision goes beyond that: under the right regulatory guardrails, AI could evolve from a hard-working but rigid researcher to meet one of finance's highest bars: the fiduciary standard.
