AI firms ‘unprepared' for dangers of building human-level systems, report warns
The Future of Life Institute (FLI) said none of the firms on its AI safety index scored higher than a D for 'existential safety planning'.
One of the five reviewers of the FLI's report said that, despite aiming to develop artificial general intelligence (AGI), none of the companies scrutinised had 'anything like a coherent, actionable plan' to ensure the systems remained safe and controllable.
AGI refers to a theoretical stage of AI development at which a system is capable of matching a human in carrying out any intellectual task. OpenAI, the developer of ChatGPT, has said its mission is to ensure AGI 'benefits all of humanity'. Safety campaigners have warned that AGI could pose an existential threat by evading human control and triggering a catastrophic event.
The FLI's report said: 'The industry is fundamentally unprepared for its own stated goals. Companies claim they will achieve artificial general intelligence (AGI) within the decade, yet none scored above D in existential safety planning.'
The index evaluates seven AI developers – Google DeepMind, OpenAI, Anthropic, Meta, xAI and China's Zhipu AI and DeepSeek – across six areas including 'current harms' and 'existential safety'.
Anthropic received the highest overall safety score with a C+, followed by OpenAI with a C and Google DeepMind with a C-.
The FLI is a US-based non-profit that campaigns for safer use of cutting-edge technology and is able to operate independently due to an 'unconditional' donation from crypto entrepreneur Vitalik Buterin.
SaferAI, another safety-focused non-profit, also released a report on Thursday warning that advanced AI companies have 'weak to very weak risk management practices' and labelled their current approach 'unacceptable'.
The FLI safety grades were assigned and reviewed by a panel of AI experts, including British computer scientist Stuart Russell, and Sneha Revanur, founder of AI regulation campaign group Encode Justice.
Max Tegmark, a co-founder of FLI and a professor at Massachusetts Institute of Technology, said it was 'pretty jarring' that cutting-edge AI firms were aiming to build super-intelligent systems without publishing plans to deal with the consequences.
He said: 'It's as if someone is building a gigantic nuclear power plant in New York City and it is going to open next week – but there is no plan to prevent it having a meltdown.'
Tegmark said the technology was continuing to outpace expectations, citing a previously held belief that experts would have decades to address the challenges of AGI. 'Now the companies themselves are saying it's a few years away,' he said.
He added that progress in AI capabilities had been 'remarkable' since the global AI summit in Paris in February, with new models such as xAI's Grok 4, Google's Gemini 2.5, and its video generator Veo3, all showing improvements on their forebears.
A Google DeepMind spokesperson said the reports did not take into account 'all of Google DeepMind's AI safety efforts'. They added: 'Our comprehensive approach to AI safety and security extends well beyond what's captured.'
OpenAI, Anthropic, Meta, xAI, Zhipu AI and DeepSeek have also been approached for comment.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Reuters
21 minutes ago
- Reuters
Microsoft poised for $4 trillion valuation after solid results
July 31 (Reuters) - Microsoft (MSFT.O), opens new tab is set to soar past $4 trillion in market valuation for the first time on Thursday, as a burst of investor confidence in its booming Azure cloud division helps the tech behemoth become the second company after Nvidia to surpass the milestone. The software company forecast a record $30 billion in capital spending for the current fiscal first quarter and reported booming sales in its Azure cloud computing business on Wednesday. Shares of Microsoft were up 8.6% at $557.34 in early premarket trading, valuing it at $4.14 trillion.
The Guardian
22 minutes ago
- The Guardian
Shell profits down nearly a third after drop in oil prices
Profits at Shell fell by nearly a third in the last quarter as the energy company was hit by a fall in earnings from oil and gas. Shell reported on Thursday morning that its adjusted earnings dropped to $4.26bn in the second quarter of this year, 32% less than the $6.29bn it made in April-June 2024 when energy prices were higher. This beat City forecasts of a larger drop in profits to $3.7bn. Shell attributed the drop to 'lower trading and optimisation margins' as well as lower prices for oil and gas. At the end of June, Brent crude was trading below $68 a barrel, compared with more than $86 a barrel a year earlier. Despite the fall in profits and a rise in debt, Shell is continuing to pump money back to its investors through share buyback schemes. It announced it would spend $3.5bn buying back shares in the third quarter of the year. Shell's chief executive, Wael Sawan, said the company had delivered a strong operational performance in 'a less favourable macro environment'. He said: 'Our continued focus on performance, discipline and simplification helped deliver $3.9bn of structural cost reductions since 2022, with the majority delivered through non-portfolio actions. This focus enables us to commence another $3.5bn of buybacks for the next three months, the 15th consecutive quarter of at least $3bn in buybacks.' Shell's net debt increased to $43.21bn in the second quarter, up from $38.3bn a year earlier. Derren Nathan, the head of equity research at Hargreaves Lansdown, said a recent rise in oil prices should help Shell's financial performance improve in the third quarter of the year. 'Shell's second-quarter earnings hit a bit of an oil patch, with lower commodity prices, a weaker trading environment and unplanned downtime at its chemical plants all playing their part,' Nathan said. Shares in Shell rose 2.5% in early trading, to £27.45. Sign up to Business Today Get set for the working day – we'll point you to all the business news and analysis you need every morning after newsletter promotion Shell's profits continue to anger environmental campaigners, after the company last year rolled back decarbonisation targets. Robin Wells, the director of Fossil Free London, a campaign group that protested outside Shell's headquarters on Wednesday night, said 'We are now in a new normal of record-breaking heat, created by corporations like Shell. This will mean devastation and mass loss of human life. Climate scientists have warned us that this new normal will spell the end of human civilisation by 2100. It's time for destruction to stop raising billions in profit.'
Reuters
22 minutes ago
- Reuters
Lufthansa, Air France-KLM defy trade war worries with Q2 growth
LONDON/CHICAGO/GDANSK, July 31 (Reuters) - European airlines Lufthansa ( opens new tab and Air France-KLM ( opens new tab reported higher second-quarter profits on Thursday, defying worries that economic uncertainty and U.S. tariffs might hit transatlantic travel. Transatlantic connections are among the most lucrative for airlines, having bolstered British Airways-owner IAG (ICAG.L), opens new tab in recent years as European competitors struggled. A number of U.S. airlines, including Delta (DAL.N), opens new tab, abandoned their full-year financial forecasts this spring on the back of weakening travel demand after U.S. President Donald Trump's tariffs dented business and consumer confidence. European airlines, however, are bucking the trend. Lufthansa said on Thursday that demand in the United States remained strong despite a weaker U.S. dollar, while Air France-KLM highlighted the strength of its premium offering. Lufthansa reported a 27% year-on-year increase in second-quarter operating profit to 871 million euros ($995 million), beating analysts' average forecast of 805 million euros. "Although the second quarter was again marked by geopolitical crises and economic uncertainties, we are today confirming our positive outlook for the full year," Chief Executive Carsten Spohr said in a statement. U.S. airlines have reported an improvement in bookings since late June after a sharp drop in March and April when Trump unleashed his trade war. While demand has stabilised, airline executives say it is below estimates at the start of the year. Moreover, spending by price-sensitive travellers remains depressed amid lingering uncertainty about the U.S. economy and rising living costs. European travellers are known for being more price-sensitive than Americans, often having less spending power. But wealthy Americans are flocking to Europe this summer. While domestic U.S. travel has struggled, hitting budget airlines, resilient demand for premium and long-haul international travel has helped Delta and United Airlines (UAL.O), opens new tab perform better. Lufthansa's profit beat was helped by its investment in Italy's ITA Airways, which contributed a "surprisingly large" profit to the group's bottom line, Bernstein analyst Alex Irving said in a note to clients. Still, Irving said Air France-KLM had "meaningfully outperformed" Lufthansa on North Atlantic sales. At 0750 GMT, Lufthansa shares were down 1%, while Air France-KLM's were up 2.7%. Lufthansa has struggled with rising labour costs as well as a slower return in traffic from Asia since the pandemic, issuing two profit warnings last year. The move to focus on Italy was a cost-saving measure - the Rome hub is far cheaper to maintain than German bases - that is starting to pay off, the company said. Air France-KLM's second-quarter operating profit rose to 736 million euros from 513 million euros a year earlier, in line with analyst expectations. While Air France has benefited from strong demand to Paris and capitalised on its luxury French appeal, KLM has struggled with ongoing challenges at Schiphol airport near Amsterdam. ($1 = 0.8751 euros)
