logo
‘AI godfather' sounds the alarm on growing risks in the AI race

‘AI godfather' sounds the alarm on growing risks in the AI race

HANOI, VIETNAM - Media OutReach Newswire - 28 February 2025 - The rise of powerful artificial intelligence (AI) like DeepSeek is transforming the world at an unprecedented pace, sparking enthusiasm and deep concerns about its potential risks. On that subject, 'AI godfather' Yoshua Bengio – Laureate of the 2024 VinFuture Grand Prize – highlighted the urgent need for national and global efforts to regulate AI and ensure equitable benefits for all.
'AI Godfather' and 2024 VinFuture Grand Prize Laureate Yoshua Bengio (left) warns global superpowers about the risks AI poses to humanity.
Double-edged sword
Since the beginning of 2025, the rise of DeepSeek has been described as a 'black swan' moment creating a game-changing shift in an AI landscape almost overnight. It is a wake-up call showing that powerful AI can be achieved without exorbitant costs, challenging the prevailing 'money equals progress' model.
Regarding this, Yoshua Bengio, often regarded as 'one of the godfathers of modern AI,' warned that its breakthrough in AI affordability could pose serious risks.
'If open-weight AI models, like DeepSeek, are distributed completely, terrorists may exploit them for disinformation campaigns, cyberattacks, or even bioweapon development,' he stated in an interview with VinFuture Foundation. 'This is a double-edged sword because while these systems become more available, cheaper, and more powerful, they also lower the barrier to misuse.'
Yoshua Bengio, a pioneer in neural networks and deep learning algorithms, has been recognized with numerous prestigious international awards, including the 2018 A.M. Turing Award, the 2024 VinFuture Grand Prize, and most recently, the 2025 Queen Elizabeth Prize for Engineering. He emphasized that AI is evolving toward greater autonomy, with systems capable of planning and acting in pursuit of a goal. 'Today, AI already surpasses humans in certain domains. It can master hundreds of languages and pass PhD-level exams across multiple disciplines', he explained.
Despite these current limitations in long-term planning abilities, major technology corporations have thrown billions of dollars into developing AI agents capable of autonomous decision-making over extended periods. While this promises efficiency gains, it raises concerns about large-scale job displacement.
Beyond economic shifts, a far more critical issue looms - the loss of human control over AI. In controlled experiments, some AI systems have even engaged in deceptive behavior to prevent being shut down - a troubling sign of self-preservation tendencies.
'This is alarming because we don't want machines that will compete with us,' he emphasized.
According to Bengio, while they are not yet intelligent enough to pose a major threat, this trajectory is concerning.
'In a few years, they might be sufficiently smarter and we need to start paying attention before it is too late,' Bengio warned.
Coupled with technical risks, AI presents a profound threat to privacy and civil liberties. Recently, a comprehensive International AI Safety report, chaired by Yoshua Bengio and compiled by 96 experts from 30 countries and organizations (including the UN, EU, and OECD) to guide policymakers on AI safety, revealed the growing potential for AI misuse in malicious activities.
Bengio noted that AI's ability to process vast amounts of data can empower individuals, corporations, or governments with unprecedented control. Given AI's uncertain future, he shared that the way humans manage AIs in the future will be central to preventing this scenario. 'We need to make sure that no single person, no single corporation, and no single government can have total power over super intelligent AI,' he emphasized.
Advances by the Chinese startup DeepSeek could further intensify the AI race among superpowers, raising a worrying development in a field dominated by the Silicon Valley and large Western tech companies in recent years.
'The danger here is that in their race to outpace each other, safety issues might be overlooked. We can be all the victims of this race if we are not careful enough,' Bengio cautioned.
Moreover, the intensifying race is expected to drive profound environmental consequences, particularly in energy consumption. Major AI companies, pushed by the prospect of massive profits, are willing to absorb high energy costs. This surge in demand will inevitably drive-up energy prices across the board, including electricity, oil, and other resources, affecting not just tech firms but households and industries worldwide.
This is where unchecked market forces and national competition could lead to global losses. 'That is why government intervention is crucial. Policymakers must negotiate agreements that cap energy consumption at sustainable levels. Otherwise, the forces of competition between companies will only accelerate AI expansion in ways that are not just unsustainable but potentially dangerous,' Bengio urged.
Bridging the AI divide
The godfather of AI has raised urgent calls to establish robust ethical frameworks and regulatory measures to ensure responsible development and deployment.
'Currently, there is essentially no regulatory framework almost anywhere in the countries where these systems are being developed. I think the governments have a responsibility to at least require a kind of reporting to them,' he said.
Responsibility is another key aspect. In many countries, legal principles hold companies accountable for products that cause harm. However, when it comes to software, liability remains a grey area, according to Bengio. 'Clarifying liability laws would be a simple but effective step. If companies knew they could face lawsuits for negligence, they would have stronger incentives to manage risks properly,' he asserted.
He also emphasized that it would require a concerted effort from individuals and institutions who recognize the existential risks, like catastrophic malicious use. Elsewhere, concerns over job security and future employment opportunities loom. 'The timeline for this shift is uncertain, but we could see radical transformations within five to ten years,' Bengio predicted.
While some jobs will inevitably be replaced by automation, Bengio emphasized that not all professions are equally at risk. 'Expanding digital and AI education is essential, but it will not be a universal solution. Not everyone can become an AI engineer,' he noted. Instead, roles that require emotional intelligence and human interaction, including healthcare professionals, therapists, and managers, are more likely to endure. Rather than individual adaptation, Bengio poses a larger question: Can AI deployment be deliberately shaped to minimize disruption?
'Again, this is something that has to be done globally, which is very challenging. We should do it in a way that does not create radical disruptions in the social fabric,' he concluded.
Beyond national regulations, Bengio stressed the need for global coordination. He highlighted eventually, humans should aim for global agreements and treaties, similar to how we handle other scientific and technological risks. As AI rapidly reshapes industries, new divides in wealth, job displacement, or political power could deepen unless proactive measures are taken. Bengio warned that AI is currently concentrated in the hands of a few corporations and nations.
He took Vietnam, a country with a strong industrial sector, as an example. If widespread automation shifts production to AI-powered facilities in wealthier nations like the US, it could lead to significant job losses and economic hardship in countries dependent on manufacturing exports.
Therefore, Bengio suggested establishing global negotiations - a form of exchange in which countries developing advanced AI might ask other countries to refrain from creating potentially dangerous AI. In return, the wealth generated by these AI systems, like new technologies and medical advancements, should be shared globally.
'Of course, we are very far from this, but we need to start those discussions at a global level,' he emphasized.
The first step toward bridging the AI divide is fostering collaboration between emerging economies and technologically advanced nations. Bengio highlighted the importance of initiatives like the VinFuture Prize, which draws global attention to scientific advancements in regions outside the traditional tech powerhouses.
'A big prize like the VinFuture Prize can make leading scientists far more aware of what is happening in Vietnam and other developing countries,' he explained.
Countries such as Vietnam, India, and Brazil already possess strong talent pools and growing expertise in AI. By forming strategic partnerships with resource-rich nations like Canada and European countries, they can develop competitive AI projects on a global scale. Such collaborations, if carefully structured, could ensure a more equitable distribution of technological power, according to Bengio.
Moreover, Bengio stressed the importance of bridging the gap between academia and industry. 'By recognizing and supporting breakthrough innovations, VinFuture Prize encourages deeper collaboration between scientists, industry leaders, and policymakers, as well as fosters global dialogue on responsible AI,' he said.
The VinFuture Foundation, established on International Human Solidarity Day on December 20th, 2020, is a non-profit organization co-founded by billionaire Mr. Pham Nhat Vuong and his wife, Mrs. Pham Thu Huong. The Foundation's core activity is awarding the annual VinFuture Prize, which recognizes transformative scientific and technological innovations capable of making significant positive changes in the lives of millions of people worldwide.
The nomination period for the 2025 VinFuture Prize will close at 2:00 PM on April 17, 2025 (Vietnam time, GMT+7).
The VinFuture Prize consists of four prestigious awards presented each year. The most esteemed is the VinFuture Grand Prize, valued at US$3 million, making it one of the largest annual prizes globally. Additionally, there are three Special Prizes, each valued at US$500,000, specifically dedicated to honoring women innovators, innovators from developing countries, and innovators with outstanding achievements in emerging fields.
Orange background

Try Our AI Features

Explore what Daily8 AI can do for you:

Comments

No comments yet...

Related Articles

Trading Day: AI fatigue, policy intrigue
Trading Day: AI fatigue, policy intrigue

Yahoo

time24 minutes ago

  • Yahoo

Trading Day: AI fatigue, policy intrigue

By Jamie McGeever ORLANDO, Florida (Reuters) -TRADING DAY Making sense of the forces driving global markets By Jamie McGeever, Markets Columnist Gnawing doubts about the frenzy around artificial intelligence weighed on tech shares again on Wednesday, pushing Wall Street into the red as investors cast a nervous eye toward a key speech from Fed Chair Jerome Powell on Friday. More on that below. In my column today, I look ahead to Powell's eighth and final Jackson Hole speech. If market moves following his previous seven are any guide, investors should be in for a bumpy ride. If you have more time to read, here are a few articles I recommend to help you make sense of what happened in markets today. 1. Trump calls on Fed Governor Cook to resign 2. Fed's dilemma between AI and housing: Mike Dolan 3. Big investors ditch tech ahead of expected Septemberstocks slump 4. US tech-stock stumble shows vulnerability in AI 5. UK inflation heat puts Bank of England back in thespotlight Today's Key Market Moves * STOCKS: Wall Street in the red, again led by techselloff. Nasdaq sheds 0.7%. China closes at a 10-year high,Europe gains too, but benchmark EM falls. * SHARES/SECTORS: Target slides 6% after firm announcesinsider Michael Fiddelke as new CEO. Intel falls 7% and othertech firms fall on news the government is eyeing stakes inchipmakers. * FX: New Zealand dollar falls 1% after dovish RBNZ ratecut, bucking broader trend of U.S. dollar weakness. * BONDS: U.S. yields down ever so slightly, recoveringafter the Fed minutes. The 20-year auction was mixed. * COMMODITIES: Safety bid lifts gold 1%, oil reboundsaround 1.5% on U.S. inventory drawdown. Today's Talking Points: * Trump interference. Investors are increasingly concerned about the involvement - or interference - from President Donald Trump and his administration in many aspects of the economy, private sector business, and independent policymaking. Trump on Wednesday called for Fed Governor Lisa Cook to resign over mortgage allegations, which could pave the way for another Trump appointee at the Fed inclined to lower interest rates. Commerce Secretary Howard Lutnick, meanwhile, is said to be looking into the government taking equity stakes in Intel and other chipmakers in exchange for grants under the CHIPS Act. This comes on the heels of Trump's recent sideswipe at Goldman Sachs's CEO and chief U.S. economist, criticism of JPMorgan Chase and Bank of America, his firing of a senior statistics official, and months of verbal attacks on Powell for not cutting rates. * Tech fatigue. After leading Wall Street's charge this year to new peaks, U.S. tech shares are now losing steam and dragging broader indexes lower. Whether that's simply rotation and diversification, unease over the megacap concentration, or doubts about the huge AI spend, air is coming out of the tech balloon. The S&P 500 tech sector is down nearly 5% in the last five trading days. But a bit of perspective is required - the sector rallied 60% between April 7 and August 13. * Fed minutes. With just two days to go until Powell's last Jackson Hole speech, investors on Wednesday had the minutes of the Fed's July 29-30 policy meeting to pore over. The minutes appear to show that the two policymakers who dissented against the central bank decision to leave rates unchanged appear not to have been joined by others in voicing support for lowering rates at that meeting. "Almost all participants viewed it as appropriate to maintain the target range for the federal funds rate at 4.25% to 4.50% at this meeting," the minutes read. Maybe the bar to cutting rates is higher than thought? But bear in mind, the weak July payrolls data were released two days after that decision. Jackson Hole speech could pack a punch Financial markets are taking in a collective breath ahead of Powell's eighth and final keynote Jackson Hole speech as Federal Reserve chair. If the moves following his last seven are any guide, investors should buckle up for a bumpy ride. Fed-watchers will be focused squarely on whether Powell signals that he's willing to cut interest rates at the central bank's September 16-17 meeting. His public comments in recent months have been relatively hawkish, but those were all before the release of the weak July employment figures that fired up easing expectations. Rates futures traders are pricing in an 85% probability of a quarter-point cut next month, with another 25 basis points of easing expected by year's end. Powell's words on Friday could provide significant clarity about whether these positions are "in the money" or not. Given that traders are betting so heavily on an imminent move, the "pain trade" will be if Powell holds the line that policymakers need to see more incoming data before resuming the easing cycle put on hold in December. Investors have reason to be cautious. History shows Powell's Jackson Hole speeches tend to move markets a lot, especially the bond market. And even though Powell is often considered a policy dove at heart, his Jackson Hole set-piece speeches have usually pushed yields higher, not lower. WATCH BOND YIELDS In the month following each of Powell's last seven Jackson Hole speeches, the 10-year Treasury yield has risen by an average of 21 bps, according to Reuters calculations. The dollar has risen 1.4% and the S&P 500 has fallen nearly 2%, on average, over the same period. Stretching that out, the S&P 500 has risen an average of 2.3% between the late-August speech and year-end, the dollar has gained 0.4%, while the 10-year yield has climbed 27 basis points on average. But these averages mask some much bigger moves, especially in the month after the central bank jamboree in Wyoming. The stand-out example is 2022, when Powell, in his Monetary Policy and Price Stability speech, invoked former Fed Chair Paul Volcker, warning of the "pain" that households and businesses were likely to face from the tight policy needed to slay inflation. In the following month, the S&P 500 tanked 12%, the dollar rallied 5%, and the 10-year Treasury yield soared 75 bps. Bond yields climbed at least 20 bps in the month following three other Powell Jackson Hole speeches, in 2018, 2021, and 2023, the latter being another where Powell signaled a readiness to keep rates higher for longer. KEY CONSIDERATIONS Inflation today is not as lofty as it was two years ago, but, sitting around 1 percentage point above the Fed's 2% goal, it is higher than Powell would like. Meanwhile, on the other side of the Fed's dual mandate, unemployment remains at a historical low of 4.2%. This year's theme at Jackson Hole is "Labor Markets in Transition: Demographics, Productivity, and Macroeconomic Policy." Powell has stated that the unemployment rate is the best measure of the labor market. But that does not mean today's low unemployment rate will automatically lead to a hawkish speech - history shows that when unemployment starts to rise, it can move quickly, leaving the Fed woefully behind the curve. Markets are probably prepared for some large price swings, whichever way Powell leans. THE LAST TIME It's also likely that Powell will use the platform to defend his tenure, just like his predecessors: Alan Greenspan in 2005, Ben Bernanke in 2012, and Janet Yellen in 2017. Given the unprecedented public pressure Trump has placed on Powell to cut interest rates this year, why would the Fed chair not seize this opportunity to have his say? "He may offer some soft guidance that rates may move lower at a coming meeting. But this is his last speech at Jackson Hole. He may never again have a platform this influential to offer his view of how his history should be written," economists at UBS wrote on Friday. Will he sign off with a bang? Markets are locked and loaded. What could move markets tomorrow? * Australia, Japan, India PMIs (August, flash) * South Korea producer inflation (July) * UK public finances (July) * UK, euro zone PMIs (August, flash) * Canada producer inflation (July) * U.S. weekly jobless claims * U.S. Philly Fed business index (August) * U.S. PMI (August) * U.S. $8 billion auction of 30-year TIPS * U.S. earnings - Walmart * Atlanta Fed President Raphael Bostic speaks Want to receive Trading Day in your inbox every weekday morning? Sign up for my newsletter here. Opinions expressed are those of the author. They do not reflect the views of Reuters News, which, under the Trust Principles, is committed to integrity, independence, and freedom from bias. (By Jamie McGeever; Editing by Rod Nickel)

Oracle will reportedly power a giant data center with gas generators
Oracle will reportedly power a giant data center with gas generators

Engadget

time25 minutes ago

  • Engadget

Oracle will reportedly power a giant data center with gas generators

Bloomberg has published a deep dive into operations at Oracle, chronicling the software giant's rise in cloud computing and current push into powering artificial intelligence projects. The publication reported that Oracle has promised to develop tens of billions of dollars in data centers, which have become a hot business. Notably, Oracle landed a deal to back operations at OpenAI, in a partnership that will give the AI company 4.5 gigawatts of computing power . According to Bloomberg , that's enough energy to power "millions of American homes." So far, Oracle has seemed willing to throw money at its AI data center projects, no matter how expensive or irresponsible the needs might be. For instance, a source said the company plans to spend more than $1 billion a year powering a single data center in Texas with gas generators rather than waiting for a utility connection to be built. When completed, this data center is expected to be one of the largest known sites, with computing power of 1.4 gigawatts. In addition to the huge monetary cost, such a project can also have negative human and environmental impact. The Elon Musk-owned xAI is under fire after a supercomputer for its artificial intelligence operations became a primary source of air pollution in Memphis thanks to methane-powered turbines. Other majors, including Google , Microsoft and Meta , have chosen to try nuclear power for their data center projects, which comes with its own potential complications and risks. Purely on the financial side, Oracle's decision to invest so much so quickly meant the company reported its first negative annual cash flow since 1990. Should the current rates of AI investment turn out to be a bubble, it could be very bad news to have many billions of dollars on the line.

Wall Street steadies after Nvidia, Palantir and other AI stars trim their losses
Wall Street steadies after Nvidia, Palantir and other AI stars trim their losses

Los Angeles Times

time25 minutes ago

  • Los Angeles Times

Wall Street steadies after Nvidia, Palantir and other AI stars trim their losses

Stock indexes ended mixed on Wednesday after Nvidia, Palantir and other superstar stocks pared most of their steep losses from the morning. The S&P 500 dipped 0.2% after trimming a loss that reached 1.1% earlier in the day and remains near its all-time high set last week. The Dow Jones Industrial Average added 16 points, or less than 0.1%, and the Nasdaq composite fell 0.7%. The day's action centered again around stocks caught up in the mania around artificial-intelligence technology. Nvidia, whose chips are powering much of the world's move into AI, sank as much as 3.9% during the morning and was on track to be the heaviest weight on Wall Street following its 3.5% fall on Tuesday. But it clawed back nearly all of Wednesday's drop and finished with a dip of just 0.1%. As it pared its loss, so did broad market indexes because Nvidia is Wall Street's most influential stock by being its most valuable. Palantir Technologies, another AI darling, fell 1.1% to add to its 9.4% loss from the day before, but it had been down as much as 9.8% Wednesday morning. One possible contributor to the swoon was a study from MIT's Nanda Initiative that warned that most corporations are not yet seeing any measurable return from their generative AI investments, according to Ulrike Hoffmann-Burchardi, global head of equities at UBS Global Wealth Management. But the larger factor may be the simple criticism that prices for such stock simply shot too high, too fast, amid the furor around AI and became too expensive. Nvidia, whose profit report scheduled for next week is one of Wall Street's next major events, had soared 35.5% for the year so far heading into Tuesday. Palantir had surged even more, more than doubling. The tech stocks still have supporters, though, who say AI will bring the next generational revolution in business. Mixed profit reports from big U.S. retailers helped keep the rest of the market in check. TJX, the company behind the TJ Maxx and Marshalls stores, climbed 2.7% after beating analysts' forecasts for profit and revenue. It also raised its forecast for profit over its full fiscal year, while CEO Ernie Herrman said TJX is seeing 'strong demand at each of our U.S. and international businesses' and that its current quarter is off to a strong start. Lowe's added 0.3% after the home-improvement retailer delivered a profit for the latest quarter that topped analysts' expectations. Target, meanwhile, tumbled 6.3%. The struggling retailer said that CEO Brian Cornell plans to step down Feb. 1 and that an insider, 20-year veteran Michael Fiddelke, will replace him. He helped reenergize the company, but it has struggled to turn around weak sales in a more competitive post-COVID retail landscape. Estee Lauder dropped 3.7% after offering a forecast for profit this upcoming fiscal year that fell short of Wall Street's estimates. The beauty company said it expects tariffs to shave roughly $100 million off its upcoming earnings. La-Z-Boy sank 12.1% after the furniture maker's profit and revenue for the spring came up shy of analysts' expectations. All told, the S&P 500 fell 15.59 points to 6,395.78. The Dow Jones Industrial Average added 16.04 to 44,938.31, and the Nasdaq composite fell 142.10 to 21,172.86. The week's biggest news for Wall Street is likely arriving on Friday, when Federal Reserve Chair Jerome Powell will give a highly anticipated speech in Jackson Hole, Wyoming. The hope on Wall Street is that Powell will hint that cuts to interest rates are coming soon. The Fed has kept its main interest rate steady this year, primarily because of the fear of the possibility that President Donald Trump's tariffs could push inflation higher. But a surprisingly weak report on job growth across the country may be superseding that. Treasury yields have come down sharply on expectations for an easing of interest rates, and the yield on the 10-year Treasury fell to 4.29% from 4.30% late Tuesday. Trump has been angrily calling for lower interest rates, often insulting Powell personally while doing so. Trump on Wednesday called on a top official at the Federal Reserve, Lisa Cook, to resign after a member of his administration accused her of committing mortgage fraud. In stock markets abroad, indexes were mixed across Europe and Asia. London's FTSE 100 rose 1.1% despite a report that said inflation in the U.K. rose more than expected through July, in part due to soaring airfares and food prices. Hong Kong's Hang Seng added 0.2%. Shares that trade there of the Chinese toy company Pop Mart International Group soared 12.5% after its CEO said its annual revenue could top $4 billion this year and announced the release of a mini version of its popular Labubu dolls. Choe writes for the Associated Press.

DOWNLOAD THE APP

Get Started Now: Download the App

Ready to dive into a world of global content with local flavor? Download Daily8 app today from your preferred app store and start exploring.
app-storeplay-store