Top scientist wants to prevent AI from going rogue
NEW YORK - Concerned about the rapid spread of generative AI, a pioneer researcher is developing software to keep tabs on a technology that is increasingly taking over human tasks.
Canadian computer science professor Yoshua Bengio is considered one of the godfathers of the artificial intelligence revolution and on Tuesday announced the launch of LawZero, a non-profit organization intended to mitigate the technology's inherent risks.
The winner of the Turing Award, also known as the Nobel Prize for computer science, has been warning for several years of the risks of AI, whether through its malicious use or the software itself going awry.
Those risks are increasing with the development of so-called AI agents, a use of the technology that tasks computers with making decisions that were once made by human workers.
The goal of these agents is to build virtual employees that can do practically any job a human can, at a fraction of the cost.
"Currently, AI is developed to maximize profit," Bengio said, adding it was being deployed even as it persists to show flaws.
Moreover, for Bengio, giving AI human-like agency will easily be used for malicious purposes such as disinformation, bioweapons, and cyberattacks.
"If we lose control of rogue super-intelligent AIs, they could greatly harm humanity," he said.
One of the first objectives at LawZero will be to develop Scientist AI, a form of specially trained AI that can be used as a guardrail to ensure other AIs are behaving properly, the company said.
The organization already has over 15 researchers and has received funding from Schmidt Sciences, a charity set up by former Google boss Eric Schmidt and his wife Wendy.
The project comes as powerful large language models (or LLMs) from OpenAI, Google and Anthropic are deployed across all sectors of the digital economy, while still showing significant problems.
These include AI models that show a capability to deceive and fabricate false information even as they increase productivity.
In a recent example, AI company Anthropic said that during safety testing, its latest AI model tried to blackmail an engineer to avoid being replaced by another system. — Agence France-Presse
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
GMA Network
2 days ago
- GMA Network
Top scientist wants to prevent AI from going rogue
NEW YORK - Concerned about the rapid spread of generative AI, a pioneer researcher is developing software to keep tabs on a technology that is increasingly taking over human tasks. Canadian computer science professor Yoshua Bengio is considered one of the godfathers of the artificial intelligence revolution and on Tuesday announced the launch of LawZero, a non-profit organization intended to mitigate the technology's inherent risks. The winner of the Turing Award, also known as the Nobel Prize for computer science, has been warning for several years of the risks of AI, whether through its malicious use or the software itself going awry. Those risks are increasing with the development of so-called AI agents, a use of the technology that tasks computers with making decisions that were once made by human workers. The goal of these agents is to build virtual employees that can do practically any job a human can, at a fraction of the cost. "Currently, AI is developed to maximize profit," Bengio said, adding it was being deployed even as it persists to show flaws. Moreover, for Bengio, giving AI human-like agency will easily be used for malicious purposes such as disinformation, bioweapons, and cyberattacks. "If we lose control of rogue super-intelligent AIs, they could greatly harm humanity," he said. One of the first objectives at LawZero will be to develop Scientist AI, a form of specially trained AI that can be used as a guardrail to ensure other AIs are behaving properly, the company said. The organization already has over 15 researchers and has received funding from Schmidt Sciences, a charity set up by former Google boss Eric Schmidt and his wife Wendy. The project comes as powerful large language models (or LLMs) from OpenAI, Google and Anthropic are deployed across all sectors of the digital economy, while still showing significant problems. These include AI models that show a capability to deceive and fabricate false information even as they increase productivity. In a recent example, AI company Anthropic said that during safety testing, its latest AI model tried to blackmail an engineer to avoid being replaced by another system. — Agence France-Presse
GMA Network
5 days ago
- GMA Network
Trump says he plans to double steel, aluminum tariffs to 50%
US President Donald Trump visits US Steel Corporation–Irvin Works in West Mifflin, Pennsylvania, US, May 30, 2025. REUTERS/Leah Millis WEST MIFFLIN, Pennsylvania - US President Donald Trump said on Friday he planned to increase tariffs on imported steel and aluminum to 50% from 25%, ratcheting up pressure on global steel producers and deepening his trade war. "We are going to be imposing a 25% increase. We're going to bring it from 25% to 50% — the tariffs on steel into the United States of America, which will even further secure the steel industry in the United States," he said at a rally in Pennsylvania. The doubling of steel and aluminum levies intensifies Trump's global trade war and came just hours after he accused China of violating an agreement with the US to mutually roll back tariffs and trade restrictions for critical minerals. Trump announced the higher tariffs just outside Pittsburgh, where he was talking up an agreement between Nippon Steel and U.S. Steel. Trump said the $14.9 billion deal, like the tariff increase, will help keep jobs for steel workers in the US. He later posted on social media that the increased tariff would also apply to aluminum products and that it would take effect on Wednesday. Shares of steelmaker Cleveland-Cliffs Inc surged 26% after the market close as investors bet the new levies will help its profits. The announcement drew harsh reactions from US trading partners around the world. Canada's Chamber of Commerce quickly denounced the tariff hike as "antithetical to North American economic security." "Unwinding the efficient, competitive and reliable cross-border supply chains like we have in steel and aluminum comes at a great cost to both countries," Candace Laing, president of the chamber, said in a statement. Canada's United Steelworkers union called the move a direct attack on Canadian industries and workers. The European Commission said on Saturday that Europe is prepared to retaliate. "This decision adds further uncertainty to the global economy and increases costs for consumers and businesses on both sides of the Atlantic," a European Commission spokesperson said. "The EU is prepared to impose countermeasures, including in response to the latest US tariff increase." Australia's center-left government also condemned the tariff increase, with Trade Minister Don Farrell calling it "unjustified and not the act of a friend." Trump spoke at US Steel's Mon Valley Works, a steel plant that symbolizes both the one-time strength and the decline of US manufacturing power as the Rust Belt's steel plants and factories lost business to international rivals. Closely contested Pennsylvania is also a major prize in presidential elections. The US is the world's largest steel importer, excluding the European Union, with a total of 26.2 million tons of imported steel in 2024, according to the Department of Commerce. As a result, the new tariffs will likely increase steel prices across the board, hitting industry and consumers alike. Steel and aluminum tariffs were among the earliest put into effect by Trump when he returned to office in January. The tariffs of 25% on most steel and aluminum imported to the US went into effect in March, and he had briefly threatened a 50% levy on Canadian steel but ultimately backed off. Under the so-called Section 232 national security authority, the import taxes include both raw metals and derivative products as diverse as stainless steel sinks, gas ranges, air conditioner evaporator coils, horseshoes, aluminum frying pans and steel door hinges. The 2024 import value for the 289 product categories came to $147.3 billion with nearly two-thirds aluminum and one-third steel, according to Census Bureau data retrieved through the US International Trade Commission's Data Web system. By contrast, Trump's first two rounds of punitive tariffs on Chinese industrial goods in 2018 during his first term totaled $50 billion in annual import value. —Reuters
GMA Network
27-05-2025
- GMA Network
King Charles expresses love for 'strong and free' Canada
Canada's Prime Minister Mark Carney looks on as Britain's King Charles delivers the speech from the throne in the Senate in Ottawa, Canada, May 27, 2025. (Chris Young/Pool via REUTERS) OTTAWA —King Charles, speaking during a brief symbolic visit to show support for Canada at a time it has faced annexation threats from U.S. President Donald Trump, on Tuesday expressed his love for the country, which he described as "strong and free." Charles, Canada's head of state, is the first British monarch in almost 70 years to preside over the opening of the Canadian parliament. In a speech in the Senate, Charles referred to "the country that Canadians and I love so much" but did not mention Trump, who has imposed tariffs on Canadian exports and muses about turning Canada into the 51st U.S. state. "The True North is indeed strong and free," Charles said, referring to Canada's national anthem. The speech outlining the government's plans was largely written by officials working for Prime Minister Mark Carney. But Charles was responsible for the comments about Canada. "Every time I come to Canada ... a little more of Canada seeps into my bloodstream – and from there straight to my heart," said the monarch, accompanied by his wife Queen Camilla. "Canada has continued to set an example to the world in her conduct and values, as a force for good." The 76-year-old king, who is undergoing cancer treatment, later left Canada after a visit that barely lasted 24 hours. Charles, who joked and laughed with Carney before the speech, wore the Order of Canada around his neck. Canada is one of 15 countries where he is monarch. Useful relationship He and Camilla were driven to the Senate in a horse-drawn carriage, escorted by 28 riders from the Royal Canadian Mounted Police and cheered on by flag-waving onlookers. An Ipsos Reid poll released on Tuesday for Global News found that 66% of respondents believed Canada's relationship with the monarchy was useful because it helped set the nation apart from the United States, up from 54% in April 2023. "With the tariffs and ... the trade war, if the British monarchy plays a more active role in Canadian politics and standing up for Canada, then I welcome the British monarchy," Toronto realtor Abdel Rafeeq said on Tuesday. In the speech, the government reiterated its belief that Canada needs to agree a new relationship with the U.S. and look for more reliable trading partners. Carney, asked later whether the King had reinforced Canada's sovereignty, replied "Our sovereignty is strong". The welcome for the royal couple contrasted with a visit to Australia last October, when an Indigenous senator heckled Charles in Parliament House, accusing him of "genocide". Australia has long debated the need to keep a distant monarch. A 1999 referendum on becoming a republic lost with 55% of voters opposed. The monarchy is not a major factor in Canadian daily life, even though coins and bank notes feature the monarch's head and the country is defended by the Royal Canadian Air Force and the Royal Canadian Navy. A poll from the non-profit Angus Reid Institute released on Tuesday showed 83% of Canadians say they were indifferent or did not care about the visit. —Reuters
