The ‘godfather of AI' reveals the only way humanity can survive superintelligent AI

CNN

2 days ago

Geoffrey Hinton, known as the 'godfather of AI,' fears the technology he helped build could wipe out humanity — and 'tech bros' are taking the wrong approach to stop it.
Hinton, a Nobel Prize-winning computer scientist and a former Google executive, has warned in the past that there is a 10% to 20% chance that AI wipes out humans. On Tuesday, he expressed doubts about how tech companies are trying to ensure humans remain 'dominant' over 'submissive' AI systems.
'That's not going to work. They're going to be much smarter than us. They're going to have all sorts of ways to get around that,' Hinton said at Ai4, an industry conference in Las Vegas.
In the future, Hinton warned, AI systems might be able to control humans just as easily as an adult can bribe 3-year-old with candy. This year has already seen examples of AI systems willing to deceive, cheat and steal to achieve their goals. For example, to avoid being replaced, one AI model tried to blackmail an engineer about an affair it learned about in an email.
Instead of forcing AI to submit to humans, Hinton presented an intriguing solution: building 'maternal instincts' into AI models, so 'they really care about people' even once the technology becomes more powerful and smarter than humans.
AI systems 'will very quickly develop two subgoals, if they're smart: One is to stay alive… (and) the other subgoal is to get more control,' Hinton said. 'There is good reason to believe that any kind of agentic AI will try to stay alive.'
That's why it is important to foster a sense of compassion for people, Hinton argued. At the conference, he noted that mothers have instincts and social pressure to care for their babies.
'The right model is the only model we have of a more intelligent thing being controlled by a less intelligent thing, which is a mother being controlled by her baby,' Hinton said.
Hinton said it's not clear to him exactly how that can be done technically but stressed it's critical researchers work on it.
'That's the only good outcome. If it's not going to parent me, it's going to replace me,' he said. 'These super-intelligent caring AI mothers, most of them won't want to get rid of the maternal instinct because they don't want us to die.'
Hinton is known for his pioneering work on neural networks, which helped pave the way to today's AI boom. In 2023, he stepped down from Google and started speaking out about the dangers of AI.
Emmett Shear, who briefly served as interim CEO of ChatGPT owner OpenAI, said he's not surprised that some AI systems have tried to blackmail humans or bypass shutdown orders.
'This keeps happening. This is not going to stop happening,' Shear, the CEO of AI alignment startup Softmax, said at the Ai4 conference. 'AIs today are relatively weak, but they're getting stronger really fast.'
Shear said that rather than trying to instill human values into AI systems, a smarter approach would be to forge collaborative relationships between humans and AI.
Many experts believe AIs will achieve superintelligence, also known as artificial general intelligence, or AGI, in the coming years.
Hinton said he used to think it could take 30 years to 50 years to achieve AGI but now sees this moment coming sooner.
'A reasonable bet is sometime between five and 20 years,' he said.
While Hinton remains concerns about what could go wrong with AI, he is hopeful the technology will pave the way to medical breakthroughs.
'We're going to see radical new drugs. We are going to get much better cancer treatment than the present,' he said. For instance, he said AI will help doctors comb through and correlate the vast amounts of data produced by MRI and CT scans.
However, Hinton does not believe AI will help humans achieve immortality.
'I don't believe we'll live forever,' Hinton said. 'I think living forever would be a big mistake. Do you want the world run by 200-year-old white men?'
Asked if there's anything he would have done differently in his career if he knew how fast AI would accelerate, Hinton said he regrets solely focusing on getting AI to work.
'I wish I'd thought about safety issues, too,' he said.