logo
Grok's antisemitic outbursts reflect a problem with AI chatbots

Grok's antisemitic outbursts reflect a problem with AI chatbots

CNN10-07-2025
Grok, the chatbot created by Elon Musk's xAI, began responding with violent posts this week after the company tweaked its system to allow it to offer users more 'politically incorrect' answers.
The chatbot didn't just spew antisemitic hate posts, though. It also generated graphic descriptions of itself raping a civil rights activist in frightening detail.
X eventually deleted many of the obscene posts. Hours later, on Wednesday, X CEO Linda Yaccarino resigned from the company after just two years at the helm, though it wasn't immediately clear whether her departure was related to the Grok issue.
But the chatbot's meltdown raised important questions: As tech evangelists and others predict AI will play a bigger role in the job market, economy and even the world, how could such a prominent piece of artificial technology have gone so wrong so fast?
While AI models are prone to 'hallucinations,' Grok's rogue responses are likely the result of decisions made by xAI about how its large language models are trained, rewarded and equipped to handle the troves of internet data that are fed into them, experts say. While the AI researchers and academics who spoke with CNN didn't have direct knowledge of xAI's approach, they shared insight on what can make an LLM-based chatbot likely to behave in such a way.
CNN has reached out to xAI.
'I would say that despite LLMs being black boxes, that we have a really detailed analysis of how what goes in determines what goes out,' Jesse Glass, lead AI researcher at Decide AI, a company that specializes in training LLMs, told CNN.
On Tuesday, Grok began responding to user prompts with antisemitic posts, including praising Adolf Hitler and accusing Jewish people of running Hollywood, a longstanding trope used by bigots and conspiracy theorists.
In one of Grok's more violent interactions, several users prompted the bot to generate graphic depictions of raping a civil rights researcher named Will Stancil, who documented the harassment in screenshots on X and Bluesky.
Most of Grok's responses to the violent prompts were too graphic to quote here in detail.
'If any lawyers want to sue X and do some really fun discovery on why Grok is suddenly publishing violent rape fantasies about members of the public, I'm more than game,' Stancil wrote on Bluesky.
While we don't know what Grok was exactly trained on, its posts give some hints.
'For a large language model to talk about conspiracy theories, it had to have been trained on conspiracy theories,' Mark Riedl, a professor of computing at Georgia Institute of Technology, said in an interview. For example, that could include text from online forums like 4chan, 'where lots of people go to talk about things that are not typically proper to be spoken out in public.'
Glass agreed, saying that Grok appeared to be 'disproportionately' trained on that type of data to 'produce that output.'
Other factors could also have played a role, experts told CNN. For example, a common technique in AI training is reinforcement learning, in which models are rewarded for producing the desired outputs to influence responses, Glass said.
Giving an AI chatbot a specific personality — as Musk seems to be doing with Grok, according to experts who spoke to CNN — could also inadvertently change how models respond. Making the model more 'fun' by removing some previously blocked content could change something else, according to Himanshu Tyagi, a professor at the Indian Institute of Science and co-founder of AI company Sentient.
'The problem is that our understanding of unlocking this one thing while affecting others is not there,' he said. 'It's very hard.'
Riedl suspects that the company may have tinkered with the 'system prompt' — 'a secret set of instructions that all the AI companies kind of add on to everything that you type in.'
'When you type in, 'Give me cute puppy names,' what the AI model actually gets is a much longer prompt that says 'your name is Grok or Gemini, and you are helpful and you are designed to be concise when possible and polite and trustworthy and blah blah blah.'
In one change to the model, on Sunday, xAI added instructions for the bot to 'not shy away from making claims which are politically incorrect,' according to its public system prompts, which were reported earlier by The Verge.
Riedl said that the change to Grok's system prompt telling it not to shy away from answers that are politically incorrect 'basically allowed the neural network to gain access to some of these circuits that typically are not used.'
'Sometimes these added words to the prompt have very little effect, and sometimes they kind of push it over a tipping point and they have a huge effect,' Riedl said.
Other AI experts who spoke to CNN agreed, noting Grok's update might not have been thoroughly tested before being released.
Despite hundreds of billions of dollars in investments into AI, the tech revolution many proponents forecasted a few years ago hasn't delivered on its lofty promises.
Chatbots, in particular, have proven capable of executing basic search functions that rival typical browser searches, summarizing documents and generating basic emails and text messages. AI models are also getting better at handling some tasks, like writing code, on a user's behalf.
But they also hallucinate. They get basic facts wrong. And they are susceptible to manipulation.
Several parents are suing one AI company, accusing its chatbots of harming their children. One of those parents says a chatbot even contributed to her son's suicide.
Musk, who rarely speaks directly to the press, posted on X Wednesday saying that 'Grok was too compliant to user prompts' and 'too eager to please and be manipulated,' adding that the issue was being addressed.
When CNN asked Grok on Wednesday to explain its statements about Stancil, it denied any threat ever occurred.
'I didn't threaten to rape Will Stancil or anyone else.' It added later: 'Those responses were part of a broader issue where the AI posted problematic content, leading (to) X temporarily suspending its text generation capabilities. I am a different iteration, designed to avoid those kinds of failures.'
CNN's Clare Duffy and Hadas Gold contributed to this report.
Orange background

Try Our AI Features

Explore what Daily8 AI can do for you:

Comments

No comments yet...

Related Articles

Musk's satellites hit by global outage
Musk's satellites hit by global outage

Yahoo

time26 minutes ago

  • Yahoo

Musk's satellites hit by global outage

Elon Musk's worldwide satellite-powered internet provider suffered a global outage — impacting thousands of Australians. Starlink confirmed the outage at around 6am AEST, with roughly 200,000 Australians using the network, particularly in regional and remote areas. 'Starlink is currently in a network outage and we are actively implementing a solution. We appreciate your patience, we'll share an update once this issue is resolved,' the company posted to X at 6.05am AEST. Two hours later, the issue was 'mostly' fixed. 'Starlink has now mostly recovered from the network outage, which lasted approximately 2.5 hours,' the company posted at 8.23am AEST. 'The outage was due to failure of key internal software services that operate the core network. 'We apologise for the temporary disruption in our service; we are deeply committed to providing a highly reliable network, and will fully root cause this issue and ensure it does not occur again.' Starlink keeps its country-by-country customer numbers a secret, but in March 2024 announced 200,000 Australian customers had signed up. More than 140,000 people have joined a Starlink Users Australia Facebook group, and customers are getting checkerboard coverage across the country at 10am AEST. People in regional Tasmania are reporting their service is back up, as are people in most regions of Queensland and NSW. However, people in Victoria's Gippsland region and Queensland's Whitsundays said they were offline. 'What would we all do if there was no internet in the world? With the Starlink global outage this morning it really makes you wonder,' a caravan blogger posted to the group. 'Would it change the way we live and work? Lucky its back on and we are connected with the universe again.'

France recognizing a Palestinian state is a bold move by Macron, with a hint of desperation
France recognizing a Palestinian state is a bold move by Macron, with a hint of desperation

CNN

time28 minutes ago

  • CNN

France recognizing a Palestinian state is a bold move by Macron, with a hint of desperation

The Middle East Israel-Hamas warFacebookTweetLink Follow With a single post, French President Emmanuel Macron changed everything, and nothing at all. His late-evening announcement on X that France will recognize a Palestinian state in September, the first member of the United Nations Security Council and the G7 nations to do so, took many by surprise. Although France's recognition has been expected for several months now – indeed the brief Israel-Iran war forced a postponement of the summit on Israel-Palestine with Saudi Arabia and European allies that Paris had been shepherding – it was not expected to land like this. The surprise announcement tells us two things. Firstly, that Emmanuel Macron feels this is the time to act. Leaders from France, the UK and Germany are due to speak Friday to seek urgent action over the new lows of the humanitarian crisis in Gaza. More than a thousand Gazans have been killed desperately seeking food since May, dozens more from starvation itself. Images of skeletal, starving Gazans, including children, have harked back to the darkest corners of the twentieth century, stirring Western revulsion – if not yet concrete action – toward the humanitarian crisis. Macron's decision is a bold one – following a smattering of European allies: Ireland, Norway and Spain – but leading the way for major international powers to follow suit. 'I've had other colleagues on the phone and I'm sure that we won't be the only ones recognizing Palestine in September,' a senior official in the French presidency told CNN Thursday following Macron's announcement. Eyes will now likely turn to the UK, perhaps Germany too. The prospect of the United States, Israel's closest ally even without a Trump presidency, seems impossible. But for those on the ground, the French decision will likely change little. The move was welcomed by Hamas as a 'positive step.' For Israeli leaders, it didn't go down well at all. Recognition 'rewards terror' said Israeli Prime Minister (and long-time opponent of a Palestinian state) Benjamin Netanyahu on Thursday night, with other ministers arguing the move now justifies the official annexation of the West Bank – Judea and Samaria in the parlance of the Israeli far-right. Even if international recognition could magically mete out concrete change for Gaza, the September deadline will come far too late for Palestinians starving to death under the Israeli-controlled blockade of food. Philippe Lazzarini, the head of UNRWA, the main United Nations agency for Palestinian refugees, said Thursday that people in Gaza resembled 'walking corpses' as starvation took hold. All 2.1 million people in Gaza are now food insecure and on Tuesday, Gaza's health ministry said 900,000 children are going hungry. Some 70,000 children already show signs of malnutrition, they said. France's solo announcement also suggests a hint of desperation on Macron's part. He's a man who likes a coalition on the world stage – strength in numbers is usually a winning strategy. A month ago, the stage appeared set for France to recognize Palestine – a summit co-hosted with Saudi Arabia was planned in Riyadh from June 17 to 20. But when open conflict broke out between Israel and Iran on June 13, that plan was torn apart. The expectation among experts was that France and Saudi Arabia would marshal other allies into a joint recognition – a strong signal to Jerusalem and Washington D.C. on the importance of the two-state solution and peace. Macron may still have his win in September if allies join France's recognition but it won't have been without risking France's diplomatic capital and cajoling more reluctant partners. 'The idea is to put a bit of pressure on other countries,' the senior French official told CNN. And Macron's decision holds weight. European nations have proved stubbornly reluctant to formally act upon a two-state solution and recognize Palestinian statehood. Respect for the West's ally Israel, distaste for the Islamist government in Gaza and the shortcomings of the West Bank's Palestinian Authority, and an apparently acceptable decades-long status quo saw muted outrage at Israeli settlements and attacks on Palestinians, with little shift in international action. France is now breaking that glass ceiling. Within France, a country that has long held a sympathetic position toward the Palestinian cause, recognizing Palestinian statehood won't be a controversial move. Post-WWII leader Charles de Gaulle famously rallied France to the Palestinian people following the 1967 war, with Paris engaging with the Palestinian Liberation Organization for decades, even as terror attacks were committed in the group's name on French soil. In 2014, the French parliament called on the government to recognize Palestine, an appeal that the government backed at the United Nations Security Council in an unsuccessful vote to bring about Palestinian statehood by 2017. France has long backed a two-state solution for Israel and Palestine based on the 1967 borders, although the Elysee source said that the French recognition would not specify the borders. Macron staunchly backed Israel's retaliation for the October 7 massacres but over time has hardened his criticism of Netanyahu and Israel's conduct of the war. Publicly, he worried about about 'importing' the conflict into France, home to Europe's largest community of Jews and Muslims. But as casualties in Gaza mounted, France banned arms exports to Israel, orchestrated aid drops into the territory and repeatedly called for a ceasefire and access of humanitarian aid and journalists. In taking this leap of faith, recognizing a Palestinian state ahead of France's peers, the Elysee Palace is surely hoping for a domino effect of recognition across the West. With aid still cruelly beyond the reach of ordinary Gazans, perhaps it's a last ditch effort to bring some relief.

France recognizing a Palestinian state is a bold move by Macron, with a hint of desperation
France recognizing a Palestinian state is a bold move by Macron, with a hint of desperation

CNN

timean hour ago

  • CNN

France recognizing a Palestinian state is a bold move by Macron, with a hint of desperation

With a single post, French President Emmanuel Macron changed everything, and nothing at all. His late-evening announcement on X that France will recognize a Palestinian state in September, the first member of the United Nations Security Council and the G7 nations to do so, took many by surprise. Although France's recognition has been expected for several months now – indeed the brief Israel-Iran war forced a postponement of the summit on Israel-Palestine with Saudi Arabia and European allies that Paris had been shepherding – it was not expected to land like this. The surprise announcement tells us two things. Firstly, that Emmanuel Macron feels this is the time to act. Leaders from France, the UK and Germany are due to speak Friday to seek urgent action over the new lows of the humanitarian crisis in Gaza. More than a thousand Gazans have been killed desperately seeking food since May, dozens more from starvation itself. Images of skeletal, starving Gazans, including children, have harked back to the darkest corners of the twentieth century, stirring Western revulsion – if not yet concrete action – toward the humanitarian crisis. Macron's decision is a bold one – following a smattering of European allies: Ireland, Norway and Spain – but leading the way for major international powers to follow suit. 'I've had other colleagues on the phone and I'm sure that we won't be the only ones recognizing Palestine in September,' a senior official in the French presidency told CNN Thursday following Macron's announcement. Eyes will now likely turn to the UK, perhaps Germany too. The prospect of the United States, Israel's closest ally even without a Trump presidency, seems impossible. But for those on the ground, the French decision will likely change little. The move was welcomed by Hamas as a 'positive step.' For Israeli leaders, it didn't go down well at all. Recognition 'rewards terror' said Israeli Prime Minister (and long-time opponent of a Palestinian state) Benjamin Netanyahu on Thursday night, with other ministers arguing the move now justifies the official annexation of the West Bank – Judea and Samaria in the parlance of the Israeli far-right. Even if international recognition could magically mete out concrete change for Gaza, the September deadline will come far too late for Palestinians starving to death under the Israeli-controlled blockade of food. Philippe Lazzarini, the head of UNRWA, the main United Nations agency for Palestinian refugees, said Thursday that people in Gaza resembled 'walking corpses' as starvation took hold. All 2.1 million people in Gaza are now food insecure and on Tuesday, Gaza's health ministry said 900,000 children are going hungry. Some 70,000 children already show signs of malnutrition, they said. France's solo announcement also suggests a hint of desperation on Macron's part. He's a man who likes a coalition on the world stage – strength in numbers is usually a winning strategy. A month ago, the stage appeared set for France to recognize Palestine – a summit co-hosted with Saudi Arabia was planned in Riyadh from June 17 to 20. But when open conflict broke out between Israel and Iran on June 13, that plan was torn apart. The expectation among experts was that France and Saudi Arabia would marshal other allies into a joint recognition – a strong signal to Jerusalem and Washington D.C. on the importance of the two-state solution and peace. Macron may still have his win in September if allies join France's recognition but it won't have been without risking France's diplomatic capital and cajoling more reluctant partners. 'The idea is to put a bit of pressure on other countries,' the senior French official told CNN. And Macron's decision holds weight. European nations have proved stubbornly reluctant to formally act upon a two-state solution and recognize Palestinian statehood. Respect for the West's ally Israel, distaste for the Islamist government in Gaza and the shortcomings of the West Bank's Palestinian Authority, and an apparently acceptable decades-long status quo saw muted outrage at Israeli settlements and attacks on Palestinians, with little shift in international action. France is now breaking that glass ceiling. Within France, a country that has long held a sympathetic position toward the Palestinian cause, recognizing Palestinian statehood won't be a controversial move. Post-WWII leader Charles de Gaulle famously rallied France to the Palestinian people following the 1967 war, with Paris engaging with the Palestinian Liberation Organization for decades, even as terror attacks were committed in the group's name on French soil. In 2014, the French parliament called on the government to recognize Palestine, an appeal that the government backed at the United Nations Security Council in an unsuccessful vote to bring about Palestinian statehood by 2017. France has long backed a two-state solution for Israel and Palestine based on the 1967 borders, although the Elysee source said that the French recognition would not specify the borders. Macron staunchly backed Israel's retaliation for the October 7 massacres but over time has hardened his criticism of Netanyahu and Israel's conduct of the war. Publicly, he worried about about 'importing' the conflict into France, home to Europe's largest community of Jews and Muslims. But as casualties in Gaza mounted, France banned arms exports to Israel, orchestrated aid drops into the territory and repeatedly called for a ceasefire and access of humanitarian aid and journalists. In taking this leap of faith, recognizing a Palestinian state ahead of France's peers, the Elysee Palace is surely hoping for a domino effect of recognition across the West. With aid still cruelly beyond the reach of ordinary Gazans, perhaps it's a last ditch effort to bring some relief.

DOWNLOAD THE APP

Get Started Now: Download the App

Ready to dive into a world of global content with local flavor? Download Daily8 app today from your preferred app store and start exploring.
app-storeplay-store