Grok, is that Gaza? AI image checks mislocate news photographs
But when social media users asked Grok where it came from, X boss Elon Musk's artificial intelligence chatbot was certain that the photograph was taken in Yemen nearly seven years ago.
The AI bot's untrue response was widely shared online and a left-wing pro-Palestinian French lawmaker, Aymeric Caron, was accused of peddling disinformation on the Israel-Hamas war for posting the photo.
At a time when internet users are turning to AI to verify images more and more, the furore shows the risks of trusting tools like Grok, when the technology is far from error-free.
Grok said the photo showed Amal Hussain, a seven-year-old Yemeni child, in October 2018.
In fact the photo shows nine-year-old Mariam Dawwas in the arms of her mother Modallala in Gaza City on August 2, 2025.
Before the war, sparked by Hamas's October 7, 2023 attack on Israel, Mariam weighed 25 kilograms, her mother told AFP.
Today, she weighs only nine. The only nutrition she gets to help her condition is milk, Modallala told AFP--and even that's "not always available".
Challenged on its incorrect response, Grok said: "I do not spread fake news; I base my answers on verified sources."
The chatbot eventually issued a response that recognised the error -- but in reply to further queries the next day, Grok repeated its claim that the photo was from Yemen.
The chatbot has previously issued content that praised Nazi leader Adolf Hitler and that suggested people with Jewish surnames were more likely to spread online hate.
- Radical right bias -
Grok's mistakes illustrate the limits of AI tools, whose functions are as impenetrable as "black boxes", said Louis de Diesbach, a researcher in technological ethics.
"We don't know exactly why they give this or that reply, nor how they prioritise their sources," said Diesbach, author of a book on AI tools, "Hello ChatGPT".
Each AI has biases linked to the information it was trained on and the instructions of its creators, he said.
In the researcher's view Grok, made by Musk's xAI start-up, shows "highly pronounced biases which are highly aligned with the ideology" of the South African billionaire, a former confidante of US President Donald Trump and a standard-bearer for the radical right.
Asking a chatbot to pinpoint a photo's origin takes it out of its proper role, said Diesbach.
"Typically, when you look for the origin of an image, it might say: 'This photo could have been taken in Yemen, could have been taken in Gaza, could have been taken in pretty much any country where there is famine'."
AI does not necessarily seek accuracy -- "that's not the goal," the expert said.
Another AFP photograph of a starving Gazan child by al-Qattaa, taken in July 2025, had already been wrongly located and dated by Grok to Yemen, 2016.
That error led to internet users accusing the French newspaper Liberation, which had published the photo, of manipulation.
- 'Friendly pathological liar' -
An AI's bias is linked to the data it is fed and what happens during fine-tuning -- the so-called alignment phase -- which then determines what the model would rate as a good or bad answer.
"Just because you explain to it that the answer's wrong doesn't mean it will then give a different one," Diesbach said.
"Its training data has not changed and neither has its alignment."
Grok is not alone in wrongly identifying images.
When AFP asked Mistral AI's Le Chat -- which is in part trained on AFP's articles under an agreement between the French start-up and the news agency -- the bot also misidentified the photo of Mariam Dawwas as being from Yemen.
For Diesbach, chatbots must never be used as tools to verify facts.
"They are not made to tell the truth," but to "generate content, whether true or false", he said.
"You have to look at it like a friendly pathological liar -- it may not always lie, but it always could."
dou-aor/sbk/rlp
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
New York Times
41 minutes ago
- New York Times
Huckabee Says U.S.-Backed Aid Sites in Gaza Will ‘Scale Up'
As the hunger in Gaza draws increasing international condemnation, Mike Huckabee, the United States ambassador to Israel, said on Wednesday that an American-backed aid initiative in the enclave would soon 'scale up.' The initiative, called the Gaza Humanitarian Foundation (G.H.F.) and conceived by Israelis, is run by American contractors and has the diplomatic and financial support of the United States. Currently, the G.H.F. runs four distribution sites, mostly in southern Gaza. That figure could soon quadruple, Mr. Huckabee said. 'The immediate plan is to scale up the number of sites up to 16 and begin to operate them as much as 24 hours a day,' he said in a Fox News interview, responding to questions about whether and how the United States planned to get more involved in aid distribution in Gaza. The G.H.F. did not immediately respond to a request for comment on the plans to run up to 16 sites around the clock. Mr. Huckabee and Steve Witkoff, President Trump's envoy for peace missions, visited a G.H.F. aid distribution site in Gaza last week. Mr. Huckabee's statement comes as aid groups say Gaza is in the grip of a hunger crisis, with Palestinians there facing famine. The World Food Program, an arm of the United Nations, has also said that the crisis in Gaza had reached 'new and astonishing levels of desperation, with a third of the population not eating for multiple days in a row.' The foundation has also been boycotted by the United Nations, which led a network of hundreds aid sites in Gaza. The U.N. says that the G.H.F.'s methods fly in the face of established principles of humanitarian law and that there are not enough distribution sites. Want all of The Times? Subscribe.
New York Times
2 hours ago
- New York Times
On the Hunt for Spies, Iran Executes a Nuclear Scientist
Iran executed one of its nuclear scientists on Wednesday over allegations that he was a spy for Israel and had facilitated Israel's assassination of another nuclear scientist during the two countries' war in June, according to the judiciary's news outlet, Mizan. The judiciary said the scientist, Roozbeh Vadi, had worked at one of the country's most sensitive and important nuclear sites and had access to the type of classified information sought by Iran's enemies. Mr. Vadi was executed by hanging after he was found guilty of espionage and providing information to Israel, the judiciary said. The execution follows a 12-day war with Israel and the United States in June, when Israel assassinated at least 30 Iranian senior military commanders and 11 nuclear scientists. Iranian officials have acknowledged publicly that Israel's widespread infiltration of its security and intelligence apparatuses enabled Israel to eliminate key parts of Iran's military chain of command in the war's first night and helped it launch drone attacks from inside Iran. Following the war, officials have blamed Israel for a series of explosions and fires around the country. While the two countries have been locked in a long-running shadow war, the apparent accuracy of Israel's information and its launching attacks inside the country has rattled Iranian officials. Since the war ended, authorities have swept up hundreds of people, including activists and dissidents, on suspicions of spying and threatening national security, Iranian media reports and rights groups say. Want all of The Times? Subscribe.
Yahoo
3 hours ago
- Yahoo
Lebanon's Hezbollah rejects cabinet decision to disarm it
Hezbollah said Wednesday that it would treat a Lebanese government decision to disarm the militant group "as if it did not exist", accusing the cabinet of committing a "grave sin". Amid heavy US pressure and fears Israel could expand its strikes on Lebanon, Prime Minister Nawaf Salam said Tuesday that the government had tasked the army with developing a plan to restrict weapons to government forces by year end. The plan is to be presented to the government by the end of August for discussion and approval, and another cabinet meeting is scheduled for Thursday to continue the talks, including on a US-proposed timetable for disarmament. Hezbollah said the government had "committed a grave sin by taking the decision to disarm Lebanon of its weapons to resist the Israeli enemy". The decision is unprecedented since Lebanon's civil war factions gave up their weapons three and a half decades ago. "This decision undermines Lebanon's sovereignty and gives Israel a free hand to tamper with its security, geography, politics and future existence... Therefore, we will treat this decision as if it does not exist," the Iran-backed group said in a statement. - 'Serves Israel's interests' - The government said its decision came as part of implementing a November ceasefire that sought to end more than a year of hostilities between Israel and Hezbollah, which culminated in two months of full-blown war. Hezbollah said it viewed the government's move as "the result of dictates from US envoy" Tom Barrack. It "fully serves Israel's interests and leaves Lebanon exposed to the Israeli enemy without any deterrence", the group said. Hezbollah was the only faction that kept its weapons after Lebanon's 1975-1990 civil war. It emerged weakened politically and militarily from its latest conflict with Israel, its arsenal pummelled and its senior leadership decimated. Israel has kept up its strikes on Hezbollah and other targets despite the November truce, and has threatened to keep doing so until the group has been disarmed. An Israeli strike on the southern town of Tulin on Wednesday killed one person and wounded another, the health ministry said. Israel also launched a series of air strikes on southern Lebanon, wounding at least two people according to the health ministry. The Israeli military said it struck "weapons storage facilities, a missile launcher and Hezbollah terrorist infrastructure which stored engineering tools that allowed for the re-establishment of terrorist infrastructure in the area". Hezbollah said Israel must halt the attacks before any domestic debate about its weapons and a new defence strategy could begin. - 'Pivotal moment' - "We are open to dialogue, ending the Israeli aggression against Lebanon, liberating its land, releasing prisoners, working to build the state, and rebuilding what was destroyed by the brutal aggression," the group said. Hezbollah is "prepared to discuss a national security strategy", but not under Israeli fire, it added. Two ministers affiliated with Hezbollah and its ally the Amal movement walked out of Tuesday's meeting. Hezbollah described the walkout as "an expression of rejection" of the government's "decision to subject Lebanon to American tutelage and Israeli occupation". The Amal movement, headed by parliament speaker Nabih Berri, accused the government of "rushing to offer more gratuitous concessions" to Israel when it should have sought to end the ongoing attacks. It called Thursday's cabinet meeting "an opportunity for correction". Hezbollah opponent the Lebanese Forces, one of the country's two main Christian parties, said the cabinet's decision to disarm the militant group was "a pivotal moment in Lebanon's modern history -- a long-overdue step toward restoring full state authority and sovereignty". The Free Patriotic Movement, the other major Christian party and a former ally of Hezbollah, said it was in favour of the army receiving the group's weapons "to strengthen Lebanon's defensive power". Iran's Foreign Minister Abbas Araghchi said in a televised interview that any decision on disarmament "will ultimately rest with Hezbollah itself". "We support it from afar, but we do not intervene in its decisions," he added, noting that the group had "rebuilt itself" following setbacks during its war with Israel. lar/lg-nad/js
