Hey chatbot, is this true? AI 'factchecks' sow misinformation
WASHINGTON: As misinformation exploded during India's four-day conflict with Pakistan, social media users turned to an AI chatbot for verification – only to encounter more falsehoods, underscoring its unreliability as a fact-checking tool.
With tech platforms reducing human fact-checkers, users are increasingly relying on AI-powered chatbots – including xAI's Grok, OpenAI's ChatGPT, and Google's Gemini – in search of reliable information.
"Hey @Grok, is this true?" has become a common query on Elon Musk's platform X, where the AI assistant is built in, reflecting the growing trend of seeking instant debunks on social media.
But the responses are often themselves riddled with misinformation.
Grok – now under renewed scrutiny for inserting "white genocide", a far-right conspiracy theory, into unrelated queries – wrongly identified old video footage from Sudan's Khartoum airport as a missile strike on Pakistan's Nur Khan airbase during the country's recent conflict with India.
Unrelated footage of a building on fire in Nepal was misidentified as "likely" showing Pakistan's military response to Indian strikes.
"The growing reliance on Grok as a fact-checker comes as X and other major tech companies have scaled back investments in human fact-checkers," McKenzie Sadeghi, a researcher with the disinformation watchdog NewsGuard, told AFP.
"Our research has repeatedly found that AI chatbots are not reliable sources for news and information, particularly when it comes to breaking news," she warned.
'Fabricated'
NewsGuard's research found that 10 leading chatbots were prone to repeating falsehoods, including Russian disinformation narratives and false or misleading claims related to the recent Australian election.
In a recent study of eight AI search tools, the Tow Center for Digital Journalism at Columbia University found that chatbots were "generally bad at declining to answer questions they couldn't answer accurately, offering incorrect or speculative answers instead."
When AFP fact-checkers in Uruguay asked Gemini about an AI-generated image of a woman, it not only confirmed its authenticity but fabricated details about her identity and where the image was likely taken.
Grok recently labeled a purported video of a giant anaconda swimming in the Amazon River as "genuine", even citing credible-sounding scientific expeditions to support its false claim.
In reality, the video was AI-generated, AFP fact-checkers in Latin America reported, noting that many users cited Grok's assessment as evidence the clip was real.
Such findings have raised concerns as surveys show that online users are increasingly shifting from traditional search engines to AI chatbots for information gathering and verification.
The shift also comes as Meta announced earlier this year it was ending its third-party fact-checking program in the United States, turning over the task of debunking falsehoods to ordinary users under a model known as "Community Notes", popularised by X.
Researchers have repeatedly questioned the effectiveness of "Community Notes" in combating falsehoods.
'Biased answers'
Human fact-checking has long been a flashpoint in a hyperpolarized political climate, particularly in the United States, where conservative advocates maintain it suppresses free speech and censors right-wing content – something professional fact-checkers vehemently reject.
AFP currently works in 26 languages with Facebook's fact-checking program, including in Asia, Latin America, and the European Union.
The quality and accuracy of AI chatbots can vary, depending on how they are trained and programmed, prompting concerns that their output may be subject to political influence or control.
Musk's xAI recently blamed an "unauthorized modification" for causing Grok to generate unsolicited posts referencing "white genocide" in South Africa.
When AI expert David Caswell asked Grok who might have modified its system prompt, the chatbot named Musk as the "most likely" culprit.
Musk, the South African-born billionaire backer of President Donald Trump, has previously peddled the unfounded claim that South Africa's leaders were "openly pushing for genocide" of white people.
"We have seen the way AI assistants can either fabricate results or give biased answers after human coders specifically change their instructions," Angie Holan, director of the International Fact-Checking Network, told AFP.
"I am especially concerned about the way Grok has mishandled requests concerning very sensitive matters after receiving instructions to provide pre-authorized answers." – AFP
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
The Star
6 hours ago
- The Star
Exclusive-SES $3.1 billion Intelsat deal to gain unconditional EU antitrust nod, sources say
FILE PHOTO: Satellite model is placed on Intelsat logo in this picture illustration taken April 4, 2022. REUTERS/Dado Ruvic/Illustration/File Photo BRUSSELS (Reuters) -European satellite company SES is set to win unconditional EU antitrust approval for its $3.1-billion bid for rival Intelsat, people familiar with the matter said, creating a major European player to rival Elon Musk's Space X-owned Starlink. Together with other European satellite companies, Luxembourg-headquartered SES is looking for greater scale to compete more effectively with Starlink and Amazon's Project Kuiper. The European Commission, which is scheduled to decide on the deal by June 10, and SES declined to comment. The acquisition comes as the European Union ramps up its drive for strategic autonomy in this area to reduce its dependence on U.S. companies. The merged company would have a fleet of more than 100 geostationary Earth orbit (GEO) and 26 medium Earth orbit (MEO) satellites compared with Starlink's 5,800 satellites. The deal, which secured unconditional clearance from the UK competition authority last week, is currently being reviewed by the U.S. Federal Communications Commission and the Department of Justice. (Reporting by Foo Yun Chee. Editing by Jane Merriman)
The Star
18 hours ago
- The Star
Sales of refurbished tech products surge under US tariffs, says Back Market
The French startup specialising in the online sale of professionally refurbished phones, computers, gaming consoles and accessories says growth in the US has accelerated. — Image by Freepik LONDON: US sales of French startup Back Market, which sells refurbished tech products, have surged in response to President Donald Trump's tariffs, as more consumers turn to devices already in the country, its CEO told AFP on June 3. Since returning to the presidency in January, Trump has imposed sweeping tariffs on allies and adversaries alike in moves that have rocked the world trade order and roiled financial markets. But the French startup specialising in the online sale of professionally refurbished phones, computers, gaming consoles and accessories says growth in the United States has accelerated. When tariffs were announced, "there was no mechanical impact on new product prices but there was fear and an immediate reaction in demand", said Thibaud Hug de Larauze, Back Market's CEO and co-founder. "We saw our growth triple the following week" and nearly two months later, "it's still stronger than before", Larauze said during an interview at the South by Southwest (SXSW) festival in London. Founded in 2014, the startup has become one of the flagships of French tech, operating in 17 countries and valued in January 2022 at approximately €5.1bil (RM24.69bil). Back Market achieved profitability in Europe last year and hopes to generate global profits in 2026. Its revenues grew by 45% year-on-year in 2023, reaching €320mil (RM 1.54bil) . In the United States, its biggest market outside Europe – with France, Germany, the United Kingdom and Spain leading the way – profitability is close, Larauze said. With tariffs, Trump created a "huge incentive for Americans to consume circularly and locally", Larauze said, noting that the amount of carbon dioxide (CO2) produced in the fabrication of tech products is twice as much as that of commercial aviation. If US tariff policy "can have positive effects on the environment and American purchasing power, obviously, we're thrilled to meet this demand". – AFP
The Star
19 hours ago
- The Star
Job interviews enter a strange new world with AI that talks back
For better or worse, the next generation of job interviews has arrived: Employers are now rolling out artificial intelligence simulating live, two-way screener calls using synthetic voices. Startups like Apriora, HeyMilo AI and Ribbon all say they're seeing swift adoption of their software for conducting real-time AI interviews over video. Job candidates converse with an AI "recruiter' that asks follow-up questions, probes key skills and delivers structured feedback to hiring managers. The idea is to make interviewing more efficient for companies – and more accessible for applicants – without requiring recruiters to be online around the clock. "A year ago this idea seemed insane,' said Arsham Ghahramani, co-founder and chief executive officer of Ribbon, a Toronto-based AI recruiting startup that recently raised US$8.2mil (RM34.81mil) in a funding round led by Radical Ventures. "Now it's quite normalised.' Employers are drawn to the time savings, especially if they're hiring at high volume and running hundreds of interviews a day. And job candidates – especially those in industries like trucking and nursing, where schedules are often irregular – may appreciate the ability to interview at odd hours, even if a majority of Americans polled last year by Consumer Reports said they were uncomfortable with the idea of algorithms grading their video interviews. At Propel Impact, a Canadian social impact investing nonprofit, a shift to AI screener interviews came about because of the need to scale up the hiring process. The organisation had traditionally relied on written applications and alumni-conducted interviews to assess candidates. But with plans to bring on more than 300 fellows this year, that approach quickly became unsustainable. At the same time, the rise of ChatGPT was diluting the value of written application materials. "They were all the same,' said Cheralyn Chok, Propel's co-founder and executive director. "Same syntax, same patterns.' Technology allowing AI to converse with job candidates on a screen has been in the works for years. Companies like HireVue pioneered one-way, asynchronous video interviews in the early 2010s and later layered on automated scoring using facial expressions and language analysis – features that drew both interest and criticism. (The visual analysis was rolled back in 2020.) But those platforms largely left the experience static: candidates talking into a screen with no interaction, leaving recorded answers for a human to dissect after the fact. It wasn't until the public release of large language models like ChatGPT in late 2022 that developers began to imagine – and build – something more dynamic. Ribbon was founded in 2023 and began selling its offering the following year. Ghahramani said the company signed nearly 400 customers in just eight months. HeyMilo and Apriora launched around the same time and also report fast growth, though each declined to share customer counts. "The first year ChatGPT came out, recruiters weren't really down for this,' said HeyMilo CEO Sabashan Ragavan. "But the technology has gotten a lot better as time has gone on.' Technical stumbles Even so, the rollout hasn't been glitch-free. A handful of clips circulating on TikTok show interview bots repeating phrases or misinterpreting simple answers. One widely shared example involved an AI interviewer created by Apriora repeatedly saying the phrase "vertical bar pilates. .Aaron Wang, Apriora's co-founder and CEO, attributed the error to a voice model misreading the term "Pilates'. He said the issue was fixed promptly and emphasised that such cases are rare. "We're not going to get it right every single time,' he said. "The incident rate is well under 0.001%.' Chok said Propel Impact had also seen minor glitches, though it was unclear whether they stemmed from Ribbon itself or a candidate's WiFi connection. In those cases, the applicant was able to simply restart. Braden Dennis, who has used chatbot technology to interview candidates for his AI-powered investment research startup FinChat, noted that AI sometimes struggles when candidates ask specific follow-up questions. "It is definitely a very one-sided conversation,' he said. "Especially when the candidate asks questions about the role. Those can be tricky to field from the AI.' Startups providing the technology emphasised their approach to monitoring and support. HeyMilo maintains a 24/7 support team and automated alerts to detect issues like dropped connections or failed follow-ups. "Technology can fail,' Ragavan said, "but we've built systems to catch those corner cases.' Ribbon has a similar protocol. Any time a candidate clicks a support button, an alert is triggered that notifies the CEO. "Interviews are high stakes,' Ghahramani said. "We take those issues really seriously.' And while the videos of glitches are a bad look for the sector, Ghahramani said he sees the TikToks making fun of the tools as a sign the technology is entering the mainstream. Preparing job applicants Candidates applying to FinChat, which uses Ribbon for its screener interviews, are notified up front that they'll be speaking to an AI and that the team is aware it may feel impersonal. "We let them know when we send them the link to complete it that we know it is a bit dystopian and takes the 'human' out of human resources,' Dennis said. "That part is not lost on us.' Still, he said, the asynchronous format helps widen the talent pool and ensures strong applicants aren't missed. "We have had a few folks drop out of the running once I sent them the AI link,' Dennis said. "At the end of the day, we are an AI company as well, so if that is a strong deterrent then that's OK.' Propel Impact prepares candidates by communicating openly about its reasons for using AI in interviews, while hosting information sessions led by humans to maintain a sense of connection with candidates. "As long as companies continue to offer human touch points along the way, these tools are going to be seen far more frequently,' Chok said. Regulators have taken notice. While AI interview tools in theory promise transparency and fairness, they could soon face more scrutiny over how they score candidates – and whether they reinforce bias at scale. Illinois now requires companies to disclose whether AI is analysing interview videos and to get candidates' consent, and New York City mandates annual bias audits for any automated hiring tools used by local employers. Beyond screening calls Though AI interviewing technology is mainly being used for initial screenings, Ribbon's Ghahramani said 15% of the interviews on its platform now happen beyond the screening stage, up from just 1% a few months ago. This suggests customers are using the technology in new ways. Some employers are experimenting with AI interviews in which they can collect compensation expectations or feedback on the interview process – potentially awkward conversations that some candidates, and hiring managers, may prefer to see delegated to a bot. In a few cases, AI interviews are being used for technical evaluations or even to replace second-round interviews with a human. "You can actually compress stages,' said Wang. "That first AI conversation can cover everything from 'Are you authorised to work here?' to fairly technical, domain-specific questions.' Even as AI handles more of the hiring process, most companies selling the technology still view it as a tool for gathering information, not making the final call. "We don't believe that AI should be making the hiring decision,' Ragavan said. "It should just collect data to support that decision.' – Bloomberg
