Hey chatbot, is this true? AI 'factchecks' sow misinformation
As misinformation exploded during India's four-day conflict with Pakistan, social media users turned to an AI chatbot for verification only to encounter more falsehoods, underscoring its unreliability as a fact-checking tool.
With tech platforms reducing human fact-checkers, users are increasingly relying on AI-powered chatbots, including xAI's Grok, OpenAI's ChatGPT, and Google's Gemini, in search of reliable information.
"Hey @Grok, is this true?" has become a common query on Elon Musk's platform X, where the AI assistant is built in, reflecting the growing trend of seeking instant debunks on social media.
But the responses are often themselves riddled with misinformation.
Grok, now under renewed scrutiny for inserting "white genocide," a far-right conspiracy theory, into unrelated queries, wrongly identified old video footage from Sudan's Khartoum airport as a missile strike on Pakistan's Nur Khan airbase during the country's recent conflict with India.
Unrelated footage of a building on fire in Nepal was misidentified as "likely" showing Pakistan's military response to Indian strikes.
"The growing reliance on Grok as a fact-checker comes as X and other major tech companies have scaled back investments in human fact-checkers," McKenzie Sadeghi, a researcher with the disinformation watchdog NewsGuard, told AFP.
"Our research has repeatedly found that AI chatbots are not reliable sources for news and information, particularly when it comes to breaking news," she warned.
NewsGuard's research found that 10 leading chatbots were prone to repeating falsehoods, including Russian disinformation narratives and false or misleading claims related to the recent Australian election.
In a recent study of eight AI search tools, the Tow Center for Digital Journalism at Columbia University found that chatbots were "generally bad at declining to answer questions they couldn't answer accurately, offering incorrect or speculative answers instead."
When AFP fact-checkers in Uruguay asked Gemini about an AI-generated image of a woman, it not only confirmed its authenticity but fabricated details about her identity and where the image was likely taken.
Grok recently labeled a purported video of a giant anaconda swimming in the Amazon River as "genuine," even citing credible-sounding scientific expeditions to support its false claim.
In reality, the video was AI-generated, AFP fact-checkers in Latin America reported, noting that many users cited Grok's assessment as evidence the clip was real.
Such findings have raised concerns as surveys show that online users are increasingly shifting from traditional search engines to AI chatbots for information gathering and verification.
The shift also comes as Meta announced earlier this year it was ending its third-party fact-checking program in the United States, turning over the task of debunking falsehoods to ordinary users under a model known as "Community Notes," popularized by X.
Researchers have repeatedly questioned the effectiveness of "Community Notes" in combating falsehoods.
Human fact-checking has long been a flashpoint in a hyperpolarized political climate, particularly in the United States, where conservative advocates maintain it suppresses free speech and censors right-wing content -- something professional fact-checkers vehemently reject.
AFP currently works in 26 languages with Facebook's fact-checking program, including in Asia, Latin America, and the European Union.
The quality and accuracy of AI chatbots can vary, depending on how they are trained and programmed, prompting concerns that their output may be subject to political influence or control.
Musk's xAI recently blamed an "unauthorized modification" for causing Grok to generate unsolicited posts referencing "white genocide" in South Africa.
When AI expert David Caswell asked Grok who might have modified its system prompt, the chatbot named Musk as the "most likely" culprit.
Musk, the South African-born billionaire backer of President Donald Trump, has previously peddled the unfounded claim that South Africa's leaders were "openly pushing for genocide" of white people.
"We have seen the way AI assistants can either fabricate results or give biased answers after human coders specifically change their instructions," Angie Holan, director of the International Fact-Checking Network, told AFP.
"I am especially concerned about the way Grok has mishandled requests concerning very sensitive matters after receiving instructions to provide pre-authorized answers."
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Economic Times
43 minutes ago
- Economic Times
Good Glamm misses payroll again; Uber top-deck reshuffle
Cash-strapped beauty platform Good Glamm Group did not pay wages for the second month in a row. This and more in today's ETtech Top 5. Also in the letter: ■ Musk in fundraising mode ■ Fresh layoffs at Microsoft■ Top exit at Prosus Good Glamm delays paying salaries again amid cash crunch Cash-strapped beauty and content platform Good Glamm Group has delayed employee salaries for a second consecutive month, as it continues to grapple with a funding squeeze, sources told us. What's happening? The company had previously informed employees that April salaries would be deferred and paid along with May's in June. However, as of June 3, no salaries have been credited, and this time, management has not provided any explanation for the delay. Several former employees are also awaiting their full and final settlements, leaving both current and ex-staff financially stretched. Asset sales: To stay afloat, the Mumbai-based company has been selling or exploring the sale of multiple portfolio brands. Sources said Good Glamm is in talks to sell its stake in personal care brand Organic Harvest back to the brand's founders. As we've reported earlier, it has already exited Sirona and ScoopWhoop. The bigger picture: Once valued at over a billion dollars, Good Glamm pursued an aggressive acquisition spree during the peak of the roll-up ecommerce boom, rapidly acquiring direct-to-consumer (D2C) and content brands. However, scaling and integrating those businesses proved more challenging than anticipated, leading to layoffs, restructuring, stalled growth, and a depleted funding pipeline. Pradeep Parameswaran elevated as Uber's global mobility head in top-level rejig Uber has named Pradeep Parameswaran, its former head of India and Asia-Pacific, as the company's global head of mobility. What's happening: The move is part of a broader leadership reshuffle at the ride-hailing giant. Parameswaran joins Uber's executive leadership team and will report directly to CEO Dara Khosrowshahi. He replaces Andrew Macdonald, who has been promoted to chief operating officer after a 13-year run at the company. This marks Parameswaran's second promotion in just over a year, after being elevated from his APAC role to global head of business development. Indian leadership: Parameswaran's promotion also highlights the growing influence of Indian-origin executives within Uber's global ranks. In October 2024, Sachin Kansal and Praveen Naga were appointed chief product officer and chief technology officer, respectively. In December 2023, Madhu Kannan, a former executive of the Tata Group, joined Uber as its global head of corporate development. Musk kicks off xAI, Neuralink fundraises after DOGE farewell Elon Musk is back on the fundraising saddle, channelling efforts into his new-age companies–xAI and Neuralink, as he sidelines political distractions to refocus on business. xAI to raise $5 billion: Musk's AI venture is seeking to raise $5 billion. Morgan Stanley is shopping the debt at a double-digit interest rate, with the package comprising a floating-rate term loan, a fixed-rate term loan, and senior secured notes. Separately, Musk is selling $300 million worth of xAI shares through a secondary offering, aiming for a sky-high valuation of $113 billion. The funds will likely go towards scaling AI infrastructure, including a data centre in Memphis, and xAI's supercomputer, Colossus. Neuralink secures fresh cash: Neuralink has raised $650 million as it kicks off clinical trials. The round saw participation from ARK Invest, DFJ Growth, Founders Fund, G42, Human Capital, Lightspeed, QIA, Sequoia Capital, Thrive Capital, Valor Equity Partners and Vy Capital. XChat rolls out: In his push to turn X into an 'everything app', Musk has unveiled XChat, a replacement for the legacy direct message (DM) feature inherited from Twitter. The feature offers Bitcoin-style encryption, disappearing messages, cross-platform audio and video calls, and native file sharing. Tesla not into India: Tesla has no plans to manufacture in India, according to union heavy minister HD Kumaraswamy. His comment comes just as India announces its new flagship electric vehicle (EV) policy. Also Read: India's new flagship EV policy to be a 'non-starter' for global biggies Microsoft cuts hundreds more jobs after firing 6,000 last month Microsoft has laid off over 300 employees on Monday, Bloomberg reported, as the company looks to rein in costs even while ramping up investments in AI. Previous round: This comes weeks after Microsoft let go of around 6,000 staff in its biggest layoff round in years. That wave cut across levels, teams and regions. However, software engineers, particularly those based in its Washington home, bore the brunt. Company's justification: 'We continue to implement organisational changes necessary to best position the company for success in a dynamic marketplace,' said a Microsoft spokesperson. Zoom out: This move reflects a broader trend in tech, where companies are reducing headcount, automating roles and prioritising AI-focused talent. Last week, ET reported that Salesforce CFO and COO Robin Washington said the company is slowing hiring and reassigning about 500 customer service employees to new roles, a shift expected to save $50 million. In April, Microsoft CEO Satya Nadella revealed that AI now writes roughly 30% of the code across the company's repositories. Also Read: As Google layoffs continue, a look at Big Tech job cuts in 2025 Prosus chief investment officer Ervin Tu to step down Ervin Tu, the group president and chief investment officer at Prosus, will step down from his role, but continue as an advisor to the company. Curriculum vitae: Tu joined Prosus in August 2021 and has since led several key initiatives, including simplifying the group's structure, improving financial performance, overseeing the ongoing share repurchase programme, and enhancing the operations of the investment team at the Naspers-controlled company. Changing scenario: Over the past 10 months, under the leadership of CEO Fabricio Bloisi, Prosus has transitioned from an investment holding company to an operating tech business, with a sharper focus on lifestyle ecommerce across its core markets in Latin America, India, and Europe. Against this backdrop, Tu believes now is the right time to move on, the company added. Quote, unquote: "I have enjoyed my time with the group immensely, I've accomplished what I wanted to achieve, and the Group is in very good hands," Tu said.
Time of India
an hour ago
- Time of India
Russian billionaire says replacement of SAP software is costly but essential
Live Events Russian steel billionaire Alexey Mordashov said that developing a homegrown alternative to the widely-used business software made by Germany's SAP will require more time and money than anticipated but is a matter of which became Europe's largest company by market capitalization this year, makes software that helps businesses manage functions from marketing and human resources to logistics and provided software to Russia's largest companies, including airline carrier Aeroflot and Russian Railways, but gradually curtailed its business in response to Moscow dispatching troops to Ukraine in 2022 and stopped operations in March Severstal , owned by Mordashov, and petrochemicals firm Sibur have jointly sought to develop an alternative to SAP software."We have done a lot to study this issue over the past year, but it turned out that everything is much more expensive and complicated, requiring more meticulous refinement," he said at a technology conference."We understand the importance of this task... because we need to survive," he held up to 60% of the Russian market for business software before the Ukraine conflict, with the rest mostly divided between Microsoft and many Russian companies are still using pre-installed SAP software but lack access to updates and support from the German company, making their systems vulnerable to statement highlighted the difficulties experienced by Russian companies as they try to develop alternatives to Western software amid Western and Sibur initially teamed up with domestic software maker Consist but have since exited the partnership. Severstal is now looking into solutions provided by developer Business Russian companies like Russian Railways and oil firm Gazpromneft have chosen to cooperate with developer 1C, and are planning to launch a domestic alternative to SAP software in 2027.
Time of India
an hour ago
- Time of India
Meta's nuclear deal signals AI's growing energy needs
Meta's deal to help revive an Illinois nuclear power plant was one way of signaling that the parent company of Facebook and Instagram is preparing for a future built with artificial intelligence. Meta's 20-year deal with Constellation Energy follows similar maneuvers from Amazon, Google and Microsoft, but it will take years before nuclear energy can meet the tech industry's insatiable demand for new sources of electricity. AI uses vast amounts of energy, much of which comes from burning fossil fuels, which causes climate change. The unexpected popularity of generative AI products over the past few years has disrupted many tech companies' carefully laid plans to supply their technology with energy sources that don't contribute to climate change. Even as Meta anticipates more nuclear in the future, its more immediate plans rely on natural gas. Entergy, one of the nation's largest utility providers, has been fast-tracking plans to build gas-fired power plants in Louisiana to prepare for a massive Meta data center complex. Is the US ready for nuclear-powered AI? France has touted its ample nuclear power - which produces about 75% of the nation's electricity, the highest level in the world - as a key element in its pitch to be an AI leader. Hosting an AI summit in Paris earlier this year, French President Emmanuel Macron cited President Donald Trump's "drill baby drill" slogan and offered another: "Here there's no need to drill, it's just plug baby plug." Live Events In the US, however, most of the electricity consumed by data centers relies on fossil fuels - burning natural gas and sometimes coal - according to an April report from the International Energy Agency. As AI demand rises, the main source of new supply over the coming years is expected to be from gas-fired plants, a cheand reliable source of power but one that produces planet-warming emissions. Discover the stories of your interest Blockchain 5 Stories Cyber-safety 7 Stories Fintech 9 Stories E-comm 9 Stories ML 8 Stories Edtech 6 Stories Renewable energy sources such as solar and wind account for about 24% of data center power in the US, while nuclear comprises about 15%, according to the IEA. It will take years before enough climate-friendlier power sources, including nuclear, could start slowing the expansion of fossil fuel power generation. A report released by the US Department of Energy late last year estimated that the electricity needed for data centers in the US tripled over the past decade and is projected to double or triple again by 2028 when it could consume up to 12% of the nation's electricity. Why does AI need so much energy? It takes a lot of computing power to make an AI chatbot and the systems they're built on, such as Meta's Llama. It starts with a process called training or pretraining - the "P" in ChatGPT - that involves AI systems "learning" from the patterns of huge troves of data. To do that, they need specialized computer chips - usually graphics processors, or GPUs - that can run many calculations at a time on a network of devices in communication with each other. Once trained, a generative AI tool still needs electricity to do the work, such as when you ask a chatbot to compose a document or generate an image. That process is called inferencing. A trained AI model must take in new information and make inferences from what it already knows to produce a response. All of that computing takes a lot of electricity and generates a lot of heat. To keep it cool enough to work properly, data centers need air conditioning. That can require even more electricity, so most data center operators look for other cooling techniques that usually involve pumping in water.
