logo
The new reputation risk: When AI misquotes you

The new reputation risk: When AI misquotes you

Fast Company18-07-2025
AI summaries are everywhere now. They appear above search engine results, in chatbots, and as part of the tools customers use when deciding which brands to trust. But what happens when those summaries are wrong, and they're the first thing people see about you?
Welcome to the new era of hallucinated reputation.
AI OVERVIEWS ARE FAST—AND FLAWED
In May 2024, Google launched AI Overviews to millions of U.S. users. The tool uses generative AI to answer search queries with a synthesized answer pulled from across the web. But within days, the cracks showed.
One user asked how to make cheese stick to pizza. Google's AI Overview replied, 'Add a little non-toxic glue.' That response was pulled from a sarcastic Reddit post, not a food blog or scientific source. AI Overviews has treated satirical websites as if they were genuine news outlets and given detailed answers to nonsense questions like 'Can you lick a badger twice?'.
With AI-powered search and summaries being integrated into other major platforms, these issues aren't simple one-offs. Far from rare, their impact will have lasting consequences.
BAD DATA IN, FALSE NARRATIVES OUT
Unlike traditional search results that link directly to verified content, most AI systems don't cite reliable sources consistently. In some cases, they cite them incorrectly; other times, they just make things up. That's a big problem for businesses and public figures.
At erase.com, for example, we worked with a local HVAC service provider that shared a similar name with a much larger national provider, so AI Overviews and chatbot responses were blending the two. When someone searched 'Is [Company Name] legit?' or 'reviews for [Company Name],' the summaries pulled in Reddit threads and Quora comments about the national chain, even after adding narrower search terms like the local business' city or suburb. The generated reviews cited complaints and service issues that had nothing to do with the local provider. One summary even listed an out-of-state headquarters address and misidentified the owners.
AI hallucinations aren't the only concern. Fake reputation services are now bundling AI tools into their offerings. Need a dozen fake press mentions? They'll generate them with GPT-based models and upload them to abandoned blogs. Need a fake bio or testimonial? It's just a prompt away. These fabricated mention often pass initial detection and are hard to trace.
This isn't just about bad jokes or trivia. It's about trust. When customers, investors, or media search for your name or company and see an AI summary that's flat-out wrong, it can quickly distort public perception. And because these AI summaries are designed to reduce clicks, users may never scroll past the top answer to see a correction.
In 2024, the Federal Trade Commission (FTC) issued a final ruling to ban the creation and sale of fake reviews and deceptive testimonials, including those generated by AI. Meanwhile, the U.K.'s Competition and Markets Authority pressured Google into tougher content moderation policies, including warning labels for businesses that manipulate reviews. The EU's Digital Services Act (DSA) now mandates transparency around algorithmic recommendation systems.
But these enforcement systems are still playing catch-up. Hallucinated AI summaries don't clearly fall into categories like defamation or review fraud. They're just wrong. And right now, no one is really accountable. The burden shouldn't just fall on the occasional business that gets caught. There needs to be more accountability for the platforms that enable this kind of manipulation in the first place. Government fines help, but they're only hitting a fraction of the problem.
WHAT YOU CAN DO ABOUT IT
Reputation isn't just about what people say anymore. It's about what machines think people say. Your online presence is being read, summarized, and judged by large language models. And your reputation is being reduced to a few AI-generated lines. If those lines are wrong, misleading, or based on outdated content, your brand or name can take a hit before you even know what's out there. This is the new reality, and you can't opt out. But you can influence what AI sees.
The first step is to audit your public presence. Search your name or brand across major search platforms and AI tools with browsing enabled. Take note of summaries, bios, or claims that are inaccurate or outdated. If something's wrong, don't just wait for it to go away—address it.
Then, update your bios, About pages, and press mentions with consistent facts. Make sure the first three to five search results for your name reflect who you are today, not who you were years ago. These are the signals AI pulls from most often.
It's not just about ranking anymore. People are asking chatbots and AI tools things like 'Is [Your Name] legit?' or 'What do people say about [Your Company]?' That's why long-tail keywords and conversational Q&A content matter. AI models prioritize natural language and structured answers when summarizing reputations.
In a world where machines write the first draft of your reputation, the real risk is staying silent. AI doesn't understand nuance. It just summarizes whatever is most visible and frequent. Make sure the version of you they find is the one you actually want seen.
Orange background

Try Our AI Features

Explore what Daily8 AI can do for you:

Comments

No comments yet...

Related Articles

China calls for global 'consensus' on AI regulation
China calls for global 'consensus' on AI regulation

Yahoo

time25 minutes ago

  • Yahoo

China calls for global 'consensus' on AI regulation

Chinese Premier Li Qiang on Saturday urged the international community to build a global consensus on artificial intelligence (AI) governance, highlighting security risks amid the raging tech race between Beijing and Washington. Speaking at the opening of the World Artificial Intelligence Conference (WAIC) in Shanghai, Li said it is prudent to look at "how to find a balance between development and security [which] urgently requires further consensus from the entire society." Li also announced the creation of a Chinese-led body to promote global AI cooperation and open-source development to keep AI from becoming "the preserve of a few countries and a few enterprises." What is the tech rivalry between the US and China? The three-day WAIC event comes amid intensifying US-China competition in advanced AI technology. Just days before, US President Donald Trump announced the slashing of AI regulations to maintain the US' dominance in the field even as Washington continues to restrict exports of high-end chips to China, citing national security concerns. These restrictions are forcing Chinese companies to look for alternatives, with startup DeepSeek introducing an AI model in January that matched the performance of leading US systems, despite working on less advanced chips. Li, without naming the US, criticized monopolistic control and called for open access to AI technologies, warning of insufficient supply of AI chips and restrictions on talent exchange otherwise. "Only by adhering to openness, sharing and fairness in access to intelligence can more countries and groups benefit from (AI)," he said. 'AI a test of international cooperation' At the WAIC opening ceremony, UN Secretary-General Antonio Guterres said in a video message that AI regulation would be "a defining test of international cooperation." More than 800 companies are participating in this year's WAIC, showcasing over 3,000 tech innovations. While Chinese firms like Huawei and Alibaba are the main entrants, international firms including US-based companies Tesla, Alphabet, and Amazon are also present. Edited by: Saim Dušan Inayatullah

This robot system by TikTok parent ByteDance can fold clothes and clear your table thanks to AI
This robot system by TikTok parent ByteDance can fold clothes and clear your table thanks to AI

Yahoo

time28 minutes ago

  • Yahoo

This robot system by TikTok parent ByteDance can fold clothes and clear your table thanks to AI

TikTok parent company ByteDance has built a robotic system that allows bots to perform household tasks such as folding laundry and cleaning tables. The system uses artificial intelligence (AI) that allows robots to follow language commands and carry out tasks. China, where ByteDance is based, has been developing the technology at lightning speed with the development of its DeepSeek and Manus. According to chip designer Nvidia, robotics is the next phase of AI. That's because while tech companies have been trying to build a general-purpose robot for years, programming robots is difficult. However, with AI, it becomes much easier. Related Cannibal robot? Scientists develop a robot that can grow and heal by eating others What did ByteDance do? ByteDance built a large-scale vision-language-action (VLA) model called GR-3, which allows robots to follow natural language commands and do general tasks. GR-3 can be thought of as the brain of the robot. ByteDance used a robot called ByteMini for the experiment. After GR-3 was inserted into it, the robot could put a shirt on a hanger and place it on a clothing rack. Video by the company also shows the robot picking up household items and placing them in a designated spot. It could differentiate between sizes, successfully following commands to pick up the 'larger plate'. It also completed tasks such as cleaning up the dining table. ByteDance's Seed department, which heads the company's AI research and large language model (LLM) development, said it trained the model with image and text data and then fine-tuned it with data from humans interacting in virtual reality. It was also taught to copy the movements of real robots. Related Humanoids will be the next phase of AI. This is how to train a robot, according to Nvidia ByteDance appears to be increasingly focusing on AI, launching the Seed department in 2023. The new development comes as TikTok is facing another threat of being banned in the US unless the company sells its American assets. US commerce secretary Howard Lutnick reiterated this on Thursday, saying, 'China can have a little piece or ByteDance, the current owner, can keep a little piece'. 'But basically, Americans will have control. Americans will own the technology, and Americans will control the algorithm,' Lutnick told CNBC, adding that if this doesn't happen, 'TikTok is going to go dark, and those decisions are coming very soon'.

GDEV Sends Cash Back to Investors with Special Payout
GDEV Sends Cash Back to Investors with Special Payout

Yahoo

time33 minutes ago

  • Yahoo

GDEV Sends Cash Back to Investors with Special Payout

GDEV Inc. (NASDAQ:GDEV) is included among the 14 Stocks that Paid Special Dividends in 2025. A gaming enthusiast in front of a widescreen monitor, lost in the game. GDEV Inc. (NASDAQ:GDEV) is a gaming and entertainment holding company dedicated to expanding and developing its portfolio of game franchises across multiple genres and platforms. Through its subsidiaries— such as Nexters and Cubic Games— it aims to produce games that captivate and entertain millions of players over the long term. Its popular titles, including Hero Wars, Island Hoppers, and Pixel Gun 3D, have collectively surpassed 550 million downloads and generated $2.5 billion in global bookings. On February 21, GDEV Inc. (NASDAQ:GDEV) announced that its Board of Directors had approved a one-time special cash dividend of $3.31 per share. This payout represents roughly a 20% yield, based on the volume-weighted average share price over the previous 30 trading days. The special dividend, amounting to around $60 million in total, will be funded using profits the company has accumulated in recent years. It represents part of GDEV's total cash holdings, which stood at approximately $153 million as of the third quarter of 2024. While we acknowledge the potential of GDEV as an investment, we believe certain AI stocks offer greater upside potential and carry less downside risk. If you're looking for an extremely undervalued AI stock that also stands to benefit significantly from Trump-era tariffs and the onshoring trend, see our free report on the best short-term AI stock. READ NEXT: and Disclosure: None. Error while retrieving data Sign in to access your portfolio Error while retrieving data Error while retrieving data Error while retrieving data Error while retrieving data

DOWNLOAD THE APP

Get Started Now: Download the App

Ready to dive into a world of global content with local flavor? Download Daily8 app today from your preferred app store and start exploring.
app-storeplay-store