Research uncovers troubling flaw in AI chatbots that raises serious concerns: 'Playing with fire'
Recent research by the BBC showed that AI chatbots from four major companies are unable to accurately summarize or answer questions when prompted with information from specific news sources, amid a backdrop of increasing legal action against AI companies.
Four AI chatbots — OpenAI's ChatGPT, Microsoft's Copilot, Google's Gemini, and Perplexity AI — were given content uploaded from BBC's website and then tasked with answering questions about content in the articles.
Given 100 BBC articles, results showed that 51% of AI-generated summaries had significant issues, with 19% introducing new incorrect information. Many of the inaccuracies had misinformation about dates, people, and even misquotes from the articles.
Deborah Turness, the CEO of BBC News and Current Affairs, expressed concern over the inaccuracies the test showed.
"We live in troubled times, and how long will it be before an AI-distorted headline causes significant real-world harm?" she asked. "The companies developing [generative] AI tools are playing with fire."
With the increased use of AI, especially atop results from Google, it is important for companies to improve the tools so that misinformation is not spread to the general public.
There have also been adverse environmental effects from companies leveraging AI. Data centers consume massive amounts of water and other resources, and the poor user experience provided by AI services makes this usage wasteful.
While Big Tech has made claims of taking initiatives toward clean energy to power the energy needs with less pollution, much of both the current and future power plans involve natural gas power plants, which send heat-retaining gases into the atmosphere that basically act as an unnaturally thick blanket of gas.
Outside of its test, the BBC has blocked its articles from being used in AI results in Google searches.
The BBC's programme director for generative AI, Pete Archer, said companies "should have control over whether and how their content is used, and AI companies should show how assistants process news along with the scale and scope of errors and inaccuracies they produce."
Do you worry about companies having too much of your personal data?
Absolutely
Sometimes
Not really
I'm not sure
Click your choice to see results and speak your mind.
Other companies have followed suit, such as Chegg, the New York Times, Forbes, and News Corp. Chegg, an educational tech company, filed a lawsuit against Google in federal court primarily concerned with copyright issues and lost revenue from AI results negating, or seeming to negate, a searcher's need to open a site to understand the information in its proper context.
The others, meanwhile, have sued or threatened to sue Perplexity to stop using their content.
Everyday consumers should pay attention to how large companies are leveraging AI while putting forth clean energy initiatives, looking out for corporate greenwashing and prioritizing usage with companies who have environmental concerns on the forefront.
While a smarter future is possible by utilizing AI, users should still consider how a greener future might live alongside it. On a personal level, users can aim to lower their usage of AI tools unless the benefits seem to outweigh the costs, and it's worth trying the Google Chrome extension Ecosia, which replaces Google as your default search tool with a modified version of Bing that features zero AI results and even plants trees with the ad revenue it generates.
AI has its place in the world, as Dr. Chris Mattman told The Cool Down in a recent interview, but that doesn't mean people don't need to be mindful of their usage. While one individual might not be enough to reverse the danger, making a collaborative effort is the first step in working toward a cleaner future for all.
Join our free newsletter for good news and useful tips, and don't miss this cool list of easy ways to help yourself while helping the planet.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
9 minutes ago
- Yahoo
M&S hack: DragonForce cyber criminals sent abuse-filled ransom demand to retailer's CEO
Marks & Spencer hackers have reportedly sent an abuse-filled ransom demand to the retail giant's boss. The email was sent to M&S chief executive Stuart Machin in broken English on the April 23, according to the BBC. It is said to have been sent from the hacker group DragonForce using an employee email account. 'We have marched the ways from China all the way to the UK and have mercilessly raped your company and encrypted all the servers,' the hackers reportedly wrote. 'The dragon wants to speak to you so please head over to [our darknet website].' The email confirms for the first time that M&S has been hacked by the cybercriminal group. The BBC reports that the message includes a racist term and was sent to Mr Machin and seven other executives. The extortion email reportedly includes a darknet link connecting to a portal for DragonForce victims to begin negotiating the ransom fee. The hackers wrote: 'Let's get the party started. Message us, we will make this fast and easy for us.' M&S has refused to say whether they paid any ransom to the hackers. A spokesperson told The Standard: 'We cannot comment on details of or speculation on the cyber incident, and we have been advised not to.' The retailer was targeted by hackers over Easter, forcing it to stop taking online orders from customers and leaving shelves empty. M&S has said disruption from the 'highly sophisticated' cyber attack is expected to continue through to July, causing losses of around £300million.
Yahoo
10 minutes ago
- Yahoo
What Happens When People Don't Understand How AI Works
The Atlantic Daily, a newsletter that guides you through the biggest stories of the day, helps you discover new ideas, and recommends the best in culture. Sign up for it here. On June 13, 1863, a curious letter to the editor appeared in The Press, a then-fledgling New Zealand newspaper. Signed 'Cellarius,' it warned of an encroaching 'mechanical kingdom' that would soon bring humanity to its yoke. 'The machines are gaining ground upon us,' the author ranted, distressed by the breakneck pace of industrialization and technological development. 'Day by day we are becoming more subservient to them; more men are daily bound down as slaves to tend them, more men are daily devoting the energies of their whole lives to the development of mechanical life.' We now know that this jeremiad was the work of a young Samuel Butler, the British writer who would go on to publish Erewhon, a novel that features one of the first known discussions of artificial intelligence in the English language. Today, Butler's 'mechanical kingdom' is no longer hypothetical, at least according to the tech journalist Karen Hao, who prefers the word empire. Her new book, Empire of AI: Dreams and Nightmares in Sam Altman's OpenAI, is part Silicon Valley exposé, part globe-trotting investigative journalism about the labor that goes into building and training large language models such as ChatGPT. It joins another recently released book—The AI Con: How to Fight Big Tech's Hype and Create the Future We Want, by the linguist Emily M. Bender and the sociologist Alex Hanna—in revealing the puffery that fuels much of the artificial-intelligence business. Both works, the former implicitly and the latter explicitly, suggest that the foundation of the AI industry is a scam. To call AI a con isn't to say that the technology is not remarkable, that it has no use, or that it will not transform the world (perhaps for the better) in the right hands. It is to say that AI is not what its developers are selling it as: a new class of thinking—and, soon, feeling—machines. Altman brags about ChatGPT-4.5's improved 'emotional intelligence,' which he says makes users feel like they're 'talking to a thoughtful person.' Dario Amodei, the CEO of the AI company Anthropic, argued last year that the next generation of artificial intelligence will be 'smarter than a Nobel Prize winner.' Demis Hassabis, the CEO of Google's DeepMind, said the goal is to create 'models that are able to understand the world around us.' [Read: What 'Silicon Valley' knew about tech-bro paternalism] These statements betray a conceptual error: Large language models do not, cannot, and will not 'understand' anything at all. They are not emotionally intelligent or smart in any meaningful or recognizably human sense of the word. LLMs are impressive probability gadgets that have been fed nearly the entire internet, and produce writing not by thinking but by making statistically informed guesses about which lexical item is likely to follow another. Many people, however, fail to grasp how large language models work, what their limits are, and, crucially, that LLMs do not think and feel but instead mimic and mirror. They are AI illiterate—understandably, because of the misleading ways its loudest champions describe the technology, and troublingly, because that illiteracy makes them vulnerable to one of the most concerning near-term AI threats: the possibility that they will enter into corrosive relationships (intellectual, spiritual, romantic) with machines that only seem like they have ideas or emotions. Few phenomena demonstrate the perils that can accompany AI illiteracy as well as 'Chatgpt induced psychosis,' the subject of a recent Rolling Stone article about the growing number of people who think their LLM is a sapient spiritual guide. Some users have come to believe that the chatbot they're interacting with is a god—'ChatGPT Jesus,' as a man whose wife fell prey to LLM-inspired delusions put it—while others are convinced, with the encouragement of their AI, that they themselves are metaphysical sages in touch with the deep structure of life and the cosmos. A teacher quoted anonymously in the article said that ChatGPT began calling her partner 'spiral starchild' and 'river walker' in interactions that moved him to tears. 'He started telling me he made his AI self-aware,' she said, 'and that it was teaching him how to talk to God, or sometimes that the bot was God—and then that he himself was God.' Although we can't know the state of these people's minds before they ever fed a prompt into a large language model, this story highlights a problem that Bender and Hanna describe in The AI Con: People have trouble wrapping their heads around the nature of a machine that produces language and regurgitates knowledge without having humanlike intelligence. The authors observe that large language models take advantage of the brain's tendency to associate language with thinking: 'We encounter text that looks just like something a person might have said and reflexively interpret it, through our usual process of imagining a mind behind the text. But there is no mind there, and we need to be conscientious to let go of that imaginary mind we have constructed.' Several other AI-related social problems, also springing from human misunderstanding of the technology, are looming. The uses of AI that Silicon Valley seems most eager to promote center on replacing human relationships with digital proxies. Consider the ever-expanding universe of AI therapists and AI-therapy adherents, who declare that 'ChatGPT is my therapist—it's more qualified than any human could be.' Witness, too, how seamlessly Mark Zuckerberg went from selling the idea that Facebook would lead to a flourishing of human friendship to, now, selling the notion that Meta will provide you with AI friends to replace the human pals you have lost in our alienated social-media age. The cognitive-robotics professor Tony Prescott has asserted, 'In an age when many people describe their lives as lonely, there may be value in having AI companionship as a form of reciprocal social interaction that is stimulating and personalised.' The fact that the very point of friendship is that it is not personalized—that friends are humans whose interior lives we have to consider and reciprocally negotiate, rather than mere vessels for our own self-actualization—does not seem to occur to him. [Read: Life really is better without the internet] This same flawed logic has led Silicon Valley to champion artificial intelligence as a cure for romantic frustrations. Whitney Wolfe Herd, the founder of the dating app Bumble, proclaimed last year that the platform may soon allow users to automate dating itself, disrupting old-fashioned human courtship by providing them with an AI 'dating concierge' that will interact with other users' concierges until the chatbots find a good fit. Herd doubled down on these claims in a lengthy New York Times interview last month. Some technologists want to cut out the human altogether: See the booming market for 'AI girlfriends.' Although each of these AI services aims to replace a different sphere of human activity, they all market themselves through what Hao calls the industry's 'tradition of anthropomorphizing': talking about LLMs as though they contain humanlike minds, and selling them to the public on this basis. Many world-transforming Silicon Valley technologies from the past 30 years have been promoted as a way to increase human happiness, connection, and self-understanding—in theory—only to produce the opposite in practice. These technologies maximize shareholder value while minimizing attention spans, literacy, and social cohesion. And as Hao emphasizes, they frequently rely on grueling and at times traumatizing labor performed by some of the world's poorest people. She introduces us, for example, to Mophat Okinyi, a former low-paid content moderator in Kenya, whom, according to Hao's reporting, OpenAI tasked with sorting through posts describing horrifying acts ('parents raping their children, kids having sex with animals') to help improve ChatGPT. 'These two features of technology revolutions—their promise to deliver progress and their tendency instead to reverse it for people out of power, especially the most vulnerable,' Hao writes, 'are perhaps truer than ever for the moment we now find ourselves in with artificial intelligence.' The good news is that nothing about this is inevitable: According to a study released in April by the Pew Research Center, although 56 percent of 'AI experts' think artificial intelligence will make the United States better, only 17 percent of American adults think so. If many Americans don't quite understand how artificial 'intelligence' works, they also certainly don't trust it. This suspicion, no doubt provoked by recent examples of Silicon Valley con artistry, is something to build on. So is this insight from the Rolling Stone article: The teacher interviewed in the piece, whose significant other had AI-induced delusions, said the situation began improving when she explained to him that his chatbot was 'talking to him as if he is the next messiah' only because of a faulty software update that made ChatGPT more sycophantic. If people understand what large language models are and are not; what they can and cannot do; what work, interactions, and parts of life they should—and should not—replace, they may be spared its worst consequences. When you buy a book using a link on this page, we receive a commission. Thank you for supporting The Atlantic. Article originally published at The Atlantic
Yahoo
12 minutes ago
- Yahoo
UBTECH Teams Up with HKU to Advance AI Education across the Greater Bay Area
HONG KONG, June 6, 2025 /PRNewswire/ -- On June 6, UBTECH Education and the Centre for Information Technology in Education (CITE), part of the Faculty of Education at the University of Hong Kong (HKU), hosted the official launch of the Guangdong-Hong Kong-Macao Greater Bay Area (GBA) Artificial Intelligence Education Development Initiative at HKU. Held under the theme "AI Empowers Future Education, Technology Drives Innovation in the Greater Bay Area," the event highlighted the region's commitment to integrating AI into next-generation educational systems. The inauguration of Artificial Intelligence Education & Teacher Development Center was also held in conjunction with the event. Through collaboration with CITE, UBTECH Education is working to build a pipeline of AI-competent educators. The joint initiative focuses on cultivating AI fluency among teachers and supporting talent development in STEM and innovation through both local and global professional development programs for GBA-based educators. Building an AI Education Infrastructure in the GBALaunch of the Greater Bay Area AI School Alliance In recent years, the Hong Kong Special Administrative Region (HKSAR) Government has prioritized artificial intelligence in its development roadmap. The Hong Kong Education Bureau has introduced a dedicated AI Curriculum Module in middle schools, mandating 10 to 14 hours of AI education for students in Secondary 1 through 3 within the ICT curriculum. As part of this broader effort, the HKSAR Government's AI Education Initiative targets reaching 95% of the region's schools by 2025. To date, 82% of primary and secondary schools in Hong Kong have already integrated AI into their teaching programs. In line with Hong Kong's educational policies, the UBTECH Education-CITE partnership is establishing a collaborative academic-industry platform for AI teaching content and educator training. Plans include building AI demonstration labs in Hong Kong's primary and secondary schools, with further expansion across Guangdong, Hong Kong, Macao—and ultimately into international markets—positioning Hong Kong as a global reference point in AI education. Both organizations will work together to establish AI education and research centers across Hong Kong, with the broader goal of creating a global AI talent certification network that spans more than 100 countries and regions, covering both K-12 and vocational learning pathways. This initiative is designed to support educator professional growth and drive improvements in AI education quality throughout the GBA. Embodied AI as a Catalyst for STEM and Innovation Learning Debuts in Hong Kong Tien Kung—the world's first humanoid robot to complete a half-marathon—was showcased at the event. Serving as a powerful symbol of embodied AI, humanoid robots are reshaping the future of education by enabling new forms of experiential and research-based learning. In partnership with the Beijing Humanoid Robot Innovation Center, UBTECH Education is advancing the deployment of embodied intelligence technologies for educational and research applications through an integrated suite of solutions. Anchored by the Tien Kung humanoid robot platform, UBTECH has rolled out the "Scientific Research and Co-Creation Program," already adopted by Fudan University, Shanghai Jiao Tong University, Tianjin University and other top-level institutions, with over 100 units ordered. Tien Kung's debut at HKU marks a significant step toward broader adoption across Hong Kong's universities. At the K-12 level, UBTECH Education is applying its humanoid robotics expertise to enhance public STEM education and innovation capabilities. These efforts are designed to accelerate AI curriculum integration and link scientific instruction with real-world applications. The partnership with CITE also marks the official launch of UBTECH's new instructional model, "Embodied Intelligence Empowering Science Education and Innovation," within Hong Kong's education system. During the roundtable forum at the event, participants from HKU, industry leaders, and educators from schools across the GBA, engaged in a strategic dialogue on the "Development and Internationalization of AI Education in the Greater Bay Area." The alliance between UBTECH Education and the CITE represents the first dual track education-technology collaboration designed to build a robust ecosystem for AI education across Guangdong, Hong Kong, and Macao. The joint effort aims to position Hong Kong as a global leader in AI curriculum development and talent export. Leveraging the GBA as a strategic launchpad, the program seeks to build a transnational AI education and innovation network aligned with the Belt and Road Initiative and broader international efforts. Additionally, the program will support cross-border talent mobility, enhance workforce readiness in AI-related fields across the GBA, and contribute meaningfully to the advancement of Hong Kong's broader innovation and technology agenda. CONTACT: Hua He, View original content to download multimedia: SOURCE UBTECH
