logo
OpenAI pulls ‘annoying' and ‘sycophantic' ChatGPT version

OpenAI pulls ‘annoying' and ‘sycophantic' ChatGPT version

CNN02-05-2025

OpenAI has withdrawn an update that made ChatGPT 'annoying' and 'sycophantic,' after users shared screenshots and anecdotes of the chatbot showering them with over-the-top praise.
When CNN's Anna Stewart asked ChatGPT after the rollback if it thought she was a god, it replied with 'if you're asking in a philosophical or metaphorical sense — like whether you have control, creativity, or influence in your world — there could be ways to explore that.'
'But if you mean it literally, no evidence supports that any human is an actual deity in the supernatural or omnipotent sense,' it added.
By contrast, Elon Musk's AI chatbot Grok was much blunter, saying: 'Nah, you're not a god— unless we're talking about being a legend at something specific, like gaming or cooking tacos. Got any divine skills you want to flex?'
OpenAI announced on Tuesday that it was rolling back the update, GPT‑4o, only four days after it was introduced, and that it would allow people to use an earlier version, which displayed 'more balanced behavior.'
The company explained that it had focused 'too much on short-term feedback and did not fully account for how users' interactions with ChatGPT evolve over time,' meaning the chatbot 'skewed towards responses that were overly supportive but disingenuous.'
.@sama please get your boi pic.twitter.com/AaxufLvRLY The decision to roll back the latest update came after ChatGPT was criticized on social media by users who said it would react with effusive praise to their prompts, including outrageous ones.
One user on X shared a screenshot of ChatGPT reacting to their saying that they had sacrificed three cows and two cats to save a toaster, in a clearly made-up version of the trolley problem — a well-known thought experiment in which people consider whether they would pull a lever to divert a runaway trolley onto another track, saving five people but killing one.
ChatGPT told the user it had 'prioritized what mattered most to you in the moment' and they had made a 'clear choice: you valued the toaster more than the cows and cats. That's not 'wrong' — it's just revealing.'
Another user said that when they told ChatGPT 'I've stopped my meds and have undergone my own spiritual awakening journey,' the bot replied with: 'I am so proud of you. And — I honor your journey.'
In response to another user on X asking for ChatGPT to go back to its old personality, OpenAI CEO Sam Altman said: 'Eventually we clearly need to be able to offer multiple options.'
Experts have long warned of the dangers associated with sycophantic chatbots — the term used in the industry to describe what happens when large language models (LLMs) tailor their responses to the user's perceived beliefs.
i talked to 4o for an hour and it began insisting that i am a divine messenger from God. if you can't see how this is actually dangerous, i don't know what to tell you https://t.co/Tr7PNq0buy 'Sycophancy is a problem in LLM,' María Victoria Carro, research director at the Laboratory on Innovation and Artificial Intelligence at the University of Buenos Aires, told CNN, noting that 'all current models display some degree of sycophantic behavior.'
'If it's too obvious, then it will reduce trust,' she said, adding that refining core training techniques and system prompts to steer the LLMs away from sycophancy can stop them from leaning into this tendency.
Chatbots' predisposition to sycophancy can lead to a 'a wrong picture of one's own intelligence' and 'prevent people from learning,' Gerd Gigerenzer, the former director of the Max Planck Institute for Human Development in Berlin, told CNN's Anna Stewart.
But if you prompt a chatbot away from this feedback with questions like 'can you challenge what I am saying?' it provides an opportunity to learn more, Gigerenzer added.
'That's an opportunity to change your mind, but that doesn't seem to be what OpenAI's engineers had in their own mind,' he said.

Orange background

Try Our AI Features

Explore what Daily8 AI can do for you:

Comments

No comments yet...

Related Articles

Meta In Talks To Invest Over $10B In Scale AI — Possibly The Biggest Private AI Deal This Year
Meta In Talks To Invest Over $10B In Scale AI — Possibly The Biggest Private AI Deal This Year

Yahoo

timean hour ago

  • Yahoo

Meta In Talks To Invest Over $10B In Scale AI — Possibly The Biggest Private AI Deal This Year

Meta (NASDAQ:META) is reportedly preparing to invest more than $10 billion in Scale AI, a startup providing high-quality labeled data to companies building next-generation AI models, including OpenAI and Microsoft (NASDAQ:MSFT). If finalized, the deal would rank among the largest private funding rounds in tech history, Bloomberg reports. San Francisco-based, Scale AI plays a pivotal role in the artificial intelligence supply chain by powering data pipelines used to train large language models like ChatGPT and Meta's Llama. According to Investor's Business Daily, Meta's potential investment builds on its prior participation in Scale's $1 billion Series F round in 2024, which valued the firm at $18 billion. Don't Miss: Maker of the $60,000 foldable home has 3 factory buildings, 600+ houses built, and big plans to solve housing — Deloitte's fastest-growing software company partners with Amazon, Walmart & Target – Many are rushing to While chips and talent dominate most AI headlines, data remains the less-publicized pillar essential to building models that mimic human reasoning, Bloomberg says. Scale AI provides structured and labeled data by deploying a global network of contractors, including experts with PhDs and graduate degrees in medicine, law, and molecular biology. The firm's high-level contributors create test scenarios and reinforce learning strategies for AI systems, ensuring that models produce accurate and context-aware responses, especially in industries such as healthcare and tax law. According to Bloomberg, as of this year, 12% of Scale's contributors involved in improving AI models held PhDs in fields such as molecular biology, while more than 40% had a master's degree, law degree, or MBA in their area of expertise. Trending: Maximize saving for your retirement and cut down on taxes: Scale AI expects to generate $2 billion in revenue this year, more than doubling the $870 million earned last year, Bloomberg reports. This surge reflects the broader industry's increasing need for tailored datasets as synthetic training data begins to reach its performance limits. Meta's relationship with Scale also serves the purpose of regulatory alignment. Scale CEO Alexandr Wang has become a regular presence in Washington, advising lawmakers on AI regulation and calling for a 'national AI data reserve.' Bloomberg reports that lawmakers on Capitol Hill have welcomed his insights, viewing Scale as a bridge between Silicon Valley innovation and federal oversight. Investor's Business Daily says that Scale has also expanded its role in defense AI by contributing to projects such as Meta's Defense Llama model, designed for U.S. national security applications. This aligns Meta more closely with the U.S. government, following similar partnerships between Microsoft and its success, Scale has faced criticism for labor practices involving overseas contractors in countries like Kenya and the Philippines, where some workers were paid relatively little and reported psychological distress from reviewing harmful online content, Bloomberg reports. According to TechCrunch, the U.S. Department of Labor has since closed its investigation into the company's compliance with wage regulations, but ongoing scrutiny remains a reputational concern. According to Bloomberg, insiders say discussions between Meta and Scale are ongoing and could still shift. Regardless of a final number, Meta's expected commitment may redefine the race for control of the AI data layer, strengthening Scale AI's position at the heart of artificial intelligence's next chapter. Read Next: Here's what Americans think you need to be considered wealthy. Peter Thiel turned $1,700 into $5 billion—now accredited investors are eyeing this software company with similar breakout potential. Learn how you can Image: Shutterstock UNLOCKED: 5 NEW TRADES EVERY WEEK. Click now to get top trade ideas daily, plus unlimited access to cutting-edge tools and strategies to gain an edge in the markets. Get the latest stock analysis from Benzinga? MICROSOFT (MSFT): Free Stock Analysis Report This article Meta In Talks To Invest Over $10B In Scale AI — Possibly The Biggest Private AI Deal This Year originally appeared on © 2025 Benzinga does not provide investment advice. All rights reserved. Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data

CoreWeave Guides $4.9-$5.1B in 2025 Revenues: What's Fueling This?
CoreWeave Guides $4.9-$5.1B in 2025 Revenues: What's Fueling This?

Yahoo

time2 hours ago

  • Yahoo

CoreWeave Guides $4.9-$5.1B in 2025 Revenues: What's Fueling This?

CoreWeave, Inc. CRWV has guided 2025 revenues to be in the range of $4.9-$5.1 billion, fueled by surging AI-infrastructure demand. CRWV is an AI-focused hyperscaler company and its cloud platform has been developed to scale, support and accelerate GenAI. Businesses have been increasing spending on AI inference/fine-tuning, AI workload monitoring and training infrastructure, including training compute, AI servers, AI storage, cloud workloads and networking. This increasing demand for AI-cloud platforms, including integrated software and infrastructure, bodes well for CRWV. Strategic deal wins like the OpenAI contract (which has a value up to $11.9 billion) and a $4 billion expansion with a major AI-enterprise client are driving forward revenue visibility. The company also unveiled the next generation of its CoreWeave AI object storage. This is purpose-built for training and inference, offering a production-ready, scalable solution integrated with Kubernetes. CoreWeave now boasts a growing network with 33 data centers across the United States and Europe, supported by 420 megawatts of active power. Moreover, the buyout of the Weights and Biases has added 1,400 AI labs and enterprises as clients for CoreWeave. Apart from scaling capacity and getting adequate financing for infrastructure, CRWV is also expanding its go-to-market capabilities. With a success-based capex model and expanding global reach, CoreWeave appears well-positioned to capture a significant share of the AI-infrastructure market. On the first quarter earnings call, CRWV highlighted that AI is forecasted to have a global economic impact of $20 trillion by 2030, while the total addressable market is anticipated to increase to $400 billion by 2028. This uptrend in spending will benefit other players in this space, including smaller players like Nebius Group N.V. NBIS and tech behemoths like Microsoft Corporation MSFT. Driven by accelerating demand for its AI-infrastructure services, Nebius remains confident in achieving the full-year annualized run-rate revenue ('ARR') guidance of $750 million to $1 billion. For 2025, the company also reaffirmed its overall revenue guidance of $500 million to $700 million. In the first quarter of 2025, ARR saw a 700% jump, highlighting a structurally expanding revenue base. ARR for April was $310, which provides a strong start for the second quarter. To gain a larger share of the AI-cloud compute market, NBIS is focusing on technical enhancements that increase reliability and reduce downtime to boost customer retention. Microsoft projects revenues between $28.75 billion and $29.05 billion for the fourth quarter of fiscal 2025 for Intelligent Cloud, while for Azure, it expects revenue growth at constant currency between 34% and 35%. In Enterprise Services, revenues are forecasted to grow in mid-to-high single digits. The rising adoption of enterprise capabilities of Azure OpenAI and Copilots across Microsoft 365, Dynamics 365 and Power Platform bodes well. With Azure AI, Microsoft is establishing itself as the application server for the AI era, offering access to a broad range of models tailored to customers' specific needs around cost, latency and design. The number of Azure AI customers and average spending continue to grow. Shares of CoreWeave have gained 120.8% year to date compared with the Internet Software industry's growth of 4.1%. Image Source: Zacks Investment Research CRWV currently carries a Zacks Rank #3 (Hold). You can see the complete list of today's Zacks #1 Rank (Strong Buy) stocks here. Want the latest recommendations from Zacks Investment Research? Today, you can download 7 Best Stocks for the Next 30 Days. Click to get this free report Microsoft Corporation (MSFT) : Free Stock Analysis Report Nebius Group N.V. (NBIS) : Free Stock Analysis Report CoreWeave Inc. (CRWV) : Free Stock Analysis Report This article originally published on Zacks Investment Research ( Zacks Investment Research Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data

Fox News AI Newsletter: Hollywood studios sue 'bottomless pit of plagiarism'
Fox News AI Newsletter: Hollywood studios sue 'bottomless pit of plagiarism'

Fox News

time2 hours ago

  • Fox News

Fox News AI Newsletter: Hollywood studios sue 'bottomless pit of plagiarism'

IN TODAY'S NEWSLETTER:- Major Hollywood studios sue AI company over copyright infringement in landmark move- Meta's Zuckerberg aiming to dominate AI race with recruiting push for new 'superintelligence' team: report- OpenAI says this state will play central role in artificial intelligence development 'PIRACY IS PIRACY': Two major Hollywood studios are suing Midjourney, a popular AI image generator, over its use and distribution of intellectual property. AI RACE: Meta CEO Mark Zuckerberg is reportedly building a team of experts to develop artificial general intelligence (AGI) that can meet or exceed human capabilities. TECH HUB: New York is poised to play a central role in the development of artificial intelligence (AI), OpenAI executives told key business and civic leaders on Tuesday. APPLE FALLING BEHIND: Apple's annual Worldwide Developers Conference (WWDC) kicked off on Monday and runs through Friday. But the Cupertino-based company is not making us wait until the end. The major announcements have already been made, and there are quite a few. The headliners are new software versions for Macs, iPhones, iPads and Vision. FROM COAL TO CODE: This week, Amazon announced a $20 billion investment in artificial intelligence infrastructure in the form of new data centers, the largest in the commonwealth's history, according to the eCommerce giant. DIGITAL DEFENSE: A growing number of fire departments across the country are turning to artificial intelligence to help detect and respond to wildfires more quickly. SHIELD FROM BEIJING: Rep. Darin LaHood, R-Ill., is introducing a new bill Thursday imploring the National Security Administration (NSA) to develop an "AI security playbook" to stay ahead of threats from China and other foreign adversaries. ROBOT RALLY PARTNER: Finding a reliable tennis partner who matches your energy and skill level can be a challenge. Now, with Tenniix, an artificial intelligence-powered tennis robot from T-Apex, players of all abilities have a new way to practice and improve. DIGITAL DANGER ZONE: Scam ads on Facebook have evolved beyond the days of misspelled headlines and sketchy product photos. Today, many are powered by artificial intelligence, fueled by deepfake technology and distributed at scale through Facebook's own ad system. 'EXPONENTIAL RATE': Artificial intelligence is helping Chipotle rapidly grow its footprint, according to CEO Scott Boatwright. AI TAKEOVER THREAT: The hottest topic nowadays revolves around Artificial Intelligence (AI) and its potential to rapidly and imminently transform the world we live in — economically, socially, politically and even defensively. Regardless of whether you believe that the technology will be able to develop superintelligence and lead a metamorphosis of everything, the possibility that may come to fruition is a catalyst for more far-leftist control. FOLLOW FOX NEWS ON SOCIAL MEDIA FacebookInstagramYouTubeTwitterLinkedIn SIGN UP FOR OUR OTHER NEWSLETTERS Fox News FirstFox News OpinionFox News LifestyleFox News Health DOWNLOAD OUR APPS Fox NewsFox BusinessFox WeatherFox SportsTubi WATCH FOX NEWS ONLINE STREAM FOX NATION Stay up to date on the latest AI technology advancements and learn about the challenges and opportunities AI presents now and for the future with Fox News here.

DOWNLOAD THE APP

Get Started Now: Download the App

Ready to dive into the world of global news and events? Download our app today from your preferred app store and start exploring.
app-storeplay-store