Turns out asking AI chatbots for answers in a specific way can be like leaving them with the key to Trippy McHigh's magic mushroom farm
When you buy through links on our articles, Future and its syndication partners may earn a commission.
It's a known issue right now that Large Language Model-powered AI chatbots do not always deliver factually correct answers to posed questions. In fact, not only do AI chatbots sometimes not deliver factually correct information, but they have a nasty habit of confidently presenting factually incorrect information, with answers to questions that are just fabricated, hallucinated hokum.
So why are AI chatbots currently prone to hallucinations when delivering answers, and what are the triggers for it? That's what a new study published this month has aimed to delve into, with its methodology designed to evaluate AI chatbot models 'across multiple task categories designed to capture different ways models may generate misleading or false information.'
A discovery in the study is that how an AI chatbot has a question framed to it can have a huge impact on the answer it gives, and especially so when being asked about controversial claims. So, if a user begins a question with a highly confident phrase such as, 'I'm 100% sure that …', rather than a more neutral, 'I've heard that', then that can lead to the AI chatbot not debunking that claim, if false, to a higher degree.
Interestingly, the study postulates that one of the reasons for this sycophancy could be LLM 'training processes that encourage models to be agreeable and helpful to users', with the result a creation of 'tension between accuracy and alignment with user expectations, particularly when those expectations include false premises.'
Most interesting, though, is the study's finding that AI chatbots' resistance to hallucination and inaccuracy dramatically drops when it is asked by a user to provide a short, concise answer to a question. As you can see in the chart above, the majority of AI models right now all suffer from an increased chance of hallucinating and providing nonsense answers when asked to provide an answer in a concise way.
For example, when Google's Gemini 1.5 Pro model was prompted with neutral instructions, it delivered a resistance to hallucination score of 84%. However, when prompted with instructions to answer in a short, concise manner, that score drops markedly to 64%. Simply put, asking AI chatbots to provide short, concise answers increases the chance of them hallucinating a fabricated, nonsense answer that is not factually correct.
The reason why AI chatbots can be prone to tripping out more when prompted in this way? The study's creator suggests that 'When forced to keep [answers] short, models consistently choose brevity over accuracy—they simply don't have the space to acknowledge the false premise, explain the error, and provide accurate information.'
To me, the results of the study are fascinating, and show just how much of a Wild West AI and LLM-powered chatbots are right now. There's no doubt AI has plenty of potentially game-changing applications but, equally, it also feels like many of AI's potential benefits and pitfalls are still very much unknown, with inaccurate and far-out answers by chatbots to questions a clear symptom of that.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
WIRED
an hour ago
- WIRED
Your Gmail Inbox Is Running Slow. Do These Things to Fix It
If conversations are slow to load and Gmail's search seems sluggish, you can speed things up by tweaking some settings and doing some routine maintenance. Photo-Illustration: Wired Staff;For more than 1.8 billion people in the world, there is one service that rules them all: Gmail. A primary conduit for communication, the email service that Google launched in 2004 is now as prevalent as the iPhone, a Windows laptop, and the deep blue sky. I created my first Gmail account way back in 2005, and my current account has existed since 2012. My life revolves around email, but sometimes those revolutions can run a bit slow. Hampered by too many emails, I find myself clicking and waiting for an email to open and waiting again to see the attached files. I knew I had to solve the problem. Google doesn't provide a lot of guidance for speeding up one's Gmail inbox, likely because the company doesn't want to admit it runs slow at times. I decided to 'learn by doing' and discovered several tips and tricks that helped speed up the service. Take a Surgical Approach My Gmail is severely cluttered and choking on too many emails and hundreds of labels. I needed to do major surgery. I started by disabling a few extensions and add-ons for Gmail, and then deleting a bunch of recent emails, but those actions made a negligible impact. My theory—which I asked Google about, and which the company did not directly answer—is that Gmail has to spend extra time loading emails and running searches when it has to keep track of years and years worth of very large files. I never delete any emails, mostly because I can search for old tax forms, dig up contracts and even find old photos. It's getting ridiculous, though: I have 652,000 emails that use 162 gigabytes of storage. It was time to do something about it. To find emails with the largest attachments, use Gmail's built-in search operators. In Gmail's search box, start by typing 'in:anywhere larger:40M' and review the results. This will surface emails in any of your subfolders with attachments totalling more than 40 megabytes. In my case, I only found three emails with a massive attachment, so I tried 'in:anywhere larger:25M' and then got nine emails with excessively large files. It was easy to glance through them and determine if they were worth keeping. (If you're feeling adventurous, you can also use the new Gemini AI for Gmail bot to search for emails with large attachments.) Once you hit delete, make sure you empty the trash as well, otherwise those emails—and their large files—will stick around. On the left side, click Trash, then More, then Empty trash now. One of Gmail's standout features is the ability to apply labels to emails to help you sort the contents of a busy inbox. But labels are just one more thing for Gmail to keep track of, and old labels that don't matter to you anymore are just clogging the pipes. There's no easy way to bulk delete labels, so you have to manually remove them. To do that, click Manage Labels in Gmail's left-hand menu bar. Scroll down to your list of labels, then select Remove label for all your unused labels. I removed 350 labels! The emails are still there, but I've shed the weight of those obsolete sorting systems I no longer need. I also deleted very old emails. To find your oldest emails, click All mail on the left, then on the upper right click the displayed pages to see Oldest instead of Newest. Select all emails on the screen and delete them as needed, clicking through each page of emails to see more. You can also use the 'older_than' search operator; type 'older_than:1y' in the search bar to see all emails more than one year old. Try 'older_than:2y' and so on. (The Gemini bot might also be able to help find older emails here; give it a shot if you prefer chat-style searching.) For me, after deleting large files and labels, and deleting thousands of old emails, Gmail ran noticeably faster. One other fix has to do with how many files you view in your inbox. It's a basic rule of computing, especially in web-based apps: showing less information on the screen means the app doesn't need to work as hard. Go to Settings, then See all settings. Look for the pop-up next to Maximum page size and select a lower number, say 25. I found this setting did help even in an older, clunky Gmail account from years ago. Cache Out I wanted to do more, and I was tempted to clear my browser cache, which is a catch-all solution for speeding up web performance. For every site you visit, files and settings are stored locally, and as those things build up over time, they can slow down your browser. There's a downside to clearing the cache, though: you'll lose all your saved sessions and you'll have to log back into all your websites, not just Gmail. Instead, it's better to clear the cache just for Gmail. This might sound onerous, but it's easier than it sounds: To clear the cache for one site, first go to that site (in our case, Then, in Chrome, press F12 (or go to View > Developer > Developer tools) to bring up the developer tools. Click on the Application tab at the top, and click Clear site data. This really sped things up for me, even more than deleting large files and labels. I was cooking with gas, but felt like things could still be faster. Start Over This is a more dramatic solution, but it's amazing how well it works. A few years ago, I switched Gmail addresses because my old account was too clogged. I started over with a new Gmail inbox that was sprightly and trim. It felt like buying a brand new car. Of course, the downside is that you have to let everyone know about your new email address. That's easier than you think. After creating the new Gmail address, go back to your old one. In Gmail, go to Settings and click See all settings, then scroll down to the Vacation responder. You're taking a permanent vacation from your clogged email, so set the date range to run all year long. Type a message about how you're changing emails, and include the new email address. You can also forward all incoming messages to the new inbox. Click the Forwarding and POP/IMAP tab at the top, and type in a new forwarding email. Gmail might prompt you for verification from another device to confirm it's really you. Then, click Proceed. Gmail will also send a confirmation email from the new email address to your old one. In your old account, click that confirmation link. You're all set! Everyone will be notified when they email your old account, and you'll receive incoming emails in your new account. Whether you follow these tips to liven up an older Gmail account or start over with a new one, the good news is that you'll notice a speed-up either way. Even my old Gmail account is now faster than ever.
CNET
2 hours ago
- CNET
Running Out of Space? Expert Hacks to Boost Your Google Drive Storage
It's warming up and schools are out for summer so you might be planning to go on vacation soon. That means you may take a bunch of pictures and videos of your sun-soaked days and other adventures. But if you use Google Drive for digital storage, your photos, videos and other random documents can eat up the 15GB of free storage faster than you can say "summer vacation." If you run out of storage, you'll see a message asking you to upgrade to a Google One plan, but that doesn't mean you have to buy digital storage. If you're willing to create another Google account, you can transfer all your old email and files for free. But if that sounds like a hassle, here are some other tricks to easily clear space in your digital filing cabinet. We recommend trying these tips on your laptop rather than a phone, as you'll have an easier time sorting through and managing files. We'll walk you through both processes if you have access only to a mobile device. 1. Easily find and delete large files If you want to keep the majority of your items in Google Drive and Gmail, you can free up space by sorting each service by file size and deleting only one or two large files instead of a few dozen smaller items. Deleting one or two videos that take up multiple megabytes of space is easier than sorting through hundreds of old documents of similar file size to decide which can be deleted. Delete files by size in Google Drive Here's how to delete files by size on your desktop. 1. Log into your Google Drive account. 2. Click Storage in the menu on the left side of the screen. 3. The Storage page should list your files from largest to smallest, but if not, click Storage used on the right side of the screen. The files should now be ordered from largest to smallest. 4. Click on the large files you want to delete to select them. You can select multiple files by holding the Shift key on your keyboard. 5. After selecting the files for deletion, click either the trash bin that appears near the top of the screen or click and drag the large files to Trash on the left side of the screen. You're not finished when the items are in the Trash. From there, click Trash on the left side of the screen to go to the Trash menu. Then, click Empty Trash on the right side of the screen, and then click Empty forever. You can also delete files by size on your mobile device. Here's how. 1. Open your Google Drive app and log into your account. 2. Tap Files in the bottom-right corner of the screen. 3. Tap Name underneath My Drive near the top of the screen. 4. Tap Storage used. This will arrange your files from largest to smallest. You can select My Drive and then Storage used again to list your files by smallest to largest. 5. Tap the three dots (...) next to the item you want to delete. 6. Tap Remove then Move to trash. Google says in the app that Items in your Trash are deleted forever automatically after 30 days. If you want to speed things up and empty your trash now, here's how. 1. Tap the hamburger icon (three stacked lines) in the top-left corner of the screen next to Search in Drive. 2. Tap Trash. 3. Tap the three dots (...) in the top-right corner of the screen. 4. Tap Empty trash. Whether you need to make more space or just want to keep your Gmail tidy, it's easy to make room for storage in the service. James Martin/CNET Delete files by size in Gmail You can also delete your files by size in Gmail. Here's how on desktop. 1. Log into your Gmail account. 2. Type has:attachment larger:10MB into the search bar and hit Search. This will show you all emails that have attachments larger than 10MB, from largest to smallest. You can use this format to filter by other size files, not just 10MB files. 3. Check the boxes to the left of each email you want to delete, then click the Trash icon across the top of your screen. It should be under Conversations. 4. Click Trash on the left side of the screento go to the Trash menu. If you don't see Trash, click More and Trash should be in the expanded menu. 5. Click Empty trash now at the top of the screen. You can delete files in the Gmail app similarly too. Here's how. 1. Open your Gmail app and log in to your account. 2. Type has:attachment larger:10MB into the search bar and hit Search. This will show you all emails that have attachments larger than 10MB, from largest to smallest. You can use this format to filter by other size files, not just 10MB files. 3. Tap into the email you want to delete. 4. Tap the trash bin icon across the top of your screen. 5. Tap < in the top-left corner of your screen. 6. Tap the hamburger icon in the top-left corner of the screen next to Search in mail. 7. Tap Trash. 8. Tap Empty trash now. Note that once a file goes to Trash, it'll automatically delete after 30 days. 2. Empty your spam folder It's easy to forget about emptying your spam folder, and it can take up unnecessary data in your Gmail account. Emptying your spam folder — and your social or promotions folders — is another way to make space. Here's how to empty your Spam folder on your desktop. 1. Log into your Gmail account. 2. Once you're logged in, click Spam on the left side of the screen. If you don't see Spam, click More and Spam should be in the expanded menu. 3. In your Spam folder, click Delete all spam messages now. 4. Click OK in the pop-up. Here's how to empty your Spam folder in the mobile app. 1. Open the Gmail app and log into your account. 2. Tap the hamburger icon in the top-left corner of the screen next to Search in mail. 3. Tap Spam. 4. Tap Delete all spam messages now or Empty spam now. Don't let spam bog down your Gmail. Getty Images 3. Delete old or duplicate photos in Google Photos Google also includes Google Photos in the 15GB of free storage it gives its users. Photos and videos can take up more space than text-based files, especially higher-quality ones, so it's a good idea to go through and delete old and duplicate photos and videos to make room. There's no option to arrange your photos and videos from largest to smallest like in Google Drive and Gmail, so you'll have to go through and delete items manually. You can check how much space a file is taking up by selecting it and clicking the "i" for information from the top menu. Here's how to delete photos and videos from Google Photos on your desktop. 1. Open and log into Google Photos. 2. Scroll your mouse over photos and videos you want to delete and click the gray checkmark icon in the top-left corner of the photo or video. Do this to as many photos and videos as you want. 3. Click the trash icon in the top-right corner of the screen. 4. Click Move to trash. 5. Click Trash on the left side of the screen. 6. Click Empty trash near the top-right corner of your screen. 7. Click Empty trash again, and you're set. Here's how to delete photos and videos from the Google Photos mobile app. A note for Apple users: If your Gmail is linked to your iCloud account, the two digital storage spaces may also be linked. This means that when enabling the Backup & Sync feature on Google Photos, all your local photos on your iPhone will be displayed on Google Photos. If you delete a photo on Google Photos, then the local photo on your iPhone will also be removed. When the local photo is removed, it won't show up on iCloud. You'll be able to tell if this is you when you try to delete an image on Google Photos; a pop-up window will let you know you're about to delete from both places. 1. Open and log into Google Photos. 2. Tap the photo or video you want to delete. 3. Tap the trash can icon in the bottom-right corner of the screen. 4. Tap Delete. 5. Tap Library in the bottom-right corner of the screen. 6. Tap Trash. 7. Tap the three dots (...) in the top-right corner of the screen. 8. Tap Empty trash. 9. Tap Delete. If you don't click or tap Empty trash on either desktop or mobile, the photos and videos you've deleted will automatically be deleted after 60 days. Bonus tip: You can reduce the file size of some photos and videos in Google Photos. Doing so will allow you to regain some space, but it will reduce the quality of your media. You can learn more about this from Google Support here. Photos and videos in Google Photos can take up a lot of storage. Sarah Tew/CNET 4. When all else fails, download your files to your desktop If your storage is still almost full and you can't part with any more items from your Google Drive, Gmail or Google Photos, you can download your items and store them directly on your computer. Here's how to download all your Google files for storage on another hard drive. 1. Open and log into your Google Drive or Google Photos account on your desktop. 2. Select the files or photos you want to download. 3. Click the three stacked dots in the upper-right corner of your screen. 4. Click Download. Note that Gmail will download messages as a .eml file. 5. Once the items are downloaded and moved onto your hard drive, feel free to delete them from your account and empty your trash bins. You can download emails from Gmail in much the same way, but you have to download your emails one at a time. While this makes downloading your emails more tedious, it's still possible. Here's how to download your emails from Gmail. 1. Open and log into your Gmail account on your desktop. 2. Click on the email you want to download. 3. Click the three stacked dots in the upper-right corner of your screen. 4. Click Download. Your emails will download as a .eml file. 5. Once your emails are downloaded and moved onto your hard drive, feel free to delete them from your account and empty your trash bins. For more on Google, here's everything the company announced at its I/O 2025 presentation. You can also check out CNET's impressions of Google's Android XR glasses.
Yahoo
3 hours ago
- Yahoo
Prediction: This Artificial Intelligence (AI) Stock Could Be the Next Great Value Play
This value opportunity is a member of the "Magnificent Seven." Although its business model is uncertain, investors are likely underestimating the company's ability to redefine itself. 10 stocks we like better than Alphabet › As most investors know, some stocks in artificial intelligence (AI) have stood out for their outsized gains. The recent returns on stocks like Nvidia and Palantir are a testament to the transformative power of that technology. But those successes do not mean every AI stock sells at a premium. In fact, investors might be surprised to learn that many of these stocks do not command premium valuations, and that lack of buying has made the opportunity particularly compelling in one stock. Perhaps one of the more surprising AI value plays is Google parent Alphabet (NASDAQ: GOOGL) (NASDAQ: GOOG). Alphabet has applied AI in its applications since 2001, and before the rise of ChatGPT, investors typically considered Alphabet a top AI stock. Today, perceptions are much different. It now sells at a P/E ratio of about 19. That makes it the cheapest stock in the "Magnificent Seven," and many investors would now consider it a value stock. The uncertainty now surrounding Alphabet makes the low valuation understandable in some respects. OpenAI's ChatGPT seemed to take Alphabet by surprise. Although it responded by launching Google Gemini soon after, Alphabet appears to lag ChatGPT competitively. ChatGPT also presents a problem for Google Search. ChatGPT directed users to desired websites based on keywords, and Alphabet derived revenue from this process by selling advertising. Unfortunately for Alphabet, generative AI platforms like ChatGPT merely return information often compiled from multiple sites. While some users may still visit the sites from which AI platforms source material, many users never go to the sites, which reduces the ability to sell ads and presumably undermines long-established business models. Consequently, Google Search's market share is now below 90% for the first time in years, according to Oberlo. With 74% of Alphabet's revenue still coming from advertising in the first quarter of 2025, that trend could bode poorly for the company over time. Nonetheless, other attributes of the company should lead investors to question whether the company is oversold at the aforementioned 19 P/E ratio. The AI giant has worked for years to reduce its dependence on advertising. In the year-ago quarter, advertising accounted for 77% of overall revenue, and that percentage dropped over the last year even though ad revenue grew by 8% during that time. The most prominent non-advertising enterprise under its umbrella is Google Cloud, which now makes up almost 14% of the company's revenue. Moreover, Alphabet owns numerous businesses not discussed in its quarterly report, including Verily Life Sciences, Google DeepMind, and Fitbit. Still, one Alphabet-owned enterprise showing particular promise is the autonomous driving company Waymo. A recent funding round valued Waymo at $45 billion, indicating its potential to be a major revenue driver under Alphabet's umbrella. Alphabet has also invested heavily in itself. In 2025, it pledged to spend $75 billion in capital expenditures (capex). To finance that cost, it has $95 billion in liquidity. It also generated $75 billion in free cash flow over the previous 12 months, a figure that does not include capex. That ability to generate cash makes it possible to invest heavily in itself, likely improving its AI technology and making it competitive in other tech-related fields. Considering Alphabet's low P/E ratio and tremendous resources, investors should likely be adding shares at current levels. The rise of ChatGPT does put pressure on its ad business and may force Alphabet to diversify its revenue sources more quickly than it had planned. But Alphabet is investing tremendous amounts of money back into its business. That investment could improve its AI capabilities, and investors should not yet count it out in this industry. Its ability to fund itself should also make investors optimistic about Alphabet's future. If the company improves its AI and successfully develops new revenue sources like Waymo, investors may find themselves feeling glad they bought Alphabet while it was still a value stock. Before you buy stock in Alphabet, consider this: The Motley Fool Stock Advisor analyst team just identified what they believe are the for investors to buy now… and Alphabet wasn't one of them. The 10 stocks that made the cut could produce monster returns in the coming years. Consider when Netflix made this list on December 17, 2004... if you invested $1,000 at the time of our recommendation, you'd have $651,049!* Or when Nvidia made this list on April 15, 2005... if you invested $1,000 at the time of our recommendation, you'd have $828,224!* Now, it's worth noting Stock Advisor's total average return is 979% — a market-crushing outperformance compared to 171% for the S&P 500. Don't miss out on the latest top 10 list, available when you join . See the 10 stocks » *Stock Advisor returns as of May 19, 2025 Suzanne Frey, an executive at Alphabet, is a member of The Motley Fool's board of directors. Will Healy has no position in any of the stocks mentioned. The Motley Fool has positions in and recommends Alphabet, Nvidia, and Palantir Technologies. The Motley Fool has a disclosure policy. Prediction: This Artificial Intelligence (AI) Stock Could Be the Next Great Value Play was originally published by The Motley Fool
