Gemini Can Now Answer Questions About Images in Android's TalkBack Screen Reader
Google is weaving AI advancements into its accessibility offerings. It's rolling out updates to features across Android and Chrome, including its TalkBack screen reader and Expressive Captions, the company said Thursday.
TalkBack, which was first launched in 2009, reads aloud what's on your screen and lets you navigate your device using custom gestures, voice commands or a virtual braille keyboard. Last year, Google integrated Gemini into TalkBack to offer richer and clearer image descriptions.
Gemini in TalkBack can answer questions about what's on your screen.
Google
Now, you can ask Gemini questions via TalkBack to get more information about what's in a photo. So if someone sends you an image and you want more details about what's being shown, you can ask, and Gemini will answer. If you're online shopping and want to know more about the material of a dress, Gemini can respond to your inquiries. It can also answer questions about anything on your screen, such as whether an item is on sale.
Additionally, Google is rolling out the next version of Expressive Captions, which uses AI to convey details like intensity of speech and background sounds in videos and livestreams. When the feature launched in December, it included characterizations like capitalized text for phrases spoken with excitement (such as "HAPPY BIRTHDAY!"), as well as descriptions of ambient sounds like applause or music.
Expressive Captions can now convey elongated speech.
Google
Now, Expressive Captions will also convey the duration of a statement, adding letters if a sports announcer says "amaaazing shot," for instance, or if someone in a video says "nooooo." It can also label more sounds like someone whistling or clearing their throat. The update is rolling out in English in the US, UK, Canada and Australia on devices running Android 15 and up.
It also just got easier to access PDFs on Chrome. Previously, screen readers couldn't interact with scanned PDFs in a desktop Chrome browser. Now, Optical Character Recognition makes it possible for Chrome to automatically recognize these PDFs, so you can use your screen reader and also highlight, copy and search for text like you would with any other page.
Page Zoom lets you increase text size without throwing off a webpage's layout.
Google
And Page Zoom now lets you enlarge text in Chrome on Android without distorting the webpage's layout, similar to how it works on desktop Chrome. To use the feature, tap the three-dot menu in the upper right corner in Chrome and choose your zoom level.
Google's announcement comes on Global Accessibility Awareness Day, for which other tech companies like Apple and TikTok have also shared new features. It arrives hot on the heels of The Android Show: I/O Edition, during which Google unveiled Android 16 and Gemini updates. Next week, the search giant will be hosting its I/O developers conference, which is likely to focus heavily on AI capabilities.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Tom's Guide
an hour ago
- Tom's Guide
5 Android settings you need to turn off right now because they're a huge security risk
One of the main reasons that people choose an Android smartphone over an iOS one, is the ability to customize and adjust every aspect of their device. From personalizing themes and icons to modifying aspects of the software, Android provides a vastly different landscape in which to play. So why then are so many of the security settings left on risky default modes? There are plenty of ways you can adjust and toggle your device, but one of the first ways you should familiarize yourself with your Android phone is to know how to lock down all the security features so that you can make sure that you are best protected. From checking out some of the best Android antivirus apps to knowing which settings need to be immediately shut off, it's up to you to make sure you're practicing good cybersecurity hygiene. Ideally, you're checking what permissions each app is asking for when you downloading them to see if it's reasonable and safe. After all, there's no reason for a Scrabble app to need access to your photos, or for a word processing app to require all your call logs, your location and your contact information. With the number of data breaches that occur, handing out more personal information than is necessary to apps is just waiting for identity theft to happen. To manage the permission of the apps that are on your phone, head over to Settings, then tap on Privacy, next Permission Manager. Select a permission type, tap an application then tap 'Don't allow' if you would like to remove the permission from the app. However, if you just don't want it to collect unnecessary data when the app is closed, you can choose 'Allow only while using the app.' Extend Unlock (formerly called Smart Lock) is a feature that allows you to keep your device unlocked when at home or near to a trusted device, which is convenient. However, it's also risky since it means it could also allow unauthorized access to your device if someone else were to pick up your phone. Turning this feature off doesn't (usually) add a huge amount of hassle to your experience, and it could make it harder for another member of your household to make an unapproved purchase on your device. Just go to Settings, then Security & Privacy, then select More Security & Privacy and tap Extend Unlock. Turn off three features: On Body Detected, Trusted Places and Trusted Devices. Get instant access to breaking news, the hottest reviews, great deals and helpful tips. While seeing notifications on the lock screen can be handy, it can also be a huge security risk if those notifications reveal personal information like banking details, medical appointments, emails or sensitive work details that shouldn't be shared. Fortunately, those notifications can all be toggled off at any time, for any app. Simply head back to the Settings menu, then Notifications, choose Notifications on Lock Screen, then 'Hide silent conversations and notifications.' Then you can select 'Do not show any notifications' for any apps that you don't want to see alerts for. Of all the permissions, the one to be most strict about will be your location and personalized location. That's because your phone is always using your location and tracking your current position in order to provide that data to the apps that need it (maps or delivery services are good examples). However, because your phone also keeps a log about everywhere you go, you should make sure that apps that don't need that data (Duolingo or Pinterest perhaps), don't have access to it. Turn off location for apps that don't need it, and if an app does need it, only turn it on when using the app. Go to Settings, Location, Location Services, Tap on Google Locations History and then turn it off or you can opt to have it auto delete after a set period of time. Unless you're one of the very rare people who are thinking "you know what I need in my life? More ads!" then it's probably safe to assume that you are ready to turn off or block some of the ads on your phone. You don't need them personalized, you need them gone. Open Settings, then go to Google, next click on Ads and tap your Google Account. From there, you should be able to click through to Data and Privacy, then Ad Settings and Ad Personalization where you can opt out. You don't need to make their job easier — trust me, ads will find you.
Yahoo
an hour ago
- Yahoo
Broadcom's AI Bonanza Has Limits
Broadcom is making a lot of money by helping tech companies manufacture custom chips that speed up artificial-intelligence computations. Broadcom's stock is the fifth-best-performing in the S&P 500 over the past two months, rising more than 70% over the period—a stunning rise given the company's already large size. Years ago, Broadcom began helping Google make AI chips, an interesting but not wildly profitable side hustle at the time.
Yahoo
an hour ago
- Yahoo
Alphabet to Expand Engineering Ranks Through 2026
Alphabet (NASDAQ:GOOG) CEO Sundar Pichai vows to keep hiring engineers into 2026 as AI investments ramp, saying human talent remains crucial amid Google's $100 billion-plus AI push. Speaking at Bloomberg Tech in San Francisco, Pichai said engineering headcount will grow from current levels into next year, believing more engineers will boost productivity by automating mundane tasks. The comments come as peers retrench: Microsoft (NASDAQ:MSFT) cut hundreds of roles after its largest layoff in years, and Intel (INTC) joined the wave, with 137 tech companies shedding 62,114 jobs so far in 2025 per Though Google itself has trimmed staff in recent years, Pichai argued AI still makes fundamental coding errors, underscoring the need for engineers to oversee model development. Are we on an absolute path to AGI? I don't think anyone can say for sure, he said, highlighting uncertainties around artificial general intelligence. As Google integrates AI more deeply into Search, publishers fear traffic losses from AI-generated answers, but Pichai assured that Google will continue directing users to websites. We designed AI Overviews to prioritize high-quality outbound links, and years from now that's how Google will work, he noted. Although tech layoffs have eased, sector cuts underscore headwinds. Pichai's emphasis on engineering investment signals that Alphabet sees personnel as a moat against rivals. Meanwhile, Meta Platforms' (NASDAQ:META) CTO Andrew Bosworth said Silicon Valley is now more open to supporting U.S. military projects, referencing Meta's partnership with Anduril Industries to supply XR gear for the Army. Investors should watch whether Alphabet's engineering investments pay off as rivals cut costs, because talent retention could determine AI competitiveness. Investors will eye Alphabet's Q2 earnings and headcount data when reported next month. This article first appeared on GuruFocus. Error while retrieving data Sign in to access your portfolio Error while retrieving data Error while retrieving data Error while retrieving data Error while retrieving data
