Latest news with #TalkBack
&w=3840&q=100)
Business Standard
16-05-2025
- Business Standard
Google brings AI-powered accessibility features for Android, Chrome, more
Google has announced a range of new accessibility updates set to roll out on the Android platform and Chrome web browser. This includes new AI-powered real-time Expressive Captions, an option for zooming into text without affecting the web page layout in Chrome, and more. Google is also bringing improvements to existing features such as TalkBack which can now answer questions related to images for which there is no alt text available. Here are all the new features: Gemini and TalkBack Google is expanding Gemini integration within the TalkBack feature. While previously it was limited to offering descriptions of images that did not have alt text, the feature now also allows users to ask questions related to it. For example: If a friend texts you a photo of their new guitar, you can get a description and ask follow-up questions about the make and colour, or even what other things are there in the image. Expressive Captions The new Expressive Captions feature for Android uses AI to capture what someone says, and how they say it. For example, users can know when a sports commentary is calling out an 'amaaazing shot' or when the video message is not 'no' but 'nooooo.' Additionally, users will also receive more labels for sounds, so they know when someone is whistling or clearing their throat. The feature is rolling out in English in the US, UK, Canada, and Australia for devices which are running on Android 15 and above. Improved speech recognition Google's project Euphonia which was launched in 2019, is expanding globally to make speech recognition more inclusive, especially for non-standard speech. Developers now have access to Google's open-source tools through GitHub to build and train their models for diverse speech patterns. Accessibility features on Chromebook Chromebooks already offer several accessibility features such as supporting facial gestures for navigation, and a personalised Reading mode. Google is now expanding these features to College Board's Bluebook testing app that allows students to take online tests. Accessibility features in Chrome browser Google's Chrome web browser is getting two new features: Screen reader for PDFs: Previously, Chrome browser did not allow readers to interact with a scanned PDF on their desktop, but from now on Chrome will automatically recognise these types of PDFs using Optical Character Recognition (OCR), and will allow users to highlight, copy, and search for text. Page Zoom on Chrome: Google chrome on Android will now let users increase the size of the text without affecting the web-page layout. Users can customise how much they want to zoom in and then choose to apply the preference to all of the pages they visit. Users can access this feature by tapping the three-dot menu in the top-right corner of Chrome. Apart from these new accessibility updates, Google has reportedly introduced a simple 'docked bar' for its Gmail for Android. According to a report by 9To5Google, the quick reply interface which was introduced last year, is now being replaced by a tool bar docked to the bottom of the screen. This tool bar has Reply, Reply all, Forward, and emoji options.
Mint
16-05-2025
- Mint
Google's TalkBack now lets users ask questions about on-screen images using Gemini AI
On the occasion of Global Accessibility Awareness Day, Google has announced a suite of new artificial intelligence (AI) and accessibility tools aimed at improving digital experiences for people with vision and hearing impairments. The updates will be introduced across Android devices and the Chrome browser, enhancing inclusivity through smart, user-friendly features. In a blog post published on Thursday, the California-based tech company revealed that it is enhancing Android's screen reader, TalkBack, with expanded Gemini AI capabilities. Originally launched last year to generate descriptive captions for images lacking alt text, the updated feature now allows users not only to hear descriptions but also to ask questions about the images or content on their screen. This interactive function is designed to provide deeper visual context for those with vision impairments. Google also announced a wider release of its Expressive Captions feature. Debuted in the US in late 2024, this tool is part of the Live Captions system and aims to convey tone, emotion, and ambient sounds more effectively through AI-generated subtitles. By reflecting vocal emphasis—such as stretching the word 'no' to 'noooooo' to denote despair—the feature adds a layer of expressiveness to otherwise plain text. Expressive Captions are now being rolled out in English to users in Australia, Canada, the UK, and the US on devices running Android 15 and later. Chrome users are also set to benefit from new accessibility enhancements. A major update enables the desktop browser to support screen readers for scanned PDF files, a longstanding limitation. This improvement is powered by optical character recognition (OCR) technology, allowing Chrome to identify text within scanned documents, making it possible to read aloud, highlight, copy, and search content. Additionally, Chrome on Android is introducing Page Zoom—a tool that enlarges text on web pages without distorting the overall layout. This feature is tailored to users with low vision, offering an improved reading experience without the inconvenience of constantly panning across the screen. Google has also emphasised its commitment to supporting developers creating speech recognition tools by releasing new resources to aid innovation in the field.
Hans India
16-05-2025
- Hans India
Chrome for Android Gets Smarter Text Zoom, Image Descriptions and Real-Time AI Captions
Google is making browsing and accessibility more seamless on Android with a fresh set of updates for Chrome and TalkBack. The most user-facing change? Chrome for Android now lets you zoom in on text without disrupting the layout of a webpage — a long-awaited improvement for mobile users. Previously, enlarging content on a page also zoomed in on images and menus, often causing formatting issues. With the latest update, users can simply slide to increase text size alone and apply it either per page or across all websites. To access the new Zoom feature, just tap the three-dot menu in the top-right corner of Chrome and adjust the text size slider. On desktops, Chrome's Optical Character Recognition (OCR) tool also gets a boost. It now automatically detects and processes scanned PDFs, making it easier to highlight, copy, search, and even use screen readers with these documents. The feature was earlier available in beta but is now widely rolled out for desktop users. Google is also improving accessibility on Android by deepening Gemini AI's integration with the TalkBack screenreader. TalkBack can now do more than just describe what's on screen — it can answer detailed follow-up questions about an image. Users can ask about colours, materials, or even what other elements appear in the photo. According to Google, this functionality helps provide "more contextual and nuanced information" to users with visual impairments. Another major update is the launch of Expressive Captions, a feature that brings real-time captions to most apps on Android phones. These AI-generated captions don't just display spoken words, but also convey how they're said — for instance, distinguishing between 'no' and 'noooooo.' The feature can also identify sounds like whistling or throat-clearing, making digital interactions even more immersive.
Yahoo
15-05-2025
- Yahoo
Google rolls out new AI and accessibility features to Android and Chrome
Google announced on Thursday that it's rolling out new AI and accessibility features to Android and Chrome. Most notably, TalkBack, Android's screen reader, now lets you ask Gemini about what's in images and what's on your screen. Last year, Google brought Gemini's capabilities to TalkBack to give people who are blind or have low vision access to AI-generated descriptions for images, even when Alt text isn't available. Now, people can ask questions and get responses about their images. For example, if a friend texts you a photo a their new guitar, you can get a description of it and ask questions about the brand and color. In addition, you can now get descriptions and ask questions about your whole phone screen. So, if you're shopping in an app, you can ask Gemini about the material of an item you're interested in or if there is a discount available. Google also announced today that it's updating Expressive Captions, Android's real-time captions feature that uses AI to capture what someone says, and how they say it. Google says it's aware that one of the ways people express themselves is by dragging out the sound of their words, which is why it has developed a new duration feature on Expressive Captions. Now, you'll know if a sports announcer is calling out an 'amaaazing shot' or when someone isn't simply saying 'no' but 'nooooo.' You'll also start to see new labels for sounds, such as when a person is whistling or clearing their throat. The update is rolling out in English in the U.S., U.K., Canada, and Australia for devices running Android 15 and above. Google is also making it easier to access PDFs on Chrome. Up until now, you wouldn't be able to use your screen reader to interact with a scanned PDF in your desktop Chrome browser. Now, Chrome automatically recognizes these types of PDFs, allowing you to highlight, copy, and search for text like any other page and use your screen reader to read them. This is thanks to the introduction of Optical Character Recognition (OCR), Google says. Plus, Page Zoom on Chrome on Android now lets you increase the size of the text you see without affecting the webpage layout. You can customize how much you want to zoom in and then choose to apply the preference to all of the pages you visit, or just certain ones. You can access this feature by tapping the three-dot menu in the top right corner of Chrome. Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
CNET
15-05-2025
- CNET
Gemini Can Now Answer Questions About Images in Android's TalkBack Screen Reader
Google is weaving AI advancements into its accessibility offerings. It's rolling out updates to features across Android and Chrome, including its TalkBack screen reader and Expressive Captions, the company said Thursday. TalkBack, which was first launched in 2009, reads aloud what's on your screen and lets you navigate your device using custom gestures, voice commands or a virtual braille keyboard. Last year, Google integrated Gemini into TalkBack to offer richer and clearer image descriptions. Gemini in TalkBack can answer questions about what's on your screen. Google Now, you can ask Gemini questions via TalkBack to get more information about what's in a photo. So if someone sends you an image and you want more details about what's being shown, you can ask, and Gemini will answer. If you're online shopping and want to know more about the material of a dress, Gemini can respond to your inquiries. It can also answer questions about anything on your screen, such as whether an item is on sale. Additionally, Google is rolling out the next version of Expressive Captions, which uses AI to convey details like intensity of speech and background sounds in videos and livestreams. When the feature launched in December, it included characterizations like capitalized text for phrases spoken with excitement (such as "HAPPY BIRTHDAY!"), as well as descriptions of ambient sounds like applause or music. Expressive Captions can now convey elongated speech. Google Now, Expressive Captions will also convey the duration of a statement, adding letters if a sports announcer says "amaaazing shot," for instance, or if someone in a video says "nooooo." It can also label more sounds like someone whistling or clearing their throat. The update is rolling out in English in the US, UK, Canada and Australia on devices running Android 15 and up. It also just got easier to access PDFs on Chrome. Previously, screen readers couldn't interact with scanned PDFs in a desktop Chrome browser. Now, Optical Character Recognition makes it possible for Chrome to automatically recognize these PDFs, so you can use your screen reader and also highlight, copy and search for text like you would with any other page. Page Zoom lets you increase text size without throwing off a webpage's layout. Google And Page Zoom now lets you enlarge text in Chrome on Android without distorting the webpage's layout, similar to how it works on desktop Chrome. To use the feature, tap the three-dot menu in the upper right corner in Chrome and choose your zoom level. Google's announcement comes on Global Accessibility Awareness Day, for which other tech companies like Apple and TikTok have also shared new features. It arrives hot on the heels of The Android Show: I/O Edition, during which Google unveiled Android 16 and Gemini updates. Next week, the search giant will be hosting its I/O developers conference, which is likely to focus heavily on AI capabilities.
