Apple readies feature that lets Vision Pro users scroll with their eyes
[LOS ANGELES] Apple is developing a feature for its Vision Pro headset that lets users scroll through software with their eyes, aiming to enhance the device with a novel interface.
The eye-scrolling capability is being tested as part of visionOS 3, an upcoming version of the Vision Pro's operating system, according to sources with knowledge of the matter. Already, the headset lets users navigate the software by looking at objects and then selecting them by pinching their fingers.
The idea is to leverage the Vision Pro's existing eye-tracking hardware and software to take the system a step further, said the sources, who asked not to be identified because the technology is still under wraps. Apple is planning to introduce the new Vision Pro operating system at its annual developer conference starting on Jun 9.
The company also is slated to introduce major upgrades to iOS, iPadOS and macOS at that event, including changes that will make the software experience on those platforms feel more cohesive.
On Tuesday, the iPhone maker announced a slew of upcoming accessibility upgrades for Apple devices, including support for companies working on neural-controlled interfaces.
The team working on visionOS got an overhaul last month. Staff moved out of the prior Vision Products Group into a new combined Siri and visionOS software team within the company's software engineering organisation. A spokesperson for Cupertino, California-based Apple declined to comment.
BT in your inbox
Start and end each day with the latest news stories and analyses delivered straight to your inbox.
Sign Up
Sign Up
The eye-scrolling feature will work across all of Apple's built-in apps on the Vision Pro, which starts at US$3,499, and the company is preparing a way for developers to integrate the technology into their own software. Apple continues to add new features to the device – despite it not being a commercial hit – in a bid to show off the product's underlying capabilities and improve the experience for current users.
At the same time, Apple is working on future hardware devices for the Vision product line. That includes a lighter version, as well as a model that tethers to a Mac for using applications that require low latency, or a minimal lag.
The company is also working on smart glasses – both with and without augmented reality (AR). The AR product is likely to someday run the same operating system as the Vision Pro.
Several years ago, Samsung Electronics added an eye-scrolling feature to its smartphones, taking advantage of the devices' front-facing cameras. But the option never caught on with consumers.
Apple added an eye-tracking feature to the iPhone and iPad last year, also using the front camera, as an option geared towards people with disabilities. It lets them control an on-screen pointer rather than scrolling through apps and content.
In March, Apple rolled out visionOS 2.4, a notable update that brought a new Spatial Gallery app for viewing 3D content. It also added the Apple Intelligence platform and more deeply integrated the software with the iPhone.
Apple is preparing to launch iOS 19 alongside the new visionOS and will include features such as an AI-powered battery optimisation mode and a live-translate system for AirPods. BLOOMBERG
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Business Times
13 hours ago
- Business Times
Huawei launches Pura 80 smartphone series in next step of China comeback
[BEIJING] Chinese tech giant Huawei launched its Pura 80 smartphone series on Wednesday (Jun 11), as the company seeks to cement its comeback in China's premium smartphone market following years of US sanctions. Huawei's latest flagship launch demonstrates the Chinese tech giant's continued efforts to reclaim the top spot in its home market despite ongoing US sanctions. Each new phone release is closely watched as a barometre of the company's technological capabilities and market resilience following years of restrictions that severely impacted its smartphone business. Huawei's resurgence has intensified pressure on Apple, which has seen its market share in China steadily decline and has increasingly relied on price discounts to stimulate sales. Huawei unveiled the Pura 80 series through a livestream event, with consumer business unit head Yu Chengdong focusing heavily on camera capabilities and AI features while staying silent about the chips powering the devices. The series includes four models: Pura 80, Pura 80 Pro, Pura 80 Pro+, and Pura 80 Ultra. Pricing starts at 6,499 yuan (S$1,163) for the Pro series launching Jun 14, with the Pro+ also launching Jun 14 at 7,999 yuan and the Ultra at 9,999 yuan on Jun 26. The base model launches in July. The cameras use XMAGE technology and feature ultra-wide-angle and macro telephoto lenses with embedded AI that can identify objects and provide information like tourist guides. Huawei phone launches generate significant interest as many view them as the company defying US sanctions. On Chinese microblogging platform Weibo, three of the top ten trending topics on Wednesday were Pura 80-related. User reactions were mixed, with many praising the camera capabilities and sleek design while others complained the prices were too high and not worth the cost. REUTERS
CNA
a day ago
- CNA
Russia fines Apple for violating 'LGBT propaganda' law, TASS reports
MOSCOW :A Russian court on Tuesday fined U.S. tech giant Apple six million roubles ($76,510) for violating Russian rules on what Moscow calls "LGBT propaganda," the state TASS news agency reported. Russia in 2023 widened existing restrictions on the promotion of "non-traditional sexual relations" amid a broader crackdown on LGBT rights, part of President Vladimir Putin's push to uphold what he calls traditional values. Apple was fined three million roubles in two civil cases on Tuesday, TASS reported. Apple was last month fined a total of 7.5 million roubles for the same offence. ($1 = 78.4205 roubles)
Straits Times
2 days ago
- Straits Times
Apple plays it safe on AI despite Wall Street pressure
Apple insisted on June 9 that it was still very much in the AI race, announcing incremental updates to its Apple Intelligence software. PHOTO: REUTERS CUPERTINO, United States - Apple on June 9 remained on its cautious path to embracing generative artificial intelligence (AI) even as rivals race ahead with the technology and Wall Street expresses doubts over its strategy. The pressure was on Apple not to disappoint at its annual Worldwide Developers Conference (WWDC) a year after the iPhone juggernaut made a promise it failed to keep – to improve its Siri voice assistant with generative AI. The annual WWDC is addressed to developers who build apps and tools to run on the company's products. Despite 2024's disappointment, Apple insisted on June 9 that it was still very much in the AI race, announcing incremental updates to its Apple Intelligence software, including the ability for app makers to directly access a device's AI capabilities. This would allow users to engage with apps using generative AI while offline, letting them interact ChatGPT-style with a hiking app, for example, while in remote areas without a connection. Apple CEO Tim Cook briefly mentioned that Siri's AI makeover was still under development and 'needed more time to meet our high quality bar,' which includes Apple's standards on privacy and data security. 'We are making progress, and we look forward to getting these features into customers' hands,' he added. For Mr Gadjo Sevilla, senior analyst for Emarketer, 'the delays to Apple's in-house AI efforts will continue to draw scrutiny'. 'Especially since rivals like Google and Samsung are moving ahead by introducing new on-device AI capabilities, or partnering with AI startups like Perplexity, (in Samsung's case) to provide users with AI features,' he added. The biggest announcement at the event was the renaming of Apple's operating systems so that releases better match their release year. The next operating system will be iOS 26 and will be available across all of Apple's devices – including the Mac, Watch and Vision Pro headset – in the fall, in time for the likely release of the next iPhone 17. Today, Apple's operating systems have vastly different nomenclatures across devices, including the current iOS 18 for the iPhone or macOS 15 for Mac computers. Apple also announced that the new operating system will be the first major iOS redesign since 2013, calling the new look 'liquid glass'. Wall Street divided The relationship between Apple and app-making developers has been strained in recent years, with developers chafing at the iPhone maker's high fees for getting access to the App Store. A marathon lawsuit by Fortnite maker Epic Games ended with Apple being ordered to allow outside payment systems to be used in the US App Store. Adding to doubts about Apple's direction is the fact that the legendary designer behind the iPhone, Mr Jony Ive, has joined with ChatGPT maker OpenAI to create a potential rival device for engaging with AI. Apple also has to deal with tariffs imposed by US President Donald Trump in his trade war with China, a key market for sales growth and the place where most iPhones are manufactured. Mr Trump has also threatened to hit Apple with tariffs if iPhone production wasn't moved to the US, a change which analysts say would be impossible given the costs and capabilities required. Wall Street analysts remain divided on Apple's prospects, with the stock down about 17 percent since the start of the year, wiping over US$600 billion (S$771 billion) from its market value and far outshone by its Big Tech rivals. While some analysts remain optimistic about Apple's long-term AI monetisation potential, others worry the company's cautious approach may prove costly in the longer term. WWDC 'was void of any major Apple Intelligence progress as Cupertino is playing it safe and close to the vest after the missteps in 2024,' said Mr Dan Ives of Wedbush Securities. 'We have a high level of confidence Apple can get this right, but they have a tight window to figure this out,' he added. AFP Join ST's Telegram channel and get the latest breaking news delivered to you.
