Apple readies feature that lets Vision Pro users scroll with their eyes
[LOS ANGELES] Apple is developing a feature for its Vision Pro headset that lets users scroll through software with their eyes, aiming to enhance the device with a novel interface.
The eye-scrolling capability is being tested as part of visionOS 3, an upcoming version of the Vision Pro's operating system, according to sources with knowledge of the matter. Already, the headset lets users navigate the software by looking at objects and then selecting them by pinching their fingers.
The idea is to leverage the Vision Pro's existing eye-tracking hardware and software to take the system a step further, said the sources, who asked not to be identified because the technology is still under wraps. Apple is planning to introduce the new Vision Pro operating system at its annual developer conference starting on Jun 9.
The company also is slated to introduce major upgrades to iOS, iPadOS and macOS at that event, including changes that will make the software experience on those platforms feel more cohesive.
On Tuesday, the iPhone maker announced a slew of upcoming accessibility upgrades for Apple devices, including support for companies working on neural-controlled interfaces.
The team working on visionOS got an overhaul last month. Staff moved out of the prior Vision Products Group into a new combined Siri and visionOS software team within the company's software engineering organisation. A spokesperson for Cupertino, California-based Apple declined to comment.
BT in your inbox
Start and end each day with the latest news stories and analyses delivered straight to your inbox.
Sign Up
Sign Up
The eye-scrolling feature will work across all of Apple's built-in apps on the Vision Pro, which starts at US$3,499, and the company is preparing a way for developers to integrate the technology into their own software. Apple continues to add new features to the device – despite it not being a commercial hit – in a bid to show off the product's underlying capabilities and improve the experience for current users.
At the same time, Apple is working on future hardware devices for the Vision product line. That includes a lighter version, as well as a model that tethers to a Mac for using applications that require low latency, or a minimal lag.
The company is also working on smart glasses – both with and without augmented reality (AR). The AR product is likely to someday run the same operating system as the Vision Pro.
Several years ago, Samsung Electronics added an eye-scrolling feature to its smartphones, taking advantage of the devices' front-facing cameras. But the option never caught on with consumers.
Apple added an eye-tracking feature to the iPhone and iPad last year, also using the front camera, as an option geared towards people with disabilities. It lets them control an on-screen pointer rather than scrolling through apps and content.
In March, Apple rolled out visionOS 2.4, a notable update that brought a new Spatial Gallery app for viewing 3D content. It also added the Apple Intelligence platform and more deeply integrated the software with the iPhone.
Apple is preparing to launch iOS 19 alongside the new visionOS and will include features such as an AI-powered battery optimisation mode and a live-translate system for AirPods. BLOOMBERG
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Straits Times
16 hours ago
- Straits Times
Apple plays it safe on AI despite Wall Street pressure
Apple insisted on June 9 that it was still very much in the AI race, announcing incremental updates to its Apple Intelligence software. PHOTO: REUTERS CUPERTINO, United States - Apple on June 9 remained on its cautious path to embracing generative artificial intelligence (AI) even as rivals race ahead with the technology and Wall Street expresses doubts over its strategy. The pressure was on Apple not to disappoint at its annual Worldwide Developers Conference (WWDC) a year after the iPhone juggernaut made a promise it failed to keep – to improve its Siri voice assistant with generative AI. The annual WWDC is addressed to developers who build apps and tools to run on the company's products. Despite 2024's disappointment, Apple insisted on June 9 that it was still very much in the AI race, announcing incremental updates to its Apple Intelligence software, including the ability for app makers to directly access a device's AI capabilities. This would allow users to engage with apps using generative AI while offline, letting them interact ChatGPT-style with a hiking app, for example, while in remote areas without a connection. Apple CEO Tim Cook briefly mentioned that Siri's AI makeover was still under development and 'needed more time to meet our high quality bar,' which includes Apple's standards on privacy and data security. 'We are making progress, and we look forward to getting these features into customers' hands,' he added. For Mr Gadjo Sevilla, senior analyst for Emarketer, 'the delays to Apple's in-house AI efforts will continue to draw scrutiny'. 'Especially since rivals like Google and Samsung are moving ahead by introducing new on-device AI capabilities, or partnering with AI startups like Perplexity, (in Samsung's case) to provide users with AI features,' he added. The biggest announcement at the event was the renaming of Apple's operating systems so that releases better match their release year. The next operating system will be iOS 26 and will be available across all of Apple's devices – including the Mac, Watch and Vision Pro headset – in the fall, in time for the likely release of the next iPhone 17. Today, Apple's operating systems have vastly different nomenclatures across devices, including the current iOS 18 for the iPhone or macOS 15 for Mac computers. Apple also announced that the new operating system will be the first major iOS redesign since 2013, calling the new look 'liquid glass'. Wall Street divided The relationship between Apple and app-making developers has been strained in recent years, with developers chafing at the iPhone maker's high fees for getting access to the App Store. A marathon lawsuit by Fortnite maker Epic Games ended with Apple being ordered to allow outside payment systems to be used in the US App Store. Adding to doubts about Apple's direction is the fact that the legendary designer behind the iPhone, Mr Jony Ive, has joined with ChatGPT maker OpenAI to create a potential rival device for engaging with AI. Apple also has to deal with tariffs imposed by US President Donald Trump in his trade war with China, a key market for sales growth and the place where most iPhones are manufactured. Mr Trump has also threatened to hit Apple with tariffs if iPhone production wasn't moved to the US, a change which analysts say would be impossible given the costs and capabilities required. Wall Street analysts remain divided on Apple's prospects, with the stock down about 17 percent since the start of the year, wiping over US$600 billion (S$771 billion) from its market value and far outshone by its Big Tech rivals. While some analysts remain optimistic about Apple's long-term AI monetisation potential, others worry the company's cautious approach may prove costly in the longer term. WWDC 'was void of any major Apple Intelligence progress as Cupertino is playing it safe and close to the vest after the missteps in 2024,' said Mr Dan Ives of Wedbush Securities. 'We have a high level of confidence Apple can get this right, but they have a tight window to figure this out,' he added. AFP Join ST's Telegram channel and get the latest breaking news delivered to you.
Business Times
17 hours ago
- Business Times
Apple plays it safe on AI despite Wall Street pressure
[CUPERTINO, United States] Apple on Monday remained on its cautious path to embracing generative AI even as rivals race ahead with the technology and Wall Street expresses doubts over its strategy. The pressure was on Apple not to disappoint at its annual Worldwide Developers Conference (WWDC) a year after the iPhone juggernaut made a promise it failed to keep - to improve its Siri voice assistant with generative AI. The annual WWDC is addressed to developers who build apps and tools to run on the company's products. Despite last year's disappointment, Apple insisted on Monday it was still very much in the AI race, announcing incremental updates to its Apple Intelligence software, including the ability for app makers to directly access a device's AI capabilities. This would allow users to engage with apps using generative AI while offline, letting them interact ChatGPT-style with a hiking app, for example, while in remote areas without a connection. Apple CEO Tim Cook briefly mentioned that Siri's AI makeover was still under development and 'needed more time to meet our high quality bar,' which includes Apple's standards on privacy and data security. BT in your inbox Start and end each day with the latest news stories and analyses delivered straight to your inbox. Sign Up Sign Up 'We are making progress, and we look forward to getting these features into customers' hands,' he added. For Gadjo Sevilla, senior analyst for Emarketer, 'the delays to Apple's in-house AI efforts will continue to draw scrutiny.' 'Especially since rivals like Google and Samsung are moving ahead by introducing new on-device AI capabilities, or partnering with AI startups like Perplexity (in Samsung's case) to provide users with AI features,' he added. The biggest announcement at the event was the renaming of Apple's operating systems so that releases better match their release year. The next operating system will be iOS 26 and will be available across all of Apple's devices - including the Mac, Watch and Vision Pro headset - in the fall, in time for the likely release of the next iPhone 17. Today, Apple's operating systems have vastly different nomenclatures across devices, including the current iOS 18 for the iPhone or macOS 15 for Mac computers. Apple also announced that the new operating system will be the first major iOS redesign since 2013, calling the new look 'Liquid Glass.' Wall Street divided The relationship between Apple and app-making developers has been strained in recent years, with developers chafing at the iPhone maker's high fees for getting access to the App Store. A marathon lawsuit by Fortnite maker Epic Games ended with Apple being ordered to allow outside payment systems to be used in the US App Store. Adding to doubts about Apple's direction is the fact that the legendary designer behind the iPhone, Jony Ive, has joined with ChatGPT maker OpenAI to create a potential rival device for engaging with AI. Apple also has to deal with tariffs imposed by US President Donald Trump in his trade war with China, a key market for sales growth and the place where most iPhones are manufactured. Trump has also threatened to hit Apple with tariffs if iPhone production wasn't moved to the US, a change which analysts say would be impossible given the costs and capabilities required. Wall Street analysts remain divided on Apple's prospects, with the stock down about 17 per cent since the start of the year, wiping over US$600 billion from its market value and far outshone by its Big Tech rivals. While some analysts remain optimistic about Apple's long-term AI monetisation potential, others worry the company's cautious approach may prove costly in the longer term. WWDC 'was void of any major Apple Intelligence progress as Cupertino is playing it safe and close to the vest after the missteps last year,' said Dan Ives of Wedbush Securities. 'We have a high level of confidence Apple can get this right, but they have a tight window to figure this out,' he added. AFP
Business Times
17 hours ago
- Business Times
US: Stocks end mostly up as markets eye trade talks
[NEW YORK] Wall Street stocks edged higher on Monday as US and Chinese representatives held high-stakes trade talks and markets looked ahead to key economic data. Trade representatives for the world's two biggest economies plan a second day of talks on Tuesday following an opening round on Monday. Although there were no breakthroughs, the market has welcomed the negotiations. 'There's hopes that they're inching closer to some sort of a deal,' said Peter Cardillo of Spartan Capital Securities. The Dow Jones Industrial Average finished flat at 42,761.76. The broad-based S&P 500 climbed 0.1 per cent to 6,005.88, while the tech-rich Nasdaq Composite Index added 0.3 per cent at 19,591.24. Treasury Secretary Scott Bessent, Commerce Secretary Howard Lutnick and Trade Representative Jamieson Greer are leading the US delegation, while China's team included Commerce Minister Wang Wentao and China International Trade Representative Li Chenggang. BT in your inbox Start and end each day with the latest news stories and analyses delivered straight to your inbox. Sign Up Sign Up Among individual companies, Apple fell 1.2 per cent after company executives emphasised its artificial intelligence efforts at the tech giant's annual developers conference, including allowing app makers to directly access a device's AI capabilities. Apple has lagged some rivals in introducing AI-advancing updates to its Siri voice assistant and other programs. Warner Brothers Discovery finished down 3.0 per cent after unveiling a plan to split itself into two companies to better position for the streaming era. The entertainment giant will break itself into two publicly traded companies: one covering 'Streaming & Studios' and the other 'Global Networks.' The shift, designed to enable each venture to 'maximise its potential,' is expected to be completed by mid-2026, the company said. This week's agenda includes releases on consumer and producer prices, key benchmarks on inflation. AFP
