Apple readies feature that lets Vision Pro users scroll with their eyes
Apple is developing a feature for its Vision Pro headset that lets users scroll through software with their eyes, aiming to enhance the device with a novel interface.
The eye-scrolling capability is being tested as part of visionOS 3, an upcoming version of the headset's operating system, according to people with knowledge of the matter. Already, the headset lets users navigate the software by looking at objects and then selecting them by pinching their fingers.
The idea is to leverage the Vision Pro's existing eye-tracking hardware and software to take the system a step further, said the people, who asked not to be identified because the technology is still under wraps. Apple is planning to introduce the new Vision Pro operating system at its annual developer conference starting on June 9.
The company is also slated to introduce major upgrades to iOS, iPadOS and macOS at that event, including changes that will make the software experience on those platforms feel more cohesive. On Tuesday, the iPhone maker announced a slew of upcoming accessibility upgrades for Apple devices, including support for companies working on neural-controlled interfaces.
The team working on visionOS got an overhaul last month. Staff moved out of the prior Vision Products Group into a new combined Siri and visionOS software team within the company's software engineering organization. A spokesperson for Cupertino, California-based Apple declined to comment.
The eye-scrolling feature will work across all of Apple's built-in apps on the Vision Pro, which starts at $3,499, and the company is preparing a way for developers to integrate the technology into their own software. Apple continues to add new features to the device — despite it not being a commercial hit — in a bid to show off the product's underlying capabilities and improve the experience for current users.
At the same time, Apple is working on future hardware devices for the Vision product line. That includes a lighter version, as well as a model that tethers to a Mac for using applications that require low latency, or a minimal lag. The company is also working on smart glasses — both with and without augmented reality. The AR product is likely to someday run the same operating system as the Vision Pro.
Several years ago, Samsung Electronics added an eye-scrolling feature to its smartphones, taking advantage of the devices' front-facing cameras. But the option never caught on with consumers.
Apple added an eye-tracking feature to the iPhone and iPad last year, also using the front camera, as an option geared toward people with disabilities. It lets them control an on-screen pointer rather than scrolling through apps and content.
In March, Apple rolled out visionOS 2.4, a notable update that brought a new Spatial Gallery app for viewing 3D content. It also added the Apple Intelligence platform and more deeply integrated the software with the iPhone. Apple is preparing to launch iOS 19 alongside the new visionOS and will include features such as an artificial intelligence-powered battery optimization mode and a live-translate system for AirPods.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Japan Times
4 hours ago
- Japan Times
Trump says Musk relationship over, warns of 'serious consequences' if he funds Democrats
Donald Trump said on Saturday his relationship with his billionaire donor Elon Musk is over and warned there would be "serious consequences" if Musk funds U.S. Democrats running against Republicans who vote for the president's sweeping tax and spending bill. In a telephone interview with NBC News, Trump declined to say what those consequences would be, and went on to add that he had not had discussions about whether to investigate Musk. Asked if he thought his relationship with the Tesla and SpaceX CEO was over, Trump said, "I would assume so, yeah." "No," Trump told NBC when asked if he had any desire to repair his relationship with Musk. "I have no intention of speaking to him," Trump said. However, Trump said he had not thought about terminating U.S. government contracts with Musk's StarLink satellite internet or SpaceX rocket launch companies. Musk and Trump began exchanging insults this week, as Musk denounced Trump's bill as a "disgusting abomination." Musk's opposition to the measure complicated efforts to pass the legislation in Congress, where Republicans hold only slim majorities in the House of Representatives and Senate. The bill narrowly passed the House last month and is now before the Senate, where Trump's fellow Republicans are considering making changes. Nonpartisan analysts estimate the measure would add $2.4 trillion to the $36.2 trillion U.S. debt over 10 years, which worries many lawmakers, including some Republicans who are fiscal hawks. Musk also declared it was time for a new political party in the United States "to represent the 80% in the middle!" Trump said on Saturday he is confident the bill would get passed by the U.S. July 4 Independence Day holiday. "In fact, yeah, people that were, were going to vote for it are now enthusiastically going to vote for it, and we expect it to pass," Trump told NBC. Republicans have strongly backed Trump's initiatives since he began his second term as president on January 20. While some Republican lawmakers have made comments to the news media expressing concern about some of Trump's choices, they have yet to vote down any of his policies or nominations. Musk has deleted some social media posts critical of Trump, including one that signaled support for impeaching the president, appearing to seek a de-escalation of their public feud, which exploded on Thursday. During his first term as president, the House, then controlled by Democrats, twice voted to impeach Trump but the Senate both times acquitted him. The White House and Musk did not immediately respond to requests for comment on Saturday on the deleted posts. People who have spoken to Musk said his anger has begun to recede and they thought he would want to repair his relationship with Trump. One of the X posts that Musk appeared to have deleted was a response to another user posting: "President vs Elon. Who wins? My money's on Elon. Trump should be impeached and (Vice President) JD Vance should replace him." Musk had written "yes." On Theo Von's "This Past Weekend" podcast — recorded on Thursday as the feud between Trump and Musk unfolded and released on Saturday — Vance called Musk's criticism of Trump a "huge mistake." "I'm always going to be loyal to the president, and I hope that eventually Elon kind of comes back into the fold. Maybe that's not possible now because he's gone so nuclear. But I hope it is," said Vance, describing Musk as an "incredible entrepreneur." Trump is due to attend an Ultimate Fighting Championship fight card on Saturday in New Jersey. Since his second election win, he has attended two previous UFC mixed martial arts fight cards with Musk. Musk is not expected to attend on Saturday. Musk, the world's richest man, bankrolled a large part of Trump's 2024 presidential campaign, spending nearly $300 million in last year's U.S. elections and taking credit for Republicans retaining a majority of seats in the House and retaking a majority in the Senate. Trump named Musk to head an effort to downsize the federal workforce and slash spending, lauding him at the White House only about a week ago for his work as head of the Department of Government Efficiency. Musk cut only about half of 1% of total spending, far short of his brash plans to axe $2 trillion from the federal budget.
Japan Times
4 hours ago
- Japan Times
Meta in talks for Scale AI investment that could top $10 billion
Meta Platforms is in talks to make a multibillion-dollar investment into artificial intelligence startup Scale AI, according to people familiar with the matter. The financing could exceed $10 billion in value, some of the people said, making it one of the largest private company funding events of all time. The terms of the deal are not finalized and could still change, according to the people, who asked not to be identified discussing private information. A representative for Scale did not immediately respond to requests for comment. Meta declined to comment. Scale AI, whose customers include Microsoft and OpenAI, provides data labeling services to help companies train machine-learning models and has become a key beneficiary of the generative AI boom. The startup was last valued at about $14 billion in 2024, in a funding round that included backing from Meta and Microsoft. Earlier this year, Bloomberg reported that Scale was in talks for a tender offer that would value it at $25 billion. This would be Meta's biggest ever external AI investment, and a rare move for the company. The social media giant has before now mostly depended on its in-house research, plus a more open development strategy, to make improvements in its AI technology. Meanwhile, Big Tech peers have invested heavily: Microsoft has put more than $13 billion into OpenAI while both and Alphabet have put billions into rival Anthropic. Part of those companies' investments have been through credits to use their computing power. Meta doesn't have a cloud business, and it's unclear what format Meta's investment will take. Chief Executive Officer Mark Zuckerberg has made AI Meta's top priority, and said in January that the company would spend as much as $65 billion on related projects this year. The company's push includes an effort to make Llama the industry standard worldwide. Meta's AI chatbot — already available on Facebook, Instagram and WhatsApp — is used by 1 billion people per month. Scale, co-founded in 2016 by CEO Alexandr Wang, has been growing quickly: The startup generated revenue of $870 million last year and expects sales to more than double to $2 billion in 2025, Bloomberg previously reported. Scale plays a key role in making AI data available for companies. Because AI is only as good as the data that goes into it, Scale uses scads of contract workers to tidy up and tag images, text and other data that can then be used for AI training. Scale and Meta share an interest in defense tech. Last week, Meta announced a new partnership with defense contractor Anduril Industries to develop products for the U.S. military, including an AI-powered helmet with virtual and augmented reality features. Meta has also granted approval for U.S. government agencies and defense contractors to use its AI models. The company is already partnering with Scale on a program called Defense Llama — a version of Meta's Llama large language model intended for military use. Scale has increasingly been working with the U.S. government to develop AI for defense purposes. Earlier this year the startup said it won a contract with the Defense Department to work on AI agent technology. The company called the contract "a significant milestone in military advancement.'
Japan Times
13 hours ago
- Japan Times
Trump's China gambit belies rocky road ahead on tariff deals
President Donald Trump has come up short on striking trade deals with most nations with just one month left before his self-imposed tariff deadline, even as he took his first steps in weeks toward engaging with China. Trump secured a much-desired call with Chinese President Xi Jinping, paving the way for a new round of talks on Monday in London — yet the diplomacy was overshadowed by a blowout public fight between Trump and his billionaire onetime ally, Elon Musk. Trump's aides insisted Friday that the president was moving on and focused on his economic agenda. Still, question marks remain over the U.S.'s most consequential trade relationships, with few tangible signs of progress toward interim agreements. India, which the Trump administration has cited as an early deal target, has taken a tougher line in negotiations and challenged Trump's auto tariffs at the World Trade Organization. Japan held another round of talks with the U.S., while also signaling it wants a reprieve from duties on cars and light trucks. The legal fight over Trump's tariffs hangs over everything. A court ruling striking down the country-by-country duties imposed using emergency authorities left partners with no certainty over what Trump's powers are. The next test could come as soon as next week, when a court could rule on the administration's appeal. Trump and his team were eager to draw attention to inroads with China as proof his ways are working. Trump on Friday described talks with Beijing as "very far advanced' and said Xi had agreed to speed shipments of critical rare-earth minerals that were at the center of recent tension. Unlocking those supplies would spell relief for major American automakers. Chinese Vice Premier He Lifeng will visit the U.K. next week, during which he will conduct trade negotiations with the U.S., the Chinese foreign ministry said in a statement late Saturday. The mixed results in the talks so far demonstrate the highs and lows of Trump's mercurial approach to trade, in which he and aides have cast him as the ultimate decision-maker on any deals. Rather than provide a clear-cut victory, Trump's dealings with Xi also show the difficult road ahead with China. The rare-earths dispute revealed how important those supplies, which Beijing dominates, are for the U.S. economy. "Xi is not letting go of the rare earths. He's got leverage, he's using it,' said Douglas Holtz-Eakin, president of the American Action Forum, a conservative think tank. "They talked, that's the most important thing. I think they're really far apart.' New BMW vehicles for sale at a dealership in Los Angeles, California | Bloomberg The clock is ticking for Trump. His 90-day pause on higher tariffs for the European Union and nearly five dozen countries expires July 9 — barring an extension he could do with the flick of a pen — while China's reprieve extends until August. If deals aren't reached, Trump plans to restore tariff rates to the levels he first announced in April, or lower numbers that exceed the current 10% baseline, a White House official said, speaking on condition of anonymity. "We will have deals. It takes time. Usually it takes months and years; in this administration, it's going to take more like days,' White House trade counselor Peter Navarro said Friday on Fox Business. "We're on task and on target.' The Office of the U.S. Trade Representative (USTR) "looks more like a deli now,' Navarro said, with countries lining up for talks. USTR sent letters this week to trading partners reminding them of the deadline. It's unclear what all the frantic activity has yielded. Xi for months was reluctant to get on the phone with Trump and analysts speculated about what concessions the U.S. president offered to his counterpart in exchange for the call. Trump at least appeared to give some ground on foreign students, saying it would be his "honor' to welcome Chinese scholars even as his administration cracks down on student visas. German Chancellor Friedrich Merz visited Washington facing demands from his nation's automakers for tariff credits for vehicles they produce in the U.S.. But the subject barely came up during the public portion of his meeting with Trump, who spent a large chunk of time unloading on Musk. "We'll end up hopefully with a trade deal or we'll do something — you know, we'll do the tariffs,' Trump said Thursday alongside Merz. Merz, in his U.S. visit, emphasized the integrated trade ties between countries that are at risk — including by personally driving a BMW built in South Carolina. The German leader said Friday at an industry event the nations should agree on an "offset rule' that would provide tariff relief for existing U.S. production. Trump's U.K. deal — the lone pact so far — was undercut this week when he plowed ahead with levies on steel and aluminum. The U.K. said the pact included an agreement for zero tariffs on British metals, but Trump's latest order kept a 25% charge on them while negotiations continue and doubled the rate for others. Still, the upcoming Group of Seven summit of leaders from major economies could provide an opportunity for the type of in-person dealmaking Trump craves. Canadian Prime Minister Mark Carney has been discussing terms of a potential interim deal with Trump ahead of the gathering this month near Calgary. One theme is clear: Negotiations over his so-called reciprocal tariffs have grown intertwined with his separate duties on autos and metals, despite previous U.S. signals that the administration considered them separate. "He's entirely transactional,' Holtz-Eakin said of Trump. "He will always deal.' Talks are ongoing with the EU, which has previously proposed an agreement with the U.S. to mutually drop auto tariffs to zero as part of a broader trade framework, which the Trump administration rejected. The bloc subsequently suggested working toward zero-for-zero tariffs on cars, other industrial goods and some agricultural imports with tariff-rate quotas as a possible interim measure. Commerce Secretary Howard Lutnick said this week he'd consider some type of "export credit' on autos, the kind of carve-out sought by Germany on vehicle tariffs. And he predicted there would be a U.S.-India deal in the "not too distant future.' Lutnick signaled, though, Trump's push for so-called reciprocity comes with caveats. The U.S. wouldn't agree with Vietnam to drop all tariffs, because it believes the Southeast Asian nation is a hub for so-called transshipment of Chinese goods. Talks with South Korea, where Trump spoke with newly elected president Lee Jae-myung, and Japan, which had top trade negotiator Ryosei Akazawa meet with Lutnick, continued this week. In yet another sign of the Trump team's frenetic approach, Nikkei reported that different — and even competing — positions among Treasury Secretary Scott Bessent, Trade Representative Jamieson Greer and Lutnick had confounded Japanese counterparts.
