Apple opens its AI to developers but keeps its broader ambitions modest
By
Stephen Nellis
,
Kenrick Cai
, Reuters
Apple announces a new design language for its operating systems called "Liquid Glass".
Photo:
AFP / Josh Edelson
Apple has announced a slew of artificial intelligence features, including opening up the underlying technology it uses for Apple Intelligence in a modest update of its software and services as it lays the groundwork for future advances.
The presentations at its annual Worldwide Developers Conference focused more on incremental developments, including live translations for phone calls and design changes to its operating systems, that improve everyday life rather than the sweeping ambitions for AI that Apple's rivals are marketing.
A year after it failed to deliver promised AI-based upgrades to key products such as Siri, Apple kept its AI promises to consumers modest, communicating that it could help them with tasks like finding where to buy a jacket similar to one they' have seen online. Behind the scenes in its tools for developers, Apple hinted at a strategy of offering its own tools alongside those from rivals, similar to the tack taken by Microsoft last month.
Apple software chief Craig Federighi said the company will offer both its own and OpenAI's code completion tools in its key Apple developer software and that the company is opening up the foundational AI model that it uses for some of its own features to third-party developers.
"We're opening up access for any app to tap directly into the on-device, large language model at the core of Apple," Federighi said.
In an early demonstration of how partners could improve Apple apps, the company added image generation from OpenAI's ChatGPT to its Image Playground app, saying that user data would not be shared with OpenAI without a user's permission.
Apple is facing an unprecedented set of technical and regulatory challenges as some of its key executives kicked off the company's annual software developer conference on Monday.
Shares of Apple, which were flat before the start of the event, closed about 1.2 percent lower on Monday.
"In a moment in which the market questions Apple's ability to take any sort of lead in the AI space, the announced features felt incremental at best," Thomas Monteiro, senior analyst at Investing.com, said. Compared with what other big AI companies are introducing, he added, "It just seems that the clock is ticking faster every day for Apple."
As Apple executives discussed new features at the event in Cupertino, California, OpenAI announced a new financial milestone on Monday, reaching US$10 billion (NZ$16.5b) in annualised revenue run rate as of June.
Attendees watch a presentation during the annual Apple 'Worldwide Developers Conference' (WWDC) at Apple Park.
Photo:
AFP / Josh Edelson
While Apple shied away from making big promises of AI improvements for consumers, small touches behind the scenes such as allowing developers to use ChatGPT's code generation tools in its XCode tools, which are required to make apps for Macs and iPhones, showed the company trying to keep pace with what its rivals are offering to software developers.
Federighi also said Apple plans a design overhaul of all of its operating systems.
Apple's redesign of its operating systems centred on a design it calls "liquid glass" where icons and menus are partially transparent, a step Apple executives said was possible because of the more powerful custom chips in Apple devices versus a decade ago.
Federighi said the new design will span operating systems for iPhones, Macs and other Apple products. He also said Apple's operating systems will be given year names instead of sequential numbers for each version. That will unify naming conventions that have become confusing because Apple's core operating systems for phones, watches and other devices kicked off at different times, resulting in a smattering of differently numbered operating systems for different products.
In other new features, Apple introduced "Call Screening" where iPhones will automatically answer calls from an unknown number and ask the caller the purpose of their call. Once the caller states their purpose, the iPhone will show a transcription of the reason for the call, and ring for the owner.
Apple also said it will add live translation to phone calls, as well as allow developers to integrate its live translation technology into their apps. Apple said the caller on the other end of the phone call will not need to have an iPhone for the live translation feature to work.
Apple's Visual Intelligence app - which can help users find a pair of shoes similar to ones at which they have pointed an iPhone camera - will be extended to analysing items on the iPhone's screen and linked together with apps. Apple gave an example of seeing a jacket online and using the feature to find a similar one for sale on an app already installed in the user's iPhone.
-Reuters
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
RNZ News
2 hours ago
- RNZ News
US-China trade talks to resume for a second day
By Kate Holton and Alistair Smout , Reuters Photo: AFP Top US and Chinese officials will resume trade talks for a second day in London on Tuesday, hoping to secure a breakthrough over export controls for goods such as rare earths that have threatened a global supply chain shock and slower economic growth. Investors are hoping that the two superpowers can improve ties after the relief sparked by a preliminary trade deal agreed in Geneva last month gave way to fresh doubts after Washington accused Beijing of blocking exports that are critical to sectors including autos, aerospace, semiconductors and defence. The talks come at a crucial time for both economies, with customs data showing that China's exports to the US plunged 34.5 percent in May, the sharpest drop since February 2020, when the outbreak of the Covid-19 pandemic upended global trade. While the impact on US inflation and the jobs market has so far been muted, the dollar remains under pressure from US policymaking. The two sides met at the ornate Lancaster House in the British capital on Monday to discuss disagreements around the Geneva deal, and are due to resume talks early on Tuesday before both sides are expected to issue updates. The US side is led by US Treasury Secretary Scott Bessent, Commerce Secretary Howard Lutnick and US Trade Representative Jamieson Greer, while the Chinese contingent is helmed by Vice Premier He Lifeng. The inclusion of Lutnick, whose agency oversees export controls for the US, is one indication of how central rare earths have become. China holds a near-monopoly on rare earth magnets, a crucial component in electric vehicle motors. Lutnick did not attend the Geneva talks at which the countries struck a 90-day deal to roll back some of the triple-digit tariffs they had placed on each other. Trump's often erratic policymaking on tariffs has roiled global markets, sparked congestion and confusion in major ports, and cost companies tens of billions of dollars in lost sales and higher costs. The second round of meetings between the two sides comes four days after Trump and Xi spoke by phone, their first direct interaction since Trump's 20 January inauguration. Following the call Trump said Xi had agreed to resume shipments to the US of rare earths minerals and magnets, and Reuters reported that China has granted temporary export licenses to rare-earth suppliers of the top three US automakers. But tensions remain high over the export controls, after factories around the world started to fret that they would not have enough of the materials they need to keep operating. - Reuters
Techday NZ
3 hours ago
- Techday NZ
Apple unveils macOS Tahoe 26 with new design & AI features
Apple has previewed macOS Tahoe 26, the next major update to its desktop operating system, bringing a new design, enhanced Continuity features, significant Spotlight updates, and expanded Apple Intelligence capabilities. Design updates The new design introduces the Liquid Glass material, offering translucent effects that reflect and refract the surroundings. Key elements such as the Dock, sidebars, and toolbars have been refined to focus on user content, and the menu bar is now completely transparent to maximise display space. Customisation options have been expanded, allowing users to arrange controls in the menu bar and Control Centre, and apply different colours or emojis to folders and app icons. New light and dark appearances for app icons, as well as updated wallpapers and theme colours, are also included. Continuity improvements macOS Tahoe introduces the Phone app to the Mac via Continuity, allowing users to relay cellular calls from their iPhone, access Recents, Favourites, and Voicemails, and use features such as Call Screening and Hold Assist. Call Screening answers calls from unknown numbers and gathers information for the user, while Hold Assist enables users to keep their place in a queue and continue working. Live Activities from iPhone are now integrated into the Mac menu bar, displaying real-time events such as flights, rides, or sports scores. Clicking a Live Activity opens iPhone Mirroring for further details and interaction. Spotlight enhancements Spotlight receives an update with the ability to execute hundreds of actions, such as sending emails or creating notes, directly from the search interface. Search results are grouped and prioritised by relevance, with new filtering and browsing options for faster content discovery, and improved support for documents in third-party cloud drives. Spotlight now supports actions from both Apple and third-party apps via the App Intents API. Users can also run shortcuts and perform personalised actions based on routines, as well as use quick keys for rapid commands. Apple Intelligence features Apple Intelligence expands with features focused on productivity, communication, and creativity. Live Translation provides text and audio translation in real time across Messages, FaceTime, and phone calls, using on-device models to maintain privacy. Shortcuts can now leverage Apple Intelligence models for tasks such as text summarisation and automatic image creation. Shortcuts can run at designated times or upon specific actions. Users may also access ChatGPT for broader world knowledge within shortcuts. Genmoji and Image Playground receive updates allowing users to customise emoji attributes and apply various artistic styles, including those powered by ChatGPT. Reminders can now be automatically categorised and action items identified through Apple Intelligence. Gaming and developer tools The release introduces the Apple Games app, centralising games, recommendations, and social features. Game Overlay provides fast access to system settings and social actions during gameplay. The new Metal 4 framework offers advanced graphics and rendering technologies for developers. Upcoming games for Mac include titles such as Crimson Desert, InZOI, Cyberpunk 2077, and several others, utilising features like MetalFX Upscaling and support for Apple's M3 and M4 chips with ray tracing. Additional features Other updates in macOS Tahoe include refreshed Safari design and faster performance, new features in Messages such as Backgrounds, Polls, and improved group chat navigation, as well as the launch of the Journal app for Mac. Photos receives a design update with personalisation improvements, FaceTime introduces a redesigned landing page and floating controls, and Notes gains markdown compatibility and support for audio transcription from Phone app calls. Accessibility developments include Magnifier support, Accessibility Reader, enhanced Braille Access, and Vehicle Motion Cues to help reduce motion sickness. The Passwords app tracks changes and version history for users' credentials. "macOS is the heart and soul of the Mac, and with Tahoe, we're building on what users love most. Whether you're a power user or just getting started on Mac, there's something for everyone, with even more features to turbocharge productivity and make working across Mac and iPhone more seamlessly than ever before," said Craig Federighi, Apple's Senior Vice President of Software Engineering. "With its gorgeous new design, amazing Continuity experiences, powerful enhancements to Spotlight, more intelligent shortcuts, and updates to Apple Intelligence, the Mac experience is better than ever."
Techday NZ
3 hours ago
- Techday NZ
Apple unveils watchOS 26 with new design & smart features
Apple has previewed watchOS 26, highlighting a new design and enhanced features intended to offer a more personalised user experience for Apple Watch owners. Among the most notable updates is the introduction of a redesigned interface featuring Liquid Glass, which Apple says aims to make navigation and controls more expressive while maintaining the watch's familiar usability. Features benefiting from this design include the Smart Stack, Control Centre, the Photos watch face, and in-app navigation elements. Another key addition is Workout Buddy, which utilises Apple Intelligence to deliver personalised, spoken motivation during exercise sessions. By analysing users' workout data and fitness history privately and securely, Workout Buddy provides real-time motivational insights through a generative voice influenced by Fitness+ trainer recordings. The new experience also includes music recommendations aligned with individual preferences and workout types. "Apple Watch is an indispensable companion for millions of people around the world, and watchOS 26 uses intelligence to offer an even more personalised experience," said David Clark, Apple's Senior Director of watchOS Engineering. "From a gorgeous new design, to Workout Buddy with Apple Intelligence, personalised music suggestions in the Workout app, and more intelligence in the Smart Stack and Messages, we're excited about the many ways watchOS 26 will support each user in staying active, healthy, connected, and safe throughout their day." Workout Buddy offers features such as kilometre split updates, personal milestone announcements, and post-workout summaries with statistics and encouragement. An example message might include: "Way to get out for your run this Wednesday morning. You're 18 minutes away from closing your Exercise ring. So far this week, you've run 6 kilometres. You're going to add to that today." The system also delivers milestone notifications, such as "Your total running distance for the year just crossed the 200-kilometre mark! That's a lot of running!" Upon completing a workout, users receive a recap: "Way to get your workout in! You went 6.9 kilometres in just over 38 minutes. Your average pace was 5 minutes and 34 seconds, and your average heart rate was 128. That was your longest run of the last 28 days. What will you do next?" Workout Buddy requires an Apple Intelligence-supported iPhone nearby and will initially be available in English for selected workout types, including running, walking, cycling, HIIT, and strength training, when using Apple Watch with Bluetooth headphones. Redesigned fitness app The Workout app itself has received its most significant update since its launch, introducing a new layout and navigation. Four new corner buttons aim to simplify access to custom workout features such as Workout Views, Custom Workout, Pacer, and Race Route. Users can now configure music and podcasts to play automatically when a workout is started, with Apple Music selecting playlists based on workout type and taste, or suggesting recent favourites. Smarter Smart Stack The Smart Stack now incorporates improved prediction algorithms and contextual data, delivering proactive 'hints' that appear as visual prompts on the display. Examples include suggesting Backtrack functionality in remote areas or prompting a Pilates workout when users arrive at a familiar location and time. Updates to Messages Live Translation is now available in Messages for supported Apple Watch models when paired with a compatible iPhone, translating both incoming and outgoing texts in real time into the user's preferred language. English language users will see more relevant action suggestions within Messages; for example, initiating a 'Check In' when asked about arrival time or using Apple Cash when prompted to contribute to group gifts. Customisable conversation backgrounds and the ability to respond to polls directly from the watch are also included. Smart Replies are enhanced with improved language models for more precise responses. New gestures and notifications watchOS 26 introduces a wrist flick gesture allowing users to dismiss notifications, calls, timers, alarms, or return to the watch face with a single hand. The gesture complements the existing double tap function and is intended for situations when the other hand is occupied. The system leverages the watch's sensors and machine learning to detect the movement. Additionally, Apple Watch now adjusts speaker volume automatically based on ambient noise for notifications, timers, calls, and Siri. Additional updates The Notes app comes to Apple Watch, enabling access to, creation of, and management of notes directly on the wrist. New features in the Phone app, such as Hold Assist and Call Screening, require a nearby iPhone and support selected languages. Live Listen controls for users who are deaf or hard of hearing now include live captions of iPhone audio on the watch and remote management of Live Listen sessions. The Photos watch face now shuffles images based on featured content, displaying personal moments on the wrist. The watch face gallery has been redesigned for easier exploration, offering grouped collections. Developer tools Developers have access to new APIs supporting the updated design and features in watchOS 26, including the ability to add custom controls to the Control Centre and Smart Stack, and introduce third-party widgets with new relevance signals such as Points of Interest. watchOS 26 will be available as a free software update for Apple Watch Series 6 or later, the second-generation Apple Watch SE, and all Apple Watch Ultra models when paired with iPhone 11 or higher. Apple Intelligence features require compatible devices and selected languages.
