Apple expands Apple Intelligence with developer access & new AI
Apple has announced a range of new features for Apple Intelligence, expanding its functionality across iPhone, iPad, Mac, Apple Watch, and Apple Vision Pro.
Apple Intelligence now includes Live Translation, upgrades to visual intelligence, and enhancements to Image Playground and Genmoji. Shortcuts can tap directly into Apple Intelligence, and developers are being given access to the on-device large language model at the core of the technology. This model is designed to power private, intelligent experiences within third-party apps even when offline.
Craig Federighi, Senior Vice President of Software Engineering at Apple, said: "Last year, we took the first steps on a journey to bring users intelligence that's helpful, relevant, easy to use, and right where users need it, all while protecting their privacy. Now, the models that power Apple Intelligence are becoming more capable and efficient, and we're integrating features in even more places across each of our operating systems. We're also taking the huge step of giving developers direct access to the on-device foundation model powering Apple Intelligence, allowing them to tap into intelligence that is powerful, fast, built with privacy, and available even when users are offline. We think this will ignite a whole new wave of intelligent experiences in the apps users rely on every day. We can't wait to see what developers create."
Apple Intelligence features are now available for testing and will be accessible to users with compatible devices and supported languages in the coming spring. By the end of the year, support will expand to include Danish, Dutch, Norwegian, Portuguese (Portugal), Swedish, Turkish, Chinese (traditional), and Vietnamese.
Live Translation
Live Translation is integrated into Messages, FaceTime, and the Phone app, enabling users to communicate across languages. Apple states that this function is handled entirely on device to maintain user privacy. Messages can be automatically or manually translated, FaceTime calls offer live captions with translated text while hearing the original speaker's voice, and translations on phone calls are spoken in real time.
Image Playground and Genmoji
Users can generate Genmoji from descriptions, mix emoji, and adjust personal attributes in created images. Image Playground introduces new art styles via ChatGPT, including oil painting and vector art. Descriptions can be sent to ChatGPT for custom image creation, with user control over data sharing ensured.
Visual intelligence expansion
Visual intelligence now lets users search and act on anything displayed on their device screens. This includes identifying objects, searching for similar items online, asking ChatGPT context-based questions, and extracting event details to prepopulate calendar entries. Users can access visual intelligence by pressing the screenshot buttons, after which options appear to save, share, or explore further.
Apple Watch integration
Apple Watch introduces Workout Buddy, a feature that combines workout and fitness history to produce personalised motivational feedback. This feedback uses a generative voice based on Fitness+ trainers and is processed locally for privacy. Workout Buddy will be available in English across several workout types for Apple Watch with Bluetooth headphones and an Apple Intelligence-supported iPhone nearby.
Developer access to on-device models
The Foundation Models framework is being opened for developers, who can now build intelligent and private app experiences that work offline at no additional AI inference cost. The framework provides native Swift support and includes features such as guided generation and tool calling. Example uses include generating personalised quizzes in education apps or enabling natural language search in outdoor applications.
Shortcuts enhancements
Shortcuts now benefit from a wider range of intelligent actions. Users can summarise text, create images, and use Apple Intelligence-powered models—either on-device or via Private Cloud Compute—for responses within shortcuts, while safeguarding data privacy. ChatGPT can also be integrated to provide response generation in shortcuts routines.
Additional features
Other improvements include automatic identification of relevant actions in Reminders, email order tracking in Wallet, poll suggestion capabilities in Messages, customisable chat backgrounds, and enhanced features in Photos and Mail. Writing Tools, Clean Up in Photos, Genmoji, Image Playground, Mail summaries, Smart Reply, improved Siri, natural language search, summarisation in Notes and transcriptions, and notification improvements remain available as part of Apple Intelligence.
Privacy measures
Apple highlights that Apple Intelligence is designed with privacy in focus, utilising on-device processing for most features. For more complex requests needing larger models, Private Cloud Compute keeps user data private, ensuring it is not stored or shared with Apple. Independent experts are able to inspect the code deployed on Apple silicon servers to ensure privacy commitments are upheld.
Apple Intelligence features are available for testing through the Apple Developer Program, with public beta access coming next month. The new functions will support all iPhone 16 models, iPhone 15 Pro, iPhone 15 Pro Max, iPad mini (A17 Pro), and iPad and Mac devices with M1 chips and later. Availability of features and language support may vary by region and device.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Techday NZ
19 minutes ago
- Techday NZ
ChatGPT leads enterprise AI, but model diversity is surging
New Relic has published its first AI Unwrapped: 2025 AI Impact Report, presenting data from 85,000 businesses on enterprise-level adoption and usage trends in artificial intelligence models. ChatGPT's leading role The report reveals that developers are overwhelmingly favouring OpenAI's ChatGPT for general-purpose AI tasks. According to the findings, more than 86% of all large language model (LLM) tokens processed by New Relic customers involved ChatGPT models. Nic Benders, Chief Technical Strategist at New Relic, stated, "AI is rapidly moving from innovation labs and pilot programmes into the core of business operations. The data from our 2025 AI Impact Report shows that while ChatGPT is the undisputed dominant model, developers are also moving at the 'speed of AI,' and rapidly testing the waters with the latest models as soon as they come out. In tandem, we're seeing robust growth of our AI monitoring solution. This underscores that as AI is ingrained in their businesses, our customers are realising they need to ensure model reliability, accuracy, compliance, and cost efficiency." The report highlights that enterprises have been quick to adopt OpenAI's latest releases. ChatGPT-4o and ChatGPT-4o mini emerged as the primary models in use, with developers making near-immediate transitions between versions as new capabilities and improvements are launched. Notably, there has been an observed pattern of rapid migration from ChatGPT-3.5 Turbo to ChatGPT-4.1 mini since April, indicating a strong developer focus on performance improvements and features, often taking precedence over operational cost savings. Broadening model experimentation The findings also suggest a trend toward greater experimentation, with developers trying a wider array of AI models across applications. While OpenAI remains dominant, Meta's Llama ranked second in terms of LLM tokens processed among New Relic customers. There was a 92% increase in the number of unique models used within AI applications in the first quarter of 2025, underlining growing interest in open-source, specialised, and task-specific solutions. This diversification, although occurring at a smaller scale compared to OpenAI models, points to a potentially evolving AI ecosystem. Growth in AI monitoring As the diversity of model adoption increases, the need for robust AI monitoring solutions has also grown. Enterprises continue to implement unified platforms to monitor and manage AI systems, with New Relic reporting a sustained 30% quarter-over-quarter growth in the use of its AI Monitoring solution since its introduction last year. This growth reflects a drive among businesses to address concerns such as reliability, accuracy, compliance, and cost as AI systems become more embedded in day-to-day operations. Programming languages trends The report notes that Python solidifies its status as the preferred programming language for AI applications, recording nearly 45% growth in adoption since the previous quarter. follows closely behind Python in terms of both volume of requests and adoption rates. Java, meanwhile, has experienced a significant 34% increase in use for AI applications, suggesting a rise in production-grade, Java-based LLM solutions within large enterprises. Research methodology details The AI Unwrapped: 2025 AI Impact Report's conclusions are drawn from aggregated and de-identified usage statistics from active New Relic customers. The data covers activity from April 2024 to April 2025, offering a representative view of current AI deployment and experimentation trends across a substantial commercial user base. Follow us on: Share on:
Scoop
16 hours ago
- Scoop
Marketing Agencies Urged To Pivot As Meta Moves Toward Fully Automated Advertising By 2026
Press Release – Alexanders Digital Marketing Agencies that once focused on deliverables like social posts and Google Ads are now being challenged to step into a new role: strategic enablers (helping clients convert leads into customers). With Meta announcing its ambition to fully automate advertising campaigns by 2026 using artificial intelligence, social media marketing agencies are quaking in their boots, and being urged to rethink their role in a fast-evolving digital landscape. According to a recent Reuters report, Meta is investing heavily in AI systems that will plan, purchase, and optimise ad campaigns with minimal human input, generating 30-40% better results at 10% of the cost, which could potentially wipe out much of the creative industry around social. The announcement signals a dramatic acceleration toward a future where media buying, and ad creative are machine-led. This shift is already being felt across the industry. AI tools like ChatGPT, Canva, and Meta's own Advantage+ are allowing small and mid-sized businesses to produce marketing content and run campaigns in-house, reducing their reliance on traditional agencies for execution. 'Clients no longer need an agency to write every post, design every banner, or set up every ad campaign,' said Rachel Alexander, founder of Alexanders, Christchurch's first digital marketing agency. 'They have Canva, ChatGPT, HeyGen, MidJourney & Meta automation. What they need now is someone to help them make sense of it all,' she said. Agencies that once focused on deliverables like social posts and Google Ads are now being challenged to step into a new role: strategic enablers (helping clients convert leads into customers). A recent YouTube vlog 'Meta just killed the creative industry: The 2026 Automation Apocalypse' by Julia McCoy, CEO at First Movers & AI thought leader, describes this well. 'Agencies must pivot from being tactical executors to strategic advisors, bringing clarity, structure, and prioritisation to an increasingly overwhelming landscape,' said McCoy. 'Business marketers need to think of their agency as a marketing generalist doctor: diagnosing weak points, recommending tailored treatments, and coaching internal teams through implementation,' said Alexander. With many SMEs building internal marketing teams and experimenting with DIY tools, the opportunity for agencies lies in offering higher-value services such as sales enablement, CRM integration, AI content workflows, and conversion strategy. 'It's less about deliverables, more about direction. Less about content calendars, more about conversion journeys…The marketing agency of the future is less like a factory and more like a consultancy,' said McCoy. Alexander said she is mindful, but not anxious, because we've always been a hybrid between a marketing consultancy and marketing agency. For New Zealand agencies looking to adapt, this means embracing AI, not competing with it and reasserting their value as interpreters, integrators, and insight-driven advisors. 'AI has been disruptive technology but being agile is the key to success. It's helped us survive for 28 years. Time to pivot again!,' said Alexander.
Scoop
17 hours ago
- Scoop
Marketing Agencies Urged To Pivot As Meta Moves Toward Fully Automated Advertising By 2026
With Meta announcing its ambition to fully automate advertising campaigns by 2026 using artificial intelligence, social media marketing agencies are quaking in their boots, and being urged to rethink their role in a fast-evolving digital landscape. According to a recent Reuters report, Meta is investing heavily in AI systems that will plan, purchase, and optimise ad campaigns with minimal human input, generating 30-40% better results at 10% of the cost, which could potentially wipe out much of the creative industry around social. The announcement signals a dramatic acceleration toward a future where media buying, and ad creative are machine-led. This shift is already being felt across the industry. AI tools like ChatGPT, Canva, and Meta's own Advantage+ are allowing small and mid-sized businesses to produce marketing content and run campaigns in-house, reducing their reliance on traditional agencies for execution. "Clients no longer need an agency to write every post, design every banner, or set up every ad campaign," said Rachel Alexander, founder of Alexanders, Christchurch's first digital marketing agency."They have Canva, ChatGPT, HeyGen, MidJourney & Meta automation. What they need now is someone to help them make sense of it all,' she said. Agencies that once focused on deliverables like social posts and Google Ads are now being challenged to step into a new role: strategic enablers (helping clients convert leads into customers). A recent YouTube vlog 'Meta just killed the creative industry: The 2026 Automation Apocalypse' by Julia McCoy, CEO at First Movers & AI thought leader, describes this well. 'Agencies must pivot from being tactical executors to strategic advisors, bringing clarity, structure, and prioritisation to an increasingly overwhelming landscape,' said McCoy. 'Business marketers need to think of their agency as a marketing generalist doctor: diagnosing weak points, recommending tailored treatments, and coaching internal teams through implementation,' said Alexander. With many SMEs building internal marketing teams and experimenting with DIY tools, the opportunity for agencies lies in offering higher-value services such as sales enablement, CRM integration, AI content workflows, and conversion strategy. 'It's less about deliverables, more about direction. Less about content calendars, more about conversion journeys…The marketing agency of the future is less like a factory and more like a consultancy,' said McCoy. Alexander said she is mindful, but not anxious, because we've always been a hybrid between a marketing consultancy and marketing agency. For New Zealand agencies looking to adapt, this means embracing AI, not competing with it and reasserting their value as interpreters, integrators, and insight-driven advisors. 'AI has been disruptive technology but being agile is the key to success. It's helped us survive for 28 years. Time to pivot again!," said Alexander.
