Apple Intelligence adds more powerfu new capabilities across Apple devices
CUPERTINO, CALIFORNIA — Apple has announced new Apple Intelligence features that elevate the user experience across iPhone, iPad, Mac, Apple Watch, and Apple Vision Pro. Apple Intelligence unlocks new ways for users to communicate with features like Live Translation; do more with what's on their screen with updates to visual intelligence; and express themselves with enhancements to Image Playground and Genmoji.
Additionally, shortcuts can now tap into Apple Intelligence directly, and developers will be able to access the on-device large language model at the core of Apple Intelligence, giving them direct access to intelligence that is powerful, fast, built with privacy, and available even when users are offline. These Apple Intelligence features are available for testing starting today, and will be available to users with supported devices set to a supported language this fall.
'Last year, we took the first steps on a journey to bring users intelligence that's helpful, relevant, easy to use, and right where users need it, all while protecting their privacy. Now, the models that power Apple Intelligence are becoming more capable and efficient, and we're integrating features in even more places across each of our operating systems,' said Craig Federighi, Apple's senior vice president of Software Engineering.
'We're also taking the huge step of giving developers direct access to the on-device foundation model powering Apple Intelligence, allowing them to tap into intelligence that is powerful, fast, built with privacy, and available even when users are offline. We think this will ignite a whole new wave of intelligent experiences in the apps users rely on every day. We can't wait to see what developers create.'
Apple Intelligence features will be coming to eight more languages by the end of the year: Danish, Dutch, Norwegian, Portuguese (Portugal), Swedish, Turkish, Chinese (traditional), and Vietnamese.
Live Translation Breaks Down Language Barriers
For those moments when a language barrier gets in the way, Live Translation can help users communicate across languages when messaging or speaking. The experience is integrated into Messages, FaceTime, and Phone, and enabled by Apple-built models that run entirely on device, so users' personal conversations stay personal.
In Messages, Live Translation can automatically translate messages. If a user is making plans with new friends while traveling abroad, their message can be translated as they type, delivered in the recipient's preferred language, and when they get a response, each message can be instantly translated.2 On FaceTime calls, a user can follow along with translated live captions while still hearing the speaker's voice. And when on a phone call, the translation is spoken aloud throughout the conversation.3
News Ways to Explore Creativity with Updates to Genmoji and Image Playground
Genmoji and Image Playground provide users with even more ways to express themselves. In addition to turning a text description into a Genmoji, users can now mix together emoji and combine them with descriptions to create something new. When users make images inspired by family and friends using Genmoji and Image Playground, they have the ability to change expressions or adjust personal attributes, like hairstyle, to match their friend's latest look.
In Image Playground, users can tap into brand-new styles with ChatGPT, like an oil painting style or vector art. For moments when users have a specific idea in mind, they can tap Any Style and describe what they want. Image Playground sends a user's description or photo to ChatGPT and creates a unique image. Users are always in control, and nothing is shared with ChatGPT without their permission.
Visual Intelligence Helps Users Search and Take Action
Building on Apple Intelligence, visual intelligence extends to a user's iPhone screen so they can search and take action on anything they're viewing across their apps.
Visual intelligence already helps users learn about objects and places around them using their iPhone camera, and it now enables users to do more, faster, with the content on their iPhone screen. Users can ask ChatGPT questions about what they're looking at on their screen to learn more, as well as search Google, Etsy, or other supported apps to find similar images and products. If there's an object a user is especially interested in, like a lamp, they can highlight it to search for that specific item or similar objects online.
Visual intelligence also recognizes when a user is looking at an event and suggests adding it to their calendar.4 Apple Intelligence then extracts the date, time, and location to prepopulate these key details into an event.
Users can access visual intelligence for what's on their screen by simply pressing the same buttons used to take a screenshot. Users will have the choice to save or share their screenshot, or explore more with visual intelligence.
Apple Intelligence Expands to Fitness on Apple Watch
Workout Buddy is a first-of-its-kind workout experience on Apple Watch with Apple Intelligence that incorporates a user's workout data and fitness history to generate personalised, motivational insights during their session.5
To offer meaningful inspiration in real time, Workout Buddy analyses data from a user's current workout along with their fitness history, based on data like heart rate, pace, distance, Activity rings, personal fitness milestones, and more. A new text-to-speech model then translates insights into a dynamic generative voice built using voice data from Fitness+ trainers, so it has the right energy, style, and tone for a workout. Workout Buddy processes this data privately and securely with Apple Intelligence.
Workout Buddy will be available on Apple Watch with Bluetooth headphones, and requires an Apple Intelligence-supported iPhone nearby. It will be available starting in English, across some of the most popular workout types: Outdoor and Indoor Run, Outdoor and Indoor Walk, Outdoor Cycle, HIIT, and Functional and Traditional Strength Training.
Apple Intelligence On-Device Model Now Available to Developers
Apple is opening up access for any app to tap directly into the on-device foundation model at the core of Apple Intelligence.
With the Foundation Models framework, app developers will be able to build on Apple Intelligence to bring users new experiences that are intelligent, available when they're offline, and that protect their privacy, using AI inference that is free of cost. For example, an education app can use the on-device model to generate a personalised quiz from a user's notes, without any cloud API costs, or an outdoors app can add natural language search capabilities that work even when the user is offline.
The framework has native support for Swift, so app developers can easily access the Apple Intelligence model with as few as three lines of code. Guided generation, tool calling, and more are all built into the framework, making it easier than ever to implement generative capabilities right into a developer's existing app.
Shortcuts Get More Intelligent
Shortcuts are now more powerful and intelligent than ever. Users can tap into intelligent actions, a whole new set of shortcuts enabled by Apple Intelligence. Users will see dedicated actions for features like summarising text with Writing Tools or creating images with Image Playground.
Now users will be able to tap directly into Apple Intelligence models, either on-device or with Private Cloud Compute, to generate responses that feed into the rest of their shortcut, maintaining the privacy of information used in the shortcut. For example, a student can build a shortcut that uses the Apple Intelligence model to compare an audio transcription of a class lecture to the notes they took, and add any key points they may have missed. Users can also choose to tap into ChatGPT to provide responses that feed into their shortcut.
Additional New Features
Apple Intelligence is even more deeply integrated into the apps and experiences that users rely on every day:
The most relevant actions in an email, website, note, or other content can now be identified and automatically categorised in Reminders
.
Apple Wallet
can now identify and summarise order tracking details from emails sent from merchants or delivery carriers. This works across all of a user's orders, giving them the ability to see their full order details, progress notifications, and more, all in one place.
Users can create a poll for anything in Messages
, and with Apple Intelligence, Messages can detect when a poll might come in handy and suggest one. In addition, Backgrounds in the Messages app lets a user personalise their chats with stunning designs, and they can create unique backgrounds that fit their conversation with Image Playground.
These features build on a wide range of Apple Intelligence capabilities that are already available to users:
Writing Tools
can help users rewrite, proofread, and summarise the text they have written. And with Describe Your Change, users can describe a specific change they want to apply to their text, like making a dinner party invite read like a poem.
Clean Up
in Photos allows users to remove distracting elements while staying true to the moment as they intended to capture it.
Visual intelligence
builds on Apple Intelligence and helps users learn about objects and places around them instantly.
Genmoji
allow users to create their own emoji by typing a description. And just like emoji, they can be added inline to messages, or shared as a sticker or reaction in a Tapback.
Image Playground
gives users a way to create playful images in moments, with concepts like themes, costumes, accessories, and places. And they can add their own text descriptions, and create images in the likeness of a family member or friend using photos from their photo library.
Image Wand
can transform a rough sketch into a polished image that complements a user's notes.
Mail summaries
give users a way to view key details for an email or long thread by simply tapping or clicking Summarise.
Smart Reply
provides users with suggestions for a quick response in Mail and Messages.
Siri is more natural and helpful, with the option to type to Siri
and tap into its product knowledge
about the features and settings on Apple products; Siri can also follow along if a user stumbles over their words, and maintain context from one request to the next.
Access to ChatGPT
is integrated in Writing Tools and Siri, giving users the option to tap into ChatGPT's image- and document-understanding capabilities without needing to jump between tools.
Natural language search
in Photos makes it easier for users to find a photo or video by simply describing it.
Users can create a memory movie
in Photos by typing a description.
Summaries of audio transcriptions in Notes
are automatically generated to surface important information at a glance.
Users can generate summaries of call transcriptions
to highlight important details.
Priority Messages
, a section at the top of the inbox in Mail, shows the most urgent emails, like a same-day invitation to lunch or a boarding pass.
Priority Notifications
appear at the top of a user's notifications, highlighting important notifications that may require immediate attention.
Notification summaries
give users a way to scan long or stacked notifications and provide key details right on the Lock Screen.
Previews in Mail and Messages
show users a brief summary of key information without needing to open a message.
The Reduce Interruptions
Focus surfaces only the notifications that might need immediate attention.
A Breakthrough for Privacy in AI
Designed to protect users' privacy at every step, Apple Intelligence uses on-device processing, meaning that many of the models that power it run entirely on device. For requests that require access to larger models, Private Cloud Compute extends the privacy and security of iPhone into the cloud to unlock even more intelligence so a user's data is never stored or shared with Apple; it is used only to fulfill their request. Independent experts can inspect the code that runs on Apple silicon servers to continuously verify this privacy promise, and are already doing so. This is an extraordinary step forward for privacy in AI.
Availability
All of these new features are available for testing starting today through the Apple Developer Program at developer.apple.com, and a public beta will be available through the Apple Beta Software Program next month at beta.apple.com. Users who enable Apple Intelligence on supported devices set to a supported language will have access this fall, including all iPhone 16 models, iPhone 15 Pro, iPhone 15 Pro Max, iPad mini (A17 Pro), and iPad and Mac models with M1 and later, with Siri and device language set to the same supported language: English, French, German, Italian, Portuguese (Brazil), Spanish, Japanese, Korean, or Chinese (simplified). More languages will be coming by the end of this year: Danish, Dutch, Norwegian, Portuguese (Portugal), Swedish, Turkish, Chinese (traditional), and Vietnamese. Some features may not be available in all languages or regions, and availability may vary due to local laws and regulations. For more details, visit apple.com/ae/apple-intelligence.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
The National
5 hours ago
- The National
Trump picks top economic adviser for Federal Reserve Board
US President Donald Trump announced on Thursday that he will nominate top economic adviser Stephen Miran to temporarily serve on the Federal Reserve Board of Governors as he pushes for more control over the central bank. If confirmed by the US Senate, Mr Miran, chairman of the White House's Council of Economic Advisers, would fill the seat vacated by Adriana Kugler, who is due to step down as Fed governor on Friday. Her term expires on January 31, 2026. 'In the meantime, we will continue to search for a permanent replacement,' Mr Trump wrote on the Truth Social media platform, suggesting he could nominate another person to serve a full 14-year term. Ms Kugler's surprise resignation last week opened the path for Mr Trump to exert power over the Federal Reserve, the independence of which has been tested amid the President's repeated calls for lower interest rates. Ms Kugler was absent and did not vote when the Fed kept its target range for interest rates steady at 4.25 to 4.50 per cent last week. She did not provide a reason for her resignation. The Federal Reserve referred to the White House when asked for comment. The White House referred The National to Mr Trump's Truth Social post when asked for a statement. Mr Miran has been critical of the Federal Reserve in the past, arguing for reforms to the US central bank in a March 2024 paper. 'The Federal Reserve's record in recent years raises questions about whether it has been operating in line with the best practices of central bank independence,' he wrote along with Daniel Katz, who now works at the Treasury Department. Mr Miran is also known for co-developing the 'Mar-a-Lago Accord', a playbook to devalue the dollar while preserving its status as the world's reserve currency. His nomination to the Federal Reserve Board comes as Fed chairman Jerome Powell faces increasing pressure from the Trump administration to lower interest rates. Mr Trump has relentlessly attacked Mr Powell in recent months, even visiting the central bank's headquarters where renovation costs have become a new target for the White House. It also comes as speculation increases over who will replace Mr Powell, whose term as chairman expires in May 2026. On Thursday, Bloomberg reported Fed Governor Christopher Waller has emerged as a top choice to succeed him. Mr Waller was one of two Fed governors to dissent in last week's decision to keep rates unchanged, instead favouring a cut of 25 basis points. He based his reasoning on a forward-looking view that tariffs will lead to a one-off increase in prices and that current data shows the labour market is not as strong as it appears. 'I believe that the wait-and-see approach is overly cautious and, in my opinion, does not properly balance the risks to the outlook and could lead to policy falling behind the curve,' Mr Waller said in a statement last week. 'When labour markets turn, they often turn fast. If we find ourselves needing to support the economy, waiting may unduly delay moving towards appropriate policy.' Mr Powell has not indicated if he intends to serve out the remainder of his term on the central bank, which expires in 2028, after his term as chairman ends.
UAE Moments
7 hours ago
- UAE Moments
♉ Taurus: Daily Horoscope for August 8th, 2025
Dear Taurus, today the cosmic dance invites you to embrace persistence as your guiding star. Authority figures or career pressures may try to shake your calm, but remember: like a sturdy oak, you weather storms by staying rooted in your values. Love Horoscope In love, Taurus, your loyal and devoted nature shines, but today, communication may feel a bit tangled. If your partner seems distant or a conversation goes awry, don't rush to conclusions. Instead, invite openness—perhaps over a cozy dinner or a walk in the park. Single? A surprising encounter could spark curiosity, but take your time; let connections grow organically. Remember, love is like tending a garden: patience, gentle care, and a dash of humor help relationships blossom. Trust your heart's wisdom and let kindness be your compass. Career Horoscope At work, the stars highlight both pressure and opportunity. You might face demands from superiors or feel the weight of deadlines, but your legendary endurance is your secret weapon. Approach tasks methodically—like organizing your desk before tackling emails, or breaking big projects into manageable steps. If a colleague's urgency rattles you, respond with calm assurance. Today, innovation is favored: don't hesitate to suggest a creative solution or try a new approach. Your steady progress inspires others, and your reliability could lead to well-deserved recognition. Finance Horoscope Financially, Taurus, your cautious nature is a true asset today. Unexpected expenses or tempting offers may arise, but trust your instinct to pause and assess before making decisions. This is a good day to review your budget or set a small savings goal—perhaps skipping that extra coffee and putting the money aside for something meaningful. If you're considering an investment, seek advice and take your time. Your practical wisdom keeps you on solid ground. Celebrate your progress, even in small steps; abundance grows from mindful choices. Health Horoscope Your well-being today is closely tied to your ability to balance effort and relaxation. The universe encourages you to honor your body's rhythms: after a productive morning, treat yourself to a mindful lunch or a stroll in nature. If stress creeps in, try a grounding exercise—imagine roots growing from your feet, anchoring you to the earth. Laughter is a wonderful medicine, so don't hesitate to watch a funny video or share a joke with friends. Remember, self-care isn't selfish; it's the fuel for your enduring strength. This article was previously published on bahrainmoments. To see the original article, click here
UAE Moments
7 hours ago
- UAE Moments
♍ Virgo: Daily Horoscope for August 8th 2025
Dear Virgo, today the stars invite you to embrace the beauty of order and the power of clarity. With the Moon highlighting your analytical gifts, you'll find satisfaction in ticking off your to-do list and bringing harmony to your surroundings. Love Horoscope In love, Virgo, your discerning eye is sharper than ever, but don't let it turn into nitpicking. The cosmic energies encourage you to communicate with warmth and humor—share a playful anecdote or plan a quirky date night. If you're in a relationship, focus on the little gestures: a handwritten note or a favorite snack can speak volumes. Single? Open your heart to unexpected connections, even if they don't fit your usual checklist. Today, love is about appreciating imperfections and finding joy in the simple, shared moments. Career Horoscope At work, your methodical approach is your superpower. The planetary alignments favor teamwork and creative problem-solving, so don't hesitate to share your ideas or help a colleague untangle a tricky issue. You might find that a well-organized spreadsheet or a clear project plan wins you praise. If you feel overwhelmed, break tasks into bite-sized pieces—think of it as decluttering your mental workspace. Remember, your attention to detail is a gift, but don't get lost in perfectionism. Progress, not perfection, is your mantra today! Finance Horoscope Financially, today is ideal for reviewing your budget and making practical adjustments. The cosmic climate supports clarity and foresight—think of yourself as the conductor of your own financial orchestra. Maybe it's time to cancel a subscription you no longer use or set aside a small sum for a future treat. Don't be afraid to ask for advice or explore new ways to save. Every little step counts, and your knack for organization can help you spot opportunities others might miss. Celebrate your progress, and trust that abundance flows from mindful stewardship. Health Horoscope Well-being takes center stage as you're reminded to balance mind and body. The Moon's influence suggests that a little fresh air or a mindful walk can do wonders for your mood. Try starting your day with a gentle stretch or a few minutes of meditation—imagine you're tuning your inner radio to the frequency of calm. If anxiety creeps in, ground yourself with simple rituals: savor a cup of herbal tea, organize your space, or jot down your thoughts. Remember, self-care isn't selfish—it's your secret weapon for staying centered and resilient.
