Apple plots expansion into AI robots, home security and smart displays
A tabletop robot that serves as a virtual companion, targeted for 2027, is the centerpiece of the AI strategy, according to people with knowledge of the matter. The smart speaker with a display, meanwhile, is slated to arrive next year, part of a push into entry-level smart-home products.
Home security is seen as another big growth opportunity. New cameras will anchor an Apple security system that can automate household functions. The approach should help make Apple's product ecosystem stickier with consumers, said the people, who asked not to be identified because the initiatives haven't been announced.
It's all part of an effort to restore Apple's mojo. Its most recent moonshot project, the Vision Pro headset, remains a sales flop, and the design of its bestselling devices has remained largely unchanged for years.
At the same time, Apple has come under fire for missing the generative AI revolution. And OpenAI may even threaten the company's home turf by developing new AI-driven devices with the help of former Apple design chief Jony Ive.
Though Apple is still in the early stages of turning around its AI software, executives see the pipeline of hardware as a key piece of its resurgence — helping it challenge Samsung, Meta and others in new categories.
A spokesperson for Cupertino, California-based Apple declined to comment. Because the products haven't been announced, the company's plans could still change or be scrapped. Many of the initiatives and their timelines rely on Apple's continued progress in AI-powered software.
Chief Executive Officer Tim Cook told employees in an all-hands meeting this month that Apple must win in AI and hinted at the upcoming devices. "The product pipeline — which I can't talk about — it's amazing, guys. It's amazing,' Cook said. "Some of it you'll see soon. Some of it will come later. But there's a lot to see.'
Beyond the home devices, Apple is preparing thinner and redesigned iPhones for release this year. And further out, it aims to introduce smart glasses, a foldable phone, a 20-year anniversary iPhone and a revamped headset dubbed N100. It's also planning a large foldable device that melds a MacBook and an iPad.
Apple CEO Tim Cook is banking on an ambitious product road map to help get the company's AI effort on track. |
Bloomberg
Apple is looking to boost sales after years of slowing growth for its flagship products. It also nixed some expansions into new areas, like self-driving cars, adding pressure to find other sources of revenue. Moreover, the new initiatives will help rebut the idea that the company is no longer innovating like it used to.
It was first reported last year that Apple was moving forward with a tabletop robotics project, codenamed J595, and developing a new smart-home strategy. But now a clearer picture is forming of its push into that market — and what it means for its AI ambitions.
The tabletop robot resembles an iPad mounted on a movable limb that can swivel and reposition itself to follow users in a room. Like a human head, it can turn toward a person who is speaking or summoning it, and even seek to draw the attention of someone not facing it.
The hope is to bring AI to life in ways that other hardware makers have yet to do. Apple imagines customers placing it on a desk or kitchen counter and using it to get work done, consume media and manage their day.
FaceTime calls will also be a key function of the device. During videoconferencing, the display will be able to shift to lock on to people around a room. Apple is testing a feature that turns an iPhone screen into a joystick, letting users move around the robot to show different people or items in a room during video calls.
Attendees view new products during an event at Apple Park campus in Cupertino, California, on Sept. 9, 2024. |
Bloomberg
But the hallmark of the device is an entirely new version of the Siri voice assistant that can inject itself into conversations between multiple people. It will be able to engage with users throughout the day and more easily recall information.
The idea is for the device to act like a person in a room. It could interrupt a conversation between friends about dinner plans, say, and suggest nearby restaurants or relevant recipes. It's also being designed to engage in back-and-forth discussions for things like planning a trip or getting tasks done — similar to OpenAI's voice mode.
Apple is planning to put Siri at the center of the device operating system and give it a visual personality to make it feel lifelike. The approach, dubbed Bubbles, is vaguely reminiscent of Clippy, an animated paper clip from the 1990s that served as a virtual assistant in Microsoft Office.
Apple has tested making Siri look like an animated version of the Finder logo, the iconic smiley face representing the Mac's file management system. A final decision on its appearance hasn't been made, with designers considering ideas that veer closer to Memoji, the playful characters that represent Apple user accounts.
Device prototypes use a roughly 7-inch horizontal display, approaching the size of an iPad mini. The motorized arm can extend the display away from the base roughly half a foot in any direction.
Some people familiar with the product call it the "Pixar Lamp,' referring to the animated film company's famous logo. Apple has previously disclosed some research in this area: It published a paper in January detailing a light fixture that uses robotics to move around.
Apple has multiple teams across its AI, hardware, software and interface design groups tackling on the project. The work is being led in part by Kevin Lynch, who previously oversaw a push into smart watch software and cars.
The technology giant is developing several other robots. It has teams exploring a mobile bot with wheels — something akin to Amazon's Astro — and has loosely discussed humanoid models.
Apple has a group actively developing a large mechanical arm for use in manufacturing facilities or handling tasks in the back of retail stores, a move that could potentially replace some staff. Such a robot, codenamed T1333, remains several years away.
Google has long offered smart display products. |
Bloomberg
The smart-home push includes a standalone display poised to launch by the middle of next year. That device, codenamed J490, is a stripped-down variant of the robot, lacking the arm and conversational Siri — at least to start. It will still have home control, music playback, note taking, web browsing and videoconferencing. It may also include the new Siri visual interface.
Both the smart display and tabletop robot will run a new operating system dubbed Charismatic, which is designed to be used by multiple people. The interface largely centers on clock faces and widgets — small software features that are typically dedicated to specific tasks.
Charismatic, which was previously known as Pebble and Rock earlier in development, blends the approach of the Apple TV and Apple Watch operating systems. It offers features like multiuser modes and clock-face themes, such as one based on Snoopy, the beagle from the Peanuts comic strip.
The devices are meant to be easily shared: They include a front-facing camera that can scan users' faces as they walk toward it and then automatically change the layout, features and content to the preferences of that person.
Some versions of the software use circular app icons and feature a hexagonal grid of apps. Apple is planning to include many of its core apps, including the calendar, camera, music, reminders and notes software. But the interface will be heavily reliant on voice interaction and widgets, rather than jumping in and out of apps.
Though the device will have a touch screen, the primary input method will be Siri and an upcoming upgrade to a feature dubbed App Intents. That software lets users precisely control the interface and applications via voice.
The hardware itself looks similar to a Google Nest Hub but is shaped like a square, with thin black or white bezels and rounded corners.
The non-robotic 7-inch display sits on a half-dome-shaped base, which includes some of the electronics and is perforated around the bottom edges for speakers and microphones. It can also be mounted on a wall.
The launch will mark the first time Apple is making a serious push into the smart home and comes nearly a decade after Amazon and Google started shipping smart speakers with screens.
The home is a critical space for Apple to target, especially as more users consume content from the living room and automate household functions.
Apple has long had a strong foothold in mobile devices and quickly became a player in the automotive industry via CarPlay — but that success hasn't followed into the smart home. Though the company launched HomeKit for controlling third-party devices in 2014, it has had limited success with its own HomePod speakers.
The Apple logo during the opening of the new Apple Malaysia store in Kuala Lumpur, Malaysia, in 2024. |
Bloomberg
Core to the new home devices — and current products like iPhones and iPads — is an overhaul to the underpinnings of Siri.
Engineers are working on a version codenamed Linwood with an entirely new brain built around large language models — the foundation of generative AI. The goal is to tap into personal data to fulfill queries, an ability that was delayed due to hiccups with the current version.
That new software, known internally as LLM Siri, is planned for release as early as next spring. But work is going even further: Apple is preparing a visually redesigned assistant for iPhones and iPads that will also debut as early as next year.
Craig Federighi, senior vice president of software engineering, hinted at a bigger-than-anticipated overhaul in an internal meeting with employees this month.
"The work we've done on this end-to-end revamp of Siri has given us the results we needed,' he said, adding that "this has put us in a position to not just deliver what we announced, but to deliver a much bigger upgrade than we envisioned.' He said that "there is no project people are taking more seriously.'
Linwood is based on technology developed by the Apple Foundation Models team, but the company has a competing project dubbed Glenwood as well that would power Siri with outside technology.
A final decision hasn't been made on which models will be used, but Apple has been testing Anthropic's Claude for this purpose. Mike Rockwell, the former Vision Pro chief who was put in charge of Siri earlier this year, is overseeing both the Linwood and Glenwood efforts.
During development of the tabletop robot, Apple engineers have made heavy use of ChatGPT and Google Gemini to build and test features. Within Apple's AI and Siri teams as a whole, software developers are increasingly using third-party systems as part of their development process.
Apple is working on a camera, codenamed J450, designed for home security, detecting people and automating tasks. The device will be battery-powered and could last from several months to a year on a single charge, on par with rival products.
The device has facial recognition and infrared sensors to determine who is in a room. Apple believes users will place cameras throughout their home to help with automation. That could mean turning lights off when someone leaves a room or automatically playing music liked by a particular family member.
Apple is planning to develop multiple types of cameras and home-security products as part of an entirely new hardware and software lineup. The goal is to compete with Amazon Ring, Google Nest and Roku, capitalizing on its customer loyalty to sell more products.
It has also tested a doorbell that uses facial recognition technology to unlock a door. Apple already sells iCloud+ subscriptions with online storage for security footage, but they're aimed at third-party cameras.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Japan Today
4 hours ago
- Japan Today
Are you in a mid-career to senior job? Don't fear AI – you could have an important advantage
By Kai Riemer and Sandra Peter Have you ever sat in a meeting where someone half your age casually mentions 'prompting ChatGPT' or 'running this through AI', and felt a familiar knot in your stomach? You're not alone. There's a growing narrative that artificial intelligence (AI) is inherently ageist, that older workers will be disproportionately hit by job displacement and are more reluctant to adopt AI tools. But such assumptions – especially that youth is a built-in advantage when it comes to AI – might not actually hold. While ageism in hiring is a real concern, if you have decades of work experience, your skills, knowledge and judgement could be exactly what's needed to harness AI's power – without falling into its traps. What does the research say? The research on who benefits most from AI at work is surprisingly murky, partly because it's still early days for systematic studies on AI and work. Some research suggests lower-skilled workers might have more to gain than high-skilled workers on certain straightforward tasks. The picture becomes much less clear under real-world conditions, especially for complex work that relies heavily on judgement and experience. Many older workers do experience AI as deeply unsettling. As one U.S.-based CEO of a large multinational corporation told us: "AI can be a form of existential challenge, not only to what you're doing, but how you view yourself." But leaders are also observing an important and unexpected distinction: experienced workers are often much better at judging the quality of AI outputs. This might become one of the most important skills, given that AI occasionally hallucinates or gets things wrong. The CEO of a South American creative agency put it bluntly: "Senior colleagues are using multiple AIs. If they don't have the right solution, they re-prompt, iterate, but the juniors are satisfied with the first answer, they copy, paste and think they're finished. They don't yet know what they are looking for, and the danger is that they will not learn what to look for if they keep working that way." Experience as an AI advantage Experienced workers have a crucial advantage when it comes to prompting AI: They understand context and usually know how to express it clearly. While a junior advertising creative might ask an AI to 'Write copy for a sustainability campaign', a seasoned account director knows to specify 'Write conversational social media copy for a sustainable fashion brand targeting eco-conscious millennials, emphasizing our client's zero-waste manufacturing process and keeping the tone authentic but not preachy'. This skill mirrors what experienced professionals do when briefing junior colleagues or freelancers: providing detailed instructions, accounting for audience, objectives, and constraints. It's a competency developed through years of managing teams and projects. Younger workers, despite their comfort with technology, may actually be at a disadvantage here. There's a crucial difference between using technology frequently and using it well. Many young people may become too accustomed to AI assistance. A survey of U.S. teens this year found 72% had used an AI companion app. Some children and teens are turning to chatbots for everyday decisions. Without the professional experience to recognise when something doesn't quite fit, younger workers risk accepting AI responses that feel right – effectively 'vibing' their work – rather than developing the analytical skills to evaluate AI usefulness. So what can you do? First, everyone benefits from learning more about AI. In our time educating everyone from students to senior leaders and CEOs, we find that misunderstandings about how AI works have little to do with age. A good place to start is reading up on what AI is and what it can do for you: If you're not even sure which AI platform to try, we would recommend testing the most prominent ones, OpenAI's ChatGPT, Anthropic's Claude, and Google's Gemini. If you're an experienced worker feeling threatened by AI, lean into your strengths. Your decades of experience with delegation, context-setting, and critical evaluation are exactly what AI tools need. Start small. Pick one regular work task and experiment with AI assistance, using your judgement to evaluate and refine outputs. Practice prompting like you're briefing a junior colleague: be specific about context, constraints, and desired outcomes, and repeat the process as needed. Most importantly, don't feel threatened. In a workplace increasingly filled with AI-generated content, your ability to spot what doesn't quite fit, and to know what questions to ask, has never been more valuable. Kai Riemer is Professor of Information Technology and Organisation, University of Sydney. Sandra Peter is Director of Sydney Executive Plus, Business School, University of Sydney. The Conversation is an independent and nonprofit source of news, analysis and commentary from academic experts. External Link © The Conversation
Japan Times
16 hours ago
- Japan Times
Trump's attack on Goldman could prompt watering down of Wall Street's independent analysis
U.S. President Donald Trump's criticism of Goldman Sachs' research on tariff risks could prompt some analysts to water down their research, investors and academics said, an outcome that could leave investors with less reliable information. The reams of research that banks such as Goldman produce are used by institutional investors, such as hedge funds and asset managers, in deciding how to allocate capital. Trump's comments — in which he lambasted Goldman, its economics team and CEO David Solomon and accused them of making "a bad prediction" — have triggered a debate on Wall Street about the possible fallout, according to interviews with banking industry sources and investors. At one Wall Street bank, Trump's comments spurred informal conversations among staff, a source familiar with the matter said. The source said they also discussed how to incorporate government data in the wake of Trump's decision to fire the head of the U.S. Bureau of Labor Statistics, claiming — without evidence — that its data had been politicized. Still, the bank was not considering changing the way research operates. "This is going to come down to a person's ability to withstand a barrage of criticism from the Oval Office, and the extent to which these banks provide support for their chief economists," said Dave Rosenberg of Rosenberg Research, who has worked in the economics departments at several banks. "If we notice that research is being watered down ... then we'll know that this has had an effect." Jack Ablin, chief investment strategist at Cresset Capital, said if banks do start self-censoring, smaller investors who do not have the resources to do their own analysis are likely to suffer most. Trump's criticism is his latest attack on corporate America and other institutions, and is a break from historical norms, where presidents have typically avoided calling out private companies and executives for things they do not like. Some companies that have considered passing on tariff costs to customers have faced public criticism, and Trump, who came to politics after running businesses, has intervened directly in private business decisions by making a deal with Nvidia to give a portion of its revenues from sales to China of AI chips to the government. Trump "certainly is taking a number of steps that diverge from the traditional view of the respective roles of the government and private industry,' said Henry Hu, a securities law professor at the University of Texas. In a social media post earlier this week, Trump said foreign companies and governments were mostly absorbing the cost of his tariffs, counter to Goldman's research. "Given that sell-side Wall Street analyst predictions have been about as accurate as random guessing, small investors will do just fine with the president exercising his First Amendment right about flawed Wall Street research," a White House official said. On Wednesday, Goldman's U.S. head economist David Mericle defended its research on CNBC, vowing to "keep doing" what the bank considers informative research. Goldman declined requests for further comment. Other major banks, including Wells Fargo, JPMorgan, Morgan Stanley, Deutsche Bank, Bank of America and Citigroup, declined to comment. There has already been evidence of self-censorship. A senior JPMorgan Asset Management investment strategist, Michael Cembalest, earlier this year said during a webinar that he refrained from voicing some of his thoughts on U.S. tariffs publicly. Shortly after Cembalest's comments, Jamie Dimon, JPMorgan's CEO, said that he expects analysts to speak their minds. Both Cembalest and the bank declined to comment for this story. Hu said there is a risk involved in even appearing to give way to political pressure. "Goldman's reputational capital is at stake here,' he said. "If their views on the economy become biased, and they are shown to be wrong, why would anyone choose Goldman to advise them on anything?' Mike Mayo, banking analyst at Wells Fargo, said independent research is critical for an investment bank's reputation. "Investment banks live and die by their reputation and independence. That transcends all other considerations." Wall Street research has long been tightly overseen, one source said, with supervisory analysts reviewing research reports to ensure that language is not inflammatory, emotive or partisan and that reports are objective and cite sources. That person said that if analysts feel unable to speak openly then investors will pay more or take greater risk. Liquidity will suffer and there will be less foreign participation in U.S. markets, the person said. It was large losses by smaller investors that triggered the first major probe of Wall Street research in the aftermath of the dot-com stock bubble of the late 1990s. Eliot Spitzer, then New York's attorney general, found that Wall Street analysts had swapped their honest opinions for unwarranted "buy" ratings on companies to help their banks win underwriting and advisory business. The result: a $1.5 billion global settlement payout by Wall Street and lifetime bans for some analysts. It remains to be seen whether the current kerfuffle will have an outsized impact on Wall Street or if it is a storm in a teacup, said Steve Sosnick, market strategist at IBKR. "It does raise a lot of questions," he added.
Japan Times
a day ago
- Japan Times
Trump's Golden Dome still shrouded in mystery, even for its builders
The companies expected to create U.S. President Donald Trump's "Golden Dome for America' know the objective: to protect the U.S. from missiles and airborne threats. They know it means billions of dollars' worth of contracts. But they don't know much about what, exactly, they are expected to do — and at an event last week, the government officials who might tell them weren't even allowed to mention the project by name. Attendees at the 28th annual Space and Missile Defense Symposium in Huntsville, Alabama, saw signs early on that the topic on everyone's minds might be tricky to discuss. Before the event even began, the industry groups hosting it removed a Golden Dome-focused panel. "Information regarding Golden Dome for America will be promulgated by the government,' they said. Major defense contractors, including Lockheed Martin, RTX and Northrop Grumman, prepared slick websites and flashy sideshows for the conference to demonstrate how their work fits with the president's vision for an air and missile defense network protecting the entire U.S. Their executives were all singing the same tune: The project is so ambitious and potentially lucrative that there's a role for everyone, and plenty of opportunity for collaboration, including between startups and nontraditional defense companies. Just don't ask the government for details. "In the last six months I've walked into many, many rooms and said, 'I can't take any questions on you-know-what,' and I've never received a question other than something about you-know-what,' Air Force Lieutenant General Heath Collins, director of the Missile Defense Agency, said to laughter after delivering closing remarks at the event. Golden Dome will include existing systems, accelerated development of advanced technology, and ultimately new components such as space-based interceptors, according to Trump, who announced his plan for the program in one of his first executive orders after returning to the presidency. He also has said the project will be fully operational before the end of his term and will cost $175 billion. The Congressional Budget Office has estimated the price tag for a network of space-based interceptors could be as high as $542 billion over 20 years. Space Force General Michael Guetlein, who is leading the project, is expected to unveil its architecture by mid-September. At the conference, industry representatives showcased their hardware, including RTX's Patriot missile defense system, which uses Lockheed Martin's PAC-3 MSE interceptor, and Northrop Grumman's Integrated Battle Command System, as they sought insight from the government on how the pieces will fit together. Companies also pointed to the work they or their corporate predecessors had done on President Ronald Reagan's space-based Strategic Defense Initiative — the so-called "Star Wars' missile defense program that fizzled in the 1980s — saying they were up for the challenge of making it work 40 years later. Riki Ellison, founder and chairman of the Missile Defense Advocacy Alliance, said on the sidelines of the symposium that not being able to speak openly about an "executive order that is out in the public, that we're going to build this in three years for $175 billion — it just delays this process and puts more pressure to get this thing in play.' None of the industry or academic sources interviewed for this article knew why there were such restrictions. In a statement, the Pentagon declined to disclose further information because of operational concerns, saying only that the Defense Department is gathering information to support Golden Dome. The Pentagon has declined so far to detail which organization compiled the $175 billion estimate, how many years it covered, an annual breakdown of the costs and categories on which the money would be spent. "It would be imprudent for us to release further information at this time,' Pentagon spokesperson Kingsley Wilson told reporters last week. Space Force General Guetlein "just got in the building,' said Wilson, who pledged to be "transparent where we can be' about a "very expensive' but "very critical' program. Not all of the government speakers at the event avoided the forbidden words. A NASA representative — notably not bound by the Pentagon's strictures — spoke about the work his agency is doing that could support Golden Dome, including advanced propulsion technologies and materials science. Industry representatives say they hope to learn more soon. The restriction on what can be discussed "seems to have been partially lifted and probably will be more lifted as we keep going through this,' said Milton Carroll of Peraton, which aims to help Golden Dome systems communicate seamlessly. MDA's Collins also sounded an optimistic note, telling the defense officials, contractors and academics at the event that the program's launch presented a unique opportunity. "It's a fleeting moment,' he said. "As history has shown, this doesn't last forever, and we need to make a monster change now.'
