Apple Debunks AI Reasoning Hype: Models Memorise, Don't Think, Study Reveals
Apple claimed that these models simply memorise patterns really well, but when the questions are altered or the complexity increased, they collapse altogether. In simple terms, the models work great when they are able to match patterns, but once patterns become too complex, they fall away.
"Through extensive experimentation across diverse puzzles, we show that frontier LRMs face a complete accuracy collapse beyond certain complexities," the study highlighted.
"Moreover, they exhibit a counterintuitive scaling limit: their reasoning effort increases with problem complexity up to a point, then declines despite having an adequate token budget," it added.
For the study, the researchers flipped the script on the type of questions that reasoning models usually answer. Instead of the same old math tests, the models were presented with cleverly constructed puzzle games such as Tower of Hanoi, Checker Jumping, River Crossing, and Blocks World.
Each puzzle had simple, well-defined rules, and as the complexity was increased (like more disks, more blocks, more actors), the models needed to plan deeper and reason longer. The findings revealed three regimes.
Low complexity: Regular models actually win.
Medium complexity: Thinking models show some advantage.
High complexity: Everything breaks down completely.
AGI not as near as predicted?
Apple reasoned that if the reasoning models were truly 'reasoning', they would be able to get better with more computing power and clear instructions. However, they started hitting walls and gave up, even when provided solutions.
"When we provided the solution algorithm for the Tower of Hanoi to the models, their performance on this puzzle did not improve," the study stated, adding: "Moreover, investigating the first failure move of the models revealed surprising behaviours. For instance, they could perform up to 100 correct moves in the Tower of Hanoi but fail to provide more than 5 correct moves in the River Crossing puzzle."
With talks surrounding human-level AI, popularly referred to as Artificial General Intelligence (AGI), arriving as early as 2030, Apple's study suggests that it might not be the case, and we might be some distance away from sentient technology.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Hans India
23 minutes ago
- Hans India
Meta Set to Launch Hypernova AR Glasses in September at $800 Price Point
Meta is preparing to take a major leap in wearable technology with the upcoming launch of its first smart glasses equipped with a display. According to a Bloomberg report, the device—codenamed Hypernova—is expected to make its debut in September 2025 at a starting price of around $800. This price tag marks a surprising shift from earlier expectations. Initial estimates had suggested Meta might launch Hypernova at more than $1,000, with some predictions going as high as $1,400. By choosing to lower the cost, Meta is aiming to make the product more accessible to early adopters, even if it means thinner profit margins in the short term. Designer frames and prescription lenses are likely to cost extra, but the entry price itself will be considerably more affordable than once feared. Unlike a full-fledged augmented reality headset, Hypernova is being positioned as a bridge device—something between lifestyle smart glasses and the future of true AR headsets. Early details suggest the glasses will feature a small display embedded in the right lens, enabling wearers to view notifications, alerts, and lightweight applications without needing to check their phones. A key part of the system will be Meta's neural wristband, a technology the company has been refining for several years. This wristband interprets signals from the wearer's wrist, allowing subtle hand movements to function as commands. By combining this control method with the glasses' display, Meta is offering a more intuitive, button-free user experience. The timing of this launch comes as competition in the AR/VR space heats up. Apple's Vision Pro, which launched in 2024 at $3,499, has drawn criticism for its heavy design, steep cost, and limited content library. Positioned as a mixed reality headset, the Vision Pro is marketed toward professionals and enthusiasts rather than everyday consumers. Reports suggest sales have been modest, and Apple appears to be pacing itself until it can deliver a lighter, more affordable version later this decade. Meta, however, seems to be taking a different approach. Instead of chasing ultra-premium features, the company is focusing on practicality and accessibility. Hypernova is unlikely to rival the Vision Pro in terms of immersive cinema-like experiences, but it could resonate with users looking for convenience in daily life—such as quick access to notifications, navigation, and productivity tools without needing to reach for a phone. This strategy also builds on Meta's previous experiments in wearable tech. Its collaboration with Ray-Ban produced glasses that captured photos, videos, and streamed audio, but those products leaned more toward lifestyle accessories. Hypernova pushes the concept further by integrating a display and a new control system, positioning it as a more serious step into AR. For consumers, Hypernova's launch may represent the first widely affordable opportunity to experience augmented reality in everyday life. Whether it evolves into a mainstream device or remains a niche product will depend heavily on Meta's long-term app ecosystem, updates, and user support.
Hindustan Times
an hour ago
- Hindustan Times
Pixel 10 5G mobile: Google teases new AI features ahead of August 21 launch
Google is hosting the 'Made by Google' event in two days to introduce the new Pixel 10 lineup. As the launch approaches, the Mountain View giant is sharing back-to-back teasers to reveal the Pixel 10 models and design. However, in a recent teaser, Google hints towards new and more personal AI-powered capabilities. Well, looking at Google's progress in advancing AI, there is no doubt that the company is running neck-to-neck or ahead of other competitors. As Google is significantly advancing its AI capabilities for smartphones, Apple is being highlighted for delaying promised AI features. Therefore, if you want to experience the power of an AI phone, know what Google might bring to the Pixel 10 series, based on the recent video teaser. Google Pixel 10 series teaser revealed expected AI features such as Super Res Zoom, Add Me, and more.(Screengrab/Google) Google Pixel 10 AI features: What to expect In a recent Google teaser for the Pixel 10 series launch, the tech giant teased a couple of AI-powered features in a new 28-second video. The teaser consisted of a few questions, highlighting a couple of smartphone camera capabilities, but with an AI twist. The teaser starts with the first 'What if your phone could do things other phones couldn't?', then it gives a few examples of features like 'What if the camera could get super, super, super close while being really, really, really far?', this statement gives hints to the anticipated Super Res Zoom feature. This camera AI feature will reportedly use AI and computational photography to improve the zoom quality of the Pixel 10 models. Another question in the video goes by, 'What if you could be in the group photo even if you snapped the group photo?' This feature hints towards the previously announced 'Add Me' feature that smartly adds the photographer to a group photo using AI. To end the video, Google adds a quirky line that says, 'While you used to be on the other side of the camera, now the camera is on your side.' This not only adds curiosity among fans but also creates higher expectations for new AI-powered additions. Now, to know about Google's new AI additions, we will have to wait until the 'Made by Google' event, which is scheduled for August 21, at 10:30 PM IST. During the event, the company is expected to announce several new hardware products, such as the Pixel 10 series, Pixel Watch 4, and the affordable Pixel Buds 2a.
Hindustan Times
an hour ago
- Hindustan Times
iPhone users, Apple has added this addictive ‘Little Bird' ringtone in iOS 26
Apple recently released the iOS 26 developer beta 6, and it packs a slew of new upgrades alongside new ringtones. Yes, there are a total of six new ringtones with iOS 26 beta 6, and some of them are new takes on the already existing 'Reflection' ringtone, which comes as the default ringtone on iPhones, but there's also a new surprise ringtone from Apple called 'Little Bird.' iPhone 17 series will ship with iOS 26.(Apple) We think it is catchy enough to become the new iPhone identity like the previous ringtones did, including the OG Xylophone, which you can still access, and of course the Reflection ringtone, which you find on most iPhones these days. Fresh New iPhones, Fresh New Ringtones It's another story that most people like to have their iPhones on silent mode and just have them vibrate whenever a call or notification comes. But this is, of course, a welcome addition. It could also symbolise one more thing, a big change for Apple. The iPhone 17 Pro is expected to bring a design change after multiple years. This is because iPhone Pro models have looked technically the same since the iPhone 11 Pro, with the same triangular camera setup laid out in the top left of the back. But now Apple is expected to introduce a much bigger camera module, and the 'look' of the Pro models is expected to change based on credible reports. So this could be Apple's way of creating a new identity for the iPhone, from both a visual as well as a sensory perspective. Note: You can tap here to listen to the new Little Bird ringtone. Also, if you are crafty enough, you could technically even use it as a ringtone on your phone now.
