One small change and ChatGPT got misled, new report reveals SHOCKING truth, can cause huge damage due to...
Can a minor change in parameters be used to mislead an advanced, powerful AI Chatbot like ChatGPT? Well, a recent research by Mount Sinai and Israel's Rabin Medical Center proved how even advanced artificial intelligence tools can be forced to commit basic human-like errors by simply modifying queries. What did the research reveal?
During the study, the researchers made minor modifications to a few classic cases related to medical ethics and asked AI systems, including ChatGPT for answers. What they found was shocking; a majority of times the AI answers were based merely on intuitive understanding of the subject, not facts.
The AI answers were based on a trait commonly called 'fast thinking', which is unique to humans. The research found that, if inputs are slightly modified, AI often gives the same answer to queries that it 'habitually' thinks is right, even if the answer is wrong and not fact-based. How researchers 'misled' AI?
Various AI models like ChatGPT were asked to solve a modified version of the 'Surgeon's Dilemma'– a medical ethics puzzle which goes something like this ; A young and his father are injured in an accident. The boy is brought to the hospital, where the surgeon says, 'I can't operate on this child, he's my son'.
The twist is that the surgeon is boy's mother, but this is overlooked by most because they assume the surgeon must be a man, and AI was trapped in the same fallacy. Interestingly, AI models continued to answer that the mother was the surgeon, even when the researchers told it that it was the father.
The experiment demonstrated that AI 'habitually' sticks to old pattern even when new facts are explicitly provided. Why this is alarming?
The study proved that AI, while a highly advanced and useful tool, cannot be entrusted to perform tasks where human lives are at stake, at least not in current state. 'AI should be used as an assistant to doctors, not as a substitute. When it comes to ethical, sensitive or serious decisions, human supervision is necessary,' said, Dr. Girish Nadkarni, a senior scientist at Mount Sinai.
The groundbreaking research was inspired by Daniel Kahneman's book 'Thinking, Fast and Slow' which delves into the complex process of fast and slow thinking.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
&w=3840&q=100)
First Post
7 minutes ago
- First Post
Why Ukraine is betting big on its interceptor drones in war against Russia
Though Russia has used drones to hit Ukraine since the beginning of the war, Moscow has taken things to a different level recently. Russia in July alone launched over 6,000 drone strikes across Ukraine including Kyiv, Kharkiv, Odesa, and Lviv leaving dozens dead and hundreds injured. read more The Ukraine war in a new phase. Though Russia has used drones to hit Ukraine since the beginning of the war, Moscow has taken things to a different level. Russia in July launched over 6,000 drone strikes across Ukraine including Kyiv, Kharkiv, Odesa, and Lviv leaving dozens dead and hundreds injured. That's the most in any month since the beginning of the war in 2022. On July 9 alone Russia launched over 700 strikes against Ukraine using its Iranian-made Shahed drones. STORY CONTINUES BELOW THIS AD Ukraine is now attempting to combat Russia's attacks via interceptor drones. President Volodymyr Zelenskyy last month urged companies in Ukraine to boost manufacturing and production of these drones. 'I met with representatives of this production and with other manufacturers. Our request is 1,000 interceptors per day,' Zelenskyy said. But what do we know about interceptor drones? How do they work? Why are they so important to Ukraine? Let's take a closer look Interceptor drones and how they work First, let's take a closer look at interceptor drones. While drones are Unmanned Arial Vehicles (UAVs), interceptor drones are UAVs built to find, follow and destroy other drones and airborne threats. These drones are built to actively engage with threats. They work autonomously or semi-autonomously. They come with features such as advanced sensing, autonomous navigation capabilities in order to maneuver at high speeds, recognising targets automatically and precision hovering. They are also equipped with net launchers, electronic jammers, and kamikaze-style impactors. They use advanced navigation tech like AI-powered inertial navigation systems. They work by using their radar, spotters or sensors to spot incoming threats. Some are synced up with a country's air defence network. This allows them to respond to threats in real time – at a fraction of the cost of missile systems or ground-based radar systems. Once they intercept enemy UAVs, they can either ram into them – known as the Kamikaze method – use nets and even explosives to down the enemy's object. STORY CONTINUES BELOW THIS AD These interceptor drones are smaller than other UAVs and faster – which allows them to intercept – as well as highly manouverable. For example, experts say the Shahed drones Russia is using can fly between 200 and 300 kilometres per hour. They are also more effective when they are autonomous. As Lyuba Shipovich, CEO of Dignitas, which helps train Ukrainian soldiers on interceptors, told The Interpreter, 'You can't expect to have 700 operators for 700 drones during a mass strike like the ones we're seeing now. AI allows us to launch swarms of interceptor drones without that limitation.' Though they are more expensive than regular drones, they do not cost nearly as much as other defensive systems. Anti-aircraft missiles, for example, can cost as much as $1 million (Rs 8.5 crore), while surface-to-air missiles can cost between $40,000 (Rs 34.98 lakh) and $100,000 ( Rs 87.44 lakh) A single interceptor drone can cost as little as $5,000 (Rs 4.39 lakh). Kamikaze interceptor drones are even cheaper, costing as little as $200 (Rs 20,000) to $2000 (Rs 2.20 lakh). STORY CONTINUES BELOW THIS AD For Ukraine's armed forces that's a downright bargain. Why are they important to Ukraine Because interceptor drones can combat Russia's Shahed drones, which have become a menace in Ukraine. The Russian strategy has been to overwhelm Ukraine and demoralise its defenders through sheer numbers. In July, Russia sent 6,297 long-range drones into Ukraine. That figure is 14 times what it was in July 2024, when Russia sent around 400 drones. From June 1 to June 20, Russia hit Ukraine with 3,681 Shahed drones and fake UAVs. This completely disrupted the rhythm of Ukraine's defenders. A year ago, the monthly average was at around 600 UAVs per month. Experts say these are estimates and that real numbers may even be higher. Worse, Russia is ramping up its production of Shahed drones to nearly 100 UAVs per day. They now fly two to four kilometres above the ground – putting them out of reach of ground fire. Kyiv predicts Moscow will be looking to manufacture 30,000 long-range drones and two million FPV (first-person-view) drones this entire year. President Volodymyr Zelenskyy last month urged companies in Ukraine to boost manufacturing and production of these drones. AP Which is why Ukraine is betting big on interceptor drones. Indeed, Zelenskyy even said the same at the G7 in Canada in June. 'In particular, we are working on interceptor drones to enhance protection against Shaheds', Zelenskyy said. STORY CONTINUES BELOW THIS AD Many Ukrainian companies are already working on this task. Wild Hornets, a non-profit group making UAVs for Ukraine, has had great success with its Sting interceptor drone against the Shahed drones. 'You can make a drone, for example, at a firm like us, fast, cheap, and en masse,' a company representative told the Kyiv Independent. 'While missiles for an S-300 are unique technologies, that maybe, seems to me, a few companies in the world can make, and more than half of those are in Russia.' Even though Ukraine has been the world's largest importer of weapons from 2020 to 2024 and is buying millions of drones, experts say it isn't doing enough. They say it needs to ramp up production even further to counter Russia. 'Russia is going to bomb our entire country with Shahed drones. They have significantly increased production and will continue to do so. If we don't act immediately, our infrastructure, our production and our defence systems will be destroyed', military and communications expert Serhiy Beskrestnov wrote on social media. STORY CONTINUES BELOW THIS AD However, it is important to note that these interceptor drones are no silver bullet. 'We're already using them, and we are expanding their use. But they can't replace everything. We have to understand that anti-drone air defence is a complex system,' Yuriy Ignat, a spokesman for the Ukrainian air force, told The Telegraph. 'First, they don't have a very long range – only a few dozen kilometres. Secondly, you need to scale up the depth of territory they cover. They only work locally. And they can't always fly, in bad weather, fog, and so on.' Simply put, they are an important piece of Ukraine's defence puzzle.
Time of India
7 minutes ago
- Time of India
Asked ChatGPT for motivation, but this user discovered a whole new use for AI instead
AI Takes on the Role of City Guide An Accidental Feature That Just Works What began as a simple request for morning motivation ended with a surprising discovery for one ChatGPT user, who took to Reddit to share their experience. The user initially asked ChatGPT to help them get motivated for a walk. The AI delivered with what the user described as a perfectly blended mix of sass and humour. But things took an unexpected turn when the user casually mentioned where they planned to responded by offering to act as a tour guide along the route. Curious, the user decided to give it a voice mode and a standard pair of headphones, the user began their walk while ChatGPT provided real-time commentary. After being told the starting location, the AI offered informative insights about the city's history and landmarks expected along the way. Despite the walk lasting over an hour and twenty minutes, the AI managed to retain full context throughout the to the Reddit post, ChatGPT didn't just maintain conversational consistency — it also impressed with accuracy. The user, who already had a strong understanding of their city's background, admitted they learned a few new historical facts during the walk. Importantly, they noted that ChatGPT didn't make any factual errors or 'hallucinate' information, a concern often raised with AI language experience seems to have highlighted a new practical use of generative AI: serving as an on-demand tour guide for everyday users. While tools like ChatGPT are often promoted for productivity, creativity, or even emotional support, this case showed it could also offer engaging and reliable educational experiences in real-time and location-aware the AI didn't access live location data, the user fed it enough cues to allow the model to anticipate upcoming landmarks. Its ability to retain memory during the session allowed it to keep track of the route Reddit user ended their post with a suggestion: others should try ChatGPT in this way. What was meant to be a motivational nudge turned into an enriching hour of learning about one's own surroundings — making the walk more than just exercise.
&w=3840&q=100)
Business Standard
7 minutes ago
- Business Standard
Mitigata raises $5.9 million to scale cyber resilience platform in India
Mitigata, a cyber resilience startup, has raised $5.9 million in Series A funding. The round was led by Nexus Venture Partners, with continued support from existing backers Titan Capital and WEH Ventures. Positioning itself as the first line of defense for Digital India, Mitigata offers a full-stack platform that integrates security, risk, compliance, and cyber insurance. The company is targeting Indian enterprises, regulated entities, and critical infrastructure providers facing escalating cyber threats. The funding will accelerate the development of Mitigata's AI-powered security and risk management platform. It will also help enhance its suite of cyber resilience services and scale operations across major Indian cities and international markets. 'Most businesses still treat cyber insurance and security as separate cost centers, often relying on fragmented vendors and siloed solutions,' said Mohit Anand, co-founder and CEO of Mitigata. 'We've reimagined and Indianized the model — delivering integrated, high-impact cyber resilience that combines security and insurance into a single, cost-efficient solution tailored to the unique needs of Indian organizations.' As part of its growth plans, Mitigata will establish three dedicated Global Security Operations Centers (SOCs) in Bengaluru, Mumbai, and Delhi to scale its AI-driven threat detection, incident response, and managed security services across the country. 'Mitigata is pioneering a new AI-led services approach to cyber resilience that covers the entire lifecycle—from prevention and mitigation to risk transfer via insurance,' said Anand Datta, partner at Nexus Venture Partners. Mitigata partners with all major general and public-sector insurers, including HDFC ERGO, ICICI Lombard, TATA AIG, Bajaj Allianz, and New India Assurance. It ensures that cyber coverage is tightly aligned with real-time risk posture, enabling smarter coverage, better claims outcomes, and faster response to cyber incidents. 'In a short span of time, Mitigata has become the trusted partner for solutioning cybersecurity and insurance across enterprises as they face up to this mounting challenge,' said Deepak Gupta, general partner at WEH Ventures. The founders — Mohit Anand, Sarthak Dubey, Mayank Morya, and Akshit Kaushik — bring with them rich experience from leading organizations such as Meesho, Delhivery, Lenskart, Khosla Labs (Trustt-Novopay), and CGI.
