IIT Kharagpur Student Trials ChatGPT o3 On JEE Advanced Mock Test, Stunned By Result
To test ChatGPT o3's capabilities, Anushka Aashvi simulated real exam conditions, prompting the model to act like a JEE aspirant and solve questions independently without web searches, coding tools or hints. Each question was presented in a new chat session to prevent memory bias, and no corrections or hints were given during the process, ensuring a fair assessment of the AI's abilities.
"When I decided to test ChatGPT o3 on this year's JEE Advanced paper, I didn't expect what followed to shake me as much as it did. Giving away the result straightaway, ChatGPT o3 scored a whopping 327/360 in JEE Advanced 2025 Question Paper," Ms Aashvi wrote in a blog on Heltar.
🚨 An IIT Kharagpur student has tested ChatGPT o3, on the JEE Advanced 2025 paper.
The AI scored a staggering 327 out of 360, a score that would earn it All India Rank 4 in the real exam. 😉 pic.twitter.com/QL0V9oGI4J
— Indian Tech & Infra (@IndianTechGuide) June 8, 2025
Notably, the AI achieved perfect scores of 60 in both Chemistry and Mathematics in the second phase, with minor errors only in Physics and earlier sections.
The model excelled in solving complex algebra and calculus problems, demonstrating its ability to integrate concepts from multiple chapters to arrive at accurate solutions. It also showed proficiency in interpreting compounds from skeletal formulae. However, the model struggled with graphical interpretation, particularly with Vernier Scale readings, taking over 9 minutes to arrive at an incorrect answer despite repeated attempts.
"It was not able to understand the Vernier Scale readings. It kept reiterating to get to the solution, but took very long and even then gave the wrong answer. But an overall score of 327/360 is truly remarkable," Ms Aashvi added.
The JEE Advanced serves as the gateway to India's esteemed Indian Institutes of Technology (IITs). Out of over 1.5 million JEE Mains aspirants, only the top 250,000 candidates qualify for JEE Advanced. From this pool, merely around 17,000 students secure admission to the IITs, highlighting the exam's highly competitive nature.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
The Hindu
39 minutes ago
- The Hindu
Elon Musk clashes with Sam Altman after accusing App Store of favouring OpenAI
Elon Musk has accused Apple of unfairly favouring ChatGPT on its App Store and threatened legal action, triggering a fiery exchange with OpenAI CEO Sam Altman on Tuesday. "Apple is behaving in a manner that makes it impossible for any AI company besides OpenAI to reach #1 in the App Store, which is an unequivocal antitrust violation," Musk said in a post on his social media network X on Monday, without providing evidence to back his claim. "xAI will take immediate legal action," he said, referring to his own artificial intelligence company. X users responded by pointing out that China's DeepSeek AI hit the top spot in the App Store early this year, and Perplexity AI recently ranked number one in the App Store in India. DeepSeek and Perplexity compete with OpenAI and Musk's startup xAI. OpenAI CEO Sam Altman called the accusation "remarkable" in a response on X on Tuesday, adding that Musk was alleged to "manipulate X to benefit himself and his own companies and harm his competitors and people he doesn't like." Musk then called Altman a "liar" in a heated exchange, prompting the OpenAI boss to ask whether Musk would sign a sworn legal statement declaring that he had never ordered changes to the X algorithm to harm competitors or help his own companies. OpenAI and xAI both released new versions of their AI assistants, ChatGPT and Grok, in the past week. App Store rankings listed ChatGPT as the top free iPhone app on Tuesday, with Grok in fifth place. Apple did not respond immediately to a request for comment. Factors going into App Store rankings include user engagement, reviews and the number of downloads. OpenAI and Apple announced an alliance in June last year to enhance iPhones and other devices with ChatGPT features. ChatGPT-5 rolled out free to the nearly 700 million people who use it weekly, OpenAI said in a briefing with journalists last week. Tech industry rivals Amazon, Google, Meta, Microsoft and xAI have been pouring billions of dollars into artificial intelligence since the blockbuster launch of the first version of ChatGPT in late 2022. Chinese startup DeepSeek shook up the AI sector early this year with a model that delivers high performance using less costly chips. OpenAI filed counterclaims against multi-billionaire Musk in April, accusing its former co-founder of waging a "relentless campaign" to damage the organization after it achieved success without him. OpenAI alleged in legal documents filed at the time in the northern California federal court that Musk became hostile toward the company after abandoning it years before its breakthrough achievements with ChatGPT. The lawsuit was another round in a bitter feud between the generative AI (genAI) start-up and the world's richest person, who accused OpenAI of betraying its founding mission in a lawsuit last year. OpenAI alleged in its countersuit that Musk "made it his project to take down OpenAI, and to build a direct competitor that would seize the technological lead, not for humanity but for Elon Musk." Musk founded his own genAI startup, xAI, in 2023 to compete with OpenAI and the other major AI players.
Time of India
39 minutes ago
- Time of India
Apple denies Elon Musk's allegations of favouritism to ChatGPT
Synopsis Apple has denied Elon Musk's claims of App Store bias favouring ChatGPT over his apps, X and Grok. Musk accused Apple of unfair rankings and threatened legal action. Apple insists its platform is impartial, citing objective criteria. The dispute comes amid Apple's antitrust battles and its deepening ties with OpenAI.
The Hindu
2 hours ago
- The Hindu
Lenovo charts hybrid course in a cloud market ruled by titans
In a global cloud infrastructure market valued at over $330 billion and dominated by a handful of hyperscalers, Lenovo is forging a distinct and strategic path. Rather than clashing head-on with giants like Amazon Web Services, Microsoft, and Google Cloud, the company's Infrastructure Solutions Group (ISG) is positioning itself as the indispensable foundational partner for a new era of hybrid, AI-driven computing, according to Amit Luthra, Managing Director for Lenovo ISG in India. 'Cloud is the form of the way IT is consumed,' Mr. Luthra said. 'Our strategy is to work with the complete ecosystem of the cloud—from hyperscalers and local service providers to large enterprises and SMBs.' This philosophy of collaboration over direct competition hinges on providing flexible, outcome-driven infrastructure. Mr. Luthra emphasised that the company has moved beyond simply selling hardware. The focus now is on delivering tangible results, a shift that requires a deep understanding of diverse customer needs and an open, interoperable architecture. 'We don't want to go back to our customers and say you have to let go of what you already have,' he explained, highlighting a core principle of avoiding proprietary lock-in. This allows organisations to build upon their existing IT investments, whether they are traditional on-premise systems or complex multi-cloud environments. This flexibility is particularly crucial when addressing the full spectrum of the market, from sprawling enterprises to agile small and medium-sized businesses (SMBs). Mr. Luthra pointed to a 'build vs. buy' dynamic, where many SMBs lack the resources for custom development. 'Most of the mid-market and SMB customers in India will want to buy IT — buy it like a package,' he noted. To serve this segment, Lenovo has cultivated a robust ecosystem of Independent Software Vendors (ISVs), enabling the delivery of pre-validated, turnkey solutions. 'We do have lot many solutions like these... to help them give a complete end-to-end packet solution,' Mr. Luthra added, citing examples like a 'ChatGPT in a box' for enterprises seeking a private, secure large language model. The catalyst for this market evolution, Mr. Luthra asserts, has been the explosion of artificial intelligence. While AI and analytics have been around for over a decade, the recent wave of generative models has fundamentally altered the landscape. 'GenAI took it to the mainstream. It became a boardroom imperative,' he stated. According to a global CIO survey conducted by Lenovo, India has emerged as a leader in AI adoption within the Asia-Pacific region. Indian organisations are leveraging the technology for both optimising existing processes — what Mr. Luthra calls improving 'business hygiene'—and driving disruptive innovation. Looking ahead, he believes the industry's focus is already shifting from the initial frenzy of training massive models to applying them for practical use. 'The big bet that I would have is on inferencing,' Mr. Luthra declared. 'The era of training and LLMs was a two years back story... while that is still on, inferencing is where the big bet is.' With this rapid technological advance, however, comes the critical responsibility of governance. Mr. Luthra said that security, privacy, and ethics are now central to every major technology discussion. 'Responsible AI is a very, very big discussion point in deploying most of these solutions,' he said. 'People want to talk about security, people want to talk about ethics. This is where IT makes the excitement in the board real.'
