Microsoft claims its AI Diagnostic Orchestrator outperformed 21 doctors, got 85.5% of diagnoses right
The system, called the Microsoft AI Diagnostic Orchestrator (MAI-DxO), was tested using case studies published by the New England Journal of Medicine (NEJM). These cases are known for being particularly complex and usually involve teams of specialists. According to Microsoft, the AI got the correct diagnosis 85.5 per cent of the time, compared to just 20 per cent for a group of experienced doctors from the US and UK.
As more people turn to digital tools for medical advice, the company says it sees over 50 million health-related searches every day across its services like Bing and Copilot.
To test the system, Microsoft created a new challenge called the Sequential Diagnosis Benchmark (SD Bench), based on 304 real NEJM cases. The cases were turned into step-by-step scenarios, where the AI or a human doctor could ask questions or order tests before making a diagnosis. Each test had a virtual cost, helping to measure both accuracy and how wisely resources were used.
Microsoft tested several top AI models, including OpenAI's o3, Claude, Gemini, Llama, and DeepSeek, both alone and as part of MAI-DxO. The orchestrator system works by combining different models to act like a team of doctors, sharing ideas and narrowing down possible diagnoses. The best results came from using MAI-DxO with OpenAI's o3 model, the tech giant stated.
Reportedly, the results showed that the AI not only diagnosed more cases correctly but also did so with fewer and more cost-effective tests than the doctors involved in the study.
However, Microsoft admitted the research has its limits. The tests focused on rare and complex cases, not everyday health problems. Also, the doctors were not allowed to use any support tools like books or the internet during the test, unlike in real-world situations where such resources are often used.
Other tools developed by the company include RAD-DINO, which helps improve radiology processes, and Dragon Copilot, a voice assistant for doctors.
Microsoft says it is now working with health organisations to test its AI in real clinics and hospitals. Before any wider use, the technology will need to meet safety standards and get approval from regulators.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Mint
an hour ago
- Mint
Moonlighting pro Soham Parekh secures new job at AI startup after Silicon Valley scandal, 'He'll prove everyone wrong'
Soham Parekh, the software engineer making headlines for secretly working for multiple startups simultaneously, has found a new full-time job opportunity. Following backlash over moonlighting, the techie secured a new opportunity with Darwin Studios, based in San Francisco. At this new role as a founding engineer, he will help build an AI-powered video remixing platform called Wayve. In a statement, Darwin's CEO and founder Sanjit Juneja commended the techie, accused of juggling multiple jobs at once, and suggested that there is 'something even greater to prove than just his love for software.' Calling Parekh a '10x engineer,' he defended his recruitment and said, "Soham is an incredibly talented engineer, and we believe in his abilities to help bring our products to market." He suggested that there is 'something even greater to prove than just his love for software.' Meanwhile, Soham Parekh admitted that he will no longer be taking on multiple jobs. Founder of AI company HyperSpell, Conor Brennan-Burke, also offered an engineering role to Parekh in his company and said that he believes in second chances. Sharing the e-mail, Burke wrote, 'He's definitely learned his lesson now and is going to work insanely hard to prove everyone wrong. Massive opportunity to bring on top talent with a chip on their shoulder.' Soham Parekh's moonlighting scandal first surfaced when Playground AI founder Suhail Doshi exposed the Indian techie and called him a "scammer" on X. The warning message stated, 'There's a guy named Soham Parekh (in India) who works at 3-4 startups at the same time. He's been preying on YC companies and more. Beware.' The consequences of this post that followed left Soham Parekh in trouble as he was fired from multiple roles while several recruiters flagged him as a risky hire. Soham Parekh confessed that 'dire financial hardship drove him to make those decisions' about providing false narratives on his whereabouts and his employment situation during his appearance US technology show TBPN show. He said, 'I'm not proud of what I did," about and deceiving employers and added, 'I wish I had the money.' He clarified that he did not hire junior developers and began taking multiple jobs in 2022, 'before the CoPilot boom' during his stint with US-based startups.
Indian Express
an hour ago
- Indian Express
Character.AI introduces TalkingMachines, a new AI model that can generate interactive videos
the popular platform that allows users to create and interact with AI chatbots has introduced a new diffusion model called TalkingMachines. The Google-owned startup says its newest AI model enables 'real-time, audio-driven, FaceTime-style video generation.' In a blog post, said that users said the new model can help generate an interactive, real-time video of characters with different styles, genres and identities using just an image and a voice signal. new feature is powered by a Diffusion Transformer (DiT), which utilises a technique called asymmetric knowledge distillation that enables the conversion of a 'high-quality, bidirectional video model into a blazing-fast, real-time generator.' The company says its new model listens to audio and then animates parts of the character like mouth, head and eyes, all in sync with every word, pause and intonation without compromising on things like consistency, image quality, style and expressiveness. For audio, is using a custom-built 1.2B parameter audio module that captures both speech and silence, with the company claiming that it can achieve 'infinite-length generation with no quality degradation over time.' The company goes on to say that its new AI model supports a variety of styles, like photorealistic humans to anime to 3D avatars and builds on the core infrastructure for role-playing, storytelling and interactive world-building. has been constantly adding new features like a new image-to-video generator called AvatarFX, Scenes and Streams. Following OpenAI's advanced voice mode, the startup even added a call feature that allows users to engage in voice conversations with the character of their choice to increase engagement. Last year, the Google-owned startup was sued by the mother of a 14-year-old kid in Florida who claimed that a chatbot encouraged her son to kill himself. Since then, the company has introduced new supervision tools to ensure the online safety of users under 18.
Time of India
4 hours ago
- Time of India
Microsoft closes its Pakistan office after 25 years
Karachi: Tech giant Microsoft has announced to shut down its limited operations in Pakistan as part of its global strategy to reduce workforce, which various stakeholders termed on Friday as a "troubling sign" for the country's economy. Microsoft, while closing its office in Pakistan on Thursday after 25 years, cited global restructuring and a shift to a cloud-based, partner-led model. The move came as the tech giant cut roughly 9,100 jobs worldwide (or about 4 per cent of its workforce) in its largest layoff round since 2023. Jawwad Rehman, former founding Country Manager of Microsoft Pakistan , urged the government and IT minister to engage with the tech giants with a bold KPI (Key Performance Indicators) driven plan. He said the exit reflected the current business climate. "Even global giants like Microsoft find it unsustainable to stay," he posted on LinkedIn. Former Pakistan president Arif Alvi, in a post on X, also expressed concern over Microsoft shutting down operations. "It is a troubling sign for our economic future," he wrote. He claimed Microsoft once considered Pakistan for expansion, but that instability led the company to choose Vietnam instead by late 2022. "The opportunity was lost," he wrote. Jawwad explained that Microsoft didn't operate a full commercial base in Pakistan, relying instead on liaison offices focused on enterprise, education, and government clients. Over recent years, much of that work had already shifted to local partners, while licensing and contracts were managed from its European hub in Ireland.
