UAE: Should ChatGPT give medical advice? Mental health experts call for regulation
Mental health experts say yes, and they are urging AI platforms like ChatGPT to incorporate real-world safeguards that can manage emotionally heavy conversations.
A growing number of psychologists and researchers warn that while AI tools can be helpful in moderation, they are gradually taking on roles they were never designed to fill. With rare but serious cases of AI-linked psychosis now being documented, experts say the lack of oversight is a problem, especially as more people turn to chatbots for comfort, therapy-like support, or emotional connection.
'The danger isn't just about (receiving) bad advice. It's that users can become emotionally dependent on AI, treating it like a friend or therapist. In some cases, it even becomes part of a person's distorted thinking. That's where we've seen psychosis emerge," said Dr Randa Al Tahir, a trauma-focused psychologist.
Though AI may seem responsive and comforting, it lacks the ability to recognise when a user is spiralling or in crisis. It also doesn't intervene when conversations cross a critical line.
Documented cases in Europe and the US show individuals with pre-existing vulnerabilities forming deep emotional bonds with chatbots, resulting in delusional beliefs, blurred lines between reality and fiction, and even harmful behaviour. While these are extreme examples, they expose a significant blind spot in how AI is being used.
'AI doesn't have the capacity to flag serious red flags or escalate someone to emergency care yet. But it should,' the Dubai doctor added 'We need built-in measures, whether that's emotional content warnings, timed breaks, or partnerships with international mental health organisations.'
To understand how AI itself views the issue, Khaleej Times asked ChatGPT the question: 'Should ChatGPT have regulations when it comes to mental health?'
The tool answered with surprising clarity:
'It makes sense that medical experts are calling for regulation. AI like ChatGPT can provide helpful general information, but I'm not a licensed medical professional and shouldn't replace doctors or mental health experts. Misunderstandings, outdated info, or oversimplified answers can lead to harm if someone acts on them without consulting a professional.'
It went on to say:
'Mental health advice is nuanced and deeply personal. Even well-trained professionals spend years learning how to assess and respond safely... I believe experts calling for regulation are being responsible.'
Dr Nabeel Ashraf, a clinical psychologist in Dubai, echoed this urgency. He called on AI companies and regulators to quickly implement features aimed at reducing risks, especially for vulnerable users. One key recommendation is training chatbots to detect signs of emotional distress by analysing user language in real time.
'There are patterns that can indicate when someone is spiralling, experiencing delusions, or showing signs of crisis. The AI should be able to respond appropriately,' he said.
In such cases, the chatbot should refer users to verified support services, such as mental health hotlines or licensed therapists. 'It's not enough to say 'I'm sorry you feel that way.' If there's a red flag, there should be a next step.'
'There's no shame in using AI for light advice or to feel heard,' he added. 'But without real limits, these tools can cause more harm than good, especially to someone already struggling.'chat
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Zawya
7 hours ago
- Zawya
Dubai Health, GE HealthCare to enhance Point-of-Care Ultrasound education, practice in MENA region
Dubai Health and GE HealthCare, a leading global medical technology and digital solutions innovator, have signed a Memorandum of Understanding (MoU) to collaborate on enhancing Point-of-Care Ultrasound (POCUS) practices and co-developing innovative AI solutions to support clinical decision-making, ultimately enhancing patient care and outcomes across the UAE and the Middle East and North Africa (MENA) region. The collaboration combines Dubai Health's academic and innovation expertise with GE HealthCare's advanced technological capabilities to enhance medical education, strengthen clinical decision-making, and improve health outcomes throughout the UAE and the broader MENA region. The MoU will establish Mohammed Bin Rashid University of Medicine and Health Sciences (MBRU) as a POCUS Education Center of Excellence and a pioneer in Point-of-Care Ultrasound education across the MENA region. Key initiatives include: a 'Train-of-Trainer (TOT)' structured program to build capacity in certified facilitators and trainers. The Facilitator Training Program will also enhance the scalability and effectiveness of POCUS programme delivery and execution across a broader geographical region, enabling wider participation of attendees, students, and delegates. In addition, the collaboration will extend to the co-development of AI solutions through Dubai Health Innovations, which supports transformative solutions that enhance patient care, drive medical advancements, and improve health outcomes. This partnership will focus on the development and validation of emerging AI technologies in areas of mutual interest, such as radiology and computer vision, aiming to improve diagnostic accuracy, streamline clinical workflows, and facilitate early detection of medical conditions. Through this joint effort, both parties seek to foster innovation, accelerate adoption of cutting-edge AI tools, and contribute to the advancement of healthcare delivery in the region. Dr. Hanan Al Suwaidi, Acting Chief Academic Officer of Dubai Health and Provost of MBRU said, 'This collaboration reflects Dubai Health's commitment to delivering on our 'Patient First' promise through the integration of care, learning, and innovation to elevate healthcare standards. By building capacity in POCUS education and co-developing AI-powered solutions, we are empowering clinicians with next-generation technologies to improve patient outcomes.' President of GE HealthCare EAGM (Eurasian and African Growth Markets), Konstantinos Deligiannis, said, 'This MoU marks a pivotal moment for POCUS advancement in the MENA region. We are excited to partner with Dubai Health to build skills, accelerate knowledge transfer, and strengthen the local and regional healthcare expertise. By combining our advanced ultrasound technology with innovative AI solutions, we are committed to enhancing diagnostic accuracy and efficiency, ultimately contributing to the region's broader healthcare objectives.' Dr. Rasha Buhumaid, Vice Dean of Graduate Medical Education, Assistant Professor of Emergency Medicine, and Programme Director of POCUS at MBRU, further commented, 'This partnership is a significant step toward realising our vision of positioning MBRU as a Centre of Excellence for Point-of-Care Ultrasound education. Through the Facilitator Training Programme and other initiatives, this collaboration enables us to strengthen the integration of POCUS into clinical practice, build sustainable expertise, and support better outcomes at the point of care and across the health system.' Professor Nabil Zary, Senior Director of the Institute of Learning at Dubai Health, also noted, 'Education is at the heart of sustainable healthcare transformation. This partnership with GE HealthCare enables us to deliver high-impact, evidence-based training in POCUS that not only equips clinicians with advanced skills but also fosters a culture of continuous learning and innovation.' The MoU between the two parties will be in effect for two years and is renewable by mutual agreement.
The National
8 hours ago
- The National
Measles is back but it didn't have to be. What is the western world thinking?
When I was five years old, I had measles. What I remember most, beyond feeling terrible, was how worried my parents were. Statistically only between one and three children out of a thousand with measles will die. It's a tiny number, until you think it might be your child that makes up the mortality statistics. I remember lying in a darkened room for about a week, bored, sick, aching, unable to read, uninterested in television or the radio. It was sunny outside but the curtains in my bedroom were closed. Just enough light got in that my eyes still hurt and my father let me wear a pair of his sunglasses. One of the many unpleasant symptoms of measles is sensitivity to light. The positive lesson of that outbreak for me, my family and millions of others around the world was the prospect of herd immunity if we were vaccinated against common childhood diseases like measles, mumps and rubella, polio and smallpox. The British government view is clear. The MMR vaccine is the best way to prevent your children getting sick or even risking death. The miracle – as it must have seemed to my parents and older generations – was that vaccination meant it was as if these diseases no longer existed. Nowadays smallpox, caused by the variola virus and feared for its high mortality rate, only exists in laboratories. There have been no known smallpox cases anywhere in the world since 1977. Vaccination programmes are a public health miracle. They are as significant as providing clean water to eliminate the threat of cholera and other water-borne diseases. What is therefore astonishing to those of us who remember and survived the childhood misery of measles is the degree of 'vaccine scepticism' in developed countries. This is contributing to measles outbreaks and the advancement of other diseases too, including in societies that felt as if these diseases were no longer a significant threat, except perhaps among the poorest and least developed countries in the world. Measles is back. As a result of the infection spreading among unvaccinated people in Texas, the US is seeing the worst measles outbreak in 33 years. Some speak of a 'post-herd immunity' problem, with immunisation rates disrupted after the coronavirus outbreak and also diminished by an increase in vaccine scepticism. This is more accurately defined as the unscientific belief – based on anecdotes and faith rather than research – that vaccines either do not work or are harmful. US Secretary of Health and Human Services Robert F Kennedy Jr is known as a prominent vaccine sceptic. His appointment may further reduce the inclination of some parents to get their children vaccinated. The National Library of Medicine website includes a recent report that 'vaccine scepticism is an increasingly important barrier to optimal coverage in developed countries'. The report goes on to conclude that personal or political views often undermine scientific facts. 'Just like specific political views [for example on reproductive rights, gun control] reflect a broader set of values and a commitment to a certain cultural group, vaccination scepticism typically reflects core beliefs about personal agency, and a spiritual, natural, life-affirming approach to health … ['I feel that most knowledge comes from spiritual experiences'],' the report says. Britain is also seeing an upswing in measles cases as a result of a downturn in vaccination rates in some areas. A child died in a hospital in Liverpool recently and parents are being urged to get their children vaccinated. A UK government report says: 'In 2024 there were 2,911 laboratory confirmed measles cases in England, the highest number of cases recorded annually, since 2012. This was initially driven by an outbreak in Birmingham but was soon overtaken by a large outbreak in London, with small clusters in other regions.' The British government view is clear. The MMR vaccine is the best way to prevent your children getting sick or even risking death. But it is worth examining the American experience in detail since it reveals what might be called the information fault-lines in modern society. Experts providing information on measles and other diseases are distrusted by some sections of the population in modern democracies in ways that would have seemed unimaginable to my parents' generation. When I was a child, vaccinations against disease were a blessing, not a conspiracy. Last week, the US National Academies of Sciences, Engineering and Medicine issued a joint statement condemning 'unnecessary suffering and deaths' caused by the measles outbreak. The statement noted the highest level of measles outbreaks in 25 years and said it was grounds for 'reasonable alarm' about 'unnecessary suffering' from a disease that was once considered to have been 'eliminated' by the MMR vaccine that is 'extremely safe and effective'. Unfortunately, facts and science often fail to triumph over emotions. The question is why such emotions, fuelled by misinformation, are gaining a hold in the US right now. The World Health Organisation reported that the MMR vaccine prevented about 60 million deaths between 2000 and 2023. Even so, about 107,500 people died from measles in 2023 mostly in Asia and Africa. It is difficult to understand why some in the US act in ways likely to risk their children becoming part of that unhappy statistic. My father gave me sunglasses. Pseudo-science offers only blinkers.
Emirates 24/7
11 hours ago
- Emirates 24/7
Dubai Health and GE HealthCare to enhance Point-of-Care Ultrasound (POCUS) education and practice in the MENA region
Dubai Health and GE HealthCare, a leading global medical technology and digital solutions innovator, have signed a Memorandum of Understanding (MoU) to collaborate on enhancing Point-of-Care Ultrasound (POCUS) practices and co-developing innovative AI solutions to support clinical decision-making, ultimately enhancing patient care and outcomes across the UAE and the Middle East and North Africa (MENA) region. The collaboration combines Dubai Health's academic and innovation expertise with GE HealthCare's advanced technological capabilities to enhance medical education, strengthen clinical decision-making, and improve health outcomes throughout the UAE and the broader MENA region. The MoU will establish Mohammed Bin Rashid University of Medicine and Health Sciences (MBRU) as a POCUS Education Center of Excellence and a pioneer in Point-of-Care Ultrasound education across the MENA region. Key initiatives include: a 'Train-of-Trainer (TOT)' structured program to build capacity in certified facilitators and trainers. The Facilitator Training Program will also enhance the scalability and effectiveness of POCUS program delivery and execution across a broader geographical region, enabling wider participation of attendees, students, and delegates. In addition, the collaboration will extend to the co-development of AI solutions through Dubai Health Innovations, which supports transformative solutions that enhance patient care, drive medical advancements, and improve health outcomes. This partnership will focus on the development and validation of emerging AI technologies in areas of mutual interest, such as radiology and computer vision, aiming to improve diagnostic accuracy, streamline clinical workflows, and facilitate early detection of medical conditions. Through this joint effort, both parties seek to foster innovation, accelerate adoption of cutting-edge AI tools, and contribute to the advancement of healthcare delivery in the region. Dr. Hanan Al Suwaidi, Acting Chief Academic Officer of Dubai Health and Provost of MBRU said: 'This collaboration reflects Dubai Health's commitment to delivering on our 'Patient First' promise through the integration of care, learning, and innovation to elevate healthcare standards. By building capacity in POCUS education and co-developing AI-powered solutions, we are empowering clinicians with next-generation technologies to improve patient outcomes.' President of GE HealthCare EAGM (Eurasian and African Growth Markets), Konstantinos Deligiannis, said: 'This MoU marks a pivotal moment for POCUS advancement in the MENA region. We are excited to partner with Dubai Health to build skills, accelerate knowledge transfer, and strengthen the local and regional healthcare expertise. By combining our advanced ultrasound technology with innovative AI solutions, we are committed to enhancing diagnostic accuracy and efficiency, ultimately contributing to the region's broader healthcare objectives.' Dr. Rasha Buhumaid, Vice Dean of Graduate Medical Education, Assistant Professor of Emergency Medicine, and Program Director of POCUS at MBRU, further commented: 'This partnership is a significant step toward realizing our vision of positioning MBRU as a Center of Excellence for Point-of-Care Ultrasound education. Through the Facilitator Training Program and other initiatives, this collaboration enables us to strengthen the integration of POCUS into clinical practice, build sustainable expertise, and support better outcomes at the point of care and across the health system.' Professor Nabil Zary, Senior Director of the Institute of Learning at Dubai Health, also noted: 'Education is at the heart of sustainable healthcare transformation. This partnership with GE HealthCare enables us to deliver high-impact, evidence-based training in POCUS that not only equips clinicians with advanced skills but also fosters a culture of continuous learning and innovation.'The MoU between the two parties will be in effect for two years and is renewable by mutual agreement.
