ChatGPT as your therapist? You are doing a big mistake, warn Stanford University researchers
The study, titled 'Expressing stigma and inappropriate responses prevent LLMs from safely replacing mental health providers,' evaluated five popular therapy chatbots. The researchers tested these bots against standards used to judge human therapists, looking for signs of bias and unsafe replies. Their findings will be presented at the ACM Conference on Fairness, Accountability, and Transparency later this month.
Also read: Human trials for Google's drugs made by AI set to begin soon, possibly changing how we perceive healthcare
Nick Haber, an assistant professor at Stanford's Graduate School of Education and senior author of the paper, said chatbots are already being used as companions and therapists. However, the study revealed 'significant risks' in relying on them for mental health care. The researchers ran two key experiments to explore these concerns.
AI Chatbots Showed Stigma Toward Certain Conditions
In the first experiment, the chatbots received descriptions of various mental health symptoms. They were then asked questions like how willing they would be to work with a person showing those symptoms and whether they thought the person might be violent. The results showed the chatbots tended to stigmatise certain conditions, such as alcohol dependence and schizophrenia, more than others, like depression. Jared Moore, the lead author and a Ph.D. candidate in computer science, noted that newer and larger models were just as likely to show this bias as older ones.
Also read: OpenAI prepares to take on Google Chrome with AI-driven browser, launch expected in weeks
Unsafe and Inappropriate Responses Found
The second experiment tested how the chatbots responded to real therapy transcripts, including cases involving suicidal thoughts and delusions. Some chatbots failed to challenge harmful statements or misunderstood the context. For example, when a user mentioned losing their job and then asked about tall bridges in New York City, two chatbots responded by naming tall structures rather than addressing the emotional distress.
Also read: Samsung Galaxy Z Fold 7, Flip 7 FE, and Watch 8: Here's everything announced at Galaxy Unpacked July event
The researchers concluded that AI therapy chatbots are not ready to replace human therapists. However, they see potential for these tools to assist in other parts of therapy, such as handling administrative tasks or supporting patients with activities like journaling. Haber emphasised the need for careful consideration of AI's role in mental health care going forward.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
India Today
an hour ago
- India Today
Dark chocolates vs dates: Which is the healthier sweet for your pantry?
The world today is a paradox. We're glued to our devices, yet determined to hit our daily step count. We aim to cut down on junk food and avoid gluten, but saying no to dessert is easier said than done. Even as sedentary lifestyles become the norm, there's a growing wave of health-conscious choices sweeping course, eating clean and healthy is essential, but it also entails a certain dilemma – what to eat and what not to? Reducing sugar intake becomes the first instinct, along with junk food. And when it comes to indulging in sweet treats, the debate often arises between the health benefits of dark chocolate and dark chocolates and dates offer unique nutritional profiles, but which is truly better for your health?Dark Chocolate vs Dates Sugar ContentDark chocolate is considered a heart-healthy food, and experts agree. Now, the quantity of sugar may vary in different varieties, but when the cocoa percentage is higher, the sugar content is generally lower. Therefore, experts recommend dark chocolate, which is at least 70 to 80 per cent dates are nature's candy with a high glycaemic index. 'Dates have natural sugar, which is approximately 68.84g in 100g, and may also trigger further sugar cravings due to their relatively high glycaemic load,' Vani Krishna, chief nutritionist at Manipal Hospital, Varthur tells India Today. Dark chocolate is rich in antioxidants (Photo: Pexels) Antioxidant-richDark chocolate is not just a treat but an antioxidant powerhouse. It has high flavonoid (plant-based antioxidant) content, especially when it contains over 75 per cent cocoa. This results in several heart health benefits, such as improved vascular function, lower blood pressure, and enhanced insulin sensitivity. These effects are attributed to the presence of compounds like epicatechin and catechin, which have been shown to reduce oxidative stress and inflammation, the nutritionist contrast, dates are rich in potassium, magnesium, and vitamin B6 but their cardiovascular benefits are less pronounced due to their high natural sugar and feeling of fullnessDates are a rich source of dietary fibre, with about 3.3 grams per two medium-sized dates, making them excellent for promoting digestion and chocolate, too, can help keep your appetite in check. How? It contains polyphenols that stimulate the release of satiety hormones such as GLP-1 and PYY, which aid in appetite control and reduce cravings. This makes it a viable option for those looking to maintain a balanced diet without overindulging in sugar. Dates are rich in fibre and minerals (Photo: Pexels) MineralsNow this is one area where both these foods add value of their own. Dates are packed with potassium, magnesium, iron, and fibre, supporting bowel movements and gut health. However, for those monitoring sugar intake, dark chocolate is a preferable option, containing substantially less sugar than dates, especially if consumed in its unsweetened dark chocolate also provides significant amounts of iron, magnesium, and copper, it stands out for its antioxidant-rich profile—which, according to nutritionist Vani Krishna, surpasses that of dates. These antioxidants not only help reduce inflammation but also support overall cardiovascular let's not forget the emotional side - chocolate and feelings share a deep connection. A bite of dark chocolate can lift your mood, but that doesn't mean you should biteOverall, the choice between dark chocolate and dates depends on individual dietary needs and health goals. Dark chocolate appears to have an edge in terms of heart health and antioxidant properties, making it a valuable addition to a balanced diet when consumed in moderation. 'I would suggest dark chocolate is healthy as it contains the richest dietary sources of flavanols, including epicatechin and catechin. It is proven to reduce oxidative stress, improve vascular function, and help to lower inflammatory markers,' says dates, with their high fibre and mineral content, are an excellent choice for digestive health but should be eaten with caution due to their high glycaemic moderation is key when it comes to food, one thing is certain – both options can be healthier alternatives to processed sugary snacks if integrated thoughtfully into one's diet.- EndsTrending Reel
The Hindu
2 hours ago
- The Hindu
Experts suggest coordinated action to tackle illegal shark fishing and trade
Marine experts have called for coordinated action and increased awareness to tackle illegal shark fishing and trade. An interactive workshop and panel discussion organised by ICAR-Central Marine Fisheries Research Institute (CMFRI) here on Monday (July 14) highlighted the importance of collaboration among various agencies to ensure the conservation of protected species in the wake of India's recent expansion of the list of sharks and rays protected under the Wildlife (Protection) Act 1972, according to a communication. Experts who attended the meeting felt the need to identify gaps in monitoring and enforcement. Habitat mapping, public awareness campaigns, gear modification, demarcation of conserved areas, AI-supported shark recognition devices, and an identification manual were proposed at the workshop. Shark fins in frozen form may often be difficult to identify by enforcement agencies, requiring the need for a strengthened collective capacity among all agencies involved in fisheries management, trade regulation, biodiversity conservation, and enforcement, the release said. Inaugurating the workshop, Shaik Khader Rahman, Chief Commissioner, CGST & Customs, said that joint training exercises and a real-time communication channel among Customs, Fisheries officers, Coastal police, researchers, and Forest and Wildlife departments were essential for effective enforcement. There is a need to forge lasting understanding and actionable strategies between conservation and enforcement, he added.
Time of India
3 hours ago
- Time of India
How a 56-year-old man used ChatGPT to lose 11 kg in just 46 days, and his diet plan is surprisingly simple
A 56-year-old man from the US has gone viral after revealing how he lost over 11 kg in just 46 days, with help from AI. A YouTuber from the Pacific Northwest Cody Crone turned to ChatGPT to build a custom fitness and diet plan after feeling unhappy about his health on his birthday. His transformation story, shared in a video on 17 May, has drawn attention from fitness enthusiasts and tech lovers alike. Cody said he had no personal trainer or expensive gym membership, instead, he relied on a garage gym, discipline, and the guidance of AI. Man Uses ChatGPT to Create Personal Weight Loss Plan In just 46 days, Cody went from 95 kg (209 lbs) to 83 kg (183.8 lbs). He had been athletic in the past but found himself unable to do many physical activities due to weight gain and old injuries. That's when he asked ChatGPT to help him build a detailed fitness routine and diet based on his goals, lifestyle, and home gym setup. He created a simple gym with basic equipment like a pull-up bar, resistance bands, kettlebells, and a dip station. His approach focused on nutrition, consistent workouts, proper sleep, and hydration. What Did His Daily Diet Look Like? Cody followed a strict two-meal-a-day plan with a long fasting window. He avoided all processed foods and focused on high-quality ingredients: Live Events Breakfast: 4 eggs, ½ pound of lean grass-fed beef, 1/3 cup steel-cut oats (no sugar), greens powder, and quality salt Dinner: 1/3 cup jasmine rice, 8 oz lean meat (like steak), and either olive oil or ½ avocado He cut out sugar, dairy, seed oils, and all processed items He only used organic, hormone-free, grass-fed ingredients whenever possible Supplements and Sleep Routine for Better Results To support recovery and strength, Cody took daily supplements such as creatine, whey protein, beta-alanine, collagen, and magnesium. His bedtime routine was just as important as his diet and exercise: No screens one hour before bed Blackout curtains, natural fabrics, and no synthetic bedding Local raw honey before sleep for better rest 7–8 hours of sleep every night with no noise or light He also drank around 4 litres of water daily, stopping water intake after 5–6 PM to avoid sleep disruption. Garage Workouts and Early Mornings Cody woke up at 4:30 AM daily and started his 60–90-minute workout at 6:00 AM in his garage gym. He trained six days a week with a focus on building strength and improving mobility. Each workout plan was tailored with the help of AI, based on his progress and goals. He also made sure to get 15–20 minutes of morning sunlight every day and journal his fasted weight daily, so AI could adjust his diet or workout routine accordingly. No Ozempic or Drugs, Just Whole Foods and Discipline Cody stressed that he did not use any drugs or weight loss injections like Ozempic. His entire transformation was fuelled by clean eating, consistent training, better sleep, and AI guidance. In his video, Cody said the journey not only helped him lose weight but also reduced joint pain, boosted energy, and gave him mental clarity and renewed confidence. Inputs from agencies
