Talk to medical professionals, not just ChatGPT, urge Ontario doctors
ChatGPT and similar artificial intelligence tools can sometimes answer patient questions accurately, but Canadian medical researchers caution that the information needs to be carefully checked before acting on what you see.
The researchers' advice comes as the Ontario Medical Association (OMA) hosted a media briefing this week, discussing DIY information sources — from search engines to social media to chatbots — and their impacts, as well as what patients can do instead.
It's important to warn people now, said Dr. Valerie Primeau, a psychiatrist from North Bay who leads inpatient and community programs for mental health and addictions, because patients are increasingly turning to AI tools.
The chatbots give convincing and empathetic results — but the information might be fake.
"I have patients now that talk to ChatGPT to get advice and have a conversation," Primeau said. "So I foresee that we will continue having this issue, and if we don't address it now and help people navigate this, they will struggle."
Dr. David D'Souza, a radiation oncologist in London, Ont., who leads clinical research into image-based treatments for cancer, said depending on how patients interrupt what AI tells them, they could put off conventional treatments.
"A patient came to me asking if he should wait to have his cancer that was diagnosed treated in a few years because he believes that AI will customize cancer treatments for patients," D'Souza told reporters. "I had to convince him why he should have treatment now."
Given that consumers will use the tools, OMA president Dr. Zainab Abdurrahman advised if a post says "doctors have been hiding this from you," she suggests checking the websites of relevant specialist groups, such as provincial cancer care associations, to see if they back it up.
Fake ads, including AI-generated images, can also lead patients astray, warned Abdurrahman, who is also a clinical immunologist and allergist.
Lost nuance makes AI results harder to rely on
While the technology is progressing, today's chatbots routinely answer health queries with false information that appears authoritative.
In one study, Dr. Benjamin Chin-Yee, an assistant professor in the pathology and lab medicine department at Western University and his co-authors fed nearly 5,000 summaries of medical and scientific literature into AI large language models including ChatGPT and asked for summaries.
They found three-quarters of the AI versions missed key parts of carefully guarded statements.
For example, the journal article might say a drug was only effective in a certain group of patients while the summary leaves out that key detail, said Chin-Yee, who is also a hematologist.
"The worry is that when that nuance in detail is lost, it can be misleading to practitioners who are trying to use that knowledge to impact their clinical practice."
Chin-Yee said AI is an active area of research that is rapidly changing, with newer models that are more human-like and user-friendly, but there can be drawbacks to relying on the tools alone.
Similarly, David Chen, a medical student at the University of Toronto, compared results provided by chatbots to 200 questions about cancer from a Reddit forum to responses provided by oncologists.
"We were surprised to find that these chatbots were able to perform to near-human expert levels of competency based on our physician team's assessment of quality, empathy and readability," Chen said.
But the experimental results may not reflect what happens in the real world.
"Without medical oversight, it's hard to 100 per cent trust some of these outputs of these generative technologies," Chen said, adding concerns about privacy, security, and patient trust still haven't been fully explored.
WATCH | Researchers use AI to help treat brain patients:
MUN's Faculty of Medicine is using A.I. to treat brain patients
4 months ago
Duration 5:00
Artificial intelligence is expected to revolutionize health care. And at Memorial University's Faculty of Medicine, A.I. is already being used in the treatment of patients with various brain conditions. Neuroscience professor Michelle Ploughman showed the CBC's Carolyn Stokes around her lab at the Miller Centre and demonstrated how A.I. is changing patient care.
Don't rely on a single chatbot
Generative AI technologies like chatbots are based on pattern-matching technologies that give the most likely output to a given question, based on whatever information it was trained on. In medicine, though, unlikely possible diagnoses can also be important and shouldn't be ruled out.
Plus, chatbots can hallucinate — produce outputs that sound convincing but are incorrect, made up, nonsensical or irrelevant.
"There's also been research studies that have been put out that suggested that there are hallucination rates of these chat bots that can be upwards of 20 per cent," Chen said, which could make the output "clinically erroneous."
In the spring, cardiologist Eric Topol, a professor and executive vice president of Scripps Research in San Diego, Calif., published a book, Superagers: An Evidence-Based Approach to Longevity, that looked at the impact of AI on longevity and quality of life.
"There's a lot of good anecdotes, there's bad anecdotes," Topol said of patients using chatbots. "It hasn't been systematically assessed in a meaningful way for public use."
Topol said he advises people to consult multiple chatbots and to check that you're getting reliable information. He also suggested asking for citations from the medical literature, noting sometimes those aren't real and need to be verified.
Ideally, Topol said there would be a real-world test of chatbot responses from tens of thousands of people tracking what tests were done, what diagnosis was given and the outcomes for those who used AI sources and those who didn't. But tech companies are unlikely to participate because each one wouldn't gain, he said.
"It's a different world now and you can't go back in time," Topol said of using the tools wisely.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
CBC
2 hours ago
- CBC
Half of requests for complex dental work are being rejected under national insurance plan
Social Sharing As federal dental care expands to cover most uninsured Canadians, providers say some procedures are being bogged down by paperwork and processing delays. Health Canada says 52 per cent of requests for pre-authorized dental work between November 2024 and June 2025 have been rejected. While the vast majority of claims don't need pre-authorization, it's required for more complex and often more expensive procedures, like crowns or partial dentures. Clinics must submit extra documentation like X-rays and dental charts to show the work is medically necessary before it can be covered and completed. "There's been a lot of confusion for dentists who send in what we would normally send in to a private plan, and it comes back rejected," said Dr. Bruce Ward, a Vancouver dentist and president of the Canadian Dental Association. "It's a much, much, much higher rejection rate than private plans." The multibillion-dollar Canadian Dental Care Plan helps cover the cost of dental work for Canadian residents with a family income below $90,000 who don't have access to private insurance. The program fully expanded to cover people aged 18 to 64 last month. Health Canada says 5.2 million people have been approved for coverage so far, but only about half — 2.2 million — have received care. And some new patients are getting an unexpected bill, while certain parts of the country are struggling to keep up with a huge influx of appointments, Ward said. Still, providers told CBC News the program is providing Canadians much-needed access to care — and that issues with the program are improving. Missing information Clinics submit the pre-authorizations through Sun Life, the insurance provider that the federal government contracted to run the program. Dental offices are sometimes waiting weeks or months for a response, only to be told Sun Life needs additional documentation — further slowing down the process, Ward said. "A lot of people have been waiting for crowns to be pre-authorized," Ward said. "There was an avalanche of approvals that got sent in." Health Canada said rejections and delays in pre-authorizations are caused by several factors, including an unexpected high volume of submissions that were missing information. Oral health-care providers also tell CBC News there were many technical issues with the submission software that have since been largely resolved. Health Canada has worked to streamline the process and educate providers about how to complete the applications, a spokesperson said. Eighty per cent of the pre-authorizations are now being processed within seven business days. And more than 90 per cent of the claims, like basic cleanings or fillings, don't require pre-authorization. But Donna Wells, manager of professional practice at the Canadian Dental Hygienists Association, said the program needs to better cover preventive care. The plan currently allots one hour of scaling per year for adults. Teenagers get just 15 minutes of scaling. "These are patients who have not had oral health care, in some cases, for a number of years, because it's been such a financial barrier for them," Wells said. She said pre-authorization applications for additional scaling are being rejected en masse. Growing pains Health Canada says over a million Canadians signed on to the program when it expanded in June, and 94,980 of them received dental care. But that influx of patients has led to a backlog in some parts of the country, like Atlantic Canada. WATCH | From May 2024: Dental care program begins: First phase of Canada's national dental care plan begins 1 year ago Duration 2:02 "This program is wonderful, but it's putting a strain on providers," said Natalie Marsh, a dental assistant in North Sydney, N.S., and vice-president of the Canadian Dental Assistants Association. She said her clinic is already booking appointments for spring 2026. "You're seeing people who haven't seen a dentist in a long time. So they're coming in with a lot of work to be done," she said. Not a 'free' program Providers said patients continue to be under the impression their dental work will be free of charge. But the program reimburses clinics at a rate lower than provincial fee guides, which they often use to set their rates. That means dental offices can "balance bill," charging the difference between the price of the procedure and what Ottawa will pay them. "I just had somebody in my office a couple of weeks ago who was very upset, because they'd been told that they were covered 100 per cent," Ward said. Ward said patients, including seniors, should remember they need to reapply every year. Despite those challenges, Ward said overall he's found the dental care plan to be "very good" to work with. That sentiment is echoed by other oral health associations. "It's been a huge boon to a lot of people who frankly would never have been able to afford to have their mouths taken care of," Ward said.
CBC
2 hours ago
- CBC
Vaccination, immunity and records: Your questions on measles, answered
Social Sharing Canada continues to see an alarming rise in measles cases in 2025. Through the spring, the virus spread most intensely in Ontario. But after over 2,200 cases, hundreds hospitalized and one measles-related death, it seems to be dwindling in that province. Now, Alberta's seeing a spike, with almost 1,300 confirmed cases so far. With every province except Newfoundland and Labrador reporting cases of measles, here are some common questions from CBC readers, viewers and listeners — answered. I've had measles as a child. Am I safe from getting infected again? Most likely yes, says the Public Health Agency of Canada (PHAC). It says those who have had a past measles infection should be immune against another one, as long as they have a normal immune response. I've lost my vaccination records. Should I get another dose? Generally, yes, says PHAC. PHAC recommends that children and adults who don't have records of their vaccination history be started on an immunization schedule appropriate to their age and risk factors. Even if you've already been vaccinated, it's generally considered safe for health-care providers to give another dose, PHAC says, because they haven't seen additional side effects from repeated immunization. But this is why a national vaccine registry would be hugely helpful, says Dawn Bowdish, a professor of immunology at McMaster University. "The number of people who are looking to figure out if they got one dose, if they got two doses, if they were vaccinated as children and perhaps they just moved provinces and they can't get their records is extremely high." Two doses of the measles, mumps and rubella vaccine offer almost 100 per cent effectiveness against the virus in the long term. Can I check my immunity to measles? That depends. PHAC says routine testing for laboratory evidence of measles immunity is not recommended for the general population. Some populations, like health-care workers who work with vulnerable people, as well as some pregnant women, can get a blood test looking for antibodies against measles. Those who have received two doses of a measles-containing vaccine, or those who are born before 1970, are presumed to be immune against the virus. Do we screen for measles vaccination status among people who enter Canada? No. Proof of vaccination is not mandatory to enter Canada. Canada does require permanent residents and certain temporary residents to have an immigration medical exam before arriving in Canada, said a spokesperson for Immigration, Refugees and Citizenship Canada. The test also screens for certain communicable diseases. During that medical exam, some may be offered vaccinations — including the measles, mumps and rubella shots. Doctors who work with recent immigrants and asylum seekers tell CBC News their patients generally don't hesitate to get any childhood vaccinations they might have missed.
CTV News
2 hours ago
- CTV News
How to select a sunscreen that is safe and effective this summer
With all the different sunscreens out there how do you choose? We speak with an expert. With all the different sunscreens out there how do you choose? We speak with an expert. How to select a sunscreen that is safe and effective While it may feel like the options at the drug store are endless, not every sunscreen is made equal. Choosing a sunscreen that is safe and effective is incredibly important to stave off a bad sunburn and to avoid longer-term issues such as skin cancer from the sun's rays. With the forecast showing a UV of 10 this week, protecting yourself is even more important. Dr. Denis K. Dudley spoke with CTV Morning Live to provide some tips on how to choose the right sun protection for your family. Dudley says when choosing a new sunscreen, you should focus primarily on safety. While there are many brands of sun protection, he says there are only two types of filters that are proven to be effective and safe. 'Zinc oxide is the ideal filter,' he said. 'There's another mineral filter called titanium oxide.' Exposure to UV rays from the sun can lead to sunburns, wrinkles, skin damage, skin cancer, eye lesions and cataracts. Dudley says he doesn't typically recommend titanium oxide as a standalone sunscreen because it tends to be whitening and only targets UVB rays. He says to avoid organic sunscreens as many have chemicals that can be dangerous to your health. 'The organic sunscreen doesn't mean safe. It just means carbon-based. Those are petrochemicals so they're no different than the gas that goes in your car,' he said. 'What really bothers me is the first filter on that group of petrochemicals that was developed in the 50s was actually made to be a pesticide.' Dudley also warns of chemicals in the inactive ingredients list of a sunscreen. 'Very often, even in a mineral sunscreen, in the inactive ingredients there are a lot of pernicious chemicals that I don't like,' he said. 'Salicylates, they are there to prevent you going red – it's very deceptive. What matters is UVA protection.' He adds staying away from buzz words like 'reef safe' as they are commonly misleading marketing tactics. 'Everyone should be careful,' he said. 'Avoid the sun as much to the extent you can but you do need sunlight. All you got to do is look for zinc – as close to 20 to 25 per cent.' For more information, visit
