Doctors are using unapproved AI software to record patient meetings, investigation reveals
Doctors are using AI software that does not meet minimum standards to record and transcribe patient meetings, according to a Sky News investigation.
NHS bosses have demanded GPs and hospitals stop using artificial intelligence software that could breach data protection rules and put patients at risk.
A warning sent out by NHS England this month came just weeks after the same body wrote to doctors about the benefits of using AI for notetaking - to allow them more time to concentrate on patients - using software known as Ambient Voice Technology, or "AVT".
Health Secretary Wes Streeting will next week put AI at the heart of the reform plan to save the NHS in the 10-year plan for the health service in England.
But there is growing controversy around software that records, transcribes and summarises patient conversations using AI.
In April, NHS England wrote to doctors to sell the benefits of AVT and set out minimum national standards.
However, in a letter seen by Sky News, NHS bosses wrote to doctors to warn that unapproved software that breached minimum standards could harm patients.
The 9 June letter, from the national chief clinical information officer of NHS England, said: "We are now aware of a number of AVT solutions which, despite being non-compliant ... are still being widely used in clinical practice.
"Several AVT suppliers are approaching NHS organisations ... many of these vendors have not complied with basic NHS governance standards.
"Proceeding with non-compliant solutions risks clinical safety, data protection breaches, financial exposure, and fragmentation of broader NHS digital strategy."
Sky News has previously revealed the danger of AI "hallucinations", where the technology makes up answers then lies about them, which could prove dangerous in a healthcare setting.
1:59
NHS England sets minimum standards but does not tell NHS trusts and healthcare providers which software providers to use.
Sky News can now reveal there is growing pressure on NHS England and similar bodies to be more proactive.
Dr David Wrigley, deputy chair of the British Medical Association's GP committee, said: "Undoubtedly, as a GP myself and my 35,000 colleagues, we've got responsibilities here - but in such a rapidly developing market when we haven't got the technical knowledge to look into this.
"We need that help and support from those who can check that the products are safe, check they're secure, that they're suitable for use in the consulting room, and NHS England should do that and help and support us."
Dr Wrigley continued: "We're absolutely in favour of tech and in favour of taking that forward to help NHS patients, help my colleagues in their surgeries.
"But it's got to be done in a safe and secure way because otherwise we could have a free for all - and then data could be lost, it could be leaking out, and that just isn't acceptable.
"So we are not dinosaurs, we're very pro-AI, but it has to be a safe, secure way."
The spectre of dozens of little-known but ambitious AI companies lobbying hospitals and surgeries to get their listening products installed worries some healthcare professionals.
There are huge profits to be made in this technological arms race, but the question being asked is whether hundreds of different NHS organisations can really be expected to sift out the sharks.
Matthew Taylor, chief executive of the NHS Confederation, said the letter was "a really significant moment".
He said it was right for the NHS to experiment, but that it needed to be clearer what technology does and does not work safely.
"My own view is that the government should help in terms of the procurement decisions that trusts make and should advise on which AI systems - as we do with other forms of technology that we use in medicine - which ones are safe," Mr Taylor said.
"We'll need [government] to do a bit more to guide the NHS in the best way to use this."
When pressed whether in the short term that actually makes it sound like it could be quite dangerous, Mr Taylor replied: "What you've seen with ambient voice technology is that kind of 'let a thousand flowers bloom' approach has got its limits."
0:45
Earlier this year, the health secretary appeared to suggest unapproved technology was being used - but celebrated it as a sign doctors were enthusiastic for change.
Mr Streeting said: "I've heard anecdotally down the pub, genuinely down the pub, that some clinicians are getting ahead of the game and are already using ambient AI to kind of record notes and things, even where their practice or their trust haven't yet caught up with them.
"Now, lots of issues there - not encouraging it - but it does tell me that contrary to this, 'Oh, people don't want to change, staff are very happy and they are really resistant to change', it's the opposite. People are crying out for this stuff."
Doctors who use AI that complies with national standards already say there are big benefits.
Anil Mehta, a doctor in the health secretary's Ilford constituency, told Sky News he backed his MP's drive for more AI technology in healthcare.
"I spend 30% of my week doing paperwork," he said. "So I think once I've explained all of those features of what we're doing, patients are extremely reassured. And I haven't faced anybody that's not wanted to have me do this.
He added: "(I) think that consultation with your doctor is extremely confidential, so that's not changed at all.
"That remains confidential - so whether it's a vulnerable adult, a vulnerable child, teenager, young child with a parent, I think the concept of that confidentiality remains."
An NHS spokesperson said: "Ambient Voice Technology has the potential to transform care and improve efficiency and in April, the NHS issued guidance to support its use in a safe and secure way.
"We are working with NHS organisations and suppliers to ensure that all Ambient Voice Technology products used across the health service continue to be compliant with NHS standards on clinical safety and data security."
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Sky News
39 minutes ago
- Sky News
Amazon to invest £40bn in UK - with more warehouses and thousands of new jobs
Amazon has said it will invest £40bn in the UK over the next three years as it creates thousands of jobs and opens four new warehouses. The online shopping giant will build two huge fulfilment centres in the East Midlands, which it expects to open in 2027. The exact locations are still to be revealed. Two others - in Hull and Northampton - were previously announced and are set to be finished this year and in 2026 respectively, with 2,000 jobs expected at each site. Amazon is already one of the country's biggest private employers - with around 75,000 staff. Two new buildings will also go up at its corporate headquarters in east London, while other investment includes new delivery stations, upgrading its transport network and redeveloping Bray Film Studios in Berkshire - which it bought last year. The £40bn figure also includes most of the £8bn announced in 2024 for building and maintaining UK data centres, as well as staff wages and benefits. Prime Minister Sir Keir Starmer said the investment into Amazon's third-biggest market after the US and Germany was a "massive vote of confidence in the UK as the best place to do business". "It means thousands of new jobs - real opportunities for people in every corner of the country to build careers, learn new skills, and support their families," said Sir Keir. The chancellor, Rachel Reeves, said it was a "powerful endorsement of Britain's economic strengths". Amazon chief executive Andy Jassy stressed the investment would benefit communities across the UK. "When Amazon invests, it's not only in London and the South East," he said. "We're bringing innovation and job creation to communities throughout England, Wales, Scotland and Northern Ireland, strengthening the UK's economy and delivering better experiences for customers wherever they live." However, Amazon's immense power and size continues to raise concerns among some regulators, unions and campaigners. There have long been claims over potentially dangerous conditions at its warehouses - denied by the company, while last week Britain's grocery regulator launched an investigation into whether it breached rules on supplier payments.
Sky News
43 minutes ago
- Sky News
Women who don't come forward for cervical cancer screening to be offered home tests
Women who don't come forward for cervical cancer screening will be offered home-testing kits as part of the government's new 10-year health plan. The Department of Health and Social Care has said the initiative aims to "revolutionise" cervical cancer prevention rates by helping overcome barriers that prevent some women from having potentially life-saving screenings. This can include a fear of discomfort, embarrassment, cultural sensitives and the struggle to find time for medical appointments. Cervical screening, sometimes referred to as a smear test, is a test to check the health of the cervix and help prevent cervical cancer. The NHS offers it to women and people with a cervix aged 25 to 64 - with those aged between 25 to 49 invited for the checks every three years, and 50 to 64-year-olds every five years. However, the government has said participation in cervical cancer screening currently sits at just 68.8% - well below the NHS England target of 80%. This means more than five million women in England are not up to date with their routine check-up. Experts have now said sending home-testing kits to those who don't attend their check-ups could increase participation in the screening programme that saves approximately 5,000 lives a year across England. The self-sample kits will be offered to women who have rarely or never attended their cervical screening. It will then be sent out in "discreet packaging" that can be returned via prepaid mail. The self-sample method tests only for the presence of the human papillomavirus (HPV), a group of viruses that can lead to cervical cancer. Anyone testing positive for HPV through self-sampling will be encouraged to attend a clinician-taken follow-up cervical screening test to check for cervical cell changes. The initiative is part of the government's "10-year health plan", which is due to be published in the coming weeks. A woman named only as Gem, who was diagnosed with cervical cancer in 2015, said: "I've been cancer-free for years now, but I still live with the aftermath of my diagnosis. I hope that one day we live in a world where cervical cancer is eliminated. With advances in vaccines and screening, I believe that day is getting ever closer. "For many, though, there are barriers to attending screening. Our everyday lives are busy juggling jobs, family life, and more, which can make attending appointments difficult. But feelings of embarrassment, fear, or unease can also prevent people from going. "Making it easier for people to access screening they can do at home removes some of those barriers and will, I'm sure, save lives." 2:23 Health Secretary Wes Streeting said: "These self-sampling kits represent healthcare that works around people's lives, not the other way around. They put women firmly in control of their own health, ensuring we catch more cancers at their earliest, most treatable stages. "Our 10-year health plan will fundamentally reform the NHS, shifting focus from treating illness to preventing it before it starts. "We know the earlier cancer is diagnosed the better the chances are of survival. By making screening more convenient, we're tackling the barriers that keep millions of women from potentially life-saving tests." Michelle Mitchell, chief executive of Cancer Research UK, said: "Screening is a powerful tool to prevent cervical cancer and save lives, but we know it isn't always easy for everyone to take part. "For some, the test may seem uncomfortable, embarrassing, or simply hard to fit into their lives. That's why we welcome the UK government's decision to roll out cervical cancer home screening kits in England - to help remove barriers and make cervical screening more accessible."
The Herald Scotland
an hour ago
- The Herald Scotland
NHS ‘dying before our eyes' as third of Scots go private
Out of all those who responded, 17% had accessed private medical care in the past two years and 14% said a member of their household had. The majority (64%) of those who reported accessing private care for themselves or a member of their household said it was because the NHS waiting list was too long. In a speech to the BMA's 2025 Annual Representative Meeting in Liverpool today, Dr Iain Kennedy will say it is 'abundantly clear' that there is now a divide in Scotland between those who can afford private healthcare and those 'languishing' on NHS waiting lists. Read more: Doctor leaders warn GP practices 'on the brink' as demand intensifies Scottish Government urged to improve NHS governance to deliver reforms 'One in nine' Scots on NHS waiting list as delays hit record He will warn that the situation is likely to only get worse, as 43% of respondents to the survey said they are now more likely to go private. Dr Kennedy will point to a warning he issued last Christmas which said the health service would struggle to see out another year with its founding principles - including free at the point of delivery- remaining intact. (Image: BMA) He is expected to say: 'Our NHS should be free at the point of need. But, through today's research, I can reveal that almost a third of Scots say either they or someone in their household have had to use private healthcare within the last two years. Our survey showed that the majority are forced to do so, as waiting lists are simply too long. They just can't get the timely care they need. 'And it will only get worse, because 43% of those surveyed feel they are now more likely to go private. It is abundantly clear that Scotland has been divided into those who can afford private healthcare and those languishing on ever longer NHS waiting lists. 'Now, I don't believe anyone made an active choice to pursue this path towards a private health service. Rather, it is a failure get to grips with an evolving population and its health needs. But, be in no doubt, the NHS is dying before our very eyes.' In the latest survey, of those who accessed private care, 45% used personal savings and 20% said they had to cut back on leisure activities. Another 9% had to cut back on essential items such as energy and groceries, while 9% had to borrow money to fund private treatment. A total of 46% who did not use private care in the past two years said it was because they could not afford to and 43% said their likelihood of using private healthcare had significantly or somewhat increased in the past few years. Out of all those who responded, 63% reported that their confidence in being able to access a timely hospital appointment through the NHS had significantly or somewhat decreased in the past few years, while 60% said the same for GP appointments. During the BMA Annual Representative Meeting, Dr Kennedy will outline four key principles for NHS reform which include shifting the balance of care into the community, a workforce plan setting out how to recruit and retain doctors and other staff. Dr Kennedy will also take aim at Scottish Minister's for 'largely ignoring' pleas made by the trade union. He is expected to say: 'The chance to save our NHS remains. If we want to provide timely care to all, which is free at the point of need, then immediate action is required. 'We did ask the Scottish Government for a national conversation but were largely ignored. So, instead, NHS reform must now happen.' He will add: 'The impact of the Scottish Government repeatedly ignoring the warnings made by the BMA and many others is clear. Patients are suffering, unable to access the care they need when they need it, or having to use their own hard-earned money to go private. 'Everyone knows it is unacceptable. That's why BMA Scotland will continue to shine a light on the dire state and worsening position of the Scottish NHS. 'And it's why we will go on fighting for our members, for our patients, and for a better future for Scotland's health service.' Responding to the BMA warnings and findings, the Scottish Conservatives said Scots having to "raid their life savings" for private health care is "immoral" as they blamed the SNP for "chronic mismanagement" of the NHS. Scottish Conservative health spokesperson Dr Sandesh Gulhane MSP said: 'If BMA Scotland's devastating warning doesn't rouse failing SNP ministers, nothing will. 'Scotland's NHS is on life support thanks to 18 years of chronic mismanagement by the Nationalists. 'The fact that so many Scots are having to raid their life savings to go private for treatment isn't just unfair, it's immoral and at odds with the founding principles of our health service. 'The ability to access care should not be determined by the size of your bank balance. 'Neil Gray needs to get his head out of the sand and act now to save our NHS and prevent even more Scots being pushed into medical debt. 'The Scottish Conservatives have a plan to end this two-tier system by cutting bureaucracy and surging resources to the frontline.' Scottish Labour named the recent findings that around a third of Scots are turning to private care a "scandal" and hit out at the SNP for taking a "wrecking ball" to the founding principles of the NHS. Scottish Labour Health spokesperson Jackie Baillie said 'This damning research shows the SNP has taken a wrecking ball to the founding principles of our NHS and left too many Scots without free and available healthcare in their hour of need. 'John Swinney must heed these stark warnings from those on the frontline of his NHS crisis. 'It is a scandal that so many Scots are spending their life savings or being plunged into debt to pay to get the care desperately they need. 'The truth is if the SNP had any answers we would have seen them by now – our NHS needs a change in direction and a change in government.' The Scottish Government has invested £21.7 billion in health and social care this year, including £106 million to deliver over 150,000 additional appointments and procedures. Health Secretary Neil Gray said: 'We will always protect the founding principles of the NHS – publicly owned and free at the point of need. 'But we recognise some of the concerns raised by the BMA, and we are determined to deliver the reform our NHS needs to ensure it provides quality care for everyone who needs it now and into the future. 'The First Minister set out his plan to renew our health service by investing in prevention while harnessing technology to support earlier diagnosis and tailor medical treatment to individual patients.'
