This site is intended for health professionals only


GPs warned against using artificial intelligence without ICB approval

GPs warned against using artificial intelligence without ICB approval

GP practices in one area have been warned against using artificial intelligence (AI) without seeking approval from their ICB first.

The NHS Midlands and Lancashire information governance team said they have recently been contacted by ‘numerous different GP practices’ regarding the implementation of AI technology.

It published new guidance on the topic, indicating some of the uses of AI in general practice, including software tools assisting clinicians by automating the creation of clinical notes during patient visits, and any software supporting practices to perform tasks ‘which usually require human activity’.

But it warned practices that before considering the use of any AI technology, a Data Protection Impact Assessment (DPIA) must be conducted, approved, and signed off alongside ‘a system questionnaire’.

A DPIA is a process designed to help analyse, identify, and minimise the data protection risks of a project or plan which involves the processing of personal or sensitive data.

The guidance said: ‘If your GP practice is looking to implement a new tool, system or software which involves the use of AI you should contact [email protected] in the first instance for support and guidance.

‘This is important as the appropriate information governance advice needs to be sought, dependant on your region your ICB may not support the use of AI technology.

‘DPIAs allow organisations to identify risks and to find and fix any issues at the early stages of any project.

‘This is a benefit as it reduces the associated costs and damage to reputation that might otherwise accompany a breach of data protection laws and regulations, they also help to meet the growing privacy and data security expectations of customers, employees, and other stakeholders. Remember: no DPIA, no AI.’

It added that after a DPIA has been completed, the information governance team can advise if an associated data sharing or processing agreement are required.

It comes after a survey found that one fifth of GPs are already using artificial intelligence in clinical practice, with ChatGPT the most popular tool.

And a report commissioned by Google argued that greater use of AI could provide an extra 3.7 million GP appointments each week within 10 years.

Recently NHS England enlisted the services of an AI company to help identify patients at high risk of A&E attendance and hospital referrals by GPs.

However, GP leaders have voiced their concerns regarding the developing use of AI in general practice, with LMCs voting in favour of a motion last year which said that ‘only a doctor with full training and appropriate levels of experience will be effective to challenge an AI’.

And a medical defence organisation warned GPs not to use AI for complaint responses due to the risk of ‘inaccuracy’ or ‘insincerity’.

Pulse October survey

Take our April 2025 survey to potentially win £200 worth of tokens

Pulse October survey

          

READERS' COMMENTS [5]

Please note, only GPs are permitted to add comments to articles

David Church 17 January, 2025 6:27 pm

Do I need approval from the ICB to login to my computer or smart-phone now then? Each time?
Or only if I want to ask it to produce a list of patients that need a flu jab?
Or if I acces the presribing formulary using script-switch?
Or to ‘Duck-Duck’ a video on how to diagnose rabies?

Richard Greenway 17 January, 2025 8:46 pm

Google search and Siri are AI. We’ve been using this for years. Yes if you are using patient identifiable data -you need a DPIA. Mostly we aren’t

Manmohan Singh 20 January, 2025 12:06 pm

GPs has been more institutionalized than ever before !!

Michael Green 20 January, 2025 6:24 pm

“Computer says noooo”

Sam Tapsell 2 February, 2025 11:09 pm

Ask chatGPT
can you write a data protection impact assessment for a UK GP surgery using AI transcribing

Pulse October survey

Take our April 2025 survey to potentially win £200 worth of tokens

Pulse October survey