GPs warned against using artificial intelligence without ICB approval

GP practices in one area have been warned against using artificial intelligence (AI) without seeking approval from their ICB first.

The NHS Midlands and Lancashire information governance team said they have recently been contacted by ‘numerous different GP practices’ regarding the implementation of AI technology.

It published new guidance on the topic, indicating some of the uses of AI in general practice, including software tools assisting clinicians by automating the creation of clinical notes during patient visits, and any software supporting practices to perform tasks ‘which usually require human activity’.

But it warned practices that before considering the use of any AI technology, a Data Protection Impact Assessment (DPIA) must be conducted, approved, and signed off alongside ‘a system questionnaire’.

A DPIA is a process designed to help analyse, identify, and minimise the data protection risks of a project or plan which involves the processing of personal or sensitive data.

The guidance said: ‘If your GP practice is looking to implement a new tool, system or software which involves the use of AI you should contact [email protected] in the first instance for support and guidance.

‘This is important as the appropriate information governance advice needs to be sought, dependant on your region your ICB may not support the use of AI technology.

‘DPIAs allow organisations to identify risks and to find and fix any issues at the early stages of any project.

‘This is a benefit as it reduces the associated costs and damage to reputation that might otherwise accompany a breach of data protection laws and regulations, they also help to meet the growing privacy and data security expectations of customers, employees, and other stakeholders. Remember: no DPIA, no AI.’

It added that after a DPIA has been completed, the information governance team can advise if an associated data sharing or processing agreement are required.

It comes after a survey found that one fifth of GPs are already using artificial intelligence in clinical practice, with ChatGPT the most popular tool.

And a report commissioned by Google argued that greater use of AI could provide an extra 3.7 million GP appointments each week within 10 years.

Recently NHS England enlisted the services of an AI company to help identify patients at high risk of A&E attendance and hospital referrals by GPs.

However, GP leaders have voiced their concerns regarding the developing use of AI in general practice, with LMCs voting in favour of a motion last year which said that ‘only a doctor with full training and appropriate levels of experience will be effective to challenge an AI’.

And a medical defence organisation warned GPs not to use AI for complaint responses due to the risk of ‘inaccuracy’ or ‘insincerity’.