This site is intended for health professionals only


Internal CQC review recommends evaluation of one-word ratings

Internal CQC review recommends evaluation of one-word ratings

An internal review of the CQC has recommended that the use of one-word ratings for GP practices should be evaluated.

Following the publication of a damning interim report into the watchdog’s effectiveness in July, the CQC commissioned an internal review of the single assessment framework and its implementation.

The review, led by former chief inspector of hospitals Professor Sir Mike Richards and published today, argued that a ‘fundamental reset of the organisation is needed’ and that the CQC ‘will never be able to deliver on its objectives’ if the current structure is maintained.

It said that ‘the issue of one-word ratings’ was raised ‘on numerous occasions by providers’ and should be given ‘further consideration’.

It comes as last month the Government said that it is ‘not currently considering’ scrapping single-word CQC ratings for GP practices, despite a decision to do so for schools. 

The review said: ‘During the course of this review, the issue of “one-word ratings” was raised on numerous occasions by providers.

‘Further consideration should therefore be given to this issue. In particular, the level at which ratings makes sense to people using services should be considered.’

It found that CQC has been ‘unable’ to fulfil its primary purpose to ensure services ‘provide people with safe, effective, compassionate high-quality care’.

‘Far fewer inspections have been carried out than in previous years; publication of inspection reports have been seriously delayed, and providers have expressed serious concerns about both the inspection process and the quality of the reports,’ the review said.

It argued that the previous organisational structure of the CQC ‘should be re-instated as soon as reasonably possible’ and that chief inspectors should lead sector-based inspection teams at all levels, including primary care.

Sir Mike also said that there are currently ‘too few staff’ working in the primary care inspection programmes to undertake the duties of the regulator ‘within reasonable timescales’, and added that staffing levels and pay scales within the inspection directorates ‘should be reviewed as a matter of urgency’. 

Measures of patient experiencecollected by GP practices and hospitals ‘should be standardised’, so that evidence on this is ‘comparable’ between providers and is available on much larger numbers.

Existing datasets already collected by NHS England and associated bodies should be incorporated into assessments of primary care services and hospitals ‘as soon as possible’, the review added.

In July, the health secretary declared that the CQC is ‘not fit for purpose’ and needs ‘increased oversight’ after a damning report, led by North West London ICS chair Dr Penny Dash identified a range of failings from the regulator.

Sir Mike said: ‘I have been working closely with providers of health and social care and with CQC staff to find solutions to the very real problems identified by Dr Penny Dash. CQC’s transformation programme has not delivered what was intended.

‘CQC urgently needs to return to a structure where inspections teams are led once again by chief inspectors relating to the different sectors that CQC regulates.

‘In addition, the current assessment framework needs to be radically simplified and the major problems with the new IT system need to be rectified. I know that work is already underway to address these areas.

‘I believe that CQC’s problems can be fixed relatively quickly under the leadership of Julian Hartley, the incoming Chief Executive. Providers have overwhelmingly reaffirmed that they want good regulation, and many CQC staff remain fully committed to delivering this.

‘These changes will help the regulator to effectively deliver its crucial work of ensuring that people get high quality, safe care.’

Dr Dash’s interim report highlighted a ‘lack of consistency’ and transparency in CQC ratings of GP practices, and found that staff who worked across large groups of GP practices ‘report ratings differing from one site to the other’, when those differences are not observed in reality.

Her full review is expected to be published later today.

Former hospital consultant Professor Sir Mike Richards became the CQC’s first chief inspector of hospitals in July 2013 and led the development and implementation of a new approach to hospital inspection. He is currently chair of the UK National Screening Committee.

The recommendations in full

Structure

  1. The organisational re-structure has had a serious negative impact. CQC should revert to the previous structure. Separate sector-based inspection directorates led by Chief Inspectors should be re-established and the Regulatory Leadership directorate should be re-integrated with the inspection directorates.
  2. Cross-directorate working can still be achieved either for thematic or strategic work by giving relevant people responsibility for this as part of their job plans. Similarly, integration between sector inspection teams can be maintained by giving dual responsibilities for integration at a local (perhaps ICS level) and specialism/sector responsibility for a wider geography (perhaps 2 or 3 ICSs depending on population size) to staff at Deputy Director or ‘head of’ level.
  3. Simplify the single assessment framework and ensure it is fit for purpose in each sector, rather than slavishly expecting a single approach to work well across all sectors and for systems assessments. As a start, remove the evidence categories and scoring at evidence category level.
  4. Model the resource needed to undertake inspections at reasonable intervals, both with comprehensive inspections and with a more limited approach (see below).
  5. Re-establish relationship owner roles for all sectors.
  6. Remove the separation between the roles of assessors and inspectors.

Assessment framework

  1. Abandon the concept of a ‘single assessment framework’. The services that CQC regulates are diverse and it has not proved helpful in practice.
  2. Retain the 5 key questions across all sectors. They have stood the test of time, though some simplification might be desirable.
  3. Retain the I statements as these are liked by many people I have spoken with. They can act as useful prompts when asking about people’s experience of care.
  4. Retain the quality statements but modify where necessary to avoid overlap and to make inspection simpler. Agree which quality statements are most needed for inspections in different sectors/services and then use consistently.
  5. Routine use of all evidence categories for all quality statements should be abandoned. This is complicating the single assessment framework without benefit. The evidence categories should only be used as an aide memoire to ensure evidence is corroborated
  6. Scoring at evidence category level should be abandoned.
  7. Key lines of enquiry (KLOEs) relevant to the quality statements selected for inspection in a sector or service should be developed. For hospitals, these can largely be taken from the previous methodology.
  8. Standards relating to the quality statements/KLOEs should be developed in conjunction with the National Quality Board, NHS England, Royal Colleges and representative bodies in adult social care. CQC’s National Professional Advisers should take a leading role in this for individual services.
  9. The evidence that should be sought for each quality statement should be defined and a handbook of rating characteristics should be developed.
  10. Peer review should be encouraged at least for hospital inspections. This should build on the current role of the executive reviewer. All trusts should be expected to contribute to a pool of reviewers.
  11. Immediate feedback should be given at the end of inspections, though with caveats that this may change on review of further evidence. At the very least, serious adverse findings should be brought to the attention of the relevant person in the provider and confirmed in writing.
  12. ‘Quick fixes’. If minor negative findings are noted on an inspection, these should be included in a report. However, if these can be rectified swiftly (say within 2 weeks) and adequate assurance can be given that this has occurred, they should not affect ratings.
  13. Quality assurance processes for reports and ratings should be reviewed by CQC. This is vital to help ensure consistency and should be undertaken by staff with expertise in the relevant sector.
  14. Reports must provide a narrative that can be understood both by the provider and by the public. Suggested word lengths for different sections may be helpful, but a degree of flexibility should be allowed.
  15. Training in the use of the simplified assessment framework recommended above should be given very high priority.

Data and insight

  1. Available data should be used more effectively. High priority should be given to working with NHS England, Healthcare Quality Improvement Partnership (national clinical audits) and the Get It Right First Time (GIRFT) programme and others to develop a shared view of data required for assessments and ratings.
  2. Measures of patient experience collected by hospitals and GP practices should be standardised, so that evidence on this is comparable between providers and is available on much larger numbers of service users. This could potentially also be applied to the adult social care sector.
  3. Retain the ‘clinical searches’ approach that has been developed for primary care. However, this should be able to be done centrally, reducing the time taken by SPAs on individual practice data. This would help to identify high or low risk practices before an inspection. It would also release SPAs to participate in inspections, adding to credibility.
  4. The NHS staff survey has been demonstrated to be an effective measure of the culture of NHS trusts. Results from the survey should be incorporated into inspections of the well-led key question.

Staffing

  1. An urgent review of staffing within the current operations and regulatory leadership directorates should be undertaken. This should assess the numbers of staff at different grades with expertise in the different sectors that CQC regulates.
  2. The role of Deputy Chief Inspector should be reinstated, with additional posts being re-created. The current network director role is unsustainable.
  3. An increase in the number of inspection team staff will almost certainly be needed at other levels, if CQC is to undertake appropriate numbers of inspections within reasonable timescales
  4. Pay bands should also be compared with comparable roles in the NHS and adult social care.
  5. Recruitment will almost certainly be needed in some areas.

Prioritisation of future inspections 

In primary care: National Professional Advisers have recommended that the ‘safe’ and ‘effective’ key questions should be given priority, with ‘well-led’ being inspected if significant issues were discovered in the first 2 key questions. The inclusion of the ‘effective’ key question reflects the significant improvements to inspection methodology using ‘clinical searches’. If these could be done nationally, this would improve identification of high-risk practices and would reduce the burden on individual specialist professional advisers, who could then be available on site during inspections.

Source: CQC