Intelligent Monitoring? Assessing the ability of the Care Quality Commission's statistical surveillance tool to predict quality and prioritise NHS hospital inspections

被引:26
|
作者
Griffiths, Alex [1 ]
Beaussier, Anne-Laure [2 ]
Demeritt, David [2 ]
Rothstein, Henry [2 ]
机构
[1] Kings Coll London, Sch Management & Business, Franklin Wilkins Bldg,150 Stamford St, London SE1 9NH, England
[2] Kings Coll London, Dept Geog, London, England
基金
英国经济与社会研究理事会;
关键词
Health policy; Performance measures; Quality improvement methodologies; Quality measurement; Risk management;
D O I
10.1136/bmjqs-2015-004687
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Background The Care Quality Commission (CQC) is responsible for ensuring the quality of the health and social care delivered by more than 30 000 registered providers in England. With only limited resources for conducting on-site inspections, the CQC has used statistical surveillance tools to help it identify which providers it should prioritise for inspection. In the face of planned funding cuts, the CQC plans to put more reliance on statistical surveillance tools to assess risks to quality and prioritise inspections accordingly. Objective To evaluate the ability of the CQC's latest surveillance tool, Intelligent Monitoring (IM), to predict the quality of care provided by National Health Service (NHS) hospital trusts so that those at greatest risk of providing poor-quality care can be identified and targeted for inspection. Methods The predictive ability of the IM tool is evaluated through regression analyses and chi(2) testing of the relationship between the quantitative risk score generated by the IM tool and the subsequent quality rating awarded following detailed on-site inspection by large expert teams of inspectors. Results First, the continuous risk scores generated by the CQC's IM statistical surveillance tool cannot predict inspection-based quality ratings of NHS hospital trusts (OR 0.38 (0.14 to 1.05) for Outstanding/Good, OR 0.94 (0.80 to -1.10) for Good/Requires improvement, and OR 0.90 (0.76 to 1.07) for Requires improvement/Inadequate). Second, the risk scores cannot be used more simply to distinguish the trusts performing poorly-those subsequently rated either 'Requires improvement' or 'Inadequate' from the trusts performing well-those subsequently rated either 'Good' or 'Outstanding' (OR 1.07 (0.91 to 1.26)). Classifying CQC's risk bandings 1-3 as high risk and 4-6 as low risk, 11 of the high risk trusts were performing well and 43 of the low risk trusts were performing poorly, resulting in an overall accuracy rate of 47.6%. Third, the risk scores cannot be used even more simply to distinguish the worst performing trusts-those subsequently rated 'Inadequate'-from the remaining, better performing trusts (OR 1.11 (0.94 to 1.32)). Classifying CQC's risk banding 1 as high risk and 2-6 as low risk, the highest overall accuracy rate of 72.8% was achieved, but still only 6 of the 13 Inadequate trusts were correctly classified as being high risk. Conclusions Since the IM statistical surveillance tool cannot predict the outcome of NHS hospital trust inspections, it cannot be used for prioritisation. A new approach to inspection planning is therefore required.
引用
收藏
页码:120 / 130
页数:11
相关论文
共 16 条
  • [1] MONITORING - SURVEILLANCE FOR NOSOCOMIAL INFECTIONS AND USES FOR ASSESSING QUALITY OF CARE
    LYNCH, P
    JACKSON, MM
    [J]. AMERICAN JOURNAL OF INFECTION CONTROL, 1985, 13 (04) : 161 - 173
  • [2] How hospital survey teams function: An analysis of Care Quality Commission inspections of acute hospitals in England
    Boyd, Alan
    Ross, Shilpa
    Robertson, Ruth
    Walshe, Kieran
    Smithson, Rachael
    [J]. JOURNAL OF HEALTH ORGANIZATION AND MANAGEMENT, 2018, 32 (02) : 206 - 223
  • [3] WHAT WENT WRONG AT ADDENBROOKE'S? Care Quality Commission's unfair treatment of Addenbrooke's Hospital
    Mann, Nick
    [J]. BMJ-BRITISH MEDICAL JOURNAL, 2015, 351
  • [4] Monitoring and assessing the quality of care for youth: developing an audit tool using an expert consensus approach
    Puszka, Stefanie
    Nagel, Tricia
    Matthews, Veronica
    Mosca, Diana
    Piovesan, Rebecca
    Nori, Annapurna
    Bailie, Ross
    [J]. INTERNATIONAL JOURNAL OF MENTAL HEALTH SYSTEMS, 2015, 9
  • [5] Monitoring and assessing the quality of care for youth: developing an audit tool using an expert consensus approach
    Stefanie Puszka
    Tricia Nagel
    Veronica Matthews
    Diana Mosca
    Rebecca Piovesan
    Annapurna Nori
    Ross Bailie
    [J]. International Journal of Mental Health Systems, 9
  • [6] Hospital-level compliance with the commission on cancer's quality of care measures and the association with patient survival
    Nussbaum, Daniel P.
    Rushing, Christel N.
    Sun, Zhifei
    Yerokun, Babatunde A.
    Worni, Mathias
    Saunders, Robert S.
    McClellan, Mark B.
    Niedzwiecki, Donna
    Greenup, Rachel A.
    Blazer, Dan G., III
    [J]. CANCER MEDICINE, 2021, 10 (11): : 3533 - 3544
  • [7] Reliability of the American College of Surgeons Commission on Cancer's Quality of Care Measures for Hospital and Surgeon Profiling
    Liu, Jason B.
    Huffman, Kristopher M.
    Palis, Bryan E.
    Shulman, Lawrence N.
    Winchester, David P.
    Ko, Clifford Y.
    Hall, Bruce L.
    [J]. JOURNAL OF THE AMERICAN COLLEGE OF SURGEONS, 2017, 224 (02) : 180 - +
  • [8] VALIDITY AND RELIABILITY OF THE JOINT COMMISSION SUBJECT IDENTIFICATION CRITERIA FOR ASSESSING THE QUALITY OF CHILDREN'S INPATIENT ASTHMA CARE
    West, S.
    Nkoy, F.
    Fassl, B.
    Stone, B.
    Halbern, S.
    Maloney, C.
    [J]. JOURNAL OF INVESTIGATIVE MEDICINE, 2011, 59 (01) : 158 - 158
  • [9] Do beliefs about hospital technologies predict nurses' perceptions of their ability to provide quality care? A study in two pediatric hospitals
    Karsh, Ben-Tzion
    Escoto, Kamisha
    Alper, Samuel
    Holden, Richard
    Scanlon, Matthew
    Murkowskj, Kathleen
    Patel, Neal
    Shalaby, Theresa
    Arnold, Judi
    Kaushal, Rainu
    Skibinski, Kathleen
    Brown, Roger
    [J]. HUMAN INTERFACE AND THE MANAGEMENT OF INFORMATION: METHODS, TECHNIQUES AND TOOLS IN INFORMATION DESIGN, PT 1, PROCEEDINGS, 2007, 4557 : 77 - 83
  • [10] An audit on the awareness of Westgard rules as quality control monitoring tool among medical laboratory technologists of a tertiary care hospital
    Siddiqui, I.
    Khan, A. Habib
    Imran, S.
    Jafri, L.
    [J]. CLINICA CHIMICA ACTA, 2022, 530 : S113 - S114