Article Text

Download PDFPDF
Grand rounds in methodology: four critical decision points in statistical process control evaluations of quality improvement initiatives
  1. Perla J Marang-van de Mheen1,
  2. Thomas Woodcock2
  1. 1Department of Biomedical Data Sciences, Medical Decision Making, J10-S, Leiden University Medical Center, Leiden, The Netherlands
  2. 2National Institute for Health Research Applied Research Collaboration Northwest London, Imperial College London, London, UK
  1. Correspondence to Dr Perla J Marang-van de Mheen, Department of Biomedical Data Sciences, Medical Decision Making, J10-S, Leiden University Medical Center, 2300 RC Leiden, The Netherlands; p.j.marang-van_de_mheen{at}lumc.nl

Abstract

Quality improvement (QI) projects often employ statistical process control (SPC) charts to monitor process or outcome measures as part of ongoing feedback, to inform successive Plan-Do-Study-Act cycles and refine the intervention (formative evaluation). SPC charts can also be used to draw inferences on effectiveness and generalisability of improvement efforts (summative evaluation), but only if appropriately designed and meeting specific methodological requirements for generalisability. Inadequate design decreases the validity of results, which not only reduces the chance of publication but could also result in patient harm and wasted resources if incorrect conclusions are drawn. This paper aims to bring together much of what has been written in various tutorials, to suggest a process for using SPC in QI projects. We highlight four critical decision points that are often missed, how these are inter-related and how they affect the inferences that can be drawn regarding effectiveness of the intervention: (1) the need for a stable baseline to enable drawing inferences on effectiveness; (2) choice of outcome measures to assess effectiveness, safety and intervention fidelity; (3) design features to improve the quality of QI projects; (4) choice of SPC analysis aligned with the type of outcome, and reporting on the potential influence of other interventions or secular trends.

These decision points should be explicitly reported for readers to interpret and judge the results, and can be seen as supplementing the Standards for Quality Improvement Reporting Excellence guidelines. Thinking in advance about both formative and summative evaluation will inform more deliberate choices and strengthen the evidence produced by QI projects.

  • Statistical process control
  • Quality improvement methodologies
  • Evaluation methodology
  • Control charts, run charts
  • PDSA

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Footnotes

  • Contributors Both authors conceived this study. PJM-vdM wrote the first draft and is guarantor. Both authors critically reviewed the manuscript and approved the final version.

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Provenance and peer review Commissioned; externally peer reviewed.

Linked Articles