TY - JOUR T1 - Value of small sample sizes in rapid-cycle quality improvement projects 2: assessing fidelity of implementation for improvement interventions JF - BMJ Quality & Safety JO - BMJ Qual Saf SP - 61 LP - 65 DO - 10.1136/bmjqs-2017-006963 VL - 27 IS - 1 AU - Edward Etchells AU - Thomas Woodcock Y1 - 2018/01/01 UR - http://qualitysafety.bmj.com/content/27/1/61.abstract N2 - Fidelity is the degree to which a change is implemented as intended. Improvement project teams should measure fidelity, because if the change is not implemented, nothing will change. However, measurement resources are usually limited, especially in the early stages of implementation. A frequent problem in quality improvement is that people waste time collecting too much data. A previous paper1 showed how to demonstrate local gaps in care with very small samples of 5–10 patients. In evaluative clinical trials, the goal is to detect small differences between groups with precise estimates of these differences. By contrast, local quality improvement is often asking whether local performance meets a specific standard, such as 80% compliance with a guideline. If local performance is poor, small samples of 5–10 patients may be large enough to demonstrate a gap in care. In this paper, our goal is to offer some general guidelines to measuring fidelity of implementation on small samples in the face of constrained measurement resources.Our target audience is healthcare improvers who have:Identified a local gap in care.Analysed the causes of this gap.Developed a change theory to address the gap.Created an initial change concept to be tested and refined locally. A hypothetical scenarioA hospital-based improvement team is focused on medication reconciliation. Medication reconciliation refers to efforts to avoid unintentional changes to medication regimens at transition points such as hospital admission and discharge.2 The team has conducted several small audits showing important gaps in the local system of medication reconciliation. The team has designed a new medication reconciliation form and is keen to start Plan-Do-Study-Act (PDSA) rapid improvement cycles. The hospital director wants the new medication reconciliation form implemented broadly as soon as possible. One member of the team wonders about conducting a randomised controlled trial of the new form. The … ER -