Article Text

Do panels vary when assessing intrapartum adverse events? The reproducibility of assessments by hospital risk management groups
  1. D Kernaghan1,
  2. G C Penney2
  1. 1Scottish Programme for Clinical Effectiveness in Reproductive Health (SPCERH), Department of Obstetrics and Gynaecology, Simpson Centre for Reproductive Health, Edinburgh, UK
  2. 2Scottish Programme for Clinical Effectiveness in Reproductive Health, Aberdeen Maternity Hospital, Aberdeen, UK
  1. Correspondence to:
 D Kernaghan
 Scottish Programme for Clinical Effectiveness in Reproductive Health (SPCERH), Room S7130, Department of Obstetrics and Gynaecology, Simpson Centre for Reproductive Health, 51 Little France Crescent, Edinburgh EH16 4SA, UK; dawn.kernaghan{at}


Introduction: A national audit project, Scotland-wide Learning from Intrapartum Critical Events (SLICE), included local assessment of quality of care in cases of perinatal death and neonatal encephalopathy due to intrapartum events. Concerns had been raised about interobserver variation in case assessment by different panels. We therefore studied the extent of agreement and disagreement between assessment panels, and examined the areas in which agreement and disagreement tended to occur.

Methods: 8 cases were randomly selected from all 42 cases identified during a 6-month period (1 January–1 July 2005). Each case was independently reviewed by three panels: the local hospital clinical risk-management group and two specially convened external panels. Panels assessed quality of care in three areas: admission assessment, recognition of incident, and method and timing of delivery. Predefined standards of care were provided for these three areas. Panels were also asked to assess the overall quality of care.

Results: For each area of care, agreement between the two external panels was lowest. The lowest levels of agreement between panels were seen in assessment of overall care (50% crude agreement between external panel 1 and the hospital (κ = 0.24, AC1 =  0.36); 29% crude agreement between external panels 1 and 2 (κ = −0.11, AC1 = 0.1); 47% crude agreement between external panel 2 and the hospital (κ = 0.36, AC1 = 0.46). The lowest level of agreement among all three panels was also in the assessment of overall care (crude agreement 48%; κ = 0.16, AC1 = 0.34).

Conclusion: Moderate to substantial agreement among the three panels was achieved for the three areas in which explicit standards were provided. Therefore, a systematic approach to analysis of adverse events in perinatal care improves reproducibility.

Statistics from


  • Funding: This study was funded by NHS Quality Improvement Scotland. However, the views expressed are those of the authors.

  • Competing interests: None.

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.