Table 3

Inter-rater agreement Quality Improvement Minimum Quality Criteria Set (QI-MQCS)

#Domainnκ (95% CI)% agreement
1Organisational motivation450.46 (0.19 to 0.73)0.76
2Intervention rationale180.61 (0.21 to 1.00)0.83
3Intervention270.65 (0.02 to 1.28)0.96
4Organisational characteristics450.49 (0.17 to 0.82)0.84
5Implementation360.62 (0.23 to 1.01)0.92
6Study design450.73 (0.53 to 0.93)0.87
7Comparator description540.40 (0.14 to 0.65)0.72
8Data source180.87 (0.62 to 1.12)0.94
9Timing540.39 (0.15 to 0.63)0.70
10Adherence/fidelity360.09 (−0.22 to 0.40)0.56
11Health-related outcomes450.64 (0.42 to 0.87)0.82
12Organisational readiness450.45 (0.14 to 0.76)0.82
13Penetration/reach270.52 (0.18 to 0.85)0.81
14Sustainability180.82 (0.49 to 1.15)0.94
15Spread270.13 (−0.23 to 0.48)0.67
16Limitations450.77 (0.58 to 0.96)0.89
  • κ, Cohen's κ; n, Number of assessed publications.