Inter-rater reliability for all three reviewers for preventability
| Outcome | Frequency reported by each reviewer, N (%) | κ (95% CI) | ||
|---|---|---|---|---|
| Reviewer 1 | Reviewer 2 | Reviewer 3 | ||
| *Based on preventability scores (score 1–3 = preventable, score 4–6 = not preventable). | ||||
| Preventability decision (yes or no) | ||||
| Not preventable | 23 (3.28) | 18 (2.57) | 21 (3.00) | 0.47 (0.43 to 0.51) |
| Preventable | 329 (46.93) | 398 (56.78) | 326 (46.50) | 0.35 (0.31 to 0.39) |
| Not applicable | 349 (49.79) | 285 (40.66) | 354 (50.50) | 0.37 (0.33 to 0.41) |
| Overall agreement | 0.37 (0.33 to 0.41) | |||
| Preventability score | ||||
| 1 (definitely preventable) | 257 (36.67) | 307 (43.80) | 298 (42.51) | 0.33 (0.29 to 0.37) |
| 2 (strong evidence for preventability) | 33 (4.71) | 44 (6.28) | 13 (1.85) | 0.18 (0.14 to 0.22) |
| 3 (preventability more likely than not) | 25 (3.57) | 42 (6.00) | 14 (2.00) | 0.31 (0.27 to 0.35) |
| 4 (preventability not quite likely) | 11 (1.57) | 17 (2.43) | 5 (0.71) | 0.17 (0.13 to 0.21) |
| 5 (slight to modest evidence not preventable) | 7 (1.00) | 2 (0.29) | 7 (1.00) | 0.06 (0.02 to 0.10) |
| 6 (definitely not preventable) | 19 (2.71) | 6 (0.86) | 11 (1.57) | 0.24 (0.20 to 0.28) |
| Not scored | 349 (49.79) | 283 (40.37) | 353 (50.36) | 0.37 (0.33 to 0.41) |
| Overall agreement | 0.33 (0.29 to 0.37) | |||
| Preventability category* | ||||
| Preventable | 315 (44.94) | 393 (56.06) | 325 (46.36) | 0.37 (0.33 to 0.41) |
| Not applicable | 349 (49.79) | 283 (40.37) | 353 (50.36) | 0.37 (0.33 to 0.41) |
| Not preventable | 37 (5.28) | 25 (3.57) | 23 (3.28) | 0.53 (0.49 to 0.57) |
| Overall agreement | 0.38 (0.34 to 0.42) | |||