Table 1

Study overview

Measurement propertiesData collection period and response
Measurements per level of KirkpatrickNo. of dimensionsNo. of items (k)ScaleNew or existingBaselineAfter the trainingFirst follow-upSecond follow-up
I Reaction to the training programme
 End-of-Course Critique questionnaire*n/a145-LikertExisting100%
 Evaluation questionnaire*n/a135-LikertNew75%
II Learning from the training programme
 Situational awareness attitudes (SafeTeamA questionnaire)7435-LikertNew87%72%
III Behavioural change as a result of the training
 Enacted situational awareness tactics (SafeTeamB questionnaire)7395-LikertNew87%72%
 EPOC: Observation of explicit professional oral communication630CountExisting489 observations596 observations
IV The impact of the training on the organisation
 Routine (patient) administration datan/an/an/aExistingOne year before CRM: 4085 patients. One year after: 3942 patients
 Patient safety culture (COMPaZ)11405-LikertExisting76%72%
 Error culture (error culture questionnaire)11475-LikertExisting87%73%
 Job satisfaction and affective commitment to the ICU7185-LikertExisting87%72%
  • Overview of the measurements for each level of the Kirkpatrick framework with regard to their measurement properties, when they were collected and what the response was during that data collection period.

  • *These measurements were collected in the intervention groups only.

  • CRM, crew resource management; ICU, intensive care unit; n/a, not applicable.