Background The reported benefits of using the WHO Surgical Safety Checklist (SSC) are likely to depend on compliance with its correct use. Compliance with SSC administration in centres that have introduced the checklist under a research protocol may differ from centres where the SSC is introduced independently.

Objective To compare compliance with SSC administration at an original WHO pilot study centre (Hospital 1) with that at a similar neighbouring hospital (Hospital 2) that independently integrated the SSC with pre-existing practice.

Methods This was a prospective, observational study. One hundred operations were observed at each hospital. We recorded: compliance with administration of SSC domains (Sign In, Time Out and Sign Out) and individual domain items; timing of domain administration; and operating room team engagement during administration.

Results Domain compliance at Hospital 1 and Hospital 2, respectively, was: 96% and 31% (p<0.0005) for Sign In; 99% and 48% (p<0.0005) for Time Out and 22% and 9% (p=0.008) for Sign Out. Engagement of two or more teams during Sign In and Time Out occurred more frequently at Hospital 2 than at Hospital 1.

Discussion Compliance with administration of SSC domains was lower at Hospital 2 which introduced the SSC outside the context of a strict study protocol. This finding mandates caution in extrapolation of benefits identified in SSC studies to non-study hospitals. Staff engagement was better at Hospital 2 where checklist administration leadership is strategically shared among anaesthetic, surgical and nursing team members as compared with exclusive nursing leadership at Hospital 1.

Study registry number Australian and New Zealand Clinical Trials Registry: Ref: ACTRN12612000135819, http://www.anzctr.org.au/trial_view.aspx?ID=362007