Table 2

Agreement of pairs of assessors and score reliability (across competency dimensions and stations)

	Station 1		Station 2		Station 3		Station 4
	Near miss (DVT)		Complex discharge		Challenging authority		Medication error disclosure
PS competency area*†‡§¶	Weighted κ	Avg measures ICC	Weighted κ	Avg measures ICC	Weighted κ	Avg measures ICC	Weighted κ	Avg measures ICC
Communication*	0.517	0.608	0.660	0.789	0.717	0.815	0.432	0.547
Teamwork†	0.665	0.809	0.135	0.247	0.496	0.659	0.438	0.621
Managing risk‡	0.794	0.888	0.637	0.692	0.869	0.933	NA	NA
R, R and disclose§	0.568	0.716	NA	NA	NA	NA	0.548	0.714
Culture¶	0.560	0.712	0.693	0.795	0.390	0.502	0.754	0.860
Station score	0.803	0.894	0.737	0.811	0.794	0.870	0.816	0.895

*Communicate effectively for PS.
†Work in teams for PS.
‡Manage safety risks.
§Recognise, respond to and disclose adverse events.
¶Contribute to a culture of safety.
DVT, deep vein thrombosis; ICC, intraclass correlation coefficient; PS, patient safety.