Understanding handling of drug safety alerts: a simulation study

Purpose: To study correctness of drug safety alert handling and error type in a computerized physician order entry (CPOE) system in a simulated work environment.

Methods: Disguised observation study of 18 physicians (12 from internal medicine and 6 from surgery) entering 35 orders of predefined patient cases with 13 different drug safety alerts in a CPOE. Structured interviews about how the generated drug safety alerts were handled in the simulation test and resemblance of the test to the normal work environment. Handling and reasons for this were scored for correctness and error type.

Results: Thirty percent of alerts were handled incorrectly, because the action itself and/or the reason for the handling were incorrect. Sixty-three percent of the errors were categorized as rule based and residents in surgery used incorrect justifications twice as often as residents in internal medicine. They often referred to monitoring of incorrect substances or parameters. One alert presented as a second alert in one screen was unconsciously overridden several times. One quarter of residents showed signs of alert fatigue.

Conclusion: Although alerts were mainly handled correctly, underlying rules and reasoning were often incorrect, thereby threatening patient safety. This study gave an insight into the factors playing a role in incorrect drug safety alert handling that should be studied in more detail. The results suggest that better training, improved concise alert texts, and increased specificity might help. Furthermore, the safety of the predefined override reason 'will monitor' and double alert presentation in one screen is questioned.