Assessing potentially dangerous medical actions with the computer-based case simulation portion of the USMLE step 3 examination

Acad Med. 2009 Oct;84(10 Suppl):S79-82. doi: 10.1097/ACM.0b013e3181b379bc.

Abstract

Background: The 2000 Institute of Medicine report on patient safety brought renewed attention to the issue of preventable medical errors, and subsequently specialty boards and the National Board of Medical Examiners were encouraged to play a role in setting expectations around safety education. This paper examines potentially dangerous actions taken by examinees during the portion of the United States Medical Licensing Examination Step 3 that is particularly well suited to evaluating lapses in physician decision making, the Computer-based Case Simulation (CCS).

Method: Descriptive statistics and a general linear modeling approach were used to analyze dangerous actions ordered by 25,283 examinees that completed CCS for the first time between November 2006 and January 2008.

Results: More than 20% of examinees ordered at least one dangerous action with the potential to cause significant patient harm. The propensity to order dangerous actions may vary across clinical cases.

Conclusions: The CCS format may provide a means of collecting important information about patient-care situations in which examinees may be more likely to commit dangerous actions and the propensity of examinees to order dangerous tests and treatments.

MeSH terms

  • Clinical Competence*
  • Computer-Assisted Instruction*
  • Educational Measurement*
  • Licensure, Medical*
  • Medical Errors*
  • Risk Assessment
  • United States