Education/Outcomes Research
Effective use of human simulators in surgical education1

1 Presented at the 36th Annual Meeting of the Association For Academic Surgery, November 7–9, 2002, Marriott Copley Place, Boston, MA.
https://doi.org/10.1016/S0022-4804(03)00359-7Get rights and content

Abstract

Background

We initiated a teaching module utilizing a human simulator midway through 2001–2002 to improve student skills specific to the evaluation of patients in shock during a required clerkship in surgery for fourth-year medical students. We tested the hypothesis that student skills would improve after implementation of this module and identified factors that predicted student performance.

Materials and methods

Students (n = 86) chose one of two hospital sites for a clerkship that focuses on the care of acutely ill surgical patients. A case-based lecture focusing on the diagnosis and management of a patient in shock was replaced midway through the academic year by a simulator session with a computerized life-sized mannequin. A standardized clinical final evaluation (OSCE) was used to assess student skills. We evaluated the effect of the simulator session and other factors on student exam performance using univariate and multivariate analysis.

Results

The site of the clerkship and the simulator session were significant factors affecting the OSCE score identified by ANOVA, P < 0.05. A stepwise multiple regression analysis testing the effect of simulator module, site, time of year, prior NBME subject exam, and prior OSCE during the third year clerkship identified that the simulator module was the only independent factor that modeled performance on all shock stations, P < 0.01.

Conclusions

In a clerkship that already emphasized faculty facilitated case-based learning, the use of a teaching module employing a human simulator significantly improved test scores. This study supports the efficacy of human simulators to improve student skills related to the management of complex critically ill patients.

Introduction

Our institution requires the successful completion of a required fourth-year surgical clerkship based largely in the Surgical ICU and Trauma Service (Senior Surgery) [1]. Senior Surgery is designed to provide higher level experience in managing acutely ill surgical patients. Students are evaluated at the end of the clerkship with an Objective Structured Clinical Evaluation (OSCE) composed of patient management scenarios [2]. The faculty and resident supervised didactic sessions avoid traditionally formatted lectures, instead employing case-based learning modules.

We have utilized a variation of the RIME format to assist students in evaluating complex patients in these case-based sessions [3]. Students are instructed to evaluate an ICU flow sheet by identifying the abnormal and normal data (reporter), developing a systems based problem list (interpreter), and producing management recommendations (manager). To improve student skills specific to the evaluation of patients in shock, we initiated a simulation module using a full-scale computerized mannequin, midway through 2001–2002. This session with a human patient simulator (HPS) replaced a faculty-led case-based learning module focused on shock. Both of these modules were group sessions lasting approximately 1 h. This study tested the hypothesis that student performance on the OSCE would improve following learning with the HPS in comparison with student performance following the traditionally structured case-based module, which preceded the introduction of the HPS. Other factors that were likely to predict student performance were also evaluated.

Section snippets

Materials and methods

The administrative center of Robert Wood Johnson Medical School, located in Piscataway, NJ, is where students receive their first 2 years of basic science education. The student body is then divided into two campuses for completion of the two clinical years. Cooper Hospital in Camden is one center, and the other is located at Robert Wood Johnson University Hospital in New Brunswick. This article focuses on the students centered in New Brunswick. The Senior Surgery Clerkship located in New

Results

Fifty-four of fifty-nine students that were offered the HPS session completed the module. Student performance on the shock stations of the OSCE was dependent on the HPS session by ANOVA (Table 1). Total C scores with the HPS were 105.4 ± 2.2 vs 90.8 ± 2.5, P < 0.05. The scores on all three shock stations were significantly improved following implementation of the HPS module. Of concern, there was also a significant effect of clerkship site on OSCE scores (Table 1). The total C scores were

Discussion

A transition occurs during the education of medical students. The initial, basic science portion of the curriculum in medical schools still is largely delivered through traditional teaching methods in classrooms: faculty-identified topics delivered via lecture. Historically, the last portion of medical school is largely an immersion experience in the clinic. Medical students are incorporated into patient care teams in the multitude of medical specialties and expected to develop clinical skills

References (19)

There are more references available in the full text version of this article.

Cited by (39)

  • Objective Structured Clinical Examination (OSCE) including critical simulation: Evaluation of medical student competence

    2014, Tzu Chi Medical Journal
    Citation Excerpt :

    However, our experience indicates that the “actual patient care” simulation scenario test may be more correlated with individual differences [19]. Several recent illustrations of simulation-based evaluation research have shown training transfer to patient care settings [20]. Critical actions that do not address skill assessment ability signal a missed chance to understand better and apply the results of OSCE examinations to the clinical performance development of medical students [21].

  • Managing women with acute physiological deterioration: Student midwives performance in a simulated setting

    2012, Women and Birth
    Citation Excerpt :

    However, Ellis et al.37 concluded that neither simulation training nor teamwork training contributed to improved management of eclampsia over and above standard in-hospital training. Learning through simulation can be conducted via simple retrospective patient chart review38 or a range of clinical simulators from ‘part task’ trainers with individual workstations to integrated ‘whole patient simulation’.39 These approaches have varying degrees of fidelity.22

  • The simulated ward: Ideal for training clinical clerks in an era of patient safety

    2012, Journal of Surgical Research
    Citation Excerpt :

    The SIMFLO course was feasible for large groups of students and was well received by participants. Many groups have reported the efficacy of using simulators for technical skills training [10,11]; however, to our knowledge, SIMFLO is the first reported in the medical literature to create a hospital ward populated by high-fidelity simulators to teach surgical clerks the basics of inpatient management of surgical patients and communication skills [12,13]. The SIMFLO course represents a novel approach to teaching surgical clerks basic perioperative management, including the concepts of data gathering, documentation, and presentation skills, while allowing them to practice the application of that knowledge without risk to patient safety.

  • Evaluation of the use of patient-focused simulation for student assessment in a surgery clerkship

    2011, American Journal of Surgery
    Citation Excerpt :

    When used in the literature the term simulator can refer to the entire spectrum of simulation devices ranging from anatomic and tissue simulators, through electromechanical simulators, to high-fidelity computer-based mannequins.35,36 Although the present study used simple anatomic and tissue models, we believe that the methods developed in this study and our findings in conjunction with simulated patients may be transferable to more elaborate simulations that have been, and continue to be, evaluated experimentally in surgery clerkships.16 The results of this 3-year study support the feasibility of combining simulated patients with anatomic and tissue simulation models to produce a clinical skills assessment with greater validity than assessment using simulated patients alone.

View all citing articles on Scopus
View full text