Original articleDevelopment and Evaluation of High-Fidelity Simulation Case Scenarios for Pediatric Resident Education
Section snippets
Study Design
This study had a single-group, posttest-only quasi-experimental design.
Setting/Study Participants
We enrolled first and second year pediatric residents from Children’s Memorial Hospital’s (Chicago, Ill) pediatric residency program. During the development phase (July 2003 to June 2004), 51 residents were enrolled. In the evaluation phase (July 2004 to June 2005), 54 residents were enrolled, which represented 100% of the residents. First-year residents starting in 2003 participated in both years of the study. Participation
Results
All residents who were approached agreed to participate. Technical problems caused one session to be rescheduled. Seventy-two percent of subjects were female (78% and 67% of first- and second-year residents, respectively). Fifty-six percent reported previous simulation exposure in medical school (41% and 70% of first- and second-year residents, respectively).
Reliability data are listed in the Table. The mean adjusted κ coefficients for each case range from 0.75 to 0.87, consistent with
Discussion
In this study, we demonstrated that assessing residents with high-fidelity simulation cases can be accomplished with high reliability. Our case content was developed and reviewed by content experts in pediatric emergency medicine and medical education. The residents’ response processes produced by the cases using the simulator in the controlled environment closely approximated the behaviors needed to provide acute pediatric care in emergent situations. For 3 of the 4 cases, we demonstrated that
Acknowledgments
We are grateful for the provision of simulation laboratory time and personnel from the Patient Safety Simulation Center and the Department of Anesthesiology (M. Christine Stock, MD, Chair), Feinberg School of Medicine, Northwestern University. We also thank Leonard D. Wade for his help as simulation laboratory technician.
References (9)
The assessment of clinical skills/competence/performance
Acad Med
(1990)- et al.
Assessing pediatric senior residents’ training in resuscitation: fund of knowledge, technical skills, and perception of confidence
Pediar Emerg Care
(2000) - et al.
Mastery learning of advanced cardiac life support skills by internal medicine residents using simulation technology and deliberate practice
J Gen Intern Med
(2006) Validity: on the meaningful interpretation of assessment data
Med Educ
(2003)
Cited by (60)
Simulated patient scenario development: A methodological review of validity and reliability reporting
2020, Nurse Education TodayCitation Excerpt :Only one study piloted the simulated scenario to ensure standardization (Kyaw Tun et al., 2012); others examined videotaped performances of participants or virtual performance of patients as a way to ensure consistency (Park et al., 2010; Tai and Chung, 2008), while another compared expert responses to the simulation (Tsai et al., 2003). Some studies also pilot-tested the simulations either for content revisions and rater training (Adler et al., 2007), or to ensure that steps in the simulation exercises were reliably observable (Lammers et al., 2009). This methodological review yielded 17 records from medicine, paramedicine and nursing.
Recent Advances in Technology and Its Applications to Pediatric Emergency Care
2018, Pediatric Clinics of North AmericaDesigning and implementing full immersion simulation as a research tool
2016, Australasian Emergency Nursing JournalFive Questions Critical Care Educators Should Ask About Simulation-Based Medical Education
2015, Clinics in Chest MedicineImplementation and outcome evaluation of high-fidelity simulation scenarios to integrate cognitive and psychomotor skills for Korean nursing students
2015, Nurse Education TodayCitation Excerpt :Guided reflection may have been rated the highest in our study because students were fully able to understand their experiences using a video-assisted verbal debriefing. We randomized students to obtain unbiased results (Adler et al., 2007; Khalaila, 2014), in order to analyze whether a correlation existed between their perception of the simulation design and learning outcomes. The experimental group had significantly higher scores than the control group did for measures of self-confidence such as being able to establish a nursing care plan for a patient with high fever in scenario 1.
Teaching and assessment of ethics and professionalism: A survey of pediatric Program directors
2013, Academic PediatricsCitation Excerpt :Reviews of professionalism assessment tools indicate a lack of proper measures, with existing tools not being used consistently and heavy reliance on self-assessment or peer assessment.20–22 The shortage of assessment tools for professional behavior contrasts with other required core qualitative competencies, such as communication and interpersonal skills, where evaluation metrics are more developed.23–25 Despite the lack of formal assessment, one third of program directors in our survey reported having prohibited at least one trainee from graduating or sitting for an examination as a result of unethical or unprofessional behavior.
- 1
Ms Siddall has served as a paid educator for METI, a simulator manufacturer.