Credentialing and Certifying with Simulation

https://doi.org/10.1016/j.anclin.2007.03.002Get rights and content

Assessment and evaluation are integral parts of any educational and training process, and students at all levels of training respond by studying more seriously for the parts of the course or training that are assessed. To promote and enhance effective learning successfully, simulation and other teaching methods should be both formative and summative, because the ultimate goal is to ensure professional competence. This article describes a model of medical competence, and focuses on the use of medical simulation in assessment and evaluation of different levels of clinical competence using examples from experience.

Section snippets

Miller's model of medical competence

A well-established model of medical competence was suggested by Miller [3]. Miller's pyramid presents four layers of competence, defined as (1) knows, (2) knows how, (3) shows how, and (4) does.

  • 1.

    The “knows” level refers to the recall of facts, principles, and theories. The traditional method of assessing this level was the essay, replaced later by multiple-choice tests, to assess the recall and application of knowledge [4].

  • 2.

    The “knows how” level involves the ability to solve problems and describe

Objective structured clinical examination

The objective structures clinical examination (OSCE) consists of multiple stations around which examinees rotate and perform and are assessed on specific tasks by examiners or by simulated patients on whom the task was performed [16]. OSCE is widely used for assessment and certification around the world. This tool is used for evaluation of foreign doctors wishing to practice in the United States [17]; the General Medical Council [18]; the Medical Council of Canada [19]; and for the evaluation

Admission to Tel Aviv University Sackler School of Medicine

Most medical schools' selection processes rely mainly on tools that measure cognitive factors. The most common tools record candidates' previous academic achievements, coupled with norm-referenced cognitive examinations [35]. These tools can be efficiently administered to large numbers of candidates, produce data that can be objectively scored and analyzed, and they are good predictors of students' academic success in medical school [36]. Interviews incorporated to the admission process are the

The Israeli board examination in anesthesiology

Many institutions introduced the use of high-fidelity medical simulation into residents' training. The interrater reliability, construct validity, and value of simulation-based scenarios as an effective tool for the evaluation of residents have been explored. In the United Kingdom, OSCE was incorporated into the Fellow Royal College of Anesthesiologists (FRCA) examinations. The areas tested in the OSCE stations include resuscitation, technical skills, anatomy, history-taking, physical

Keys for success in incorporating simulation and objective structured clinical examination into assessment and evaluation

The incorporation of OSCE into the assessment of medical personnel involves a structured process of examination development, including the definition of assessment conditions, tasks, and scenarios on the basis of accepted medical protocols and broad professional consensus. This process contributes to the objectivity and the content and face validity of the examination, and also its positive reception by the medical community. According to the authors' experience, a major key for success in such

References (42)

  • G. Bordage

    An alternative approach to PMP's: the ‘key-features’ concept

  • S.M. Case et al.

    Extended-matching items: a practical alternative to free response questions

    Teach Learn Med

    (1993)
  • R.M. Harden et al.

    Assessment of clinical competence using an objective structured clinical examination (OSCE)

    Med Educ

    (1979)
  • J. Turnbull et al.

    Clinical work sampling: a new approach to the problem of in-training evaluation

    J Gen Intern Med

    (2000)
  • P. Ram et al.

    Assessment of general practitioners by video observation of communicative and medical performance in daily practice: issues of validity, reliability and feasibility

    Med Educ

    (1999)
  • P.G. Ramsey et al.

    Use of peer rating in physician performance

    JAMA

    (1993)
  • J. Rethans et al.

    Assessment of performance in actual practice of general practitioners by use of standardized patients

    Br J Gen Pract

    (1991)
  • Lockie C. The examination for membership in the Royal College of General Practitioners of England. Royal College of...
  • E.R. Petrusa

    Clinical performance assessment

  • A. Ziv et al.

    Lessons learned from six years of international administrations of the ECFMG's SP-based clinical skills assessment

    Acad Med

    (1998)
  • P. Tombeson et al.

    Defining the content for the objective structured clinical examination component of the Professional and Linguistic Assessment Board examination: development of a blueprint

    Med Educ

    (2000)
  • Cited by (52)

    • Multi-Disciplinary Trauma Evaluation and Management Simulation (MD-TEAMS) training for emergency medicine and general surgery residents

      2021, American Journal of Surgery
      Citation Excerpt :

      Simulation-based training with facilitated feedback is an effective method for teaching and assessing communication,8 trauma management,9,10 and leadership skills.7,11 High-fidelity, manikin-based simulations are conducive to trauma training due to the ability to create changes in physiology, practice performance of resuscitative procedures,12 and offers benefits in competency-based assessment.13 While simulation-based training is well-described, many of these interventions target only one group of residents8–10,14 or inter-professional teams.7,15–17

    • Mobile in Situ Simulation as a Tool for Evaluation and Improvement of Trauma Treatment in the Emergency Department

      2016, Journal of Surgical Education
      Citation Excerpt :

      This milieu has evolved not only because of technological improvements but also because of increasing awareness for patient safety and the need to decrease the amount of human errors in medicine.14 The main use of high-fidelity simulators has been directed to improve medical skills.15-18 This technology has enabled to evaluate the effect of the ATLS course on trainees.

    • Training in Trauma Management. The Role of Simulation-Based Medical Education.

      2013, Anesthesiology Clinics
      Citation Excerpt :

      Training is performed without the ethically disturbing duality of patient care and medical training associated with traditional bedside teaching. Another important benefit of SBME is the reproducible, standardized, objective setting it provides for formative assessment (debriefing)13–15 and summative assessment (testing).16,17 A major component of SBME, regardless of the simulation modality used, is the ability to observe, record, and debrief the simulation session.

    • Teaching Airway Management Outside the Operating Room

      2013, Benumof and Hagberg's Airway Management
    View all citing articles on Scopus
    View full text