Overconfidence as a Cause of Diagnostic Error in Medicine
Section snippets
Incidence and impact of diagnostic error
We reviewed the scientific literature with several questions in mind: (1) What is the extent of incorrect diagnosis? (2) What percentage of documented adverse events can be attributed to diagnostic errors and, conversely, how often do diagnostic errors lead to adverse events? (3) Has the rate of diagnostic errors decreased over time?
Physician overconfidence
“… what discourages autopsies is medicine's twenty-first century, tall-in-the-saddle confidence.”
“When someone dies, we already know why. We don't need an autopsy to find out. Or so I thought.”
—Atul Gawande83
“He who knows best knows how little he knows.”
—attributed to Thomas Jefferson84
“Doctors think a lot of patients are cured who have simply quit in disgust.”
—attributed to Don Herold85
As Kirch and Schafii78 note, autopsies not only document the presence of diagnostic errors, they also provide
Strategies to improve the accuracy of diagnostic decision making
“Ignorance more frequently begets confidence than does knowledge.”
—Charles Darwin, 1871145
We believe that strategies to reduce misdiagnoses should focus on physician calibration, i.e., improving the match between the physician's self-assessment of errors and actual errors. Klein128 has shown that experts use their intuition on a routine basis, but rethink their strategies when that does not work. Physicians also rethink their diagnoses when it is obvious that they are wrong. In fact, it is in
Analysis of strategies to reduce overconfidence
The strategies suggested above, even if they are successful in addressing the problem of overconfidence or miscalibration, have limitations that must be acknowledged. One involves the trade-offs of time, cost, and accuracy. We can be more certain, but at a price.202 A second problem is unanticipated negative effects of the intervention.
Recommendations for future research
“Happy families are all alike; every unhappy family is unhappy in its own way.”
—Leo Tolstoy, Anna Karenina209
We are left with the challenge of trying to consider solutions based on our current understanding of the research on overconfidence and the strategies to overcome it. Studies show that experts seem to know what to do in a given situation and what they know works well most of the time. What this means is that diagnoses are correct most of the time. However, as advocated in the Institute
Conclusions
Diagnostic error exists at an appreciable rate, ranging from <5% in the perceptual specialties up to 15% in most other areas of medicine. In this review, we have examined the possibility that overconfidence contributes to diagnostic error. Our review of the literature leads us to 2 main conclusions.
Author disclosures
The authors report the following conflicts of interest with the sponsor of this supplement article or products discussed in this article:
Eta S. Berner, EdD, has no financial arrangement or affiliation with a corporate organization or manufacturer of a product discussed in this article.
Mark L. Graber, MD, has no financial arrangement or affiliation with a corporate organization or manufacturer of a product discussed in this article.
Acknowledgments
We are grateful to Paul Mongerson for encouragement and financial support of this research. The authors also appreciate the insightful comments of Arthur S. Elstein, PhD, on an earlier draft of this manuscript. We also appreciate the assistance of Muzna Mirza, MBBS, MSHI, Grace Garey, and Mary Lou Glazer in compiling the bibliography.
References (211)
Error in radiology
Clin Radiol
(2001)- et al.
Ruptured abdominal aortic aneurysm: the internist as diagnostician
Am J Med
(1994) - et al.
Interobserver variability in the diagnosis of minimal and mild endometriosis
Eur J Obstet Gynecol Reprod Biol
(2005) - et al.
Misdiagnosis of atrial fibrillation and its clinical consequences
Am J Med
(2004) - et al.
Improving ambulatory prescribing safety with a handheld decision support system: a randomized controlled trial
J Am Med Inform Assoc
(2006) - et al.
Effect of CPOE user interface design on user-initiated access to educational and patient information during clinical care
J Am Med Inform Assoc
(2005) Evidence for the effectiveness of techniques to change physician behavior
Chest
(2000)- et al.
Identifying barriers to the effective use of clinical reminders: bootstrapping multiple methods
J Biomed Inform
(2005) - et al.
Clinician awareness of adherence to hypertension guidelines
Am J Med
(2004) Failure to perform autopsies means some MDs “walking in a fog of misplaced optimism.”
CMAJ
(1995)
A patient's perspective of medical informatics
J Am Med Inform Assoc
Views of practicing physicians and the public on medical errors
N Engl J Med
Patient concerns about medical errors in emergency departments
Acad Emerg Med
Adverse outpatient drug events—a problem and an opportunity
N Engl J Med
Expertise in visual diagnosis: a review of the literature
Acad Med
Mandatory second opinion surgical pathology at a large referral hospital
Cancer
Perceptual errors and negligence
Am J Radiol
Exploring the causes of adverse events in NHS hospital practice
J R Soc Med
Unnecessary delays in accident and emergency departments: do medical and surgical senior house officers need to vet admissions?
Acad Emerg Med
Evaluation of missed diagnoses for patients admitted from the emergency department
Acad Emerg Med
Clinical reasoning in medicine
Internet based consultations to transfer knowledge for patients requiring specialised care: retrospective case review
BMJ
Pathology review of cases presenting to a multidisciplinary pigmented lesion clinic
Arch Dermatol
Error detection in anatomic pathology
Arch Pathol Lab Med
Consensus conference on second opinions in diagnostic anatomic pathology: who, what, and when
Am J Clin Pathol
Sarcomas in north west EnglandI. Histopathological peer review
Br J Cancer
Pathology Panel for Lymphoma Clinical Studies: a comprehensive analysis of cases accumulated since its inception
J Natl Cancer Inst
Error in radiology
Br J Radiol
Defending the ”missed” radiographic diagnosis
Am J Radiol
Reducing errors made by emergency physicians in interpreting radiographs: longitudinal study
BMJ
The wet read. AHRQ [Agency for Heathcare Research and Quality] Web M&M, March 2006
Variability in the interpretation of screening mammograms by US radiologists: findings from a national sample
Arch Intern Med
Missed breast carcinoma: pitfalls and pearls
Radiographics
Causes of physician delay in the diagnosis of breast cancer
Arch Intern Med
Comparison of screening mammography in the United States and the United Kingdom
JAMA
Diagnosing diagnosis errors: lessons from a multi-institutional collaborative project
Advances in Patient Safety: From Research to Implementation
Clinical suspicion of fatal pulmonary embolism
Chest
Clinical prediction of acute aortic dissection
Arch Intern Med
Diagnosis of subarachnoid hemorrhage
Neurocrit Care
Autopsy diagnoses of malignant neoplasms: how often are clinical diagnoses incorrect?
JAMA
Misdiagnosis of bipolar disorder
Am J Manag Care
False-negative and false-positive errors in abdominal pain evaluation: failure to diagnose acute appendicitis and unneccessary surgery
Acad Emerg Med
Clinical impact and frequency of anatomic pathology errors in cancer diagnoses
Cancer
Psoriatic arthritis: performance of rheumatologists in daily practice
Ann Rheum Dis
Human botulism immune globulin for the treatment of infant botulism
N Engl J Med
Outpatient diagnostic errors: unrecognized hyperglycemia
Eff Clin Pract
Cited by (700)
Adaptation to stressors: Hormesis as a framework for human performance
2024, New Ideas in PsychologyImposing commitment to rein in overconfidence in learning
2024, Games and Economic BehaviorEnhancing lung abnormalities diagnosis using hybrid DCNN-ViT-GRU model with explainable AI: A deep learning approach
2024, Image and Vision ComputingMedical Student Perspectives on Sexual and Gender Minority Acceptance in Surgical Specialties and Sexual and Gender Minority Education
2023, Journal of Surgical ResearchSpeech and language therapists' management practices, perceived effectiveness of current treatments and interest in neuromuscular electrical stimulation for acquired dysarthria rehabilitation: An international perspective
2024, International Journal of Language and Communication Disorders‘Insight’ in medical training: what, why, and how?
2024, Postgraduate Medical Journal
This research was supported through the Paul Mongerson Foundation within the Raymond James Charitable Endowment Fund (ESB) and the National Patient Safety Foundation (MLG).
Statement of author disclosures: Please see the Author Disclosures section at the end of this article.