Background: Because of uniform availability, hospital administrative data are appealing for surveillance of adverse drug events (ADEs). Expert-generated surveillance rules that rely on the presence of International Classification of Diseases, 9th Revision Clinical Modification (ICD-9-CM) codes have limited accuracy. Rules based on nonlinear associations among all types of available administrative data may be more accurate.
Objectives: By applying hierarchically optimal classification tree analysis (HOCTA) to administrative data, derive and validate surveillance rules for bleeding/anticoagulation problems and delirium/psychosis.
Research design: Retrospective cohort design.
Subjects: A random sample of 3987 admissions drawn from all 41 Utah acute-care hospitals in 2001 and 2003.
Measures: Professional nurse reviewers identified ADEs using implicit chart review. Pharmacists assigned Medical Dictionary for Regulatory Activities codes to ADE descriptions for identification of clinical groups of events. Hospitals provided patient demographic, admission, and ICD9-CM data.
Results: Incidence proportions were 0.8% for drug-induced bleeding/anticoagulation problems and 1.0% for drug-induced delirium/psychosis. The model for bleeding had very good discrimination and sensitivity at 0.87 and 86% and fair positive predictive value (PPV) at 12%. The model for delirium had excellent sensitivity at 94%, good discrimination at 0.83, but low PPV at 3%. Poisoning and adverse event codes designed for the targeted ADEs had low sensitivities and, when forced in, degraded model accuracy.
Conclusions: Hierarchically optimal classification tree analysis is a promising method for rapidly developing clinically meaningful surveillance rules for administrative data. The resultant model for drug-induced bleeding and anticoagulation problems may be useful for retrospective ADE screening and rate estimation.