Data feedback efforts in quality improvement: lessons learned from US hospitals
- 1Section of Health Policy and Administration, Department of Epidemiology and Public Health, Yale University School of Medicine, New Haven, CT, USA
- 2Department of Medicine, Yale University School of Medicine, New Haven, CT, USA
- 3Yale-New Haven Hospital, Center for Outcomes Research and Evaluation, New Haven, CT, USA
- 4Yale-New Haven Health, Center for Outcomes Research and Evaluation, New Haven, CT, USA
- 5Section of Cardiovascular Medicine, Department of Medicine, Yale University School of Medicine, New Haven, CT, USA
- Correspondence to: Dr H Krumholz Yale University School of Medicine, 333 Cedar Street, PO Box 208088, New Haven, CT 06520-8088, USA;
- Accepted 21 July 2003
Background: Data feedback is a fundamental component of quality improvement efforts, but previous studies provide mixed results on its effectiveness. This study illustrates the diversity of hospital based efforts at data feedback and highlights successful strategies and common pitfalls in designing and implementing data feedback to support performance improvement.
Methods: Open ended interviews with 45 clinical and administrative staff in eight US hospitals in 2000 concerning their perceptions about the effectiveness of data feedback in supporting performance improvement efforts were analysed. The hospitals were chosen to represent a range of sizes, geographical regions, and β blocker improvement rates over a 3 year period. Data were organized and analyzed in NUD-IST 4 using the constant comparative method of qualitative data analysis.
Results: Although the data feedback efforts at the hospitals were diverse, the interviews suggested that seven key themes may be important: (1) data must be perceived by physicians as valid to motivate change; (2) it takes time to develop the credibility of data within a hospital; (3) the source and timeliness of data are critical to perceived validity; (4) benchmarking improves the meaningfulness of data feedback; (5) physician leaders can enhance the effectiveness of data feedback; (6) data feedback that profiles an individual physician’s practices can be effective but may be perceived as punitive; (7) data feedback must persist to sustain improved performance. Embedded in several themes was the view that the effectiveness of data feedback depends not only on the quality and timeliness of the data, but also on the organizational context in which such efforts are implemented.
Conclusions: Data feedback is a complex and textured concept. Data feedback strategies that might be most effective are suggested, as well as potential pitfalls in using data to promote performance improvement.
This research was supported by the Agency for Healthcare Research and Quality, R01 HS10407. Dr Bradley is supported by the Donaghue Medical Research Foundation (#02-102) and the Claude D Pepper Older Americans Independence Center at Yale (#P30AG21342).