You are here

Article Text

Article menu

Download PDFPDF

Quality improvement report
Personalised performance feedback reduces narcotic prescription errors in a NICU
  1. Kevin M Sullivan1,
  2. Sanghee Suh2,
  3. Heather Monk3,
  4. John Chuo4,5
  1. 1Department of Pediatrics, Nemours Neonatology, AI duPont Hospital for Children, Wilmington, Delaware, USA
  2. 2Virginia Tech Carilion School of Medicine, Roanoke, Virginia, USA
  3. 3School of Medicine, The Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
  4. 4Department of Neonatology, University of Pennsylvania, Philadelphia, Pennsylvania, USA
  5. 5Department of Neonatology, The Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
  1. Correspondence to Dr John Chuo, University of Pennsylvania, Neonatal Quality Officer, Children's Hospital of Philadelphia, 2NW2428 Civic Center Blvd, Philadelphia, PA 19104, USA; chuoj{at}email.chop.edu

Abstract

Objective Neonates are at high risk for significant morbidity and mortality from medication prescribing errors. Despite general awareness of these risks, mistakes continue to happen. Alerts in computerised physician order entry intended to help prescribers avoid errors have not been effective enough. This improvement project delivered feedback of prescribing errors to prescribers in the neonatal intensive care unit (NICU), and measured the impact on medication error frequency.

Methods A front-line multidisciplinary team doing multiple Plan Do Study Act cycles developed a system to communicate prescribing errors directly to providers every 2 weeks in the NICU. The primary outcome measure was number of days between medication prescribing errors with particular focus on antibiotic and narcotic errors.

Results A T-control chart showed that the number of days between narcotic prescribing errors rose from 3.94 to 22.63 days after the intervention, an 83% improvement. No effect in the number of days between antibiotic prescribing errors during the same period was found.

Conclusions An effective system to communicate mistakes can reduce some types of prescribing errors.

  • Quality improvement
  • Communication
  • Safety culture
  • Audit and feedback
  • Medication safety

This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/3.0/ and http://creativecommons.org/licenses/by-nc/3.0/legalcode

https://doi.org/10.1136/bmjqs-2012-001089

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Introduction

    A 1999 report by the Institute of Medicine estimated as many as 98 000 individuals die annually in hospitals as a result of medical errors.1 In a random sampling of 30 000+ medical records by the Harvard Medical Project, as many as 19% of the 1133 adverse events found were medication related.2 Despite efforts to solve this problem, medication-related adverse events continue to be highly prevalent and particularly harmful to a rapidly growing neonatal population.3 ,4 Medication prescribing errors, the focus of this report, are a significant contributor to medication-related adverse events. The need to pay attention to rapidly changing weights and drug dosing based on multiple parameters, such as weight and gestational age, as neonatal prescribing requires vigilance both at dose initiation and maintenance to reduce medication errors.5–8

    Doing ‘the five rights (right drug to the right patient, at the right dose, route and time)’ of medication management remains a huge challenge especially for prescribers. Aside from being the most frequent type of medication errors, prescribing errors have significant downstream effects. In our institution, it is common for the pharmacy to process approximately 34 orders per hour; since resolving a prescribing error takes an estimated 15 min, each prescribing error can, potentially, delay processing of as many as seven other medications. In addition, reconciling prescribing errors adds error opportunities by causing workflow interruption and distractions for pharmacist and prescribers. By the time errors are intercepted downstream, significant operational cost (time, resources and personnel) has been wasted.

    Alerts built into computerised physician order entry (CPOE) systems have made significant progress in preventing prescribing errors. But stifled by unintended negative consequences and high degrees of alert override,9 ,10 they have not been as effective in preventing prescribers from making errors, as previously hoped.11–13 An alternative strategy worth exploring in the prevention of errors is the use of performance feedback to help providers prescribe more carefully.

    Published literature, and our experience, indicate that there is low self-awareness of how many errors prescribers make.14 ,15 Hence, informing prescribers about specific errors they have made, and how to avoid them in the future, may be an important step to engaging them into a team effort to reduce prescribing errors. The importance of feedback and reminders in efforts to improve compliance with clinical care guidelines has been emphasised by published literature.16 ,17 To this point, similar approaches for safe practice guidelines show that direct constructive feedback to prescribers about their errors, and ways to avoid them in the future, can reduce errors.7 ,18–20 Some literature suggests that delivering feedback closer to the moment of action has more impact on the recipient.21 ,22

    The purpose of this paper is to report the development of a prescribing error feedback programme, and its impact on narcotic prescribing errors. We also discuss how an approach to synergise appropriate personnel, processes and tools was important to the programme's successful implementation.

    Local setting and problem

    This study took place in a major 75-bed neonatal intensive care unit (NICU) regional referral centre. The unit uses an electronic health record system with computerised order entry capabilities. The existing CPOE alerts have limited impact, as demonstrated by high override rates similar to the reported literature. Although an electronic formulary is available on the intranet, it cannot be accessed directly from the CPOE system when it is most needed during order entry. On average, 195 medications are prescribed per day by residents, nurse practitioners, physician assistants and attending physicians in the NICU. Everyday, pharmacists review these orders in addition to approximately 3200 other orders from other hospital units, processing approximately 34 orders per hour. Within this hour, the pharmacists have the arduous task of detecting any prescribing errors and calling prescribers for clarification or correction. These ‘incidents’ are recorded in an electronic database that can be queried for quality control activities.

    Review of prescribing errors indicated that most errors were associated with narcotics—an Institute for Safe Medication Practices-defined high-alert medication. Although pharmacists intercept most narcotic errors, those that reach neonates can cause respiratory and neurological depression leading to emergent intubation and mechanical ventilation. Therefore, reducing narcotic errors was an important safety goal of this project.

    Materials and methods

    Contextual barriers

    Lukewarm prescriber acceptance and buy-in to the feedback was a critical obstacle to overcome. One provider questioned ‘Why do we need this summary information every 2 weeks when pharmacists already call us for each error?’ ‘Will this go into my evaluation record?’ In order to maintain confidentiality, all feedback communications about prescribing errors remained within the institution firewall system, and all titles and names were removed. No error information was recorded in anyone's evaluation files. We emphasised feedback as an informative tool that offered a deeper review of error themes across all prescribers, which cannot be done on an event-by-event basis. We considered using screensavers to publicly display our findings in the unit, but believed that although this would best alert bedside nurses of prescribing error vulnerabilities, the psychosocial impact on parents were unknown. Hence, our team opted to limit feedback to individuals until we can better understand how such knowledge can best be communicated publicly.

    Intervention development

    We employed the model for improvement to create, develop and refine the feedback intervention from September 2009 to February 2010 before implementing it in March 2010.23 Our multidisciplinary team consisted of a dedicated neonatal pharmacist with several years of experience, a neonatal fellow, a research assistant and an attending neonatologist who was also the improvement advisor. The team also frequently engaged groups of residents and frontline clinicians to understand the prescribing process and determine the best feedback strategy and content.

    The team identified four primary drivers (‘must do's’) for a successful error feedback programme as (1) maximise error reporting, (2) optimise data analysis, (3) determine best feedback strategy and (4) ensure bidirectional communication between prescriber and feedback team. Since the pharmacy was already reporting prescribing errors with high regularity into a database, we focused on improving the latter three drivers (figure 1).

    Figure 1
    Figure 1

    Three critical project drivers and their related Plan Do Study Act cycles.

    Optimise data analysis (PDSA ramp #2)

    Identifying the true prescribing errors from the many pharmacy interventions recorded in the pharmacy database was a challenge. The first Plan Do Study Act (PDSA) cycle tested an electronic dashboard tool that filtered the raw error data from the database. We learned (1) the dashboard was too cumbersome for the pharmacist to use and (2) the pharmacist was able to accomplish the same task by modifying her existing workflows. The second PDSA cycle tested the new workflow, and by the third PDSA cycle, the process for identifying individual prescriber's prescribing errors from the database was streamlined, choosing specificity over sensitivity in order to minimise false positive feedbacks. The implementation team (one pharmacist, one neonatal attending, one neonatal fellow, one research assistant) met biweekly to review all prescribing errors and determine how the feedback message should be worded in order to minimise ‘blame’, offer constructive recommendations, and encourage prescriber responses.

    Determining feedback delivery strategy (PDSA ramp #3)

    We conducted a series of PDSA cycles with provider groups to test iterative versions of the feedback strategy in order to refine its content and presentation. We learned that carefully structured electronic emails that were short, personal, informative and constructive worked best. To maximise read, the message was placed within the body of the email instead of an attachment. The subject line was consistently the same, emphasising medication safety. We avoided reporting summary data, but rather gave details of specific errors and advice on how to avoid them in the future. A disclaimer (created by residents) reinforced the non-punitive intent of the feedback and invited comments from prescribers. In total, two emails detailing specific errors and recommendations were sent out biweekly: (1) ‘General Feedback on error trends and themes’ sent to all fellows, nurse practitioners and physician assistants and (2) the ‘individual feedback’ sent to individual frontline clinicians prescribing the errors. Although residents were initially excluded for logistic reasons, they were included several months later to receive the general feedback.

    Ensuring bidirectional communication (PDSA ramp #4)

    Each email invited prescribers to voice their concerns about potential system issues that contributed to errors. We investigated these concerns and quickly consulted the process owners of these systems, and together made efforts to improve the system.

    Implementation

    The implementation team educated frontline fellows, nurse practitioners and physician assistants on the intent and content of the feedback programme using emails and in-person meetings, and encouraged responses regarding system vulnerabilities. Many frontline members were already familiar with the feedback programme, having been involved with its development. The system was implemented in March 2010. Every 2 weeks, the team reviewed prescribing errors, looked for common error themes, and sent out the feedback communications. Table 1 contains examples of prescription errors and the feedback provided.

    View this table:
    Table 1

    Sample prescription errors

    Evaluation and analysis

    The primary outcome was number of days between narcotic errors and antibiotic prescribing errors. This outcome was represented over time in a time-to-event chart (t-chart), where the y-axis displayed the number of days between consecutive errors arranged in chronological order. The t-chart was chosen over a u-chart (i.e, error rates) for 2 reasons: (1) we were unable to consistently estimate the number of prescriptions (denominator) every 2 weeks and (2) the t-chart is designed to track rare events such as prescribing errors (approximately 0.5% to 1% of prescriptions in the NICU). T-chart control limits were calculated and Shewhart rules for special-cause signals were applied to identify significant shifts in the mean and trends of days between errors. Interventions were directly annotated onto the charts.

    To assess whether emails were read (ie, process metric), our team utilised the ‘Read Reply’ function in the email system. The percentage of responses was measured over time by calculating the number of responses over the total number of prescribers who received the email. The email was re-sent to those who did not respond. As a balancing metric, we also tracked the time required to (1) identify and discuss errors and (2) construct and send the emails.

    Results

    A prescribing error feedback programme was successfully implemented by using the model for improvement for its development and refinement, and engaging frontline clinicians in the process. The final iteration of the prescriber error feedback programme synergised (1) personnel (ie, a multidisciplinary implementation team), (2) process (ie, for analysing data and delivering feedback) and (3) tools (the pharmacy's electronic prescriber error database and email system). Figure 2 is a swim-lane process diagram illustrating how the synergy worked, delivering reports to prescribers that summarised (1) trends in prescribing errors happening in the NICU and (2) their own errors over the preceding 2 weeks.

    Figure 2
    Figure 2

    Prescriber feedback workflow process (A) prescriber enters order, (B) pharmacist reviews and discovers error, (C) team reviews error database every 2 weeks, (D) feedback messages created and sent to prescriber, (E) prescriber receives, reads and may respond to the feedback, (F) team reviews and uses feedback to improve system.

    Over the 17 months of the study, pharmacy-intercepted narcotic prescription errors were reduced by 83% after the programme began, increasing the number of days between errors from 3.94 to 22.63 days (figure 3). This sustained improvement triggered a special-cause signal on the control chart. Most errors were related to dosing. The antibiotic prescribing error rate was unchanged over the study with an average of 2.14 days between errors (figure 4). As a control for the ‘opportunity for error’, we were unable to identify the number of daily orders, but as a surrogate, did track average daily census per month. The census, on average, increased over the length of the study with a minimum of 63.2 patients in April 2010 and 74.9 in December 2010.

    Figure 3
    Figure 3

    Days between pharmacy-intercepted narcotic prescribing errors. Feedback program implemented 3 January 2010 in the setting of other initiatives (hospital safety behaviour training, and verbalise medication units completely during rounds).

    Figure 4
    Figure 4

    Days between pharmacy-intercepted antibiotic prescribing errors Feedback program implemented 3 January 2010 in the setting of other initiatives.

    The email read reply rate was 8% initially and reached a steady state of 40%. Reviewing the error database and verifying true errors took the pharmacist, on average, 1 h and 15 min. The team's discussion on errors and appropriate feedback content took, on average, 13 min and 5 s weekly. Sending group and individual emails took, on average, 18 min and 57 s. In total, the average time spent in the feedback of medication errors to prescribers was 1 h 43 min and 16 s every 2 weeks.

    This programme allowed opportunities for prescribers to voice their concerns about vulnerabilities in the prescribing process, resulting in changes to both the online formulary and computerised prescribing process. For instance, the option of ordering rotavirus vaccine intramuscularly in the CPOE was removed 1 week after a prescriber receiving feedback remarked that the CPOE system should never have allowed rotavirus vaccine to be ordered intramuscularly. In another example, specific education was done after prescribers expressed difficulty in navigating the electronic formulary.

    Implementation problems

    On occasion, when team members were unavailable for unforeseen reasons, parts of the process could not be carried out. Therefore, some critical processes in our feedback system require redundancies so the system can continue working when one part fails. Hence, cross-training among members of the team on sending emails, data management and facilitating meetings was conducted.

    Discussion

    Initiation of a prescriber-directed error feedback programme was associated with an 83% reduction in narcotic prescribing errors, an elimination of approximately 5–6 erroneous narcotic prescriptions per month. Interestingly, the rate of overall prescribing errors and antibiotic prescribing errors were unchanged.

    Feedback content is critical

    We have shown that feedback may reduce some types of prescribing errors if the information is concise and actionable. The timing, format and value of information to recipients are critical factors to consider when reporting errors.24 ,25 Adjusting the content and thematic delivery of the messages according to suggestions by prescribing recipients was critical. When prescribers found the message too long and complex, they read them less. Hence, shorter, more focused messaging appears to work best.

    Performance feedback and safety culture

    Feedback can prevent failures or defects in the patient care system, and it also contributes to a culture of safety within the unit. Past studies have shown that audit and feedback can provide the framework for a proactive safety culture. Jenkins et al showed that a multiprofessional regional quality improvement network of NICUs in Ireland provided the framework for a culture of regular evaluation leading to increased awareness among clinicians.26 Carefully implemented real-time patient safety audits can foster a blame-free ‘culture of patient safety’.27 Individualised feedback helps prescribers learn directly from their mistakes, while group feedback permits the entire unit to learn from each other. Encouraging providers to respond to the feedback completes a full circle of shared responsibility, and generates unit and hospital-wide changes to the formulary and CPOE system. Furthermore, feedback provided a vector to communicate and highlight vulnerabilities in medication safety that may change over time.

    Performance feedback works, sometimes

    While performance feedback helped reduce narcotic prescribing errors, the same feedback strategy did not reduce antibiotic prescribing errors and overall errors. Examination of workflow differences between narcotic and antibiotic prescribing suggests antibiotic ordering in the neonate requires more complex decision making, as one must take into account the patient's day of life, gestational age, dosing regimen, renal function and drug levels—and most antibiotic errors were related to improper accounting of these variables in dosing. Although the proper drug regimens are outlined in the electronic formulary, they are not easily available at the time of prescribing. In Reason's language of errors, antibiotic prescribing errors are likely ‘mistakes’ or errors where an action goes as intended but is the wrong one. Many narcotic prescribing errors were closely related—likely ‘lapses’ or ‘slips’ where there is an error of execution.28 We hypothesise that performance feedback may reduce errors of execution (ie, 10-fold overdoses) while having less of an impact on a multistep complex prescribing process such as antibiotic prescribing. From a systems standpoint, antibiotic prescribing may require additional system fixes, such as easier access to electronic formulary at the time of prescribing, to drive the desired behaviours.

    Limitations

    It is difficult to discern effects of other quality improvement work happening in the unit (ie, provider turnover, independent increase in safety behaviours) that may have contributed to decreasing the narcotic prescribing error rate. In the spirit of improvement, it would be counterproductive to halt coexisting improvement efforts. Prior to this study, there was a unit-wide effort to change communication around narcotic prescribing on rounds by emphasising correct units. The change in narcotic prescribing errors, however, did not occur until several weeks after this initiative, making it less likely to be the primary reason for improvement.

    Coincident to this study, there was an organisational push, and outside consultants were brought into the hospital to promote overall safety behaviours. To this end, we would have expected an overall reduction in prescribing and antibiotic errors. It is possible that the complexity of prescribing a certain medication (ie, antibiotics vs narcotic) is important in shaping the impact of improvement efforts. Of note, although residents continued to rotate through the unit on a monthly schedule, their class and patient load remained consistent throughout the course of the study. There was also minimal turnover in the other direct care providers and physicians.

    Our process metric has limitations. We utilised the ‘read report’ function in the email system, and although there was significant discussion within the unit regarding the emails, our read-response rate remained below our goal. Furthermore, our process metric, although documenting the receipt of an email does not confirm full reading and comprehension of the material. It is difficult to verify whether those who did not ‘read reply’ indeed, did not read the emails, since this method relied on the receiver to ‘actively read reply’.

    Our analysis did not stratify by prescriber's role and level of training and, therefore, cannot determine whether any particular type of prescriber made most of the errors. In addition, we would have liked to understand the errors in various NICU populations, level of acuity and census. We are currently building the necessary data infrastructure to enable such analysis.

    Conclusion

    In conclusion, direct provider feedback on medication prescribing errors does not require significant time investment, it can be performed in a non-punitive manner, and may decrease the incidence of narcotic prescribing errors.

    Acknowledgments

    We would like to acknowledge our appreciation to Sandra Murray, Robert Lloyd and Clifford Norman for their expertise and guidance on quality improvement methods. We would like to give many thanks to Seema Samuel for her invaluable contribution to the testing and implementation of this feedback system.

    References

    1. ↵
      1. Kohn L,
      2. Corrigan J
      . Crossing the quality chasm: a new health system for the 21st century. Washington, DC: National Academy Press, 2001.
    2. ↵
      1. Leape LL,
      2. Brennan TA,
      3. Laird N,
      4. et al
      . The nature of adverse events in hospitalized patients. Results of the Harvard Medical Practice Study II. N Engl J Med 1991;324:377–84.
      OpenUrlCrossRefPubMedWeb of Science
    3. ↵
      1. Gray JE
      . Medication errors in the neonatal intensive care unit: special patients, unique issues. Arch Dis in Child Fetal Neonatal Ed 2004;89:F472–3.
      OpenUrlCrossRef
    4. ↵
      1. Stavroudis TA,
      2. Shore AD,
      3. Morlock L,
      4. et al
      . NICU medication errors: identifying a risk profile for medication errors in the neonatal intensive care unit. J Perinatol 2010;30:459–68.
      OpenUrlCrossRefPubMedWeb of Science
    5. ↵
      1. Agalu A,
      2. Ayele Y,
      3. Bedada W,
      4. et al
      . Medication prescribing errors in the intensive care unit of Jimma University Specialized Hospital, Southwest Ethiopia. J Multidiscip Healthc 2011;4:377–82.
      OpenUrlPubMed
    6. ↵
      1. Lesar TS,
      2. Lomaestro BM,
      3. Pohl H
      . Medication-prescribing errors in a teaching hospital: a 9-year experience. Arch Intern Med 1997;157:1569–76.
      OpenUrlCrossRefPubMedWeb of Science
    7. ↵
      1. Campino A,
      2. Herrera ML
      . Educational strategy to reduce medication errors in a neonatal intensive care unit. Acta Paediatr 2009;98:782–5.
      OpenUrlCrossRefPubMedWeb of Science
    8. ↵
      1. Kunac DL,
      2. Reith DM
      . Identification of priorities for medication safety in neonatal intensive care. Drug Safety 2005;28:251–61.
      OpenUrlCrossRefPubMedWeb of Science
    9. ↵
      1. Chused AE,
      2. Kuperman GJ,
      3. Stetson PD
      . Alert override reasons: a failure to communicate. AMIA Annu Symp Proc 2008;111–15.
    10. ↵
      1. Van Der Sijs H,
      2. Aarts J,
      3. Vulto A
      . Overriding of drug safety alerts in computerized physician order entry. J Am Med Inform Assoc 2006;13:138–47.
      OpenUrlAbstract/FREE Full Text
    11. ↵
      1. Van der Sijs H,
      2. van Gelder T,
      3. Vulto A,
      4. et al
      . Understanding handling of drug safety alerts: a simulation study. Int J Med Inform 2010;79:361–9.
      OpenUrlCrossRefPubMedWeb of Science
    12. ↵
      1. Sheehan B,
      2. Stetson P,
      3. Wilcox A,
      4. et al
      . Sociotechnical analysis of a neonatal ICU in the context of CPOE. AMIA Annu Symp Proc; 2008;1129.
    13. ↵
      1. Cheng CH,
      2. Goldstein MK,
      3. Geller E,
      4. et al
      . The Effects of CPOE on ICU workflow: an observational study. AMIA Annu Symp Proc; 2003;150–4.
    14. ↵
      1. Dean B,
      2. Schachter M,
      3. Vincent C
      . Causes of prescribing errors in hospital inpatients: a prospective study. Lancet 2002;359:1373–8.
      OpenUrlCrossRefPubMedWeb of Science
    15. ↵
      1. Leape L,
      2. Bates D,
      3. Cullen D
      . Systems analysis of adverse drug events. JAMA 1995;274:35–43.
      OpenUrlCrossRefPubMedWeb of Science
    16. ↵
      1. Dijkstra R,
      2. Wensing M,
      3. Thomas R,
      4. et al
      . The relationship between organisational characteristics and the effects of clinical guidelines on medical performance in hospitals, a meta-analysis. BMC Health Serv Res 2006;6:53.
      OpenUrlCrossRefPubMed
    17. ↵
      1. Grimshaw JM,
      2. Thomas RE,
      3. MacLennan G,
      4. et al
      . Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess 2004;8:iii–iv, 1–72.
      OpenUrlPubMed
    18. ↵
      1. Dean B
      . Learning from prescribing errors. Qual Saf Health Care 2002;11:258–60.
      OpenUrlAbstract/FREE Full Text
    19. ↵
      1. Franklin G,
      2. Powell J,
      3. Emami-Naeini A
      . Feedback control of dynamic systems. vol. 10. Ann Arbor: Pearson, 2010.
    20. ↵
      1. Gaynes R,
      2. Richards C,
      3. Edwards J
      . Feeding back surveillance data to prevent hospital-acquired infections. Emerging Infectious Dis 2001;7:295–8.
      OpenUrlCrossRefPubMedWeb of Science
    21. ↵
      1. Schramm G,
      2. Kashyap R,
      3. Mullon J
      . Septic shock: A multidisciplinary response team and weekly feedback to clinicians improve the process of care and mortality. Critical Care Med 2011;39:252–8.
      OpenUrlCrossRefPubMedWeb of Science
    22. ↵
      1. Jacques PS
      . Enhancing Point of Care Vigilance Using Computers. Anesthesiol Clin 2011;29:505–19.
      OpenUrlCrossRefPubMed
    23. ↵
      1. Langley GJ,
      2. Moen RD,
      3. Nolan KM
      . The improvement guide: a practical approach to enhancing organizational performance. 2nd edn. San Francisco: Jossey-Bass, 2009.
    24. ↵
      1. Jamtvedt G,
      2. Young JM,
      3. Kristoffersen DT,
      4. et al
      . Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev 2003;(3):CD000259.
    25. ↵
      1. Utley M,
      2. Gallivan S,
      3. Jacklin A,
      4. et al
      . Providing feedback to hospital doctors about prescribing errors; a pilot study. Pharmacy World Science 2007;29:213–20.
      OpenUrlCrossRefPubMedWeb of Science
    26. ↵
      1. Jenkins J,
      2. Alderdice F,
      3. McCall E
      , Neonatal Intensive Care Outcomes Research and Evaluation (NICORE) Group. Improvement in neonatal intensive care in Northern Ireland through sharing of audit data. Qual Saf Health Care 2005;14:202–6.
      OpenUrlAbstract/FREE Full Text
    27. ↵
      1. Ursprung R,
      2. Gray JE,
      3. Edwards WH,
      4. et al
      . Real time patient safety audits: improving safety every day. Qual Saf Health Care 2005;14:284–9.
      OpenUrlAbstract/FREE Full Text
    28. ↵
      1. Reason JT
      . Human error. Cambridge: Cambridge University Press, 1990.

    Footnotes

    • Contributors KMS,  SS, HM and JC each made substantial contributions to conception and design, acquisition of data, analysis and interpretation of the data. All participated in drafting the article or revising it critically for important intellectual content, and participated in the final approval of the version to be published.

    • Funding This project, in part, has been funded by the Pennsylvania Department of Welfare Hospital Quality Care Investment Grant Programme.

    • Competing interests None.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Open Access This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 3.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/3.0/