Skip to main content

The SURgical PAtient Safety System (SURPASS) checklist optimizes timing of antibiotic prophylaxis

Abstract

Background

Surgical site infection (SSI) is an adverse event in which a close relation between process of care and outcome has been demonstrated: administration of antibiotic prophylaxis decreases the risk of SSI. In our tertiary referral centre, a SURgical PAtient Safety System (SURPASS) checklist was developed and implemented. This multidisciplinary checklist covers the entire surgical pathway and includes, among other items, administration of antibiotic prophylaxis before induction of anaesthesia. The aim of this study was to determine the effect of SURPASS implementation on timing of antibiotic prophylaxis.

Methods

A retrospective analysis was performed on two cohorts of patients: one cohort of surgical patients that underwent surgery before implementation of the checklist and a comparable cohort after implementation. The interval between administration of antibiotic prophylaxis and incision was compared between the two cohorts.

Results

A total of 772 surgical procedures were included. More than half of procedures were gastro-intestinal; others were vascular, trauma and hernia repair procedures. After implementation, the checklist was used in 81.4% of procedures. The interval between administration of antibiotic prophylaxis and incision increased from 23.9 minutes before implementation of SURPASS to 29.9 minutes after implementation (p = 0.047). In procedures where the checklist was used, the interval increased to 32.9 minutes (p = 0.004). The proportion of patients that did not receive antibiotics until after the incision decreased significantly.

Conclusion

The use of the SURPASS checklist leads to better compliance with regard to the timing of antibiotic prophylaxis administration.

Introduction

Surgical site infection (SSI) is a common complication of surgery: reported incidence rates range from 2% to 20%, the variation largely depending on case mix [1–3]. SSIs are a major cause of morbidity, mortality and healthcare costs [4–6]. While in many adverse events, the connection between process of care and outcome is hard to define, this is not the case with SSI. Among many process measures that decrease SSI rates, the effect of preoperative administration of antibiotic prophylaxis (AP) has been demonstrated most extensively [7–10].

Much has been written about the optimal time frame of AP. Studies suggest that AP administration should be as close to the incision as possible, while agreeing that some time must be allowed for adequate tissue concentration to be built up [11–13]. In 1992, Classen et al showed that the greatest risk reduction for SSI occurred when antibiotics were administered within two hours before the incision, as opposed to administration after incision or more than two hours prior to the incision [14]. Since then, a number of studies have been published that attempted to further define this interval [15–18]. A recent publication by Weber et al included 3,836 general surgical procedures; the greatest risk reduction occurred when antibiotics were administered between 30 and 60 minutes prior to the incision [18]. In contrast, a study by Steinberg et al, including 4,472 cardiac, orthopaedic and gynaecological patients, showed that the risk of SSI was lowest when antibiotics were administered within the final 30 minutes pre-incision, a difference that did not reach statistical significance [16].

Most guidelines recommend administration within one to two hours of incision [19–21]. However, the practical implementation of these recommendations has been shown to be difficult [22–27]. In some settings, antibiotics have been administered too early [28–30]; in most, too late or not at all [22, 23, 25].

To increase standardization in the surgical pathway and improve surgical patient safety, a SURgical PAtient Safety System (SURPASS) checklist was developed using all relevant literature and subsequently validated by observation of the surgical pathway and practical evaluation [31]. This multidisciplinary checklist covers the entire surgical pathway and includes, among many other items, administration of AP in the operating room before induction of anaesthesia. The aim of this study was to determine the effect of SURPASS implementation on timing of AP.

Methods

Setting

This study was performed in a tertiary referral centre. In this centre, AP is given in the operating room (OR) and the standard for the timing of AP is ≥30 minutes before the incision. Most commonly, the anaesthesiologist will insert an intravenous line once the patient has arrived in the operating room. Before the implementation of the checklist, in some cases, antibiotics would be administered by the anaesthesiologist at the start of induction. More often, antibiotics would not be administered until the start of surgery, when the surgeon ordered AP to be given.

Implementation

Over the course of a year (Jan-Dec 2008), the entire SURPASS checklist was implemented in a step-by-step fashion in the surgical wards and operating rooms. From January 2008 onwards, the time out part of SURPASS was implemented in the OR. This part consists of a short discussion to be performed in the operating room before induction of anaesthesia. One of the 16 items to be checked by the surgeon, anaesthesiologist and operating assistant during this discussion is: 'Appropriate antibiotic prophylaxis administered ≥30 minutes before incision'. All completed checklists were prospectively registered in the electronic registration system in use in the operating rooms.

Study design

A retrospectively defined cohort of patients that underwent surgery prior to the implementation of the checklist was compared to a cohort that underwent surgery after implementation. For two three-month periods (October-December 2007 vs. October-December 2008), all surgical procedures where AP was indicated by protocol were analysed. Both elective and urgent procedures were included. In the post-intervention cohort, all procedures were included, whether or not the checklist had been used. This strategy was chosen in order to provide a realistic estimate of the potential effect of the intervention, taking into account a less than 100% compliance rate.

Data collection

Registration of data was partly prospective. For all procedures, the time of incision was extracted from the electronic registration system in use in the operating rooms. In 2008, an electronic patient data management system was implemented for the anaesthesiologists in the OR and recovery room. For the post-intervention cohort, data on timing and choice of antibiotics were extracted from these electronic anaesthesia records. For the pre-intervention cohort, data on timing and choice of antibiotics were extracted from the paper anaesthesia records. Reliability of retrospectively collected data was checked by observation of a new sample of procedures, in which actual times of antibiotic administration and incision were compared to electronically registered times.

Analysis

Intervals between administration of AP and incision were calculated. The means of the two cohorts were compared using the independent samples T test. In addition, the proportion of patients that received AP after the incision was assessed and the difference between the two cohorts was calculated using the Chi-Square test.

In a second analysis, all procedures where the checklist had not been used were excluded from the post-intervention cohort, to identify the actual effect of the checklist in case of a 100% compliance rate. All statistical analyses were two-tailed and values of p < 0.05 were considered significant. The analyses were completed using Statistical Package for the Social Sciences version 15.0 (SPSS®, Chicago, Illinois, USA).

Results

A total of 772 surgical procedures were included (figure 1). In the post-implementation cohort, the checklist was actually used in 328 of 403 procedures (81.4%). Patient characteristics are listed in table 1. More than half of procedures were gastro-intestinal; others being vascular, trauma and hernia repair procedures. Data on antibiotic prophylaxis were available in 729 procedures. The percentage of patients that did not receive antibiotics did not differ between the two groups (table 1). Most patients (45.7%) received cefuroxime and clindamycin; a third of patients received a single dose of cefuroxime.

Figure 1
figure 1

Flowchart of inclusion before and after checklist implementation.

Table 1 Patient characteristics and antibiotic prophylaxis.

To validate the time points that were collected from the electronic databases, a sample of 44 procedures was observed. The median difference between registered and observed time of antibiotic administration was -1.0 minute (interquartile range (IQR) -6.6 to 4.0), and the median difference between registered and observed time of incision was -0.5 minutes (IQR -2.0 to 1.0).

Data on timing of antibiotic prophylaxis was available in 590 procedures. The mean interval between administration of AP and incision increased from 23.9 minutes (standard deviation 37.1) before implementation of the checklist to 29.9 minutes (standard deviation 31.9) after implementation (p = 0.047) (figure 2). The proportion of patients that did not receive antibiotics until after the incision decreased from 12.1% to 7.1% (p = 0.04).

Figure 2
figure 2

Interval between antibiotics administration and incision before and after implementation of SURPASS.

When looking only at procedures where the checklist was actually used, the post-implementation interval increased to 32.2 minutes (p = 0.006; figure 3). In this cohort, the proportion of patients that did not receive antibiotics until after the incision decreased to 6.0% (p = 0.015).

Figure 3
figure 3

Interval between antibiotics administration and incision when looking only at procedures where the checklist was actually used.

Discussion

Although it has been shown repeatedly that timely administration of AP decreases the incidence of SSI, the implementation of this knowledge into daily practice remains problematic. This study showed that implementation of a comprehensive surgical safety checklist (SURPASS) significantly improved compliance with hospital standards for timing of AP administration. The proportion of patients that did not receive antibiotics until after the incision decreased significantly.

Remarkably, the proportion of patients that did not receive AP, thus deviating from protocol, did not change. This might reflect deliberate divergence from protocol, as there were no differences in case mix before and after implementation. The inclusion criteria were based on groups of surgical procedures, without taking into account individual patient characteristics. In the 10% of patients that did not receive antibiotic prophylaxis, this might well have been a deliberate and well-considered choice, for example in the case of correction of a ventral hernia, where antibiotic prophylaxis is not always mandatory.

The checklist was not always used correctly: since the item on the checklist reads: 'Appropriate antibiotic prophylaxis administered ≥30 minutes before incision', one would expect AP to have been administered at least 30 minutes before incision in all procedures where the checklist had been used. This was obviously not the case. Apparently, the item was sometimes completed before AP had been administered and the 30 minute interval could not be guaranteed afterwards. This suboptimal way of checklist use might be solved with more education.

The optimal AP-incision interval to prevent SSIs has not been firmly established yet. Over 30 years ago, it was shown that administration within 1 hour prior to the incision yielded better results than administration 8 to 12 hours before incision [32]. In 1992, Classen et al showed that administration within two hours to incision is preferable to administration before or after this period [14]. Two recent studies attempting to further define this interval presented conflicting results [16, 18]. However, all available studies agree that AP administration after incision is undesirable; the SURPASS significantly decreased the proportion of patients receiving AP after incision. In addition, the mean AP-incision interval increased to within hospital standards.

Other studies have described interventions to improve timing of AP administration, usually in the context of multiple simultaneous interventions to decrease SSI rates. In a multicentre improvement project, a number of interventions were performed, consisting mostly of educational activities and generation of feedback data [24]. In that study, the proportion of patients receiving antibiotics within one hour preoperatively improved by 15%. Another quality improvement project focused mainly on changes in workflow management and the assignment of responsibilities [27]. Compliance with national guidelines improved by 20%. In an orthopaedic setting, timely administration of AP was added to a time out protocol to prevent wrong site surgery, leading to a 34% increase in the proportion of patients that received antibiotics within one hour preoperatively [25]. The intervention last mentioned resembles the present study, although one crucial difference is that the time out procedure described by Rosenberg et al takes place just before the incision, whereas the time out procedure included in the SURPASS checklist must be performed before the start of anaesthesia. This by itself can lead to an interval of at least 30 minutes in most procedures (assuming the checklist is used correctly), in particular in centres with more complex surgery, where anaesthetic preparation can take a considerable amount of time.

Although SURPASS is the only validated comprehensive checklist for the entire surgical patient pathway, another surgical checklist consisting of an extended time out procedure was recently described by a working party of the World Health Organization [33]. One of the items on that checklist was 'administration of AP within 60 minutes of incision', but this item was not checked until directly before incision. The authors report that mean rates of AP administration rose from as low as 56.1% (with a lower range of 18.1%) to 82.6%, and that SSI rates dropped from 6.2% to 3.4%. However, this study included a number of low-income countries with high baseline rates of SSI, where the effect of using proper AP to start with would have had a large impact. Considering the baseline SSI rate of approximately 5% and the baseline AP compliance rate of 90% in our centre, the number of patients included in the present study was too small to be able to detect a relevant influence of the checklist on SSI rates.

This study has several limitations. First, it is a before-after study: any change that was observed might have been influenced by secular changes, for example, the introduction of electronic anaesthesia records. However, we have no reason to suspect the introduction of electronic anaesthesia records had any influence on timing or recording of antibiotic prophylaxis, as it was merely a registration system and did not provide any prompts. In addition, a randomized study was not feasible because in interventions that aim to change human behaviour, there will always be contamination between intervention and control arm: whether consciously or not, the care that is provided to non-checklist patients will be influenced by the checklist. A parallel design comparing different hospitals would have been hampered by uncertainties related to inter-hospital and case mix differences. Second, the difference in data collection regarding timing of antibiotics before and after the intervention might have been of influence. In the pre-intervention cohort (paper records), data on timing of AP were missing in 73 patients, whereas, in the post-intervention cohort (electronic records), data were available in all but 4 patients. However, a difference in timing between procedures where data on timing were available and procedures where these data were not available, was deemed unlikely. Third, the fact that data on timing were collected retrospectively might render them less reliable; however, method validation in a separate small cohort comparing electronic recording with simultaneous observation showed negligible differences. Fourth, and most importantly, the effect of the SURPASS checklist on patient outcomes such as SSI's was not assessed in this study, because the numbers were too small to be able to detect a decrease in SSI's. Whether the implementation of SURPASS will lead to a decrease in SSI's will have to be tested in a much larger cohort of patients.

Conclusions

In this study, implementation of the multidisciplinary SURPASS checklist improved compliance with hospital standards for the timing of antibiotic prophylaxis. The proportion of patients that did not receive antibiotics until after the incision decreased significantly.

The checklist is currently being adopted in numerous hospitals, both in the Netherlands and in other European countries.

References

  1. Auerbach A: Prevention of surgical site infections. Making health care safer: a critical analysis of patient safety practices. Evidence report/technology assessment no. 43. AHRQ publication no. 01-E058: 221-44. Edited by: Shojania KG, Duncan BW, McDonald KM, et al. 2001, Rockville, MD: Agency for Healhcare Research and Quality

    Google Scholar 

  2. Burke JP: Infection control - a problem for patient safety. N Engl J Med. 2003, 348: 651-656. 10.1056/NEJMhpr020557.

    Article  PubMed  Google Scholar 

  3. Gaynes RP, Culver DH, Horan TC, Edwards JR, Richards C, Tolson JS: Surgical site infection (SSI) rates in the United States, 1992-1998: the National Nosocomial Infections Surveillance System basic SSI risk index. Clin Infect Dis. 2001, 33 (Suppl 2): S69-S77. 10.1086/321860.

    Article  PubMed  Google Scholar 

  4. Astagneau P, Rioux C, Golliot F, Brucker G: Morbidity and mortality associated with surgical site infections: results from the 1997-1999 INCISO surveillance. J Hosp Infect. 2001, 48: 267-274. 10.1053/jhin.2001.1003.

    Article  CAS  PubMed  Google Scholar 

  5. Kirkland KB, Briggs JP, Trivette SL, Wilkinson WE, Sexton DJ: The impact of surgical-site infections in the 1990s: attributable mortality, excess length of hospitalization, and extra costs. Infect Control Hosp Epidemiol. 1999, 20: 725-730. 10.1086/501572.

    Article  CAS  PubMed  Google Scholar 

  6. Perencevich EN, Sands KE, Cosgrove SE, Guadagnoli E, Meara E, Platt R: Health and economic impact of surgical site infections diagnosed after hospital discharge. Emerg Infect Dis. 2003, 9: 196-203.

    Article  PubMed Central  PubMed  Google Scholar 

  7. Bratzler DW, Houck PM, Richards C, Steele L, Dellinger EP, Fry DE, Wright C, Ma A, Carr K, Red L: Use of antimicrobial prophylaxis for major surgery: baseline results from the National Surgical Infection Prevention Project. Arch Surg. 2005, 140: 174-182. 10.1001/archsurg.140.2.174.

    Article  PubMed  Google Scholar 

  8. Nelson RL, Glenny AM, Song F: Antimicrobial prophylaxis for colorectal surgery. Cochrane Database Syst Rev. 2009, CD001181.

    Book  Google Scholar 

  9. Page CP, Bohnen JM, Fletcher JR, McManus AT, Solomkin JS, Wittmann DH: Antimicrobial prophylaxis for surgical wounds. Guidelines for clinical care. Arch Surg. 1993, 128: 79-88.

    Article  CAS  PubMed  Google Scholar 

  10. Song F, Glenny AM: Antimicrobial prophylaxis in colorectal surgery: a systematic review of randomized controlled trials. Br J Surg. 1998, 85: 1232-1241. 10.1046/j.1365-2168.1998.00883.x.

    Article  CAS  PubMed  Google Scholar 

  11. Bergamini TM, Polk HC: Pharmacodynamics of antibiotic penetration of tissue and surgical prophylaxis. Surg Gynecol Obstet. 1989, 168: 283-289.

    CAS  PubMed  Google Scholar 

  12. Burke JF: The effective period of preventive antibiotic action in experimental incisions and dermal lesions. Surgery. 1961, 50: 161-168.

    CAS  PubMed  Google Scholar 

  13. DiPiro JT, Vallner JJ, Bowden TA, Clark BA, Sisley JF: Intraoperative serum and tissue activity of cefazolin and cefoxitin. Arch Surg. 1985, 120: 829-832.

    Article  CAS  PubMed  Google Scholar 

  14. Classen DC, Evans RS, Pestotnik SL, Horn SD, Menlove RL, Burke JP: The timing of prophylactic administration of antibiotics and the risk of surgical-wound infection. N Engl J Med. 1992, 326: 281-286.

    Article  CAS  PubMed  Google Scholar 

  15. Hawn MT, Itani KM, Gray SH, Vick CC, Henderson W, Houston TK: Association of timely administration of prophylactic antibiotics for major surgical procedures and surgical site infection. J Am Coll Surg. 2008, 206: 814-819. 10.1016/j.jamcollsurg.2007.12.013.

    Article  PubMed  Google Scholar 

  16. Steinberg JP, Braun BI, Hellinger WC, Kusek L, Bozikis MR, Bush AJ, Dellinger EP, Burke JP, Simmons B, Kritchevsky SB: Timing of antimicrobial prophylaxis and the risk of surgical site infections: results from the Trial to Reduce Antimicrobial Prophylaxis Errors. Ann Surg. 2009, 250: 10-16. 10.1097/SLA.0b013e3181ad5fca.

    Article  PubMed  Google Scholar 

  17. van Kasteren ME, Mannien J, Ott A, Kullberg BJ, de Boer AS, Gyssens IC: Antibiotic prophylaxis and the risk of surgical site infections following total hip arthroplasty: timely administration is the most important factor. Clin Infect Dis. 2007, 44: 921-927. 10.1086/512192.

    Article  PubMed  Google Scholar 

  18. Weber WP, Marti WR, Zwahlen M, Misteli H, Rosenthal R, Reck S, Fueglistaler P, Bolli M, Trampuz A, Oertli D: The timing of surgical antimicrobial prophylaxis. Ann Surg. 2008, 247: 918-926. 10.1097/SLA.0b013e31816c3fec.

    Article  PubMed  Google Scholar 

  19. Bratzler DW, Houck PM: Antimicrobial prophylaxis for surgery: an advisory statement from the National Surgical Infection Prevention Project. Am J Surg. 2005, 189: 395-404. 10.1016/j.amjsurg.2005.01.015.

    Article  PubMed  Google Scholar 

  20. Mangram AJ, Horan TC, Pearson ML, Silver LC, Jarvis WR: Guideline for Prevention of Surgical Site Infection, 1999. Centers for Disease Control and Prevention (CDC) Hospital Infection Control Practices Advisory Committee. Am J Infect Control. 1999, 27: 97-132. 10.1016/S0196-6553(99)70088-X.

    Article  CAS  PubMed  Google Scholar 

  21. Stone HH, Haney BB, Kolb LD, Geheber CE, Hooper CA: Prophylactic and preventive antibiotic therapy: timing, duration and economics. Ann Surg. 1979, 189: 691-699. 10.1097/00000658-197906000-00004.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  22. Bull AL, Russo PL, Friedman ND, Bennett NJ, Boardman CJ, Richards MJ: Compliance with surgical antibiotic prophylaxis--reporting from a statewide surveillance programme in Victoria, Australia. J Hosp Infect. 2006, 63: 140-147. 10.1016/j.jhin.2006.01.018.

    Article  CAS  PubMed  Google Scholar 

  23. Castella A, Charrier L, Di LV, Pastorino F, Farina EC, Argentero PA, Zotti CM: Surgical site infection surveillance: analysis of adherence to recommendations for routine infection control practices. Infect Control Hosp Epidemiol. 2006, 27: 835-840. 10.1086/506396.

    Article  PubMed  Google Scholar 

  24. Dellinger EP, Hausmann SM, Bratzler DW, Johnson RM, Daniel DM, Bunt KM, Baumgardner GA, Sugarman JR: Hospitals collaborate to decrease surgical site infections. Am J Surg. 2005, 190: 9-15. 10.1016/j.amjsurg.2004.12.001.

    Article  PubMed  Google Scholar 

  25. Rosenberg AD, Wambold D, Kraemer L, Begley-Keyes M, Zuckerman SL, Singh N, Cohen MM, Bennett MV: Ensuring appropriate timing of antimicrobial prophylaxis. J Bone Joint Surg Am. 2008, 90: 226-232. 10.2106/JBJS.G.00297.

    Article  PubMed  Google Scholar 

  26. Tan JA, Naik VN, Lingard L: Exploring obstacles to proper timing of prophylactic antibiotics for surgical site infections. Qual Saf Health Care. 2006, 15: 32-38. 10.1136/qshc.2004.012534.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  27. White A, Schneider T: Improving compliance with prophylactic antibiotic administration guidelines. AORN J. 2007, 85: 173-180. 10.1016/S0001-2092(07)60023-4.

    Article  PubMed  Google Scholar 

  28. Galandiuk S, Polk HC, Jagelman DG, Fazio VW: Re-emphasis of priorities in surgical antibiotic prophylaxis. Surg Gynecol Obstet. 1989, 169: 219-222.

    CAS  PubMed  Google Scholar 

  29. Lizan-Garcia M, Garcia-Caballero J, sensio-Vegas A: Risk factors for surgical-wound infection in general surgery: a prospective study. Infect Control Hosp Epidemiol. 1997, 18: 310-315. 10.1086/647617.

    Article  CAS  PubMed  Google Scholar 

  30. Silver A, Eichorn A, Kral J, Pickett G, Barie P, Pryor V, Dearie MB: Timeliness and use of antibiotic prophylaxis in selected inpatient surgical procedures. The Antibiotic Prophylaxis Study Group. Am J Surg. 1996, 171: 548-552. 10.1016/S0002-9610(96)00036-0.

    Article  CAS  PubMed  Google Scholar 

  31. de Vries EN, Hollmann MW, Smorenburg SM, Gouma DJ, Boermeester MA: Development and validation of the SURgical PAtient Safety System (SURPASS) checklist. Qual Saf Health Care. 2009, 18: 121-126. 10.1136/qshc.2008.027524.

    Article  CAS  PubMed  Google Scholar 

  32. Stone HH, Hooper CA, Kolb LD, Geheber CE, Dawkins EJ: Antibiotic prophylaxis in gastric, biliary and colonic surgery. Ann Surg. 1976, 184: 443-452. 10.1097/00000658-197610000-00007.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  33. Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat AH, Dellinger EP, Herbosa T, Joseph S, Kibatala PL, Lapitan MC: A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009, 360: 491-499. 10.1056/NEJMsa0810119.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

Part of data presented as poster during the Annual Meeting of the Surgical Infection Society in Chicago, May 6th-9th 2009.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marja A Boermeester.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

EdV conceived of the study, analysed the data and wrote the first draft of the manuscript. LD collected the data, assisted in analysing the data and assisted in writing the first draft of the manuscript. SM participated in the design of the study. RM participated in the design of the study and facilitated data collection. MB conceived of the study, participated in the design and analysis and helped draft the manuscript. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

de Vries, E.N., Dijkstra, L., Smorenburg, S.M. et al. The SURgical PAtient Safety System (SURPASS) checklist optimizes timing of antibiotic prophylaxis. Patient Saf Surg 4, 6 (2010). https://doi.org/10.1186/1754-9493-4-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1754-9493-4-6

Keywords