Article Text
Abstract
Background: During sign-out (handover of care), information and responsibility about patients is transferred from one set of caregivers to another. Few residency training programmes formally teach resident physicians how to sign out or assess their ability to sign out, and little research has examined the sign-out process.
Objective: To characterise the effectiveness of the sign-out process between resident physicians on an acute care ward.
Design/methods: Resident physicians rotating on a paediatric acute care ward participated in a prospective study. Immediately after an on-call night, they completed a confidential survey characterising their night on call, the adequacy of the sign-out they received, and where they went to get information they had not received during sign-out.
Results: 158 of 196 (81%) potential surveys were collected. On 49/158 surveys (31%), residents indicated something happened while on call they were not adequately prepared for. In 40/49 instances residents did not receive information during sign-out that would have been helpful, and in 33/40 the situation could have been anticipated and discussed during sign-out. The quality of sign-out (assessed using a five-point Likert scale from 1 = inadequate to answer call questions to 5 = adequate to answer call questions) on the nights when something happened the resident was not adequately prepared for were significantly different than the nights they felt adequately prepared (mean (SD) score 3.58 (0.92) and 4.48 (0.70); p = 0.001). There were no significant differences in: how busy the nights were; numbers of patients on service at the beginning of the call shift; numbers of admissions during a call shift; numbers of transfers to an intensive care unit; whether residents were “cross-covering” or were members of the general ward team; or whether the resident had cared for the patient previously.
Conclusion: Although sign-out between resident physicians is a frequent activity, there are many times when important information is not transmitted. Analysis of these “missed opportunities” can be used to help develop an educational programme for resident physicians on how to sign out more effectively.
Statistics from Altmetric.com
Sign-out (handover of care) is a mechanism of transferring information, responsibility, and authority from one set of caregivers to another set of caregivers.1–4 In teaching hospitals, sign-out between resident physicians has a long tradition. In July 2003, duty hour restrictions were instituted for all residency programmes in the USA. Because of the need to reduce the number of hours resident physicians spend in the hospital, the number of sign-outs between resident physicians has increased whereas continuity of care during hospital stay has decreased.5 As a result of these changes resident physicians have become increasingly dependent on the exchange of information during sign-out.167
Despite the critical importance of sign-out between resident physicians, little research has examined the content, process and effectiveness of resident sign-out.13 This study characterises residents’ perceptions of the completeness and effectiveness of sign-out on an acute care ward in a children’s hospital.
METHODS
Scope and study population
The institutional review board of the University of Virginia approved this study and all participants gave informed consent.
We conducted the study on two contiguous general paediatric wards at the University of Virginia Children’s Hospital. The general paediatrics service consists of three first year paediatric and/or family medicine residents, two third year paediatric residents, and a paediatric attending physician. Each patient is assigned to a first year and third year resident. The first year resident serves as the child’s primary care provider and the third year resident as a supervisor. The entire team undertakes a round every morning. Night coverage is shared by eight residents—the three first year residents and two third year residents on the general paediatric ward rotation and two second year paediatric residents and one first year paediatric resident on other rotations, who “cross-cover” at night. Residents are on call every fourth night. Each night, one first year resident and one second or third year resident are on call and care for all of the patients on the two units during the night shift. The organisational structure of the ward team is depicted in fig 1.
Sign-out for these wards takes place in the Pediatric Library, which is located on one of the units. On weekdays, at 7:00 hours, residents who had been caring for all of the patients on the wards during the night shift meet with the other members of the team to review what happened overnight and hand over care back to the primary team. At 16:00 hours, team members meet the two residents who will be on-call that night and will care for the patients overnight. This is the longest and most comprehensive, and perhaps the most important sign-out session because members of the general ward team are handing over care of all the patients on the wards to two physicians who may or may not be members of the primary team. On weekends there is a single sign-out at noon each day, when the pair of residents who had cared for the patients over the previous 24 h and are ending their shift hand over care to a pair of residents who will assume care of the patients for the following 24 h. For this study, we focused on the 16:00 hours weekday sign-out and weekend sign-outs because they often involve physicians unfamiliar with the patients and are typically the most comprehensive sign-outs. The residents identify the 16:00 hours sign-out as the most important daily sign-out session. For this study the mean (SD) duration of these sign-out sessions was 34.3 (15.5) min (range 11–70 min).
Post-call survey
After each night that the residents were on call on the two paediatric acute care wards, they completed a confidential printed two-page survey (appendix A). The survey characterised their night on call, the adequacy of the sign-out they received, and where they went to get information they had not received during sign-out. The survey was created by the authors and was based on a conceptual model of handovers of care developed through an institutional quality improvement project and preliminary data obtained by a systems engineer who attended and recorded a number of sign-out sessions. Concurrent with the audio-taped sign-outs, the engineer followed first year physicians through their call period to ascertain what types of questions the residents were asked while they were on call and how they tried to answer those questions.
Data analysis
We compared continuous variables using unpaired two tailed t tests. Dichotomous variables were compared using the Fisher exact test. Differences were considered statistically different if p<0.05. Unless otherwise stated, all results are presented as mean (SD).
RESULTS
Over 98 days spanning a 4-month period during the winter of 2005–6, each post-call resident received a text page reminding them to complete a survey. During this 4-month period, 26 residents rotated on the wards. All of them completed at least one post-call survey. Of a total potential 196 surveys, 158 (81%) were completed—60% by members of the general paediatric ward team and 40% by residents who were “cross-covering” on the wards at night or during a weekend. This is very similar to the percentage of night calls covered by residents on the general ward team (62%) and residents who were cross-covering (38%). There were repeated measures both on individual nights of call and by individual residents on different call nights.
In 49/158 (31%) surveys, resident physicians indicated something happened while they were on call for which they were not adequately prepared. In 40 of these 49 (82%) instances, they indicated there was information they did not receive during sign-out that would have been helpful to them in caring for a patient overnight, and in 33 of these 40 (82.5%) instances, they indicated the situation should have been anticipated and discussed during sign-out.
The residents assessed the quality of the sign-out they received using a five-point Likert scale (1 = inadequate to answer call questions to 5 = adequate to answer call questions). Sign-out for nights when something happened for which the residents were not adequately prepared for were rated significantly lower than nights when nothing unexpected happened (3.58 (0.92) and 4.48 (0.70), respectively; p = 0.001). There did not seem to be mitigating factors beyond the quality of the sign-out: there were no differences in how busy the nights were as assessed with a five-point Likert scale (1 = slow to 5 = busy) (2.93 (1.07) vs 3.25 (1.06); p = 0.08), the number of patients on service at the beginning of the call shift (14.85 (4.33) vs 14.33 (4.56); p = 0.49), the number of patients admitted during the call shift (4.86 (2.86) vs 4.86 (3.21); p = 0.99), or the number of patients they transferred to an intensive care unit during their call shift (p = 0.25).
Residents were no more likely to report events they were unprepared for when they were “cross-covering” at night than when they were members of the general paediatric ward team (34.9% vs 29.0%; p = 0.60). Similarly, when resident physicians reported an event for which they were not prepared, they were just as likely to have cared for that child previously as not (50% vs 50%; p = 0.99).
On the 40 surveys in which residents indicated there was information they did not receive during sign-out that would have been helpful to them in caring for a patient overnight, they indicated where they went to get information that they had not received during sign-out. Fourteen of the 40 (35%) residents went to the daily progress note in the chart, however only 3/14 times did they find useful information in the progress note. Smaller numbers went to the chart and reviewed attending physician, consultant or nursing notes, and with each of these notes, they found useful information fewer than half the times. Nine of the 40 (22.5%) residents phoned an attending physician, 10 (25%) phoned a fellow, and 5 (12.5%) phoned a consultant. Approximately half of the time, they obtained useful information from their phone call. In 13 (32.5%) of 40 instances, residents could not find a clear answer to their question and they used their best clinical judgment to resolve the issue. These results are summarised in table 1.
DISCUSSION
The primary objective of any patient sign-out is the accurate transfer of information about the patient’s current state and their plan of care.8 This transfer of information is crucial for patient safety and successful care.9 There are substantial risks of failing to be told, forgetting or misunderstanding information that has been communicated during any patient care handover.71011 Incomplete information transfer and incomplete and/or unclear communication of the plan of care to covering physicians can adversely affect the quality of care.9–12 Communication problems are judged to be the most common cause of preventable inhospital disability or death,13 and more than 60% of root causes of sentinel events reported to the Joint Council on Accreditation of Healthcare Organizations (JCAHO) are judged to be due to failures of communication between healthcare personnel.14 Resident physicians believe communication difficulties have a major role in the vast majority of medical mishaps they experience.15
Our current study further shows that resident sign-out is a point of vulnerability. On nearly one-third of the nights they were on call, resident physicians indicated something happened that they were not adequately prepared for, and in most of these cases, they believed the situation could have been anticipated and should have been discussed during sign-out. Surprisingly, resident physicians were no more likely to report an event they were unprepared for if they were “cross-covering” than if they were a member of the primary team. Similarly, residents were as likely to report an event they were unprepared for if they had cared for the child previously or not. When we reviewed answers to the open-ended question on our survey, three themes emerged about the deficiencies of sign out:
Sign-out was not useful if the data provided during sign-out were not up to date.
It is important to include a rationale for the plan of care so that if changes need to be made during a call shift, there is a clear context for how to best make those changes.
Residents should anticipate problems that may occur during a call shift and provide contingency plans for those potential problems.
Our study has several limitations. While the study was performed prospectively, our principal means of data collection was through post-call surveys during which we asked resident physicians if problems could and should have been anticipated and discussed during sign-out. These types of assessments can introduce considerable hindsight bias. Another potential limitation of our study is that it was performed at a single institution on a single ward service. This may limit the generalisability of our results as there may be unique aspects to this particular acute general paediatric ward service, in that it is geographically located on a single floor and by its very nature, it looks after children who often cannot talk and so there may be an increased importance of caregivers and larger variation in medication doses. Conversely, there are some aspects of the study that may make our results applicable to a wide variety of settings. There is a relatively rapid turnover of patients typical of many paediatric and medical acute ward services in university hospitals. Moreover, the study included paediatric and family medicine residents at various levels of training,
Although we focused on the sign-out process between resident physicians in a teaching hospital, sign-out does not solely take place between physicians in teaching hospitals. Rather, sign-out between physicians takes place in many healthcare settings and continues to take place after residency has been completed. Most community physicians share calls with other physicians. The transfer of care from an on-call physician who has admitted a patient to the hospital during a night or weekend to another physician is a frequent occurrence, especially in large group practices.6 Despite the increasing frequency and importance of sign-outs in medical practice, in most settings sign-out remains an informal unstructured process, with great variation and very little standardisation in the type and extent of information exchanged between care providers1216 and in the way and the order with which the information is conveyed.17 Even in the same “microenvironment”, handovers of care can vary tremendously.18 This variability increases the potential for omissions of information and miscommunication1719 and may make it difficult to anticipate what information will be received in handover leading to wasted effort finding the information in other places even if it is covered. It may also make handovers less efficient since the “rules” of the handover have to be negotiated for each handover.
The results of this and other studies indicate sign-out between resident physicians is often inadequate and incomplete. Although no studies have examined the sign-out process between faculty physicians or between physicians in practice, these sign-outs probably have similar shortcomings. This should not be surprising as few training programmes formally teach resident physicians how to sign out and even fewer programmes assess the ability of resident physicians to sign out to their colleagues.41419 Presently, sign-out is learned informally “on the job”. Interns and junior residents learn how to sign out by observing more senior residents give sign-out.1419 Several authors have suggested that residents should be trained to communicate effectively at the time of handovers of care,15819 but there is little evidence to guide the development of such educational programmes and even less evidence on the effectiveness of any training interventions.14 While several authors have emphasised different components and strategies to improve sign-out,15819 the goals and characteristics of concise and complete sign-out must be defined before any specific curriculum can be created.
Some authors have proposed computer-based sign-out systems as a means of improving the efficiency and quality of resident sign-out,12021 In the few cases where computer-based sign-out systems have been characterised and evaluated, these systems have been developed as a means of automating existing sign-out processes to make them more efficient for the providers involved.2021 Implementation of these systems has not been accompanied by any educational intervention(s), any systematic evaluation of pre-existing sign-out processes, or by any long-term systematic assessment of the effect of the systems on communication and patient safety. It is possible that although these systems may increase resident efficiency and satisfaction with the sign-out process, they may increase rather than decrease miscommunications. Technological solutions can facilitate well-designed sign-out processes, but they cannot substitute for successful communication.22 Effective verbal communication will almost certainly remain crucial to ensure proper transmission of essential clinical information and facilitate collaborative cross-checking.1423
SUMMARY
The results of our study indicate sign-out between resident physicians is often inadequate and incomplete. The data suggest these deficiencies are not related to the specific role of the resident physician giving or receiving sign-out, how busy those residents are while they are on-call, or how ill the patients the residents are caring for are while they are on-call. Perhaps these deficiencies are due to exchange of the wrong information during the sign-out process. A number of residents commented on the importance of including contingency plans as well as the rationale for the plan of care during sign-out so that if changes need to be made during an on-call shift, there is a clear context for how to best make those changes. This type of information is often not included during sign-out, and increasingly, this kind of information is difficult to find in the medical record. The present study found that nearly a third of the time, residents could not find answers for questions arising while they were on call and they had to rely on their best clinical judgment. Future studies should be directed at identifying the information physicians need while they are on-call and using this information to clearly describe the goals and characteristics of concise and complete sign-out. Studies are also needed to identify how to best teach and evaluate a physician’s ability to sign-out.
Acknowledgments
We acknowledge the kind and compassionate young men and women who comprise the paediatric housestaff at the University of Virginia, without whom this work could not have been conceptualised or completed.
Appendix A
Post-call survey
Name:
Today’s date:
Post-call survey: We are conducting a short survey to better understand our current sign-out process. Please answer the following questions based on your most recent call night.
ALL individual results will remain strictly confidential and when entered into the database, they will be anonymous.
(1) How would you rate your most recent call night? Please circle the correlating number.
How many patients were you responsible for caring for when you started call? ___
How many patients did you admit while you were on call? ___
How many patients did you transfer to the PICU while you were on call? ___
(2) Did anything happen while you were on call that you were not adequately prepared for after sign-out?
No ___ Yes ___
If you answered Yes to question 2, please pick the most important incident that happened during your call night to answer questions 3 through 8, otherwise skip to question 9.
(3) Was there information that would have been useful that you did not receive during sign-out?
No ___ If you answered No, please skip to question 7.
Yes ___ If you answered Yes, please continue with question 4.
(4) Where did you go to get that information that you did not receive during sign-out? (Check all that apply)
The chart:
____ resident progress note
____ attending physician note
____ consultant note
____ the bedside chart
____ other
The computer:
____ MIS*
____ CareCast†
____ other
____ Made it up as it best fit clinically
____ Asked patient and/or patient’s family
____ I couldn’t get it
____ Other source not listed here, please describe
Made a phone call to:
____ an attending physician
____ a fellow
____ the chief resident
____ a consultant
____ somebody else
(5) Which information source was most useful in getting the information you required?
The chart:
____ resident progress note
____ attending physician note
____ consultant note
____ the bedside chart
____ other
The computer:
____ MIS*
____ CareCast†
____ other
____ Making it up as it best fit clinically
____ Asking the patient and/or patient’s family
____ I couldn’t get it
____ Other source not listed here, please describe
A phone call to:
_____ an attending physician
____ a fellow
____ the chief resident
____ a consultant
____ somebody else
(6) Should this situation have been anticipated and discussed during sign-out?
No ____ Yes ____
(7) Had you previously cared for this patient (either during a previous call night or a previous day shift)?
No ____ Yes ____
(8) Did you write a cross cover note (not a daily progress note) about this situation in the chart?
No ____ Yes ____
(9) Overall, how would you rate the sign-out you received at the beginning of your call night?
(10) Do you have any other comments or suggestions about sign-out that you would like to share at this time?
*MIS, Medical Information System, a hospital-wide computerised physician order entry system.
†CareCast, computerised results and document repository.
REFERENCES
Footnotes
See editorial on page 4
Funding: This work was supported in part by funding from the Graduate Medical Education Innovation Program at the University of Virginia and the Association of Pediatric Program Directors Special Project Grant.
Competing interests: None.
Linked Articles
- Quality Lines
- Editorial
- Commentary