Thanks to the authors for this insight. I wondered if they had seen this content http://qualitysafety.bmj.com/content/26/1/61 from Schmidtke et al. which deals with how boards are presented with data, including the consideration of chance (common cause variation). The material seems highly compatible.
Thank you very much for your letter. We agree that the Schmidtke et al paper is highly relevant. In our discussion we note that 'recent research has emphasised the importance of meaningful representation and interpretation of data by boards', citing the accompanying editorial by Mountford and Wakefield which provides an overview both of the Schmidtke et al paper and another paper from the same issue by Anhøj et al on 'Red Amber Green' stoplight reports.
Thank you for this article it summarises the situation well but omits to mention compassion fatigue in any detail . This is an important concept in organisations who need to change and recognise individual coping skills and support people to make positive changes in their own lives. Without self compassion we cannot be compassionate towards others. So whatever changes are made to the organisation it will not make any difference if people are not supported to change themselves. See this article - When Caring Stops Staffing Does Not Really Matter - https://www.nursingeconomics.net/necfiles/staffingUnleashed/su_ND10.pdf Or see my blog for more discussion on self compassion - http://drmarjorieghisoni.edublogs.org/
Badawy et al describe, using statistical analysis, potential inaccuracy in the recording of respiratory rates (RR) in a large cohort of inpatients across a range of inpatient settings and add to the body of data suggesting widespread inaccuracy in the measurement of RR.1 The accurate recording of RR is an important safety and quality issue and the data provided by Badawy et al further underlines the challenges with measurement of this parameter in the inpatient setting.2 Having elegantly demonstrated the problem, the extension of this finding is a need to explore what methods can be potentially employed to improve the accuracy and recording of RR measurement.
Several potential validated solutions may be adduced to address the deficiency in accurate RR measurement and recording. First, consideration could be given to introduction of a system of audit whereby healthcare workers are observed recording RR measurements during their routine practice. Despite a likely Hawthorne effect, the results of this can be collated then non-punitively and anonymously presented to organizational governance structures and health care workers. This concept has been successfully applied into staff hand hygiene quality improvement implementation with this approach having been shown to improve staff performance in this domain with an attendant systematic reduction in adverse event rates.3
Second, the provision of technological solutions, such as a touch pad ba...
Badawy et al describe, using statistical analysis, potential inaccuracy in the recording of respiratory rates (RR) in a large cohort of inpatients across a range of inpatient settings and add to the body of data suggesting widespread inaccuracy in the measurement of RR.1 The accurate recording of RR is an important safety and quality issue and the data provided by Badawy et al further underlines the challenges with measurement of this parameter in the inpatient setting.2 Having elegantly demonstrated the problem, the extension of this finding is a need to explore what methods can be potentially employed to improve the accuracy and recording of RR measurement.
Several potential validated solutions may be adduced to address the deficiency in accurate RR measurement and recording. First, consideration could be given to introduction of a system of audit whereby healthcare workers are observed recording RR measurements during their routine practice. Despite a likely Hawthorne effect, the results of this can be collated then non-punitively and anonymously presented to organizational governance structures and health care workers. This concept has been successfully applied into staff hand hygiene quality improvement implementation with this approach having been shown to improve staff performance in this domain with an attendant systematic reduction in adverse event rates.3
Second, the provision of technological solutions, such as a touch pad based application to record respiratory rates using finger tapping may also have a role in improving accuracy and has been demonstrated in paediatric settings to be potentially effective.4 This technology employs an algorithm whereby the interval between taps (each tap corresponding to a breath observed) is used to calculate a RR. This provides a real-time self-refining measurement of respiratory rate, with more taps generating greater accuracy. To further improve accuracy, and data utility, results could be directly fed into a real-time electronic medical record system.
Finally, complementing the introduction of data collection on performance (with audit of that data) and the potential integration of technological assistive structures would also be the promulgation of education measures. Education measures could focus staff on the data around the historical inaccuracy of RR recording, the assistive technology initiatives being put into place and the importance of accurate measurement for safety and quality. In addition, ongoing feedback to healthcare staff of observed accuracy, as done for hand hygiene measures, would also be important. Multifaceted education of this nature has been shown to be effective for other quality change initiatives.5
In conclusion, a combination of integrated observation and audit, technological implementation and integration and staff education could be used to address the important challenges in measurement of respiratory rate identified by Badawy et al.
References:
1. Badawy J, Nguyen OK, Clark C, et al. Is everyone really breathing 20 times a minute? Assessing epidemiology and variation in recorded respiratory rate in hospitalised adults. BMJ Qual Saf 2017:bmjqs-2017.
2. Fieselmann JF, Hendryx MS, Helms CM, et al. Respiratory rate predicts cardiopulmonary arrest for internal medicine inpatients. J Gen Intern Med 1993;8:354–60.
3. Pittet D, Hugonnet S, Harbarth S et al. Effectiveness of a hospital-wide programme to improve compliance with hand hygiene. The Lancet 2000;356(9238):1307-12.
4. Karlen W, Gan H, Chiu M, et al. Improving the accuracy and efficiency of respiratory rate measurements in children using mobile devices. PLoS One 2014;9(6):e99266.
5. Naikoba S, Hayward A. The effectiveness of interventions aimed at increasing handwashing in healthcare workers-a systematic review. Journal of Hospital Infection 2001;47(3):173-80.
In this paper, Professor Sutton's team attribute higher hospital
death rates at the weekend to the patients being sicker. Sutton is joining
very erudite company (Prof Hawking, Prof Winston and the BMA). This group
is rapidly becoming the 'climate change deniers' of healthcare. Not
including this study, there have been 50 very large studies (>100,000
patients) published so far in this area (supplied on request). 44 show...
In this paper, Professor Sutton's team attribute higher hospital
death rates at the weekend to the patients being sicker. Sutton is joining
very erudite company (Prof Hawking, Prof Winston and the BMA). This group
is rapidly becoming the 'climate change deniers' of healthcare. Not
including this study, there have been 50 very large studies (>100,000
patients) published so far in this area (supplied on request). 44 showed a
weekend effect. These studies used multivariate analysis (to take out
confounding variables, like sickness).
This effect has been shown in emergency and elective admissions, all
over the developed world. It is nothing to do with the UK. Even the degree
of increased risk (approximately 10%) is the same, in almost all of the
studies. It is even more strange that Sutton, in this paper, concluded
"Sunday daytime was .. associated with a higher mortality risk .. compared
with Wednesday daytime" (relative risk 6%) - but this was not emphasised.
In other words, whether you have an emergency admission, or a have a
planned operation, you have an approximately 10% greater chance of dying
if you are admitted at the weekend. Perhaps these Professors (and the
BMA) should read the literature before they continue to confuse the
public. I presume they would trust the NHS to look after their own health
(or that of their family) at the weekend.
Yours faithfully
Dr Andrew Stein
Consultant Physician
Conflict of Interest:
I was one of the authors of NHSE's 7DS 10 Clinical Standards in Dec 2013
With great interest we read the article of Flott et. al. (1), describing the challenges of using patient-reported feedback. We recognize the challenges described and performed a bachelorproject in the intensive care unit (ICU) in the University Medical Center Groningen (UMCG). We think the results from our project provide a potential promising practical solution to make feedback more useful.
In 2013 the UMCG participated in an independent multi-center study conducted among relatives of ICU patients (2). In the open questions of the questionnaire more dissatisfaction than expected was found, which fueled the quest for an alternative, simple and continuous feedback system. In this study we compared the quality and amount of feedback gathered by an oral survey during the first two weeks and an app during the consecutive two weeks.
Between February 20th and March 18th 2017, patients above sixteen years old, listed for discharge from the ICU that day and their relatives were approached to participate in this study. The oral survey consisted of two simple questions: “How satisfied are you with your stay in the ICU? (grade 1-10)” and ”Do you have specific suggestions of improvement for the ICU?”. The RateIt app (Rate It Limited®, Hong Kong) was used consisting of the same two questions as in the oral survey.
A total of 208 responses (133 patients and 75 relatives) were included. The median satisfaction score was 8. Despite this high score many suggestions for...
With great interest we read the article of Flott et. al. (1), describing the challenges of using patient-reported feedback. We recognize the challenges described and performed a bachelorproject in the intensive care unit (ICU) in the University Medical Center Groningen (UMCG). We think the results from our project provide a potential promising practical solution to make feedback more useful.
In 2013 the UMCG participated in an independent multi-center study conducted among relatives of ICU patients (2). In the open questions of the questionnaire more dissatisfaction than expected was found, which fueled the quest for an alternative, simple and continuous feedback system. In this study we compared the quality and amount of feedback gathered by an oral survey during the first two weeks and an app during the consecutive two weeks.
Between February 20th and March 18th 2017, patients above sixteen years old, listed for discharge from the ICU that day and their relatives were approached to participate in this study. The oral survey consisted of two simple questions: “How satisfied are you with your stay in the ICU? (grade 1-10)” and ”Do you have specific suggestions of improvement for the ICU?”. The RateIt app (Rate It Limited®, Hong Kong) was used consisting of the same two questions as in the oral survey.
A total of 208 responses (133 patients and 75 relatives) were included. The median satisfaction score was 8. Despite this high score many suggestions for improvement (n=95 suggestions given by 68 respondents) were given. The oral survey provided more often suggestions for improvement compared with the app (50 vs. 18 respondents). Suggestions for improvement were more frequently made by relatives compared with patients (57 suggestions given by 37 relatives vs. 38 suggestions given by 31 patients). All improvement suggestions were classified to one of six categories: ‘Surroundings’ 48/95 (51%), ‘Information, communication and education’ 23/95 (24%), ‘Patient care’ 15/95 (16%), ‘Attitude, handling and relation caregiver with patient/relatives 7/95 (7%), ‘Emotional support’ 1/95 (1%) and ‘Care for relatives’ 1/95 (1%).
This simple study showed that an oral survey results in more suggestions for improvement than an app. The lack of complexity of the survey resulted in very specific, useful and practical suggestions for improvement, which were easily transformed into clear recommendations, such as: “respect sufficient rest of our patients” or “don’t forget to provide food to the patients who are able to eat”. The survey can easily be repeated in the course of time. These results may give a new perspective on how to conduct feedback studies.
The key suggestions for improvement found in this study were presented to the department in the form of a coat rack, which was an improvement option frequently mentioned by relatives (A coat rack was missing in one of our family rooms). This coat rack will be hung in central places in our department. On this coatrack recommendations based on the most important improvement suggestions will be hung. We think this is one example of a simple, but practical solution to make feedback more useful: every month the recommendations will be replaced by new ones, reminding all caregivers in our department of the feedback given by our patients and their relatives and thereby striving to improve our care.
We are well aware of the fact that the surveys used in the studies described in the article of Flott et al1 are much larger and more complex than the one we used in our study. We just wanted to show that a learning point could be: don’t overcomplicate.
References
1. Flott KM, Graham C, Darzi A, Mayer E. Can we use patient-reported feedback to drive change? The challenges of using patient-reported feedback and how they might be addressed. BMJ Qual Saf 2017;26:502-507.
2. Jensen HI, Gerritsen RT, Koopmans M, Zijlstra JG, Randall Curtis J, Ording H. Families’ experiences of intensive care unit quality of care: Development and validation of a European questionnaire (euroQ2). Journal of Critical Care 2015;30(5):884-890.
This study uses rigorous analysis to obtain important insights about the realtime information that our patients are handed at discharge. It is puzzling that the EMRs used were not named. One can infer from a look through the MSU website that they have both Cerner and Epic, but why is that necessary? The heart of quality/safety work is one of transparency balanced by humility, i.e. we shouldn't expect our IT systems to be any more perfect than we are, but they won't improve if we don't have more openness. The lack of scientific foundations and published post-marketing surveillance for our EHRs, especially the ascendant ones, was initially surprising. However, as they achieve complete market dominance, with less overt scientific review and public guidance and commentary, the silence is deafening. Is the BMJQS's failure to simply identify the names (or maybe I missed the citations) an oversight, or part of nondisclosure agreements with the vendors at the MSU institutions or at BMJQS?
As you point out Root Cause Analysis will often fail with hospital adverse event (AE) data because it was not designed to deal with data arising in a complex system.1 The same can be said for Pareto analysis. Statistical process control (SPC) methods are often used to summarise AE data, particularly hospital infection data such as surgical site infections (SSIs) and bacteraemias.2 Standard SPC also frequently fails to summarise these complex data correctly.
With binary SSI data an approximate expected rate is frequently available so cumulative observed minus expected and CUSUM analysis are appropriate.2 However, the changing observed rate is not seen unless the numbers of procedures is large enough for them to be grouped by months or quarters. This is often infrequent. Even when such aggregation is possible difficulties arise as the number of procedures in each month may differ markedly. This problem can be dealt with, at least approximately, by employing a generalised additive model (GAM) analysis to the binary data that predicts the observed AE rate at various places in the time series.
Count and rate data such as bacteraemias or new isolates of an antibiotic-resistant organism will usually not have an expected rate available. These data are often grouped by months and a Shewhat chart used for their display. This chart requires a stable centre-line about which reliable control limits can be drawn. Often the mean value is used as the expected rate even though...
As you point out Root Cause Analysis will often fail with hospital adverse event (AE) data because it was not designed to deal with data arising in a complex system.1 The same can be said for Pareto analysis. Statistical process control (SPC) methods are often used to summarise AE data, particularly hospital infection data such as surgical site infections (SSIs) and bacteraemias.2 Standard SPC also frequently fails to summarise these complex data correctly.
With binary SSI data an approximate expected rate is frequently available so cumulative observed minus expected and CUSUM analysis are appropriate.2 However, the changing observed rate is not seen unless the numbers of procedures is large enough for them to be grouped by months or quarters. This is often infrequent. Even when such aggregation is possible difficulties arise as the number of procedures in each month may differ markedly. This problem can be dealt with, at least approximately, by employing a generalised additive model (GAM) analysis to the binary data that predicts the observed AE rate at various places in the time series.
Count and rate data such as bacteraemias or new isolates of an antibiotic-resistant organism will usually not have an expected rate available. These data are often grouped by months and a Shewhat chart used for their display. This chart requires a stable centre-line about which reliable control limits can be drawn. Often the mean value is used as the expected rate even though it may be representative of few or none of the monthly data values. This makes the control limits meaningless. A probable way round this is to employ confidence limits for the monthly rates. Viewed as a likelihood supported range this enables the extent of each of the monthly counts or rates to be assessed. If a GAM analysis is added to this the predicted rate and its confidence limits can also be obtained throughout the time series.2
This approach is more in keeping with the complexity of the processes responsible for the AE than is standard SPC that was not designed to deal with complex systems.
As an aside, it is worth noting that some swamps may be valuable ecosystems. This popular analogy is thus a poor one. Like root-cause analysis it belongs to the area of simple/complicated systems, not complex ones.
1. Morton, A., Whitby, M., Tierney, N., Sibanda, N. and Mengersen, K. 2016. Statistical Methods for Hospital Monitoring. Wiley StatsRef: Statistics Reference Online. 1–8.
2. Morton A, Mengersen K, Whitby M. and Playford G. Statistical Methods for Hospital Monitoring with R. Chichester John Wiley and Sons 2013.
Vindrola-Padros and colleagues provide a helpful examination of co-production of quality improvement knowledge by university-based researchers in cooperation with members of service organizations. Another important type of embedded researcher consists of “fully embedded,” researchers, who are academically trained but employed by large care delivery systems. These individuals typically work in research units in the delivery systems. Their work is funded both by the systems themselves and by external, private and public organizations, such as the Agency for Healthcare Research and Quality (AHRQ). These fully embedded researchers contribute actively to national professional forums and journals and sometimes collaborate with embedded researchers in other systems.
AHRQ leverages relationships with fully embedded researchers because of their deep and nuanced knowledge of internal system data and operations. Health systems-based researchers’ ready access to care sites within which to test new approaches, and to data sources that permit rapid analysis of results of those tests, are of great value to AHRQ as we seek to find solutions to real-world problems in areas of national importance. AHRQ-supported work of this kind demonstrates the value of health delivery organizations becoming “learning health systems”(1) – using their own internal data and resources to drive quality improvement and sharing their findings with other organizations.
Vindrola-Padros and colleagues provide a helpful examination of co-production of quality improvement knowledge by university-based researchers in cooperation with members of service organizations. Another important type of embedded researcher consists of “fully embedded,” researchers, who are academically trained but employed by large care delivery systems. These individuals typically work in research units in the delivery systems. Their work is funded both by the systems themselves and by external, private and public organizations, such as the Agency for Healthcare Research and Quality (AHRQ). These fully embedded researchers contribute actively to national professional forums and journals and sometimes collaborate with embedded researchers in other systems.
AHRQ leverages relationships with fully embedded researchers because of their deep and nuanced knowledge of internal system data and operations. Health systems-based researchers’ ready access to care sites within which to test new approaches, and to data sources that permit rapid analysis of results of those tests, are of great value to AHRQ as we seek to find solutions to real-world problems in areas of national importance. AHRQ-supported work of this kind demonstrates the value of health delivery organizations becoming “learning health systems”(1) – using their own internal data and resources to drive quality improvement and sharing their findings with other organizations.
AHRQ’s collaboration with researchers in the Palo Alto Medical Foundation (PAMF) Research Institute provides a powerful example of how partnership between fully embedded researchers and external funding agencies contributes to health system learning. AHRQ partnered with Kaiser Permanente and PAMF researchers to study implementation of a Lean-based redesign to improve care delivery efficiency in PAMF’s primary care clinics. (2) Applying Lean analysis techniques, PAMF discovered inefficiencies in a pilot primary care clinic and redesigned work roles and work flow to enhance coordination among physicians and to better support them. Key changes included:
• New roles for medical assistants as a “flow managers,” facilitating physician’s work and performing administrative tasks like handling email that previously burdened physicians
• New workflows – including daily huddles for scheduling; agenda setting during patient visits
• Co-location of physician-medical assistant teams in a shared workspace.
PAMF then tested these new roles and processes in three additional clinics, assessed the improvements’ effects, and rolled the changes out to 13 additional clinics.
PAMF researchers interviewed staff to uncover factors influencing successful implementation of these changes and system requirements for successful redesign of care. (3-4) To assess changes in efficiency, they analyzed rich and timely internal data sources such as:
• Physician efficiency metrics derived from PAMF’s time-stamped EHR data and other operational sources
• PAMF’s routine patient and personnel surveys
• Standardized quality metrics that PAMF reports.
Their research showed that PAMF’s primary care redesigns boosted efficiency without sacrificing quality and satisfaction. (5) AHRQ and PAMF disseminated these valuable findings widely through practice –oriented briefs, conference presentations, and webinars, as well as in peer-reviewed papers.
PAMF’s fully embedded researchers promoted internal learning by tracking progress and outcomes of the Lean improvement efforts and providing feedback to their system’s leaders and staff. AHRQ and the PAMF researchers promoted system-wide learning about Lean-based primary care redesign by broadly disseminating the study’s findings and implementation lessons.
3. Hung D, Gray C, Martinez M, Schmittdiel J, Harrison, MI. Acceptance of Lean redesigns in primary care: a contextual analysis. Health Care Manage Rev 2017; 42:203-212.
4. Gray C, Harrison MI, Hung D. Medical assistants as flow managers in primary care: challenges and recommendations. J. Healthc Manag 2016; 61:181-191.
5. Hung D, Harrison MI, Martinez M, Luft H. Scaling Lean in primary care: impacts on system performance. Am J Manag Care 2017; 23(3):161-168.
I read with interest the article by Peerally et al (1) on 'The
problem with root cause analysis'. I reflected on the recent cases that
happened at Royal North Shore Hospital and Sydney Hospital (2,3,4) which
led me to consider which investigative tool is best applied to different
incidences and identified risks.
The use of appropriate tools and involvement of key stakeholders are
crucial elements to a successful investig...
I read with interest the article by Peerally et al (1) on 'The
problem with root cause analysis'. I reflected on the recent cases that
happened at Royal North Shore Hospital and Sydney Hospital (2,3,4) which
led me to consider which investigative tool is best applied to different
incidences and identified risks.
The use of appropriate tools and involvement of key stakeholders are
crucial elements to a successful investigative process and outcomes,
however, we cannot ignore the reality of the process cost versus event
severity and risk.
Use of tools by subject matter expert
Root cause analysis (RCA) is a tool used in many investigative incidences
(5,6). Often as a result recommendations are made yet similar errors still
happen. As correctly mentioned by Peerally et al, most investigations of
incidences are done by the local team involved with RCA tools but with a
lack of expert accident investigator involvement to ensure regular
feedback loops and ongoing corrective actions.
I do agree that hospitals should move toward proactively preventing
adverse incidences for high probability, high severity risks. Preventing
adverse incidences can eliminate harm to patients, reduce liability for
organisations and reduce both operating costs and the need for resources.
A proactive approach often uses Failure Mode Effect Analysis (FMEA) tools.
FMEA often requires a higher level of investigative expertise and as such
often costs more so it may be optimal to assess risks on a probability
severity matrix to identify which tools are optimal.
The proposal of engaging an independent professional body, while
preferable, can be time-consuming and expensive. I propose for most cases
(with exception for cases with significant legal liability) this level of
expertise and independence could be developed within the organisation. The
body i.e. quality or risk management department, should comprise of people
with qualifications such as system thinking, sound interviewing
techniques, able to involve staff, human factor analysis, current clinical
practice, health management and have the ability to analyse data (7). This
department could then act as a quasi-independent body to avoid situational
bias and provide a platform for disseminating the results to intra-
hospitals, inter-hospitals and governmental bodies as shared learning to
help prevent occurrence or recurrence. As a largely independent department
within the organisation, they can for most cases facilitate the
investigative processes objectively thus eliminating tendency to blame
(8,9,10).
Key stake holders' involvement
The involvement of key stakeholders is very crucial in any investigative
process; leaders, managers, clinicians.
The leaders provide governance, leadership and support to the managers.
They are involved in the investigative process to gain their input,
consensus and to commit resources for any recommendations that might be
made. It is critical leaders set departmental performance indicators with
due acknowledgment for the resources needed to achieve them as too often
the burden of performance and blame is levied on departments, middle
management and individuals where identified risk avoidance is under-
resourced.
The managers (department managers, quality and risk managers) are required
to provide a safe environment for practice. They are to ensure that the
protocols and standards of care are adhered to and patients are managed in
a consistent manner. The role of the manager also includes identifying
risks and establish processes to prevent the risks from reaching the
patient with the support from the leader.
The clinicians are required to conduct the procedures/practices in
compliance with their scope of practice, organisational and regulatory
boards.
Conclusion
The usage of an appropriate tool by a qualified person with the right
expertise makes a difference. It would be economically unrealistic to
apply full FMEA processes for every incident or identified risk profile,
so the establishment of an organisational risk severity/probability matrix
needs to be developed so the most appropriate tool is used.
The involvement of key people ensures that a holistic approach is applied
and outcomes of the investigations are implemented with feedback checks
and balances and shared across intra-departments, inter-hospitals and at
national level (11).
References:
1)Peerally MF, Carr S, Waring J, Dixon-Woods M. The problem with root
cause analysis. BMJ Qual Saf. 2016 Aug;1:1-6
2)Bodies swapped: Dead baby mistakenly cremated and daughter finds
mother's body mislabelled at Royal North Shore Hospital [television
broadcast]. Sydney: The Sydney Morning Herald; 2016 Aug 31. Available
from: www.smh.com.au/nsw/daughter-finds-mothers-body-mislabelled-in-morgue
-mixup-at-royal-north-shore-hospital-20160830-gr4g3n.html
3)Joseph AP, Hunyor SN. The Royal North Shore Hospital inquiry: a analysis
of the recommendations and the implications for quality and safety in
Australian public hospitals. Med J Aust. 2008 April ;188(8):469-72
4)Family want justice for fatal gas mix up [television broadcast]. Sydney:
Skynews; 2016 Jul 26. Available from: http://www.skynews.com.au/news/top-
stories/2016/07/26/incorrect-gas-fitting-behind-nsw-baby-death.html
5)Clifford SP, Mick PB, Derhake, BM. A Case of Transfusion Error in a
Trauma Patient with Subsequent Root Cause Analysis Leading to
Instituitional Change. J Investig High Impact Case Rep. 2016 May; 4(2):1-4
6)Van-Galen LS, Struik PW, Driesen BEJM, Merten H, Ludikhuize J, Van der
Spoel JI, Kramer MHH, Nanayakkara PWB. Delayed Recognition of
Deterioration of Patients in General Wards Is Mostly Caused by Human
Related Monitoring Failures: A Root Cause Analysis of Unplanned ICU
Admissions. 2016 Aug; 11(8):1-14
7) Ibrahim JE. What is the quality of our quality managers? Is it time for
quality managers in Australia to be certified? J.Qual Clin Practice.
2000;20(1):32
8)Smetzer JL, Cohen MR. Lessons from the Denver medication error/criminal
negligence case: look beyond blaming individuals. Hosp Pharm. 1998;33:640-
57.
9)Leape L. Error in medicine. JAMA. 1994;272:1851-7
10)Runciman W, Merry A, Smith AM. Improving patients' safety by gathering
information. Anonymous reporting has an important role. BMJ. 2001;323:7308
11)Leape LL. Why should we report adverse incidents? J Eval Clin Pract.
1999;5:1-4
Thanks to the authors for this insight. I wondered if they had seen this content http://qualitysafety.bmj.com/content/26/1/61 from Schmidtke et al. which deals with how boards are presented with data, including the consideration of chance (common cause variation). The material seems highly compatible.
Thank you very much for your letter. We agree that the Schmidtke et al paper is highly relevant. In our discussion we note that 'recent research has emphasised the importance of meaningful representation and interpretation of data by boards', citing the accompanying editorial by Mountford and Wakefield which provides an overview both of the Schmidtke et al paper and another paper from the same issue by Anhøj et al on 'Red Amber Green' stoplight reports.
Thank you for this article it summarises the situation well but omits to mention compassion fatigue in any detail . This is an important concept in organisations who need to change and recognise individual coping skills and support people to make positive changes in their own lives. Without self compassion we cannot be compassionate towards others. So whatever changes are made to the organisation it will not make any difference if people are not supported to change themselves. See this article - When Caring Stops Staffing Does Not Really Matter - https://www.nursingeconomics.net/necfiles/staffingUnleashed/su_ND10.pdf Or see my blog for more discussion on self compassion - http://drmarjorieghisoni.edublogs.org/
To the Editor,
Badawy et al describe, using statistical analysis, potential inaccuracy in the recording of respiratory rates (RR) in a large cohort of inpatients across a range of inpatient settings and add to the body of data suggesting widespread inaccuracy in the measurement of RR.1 The accurate recording of RR is an important safety and quality issue and the data provided by Badawy et al further underlines the challenges with measurement of this parameter in the inpatient setting.2 Having elegantly demonstrated the problem, the extension of this finding is a need to explore what methods can be potentially employed to improve the accuracy and recording of RR measurement.
Several potential validated solutions may be adduced to address the deficiency in accurate RR measurement and recording. First, consideration could be given to introduction of a system of audit whereby healthcare workers are observed recording RR measurements during their routine practice. Despite a likely Hawthorne effect, the results of this can be collated then non-punitively and anonymously presented to organizational governance structures and health care workers. This concept has been successfully applied into staff hand hygiene quality improvement implementation with this approach having been shown to improve staff performance in this domain with an attendant systematic reduction in adverse event rates.3
Second, the provision of technological solutions, such as a touch pad ba...
Show MoreIn this paper, Professor Sutton's team attribute higher hospital death rates at the weekend to the patients being sicker. Sutton is joining very erudite company (Prof Hawking, Prof Winston and the BMA). This group is rapidly becoming the 'climate change deniers' of healthcare. Not including this study, there have been 50 very large studies (>100,000 patients) published so far in this area (supplied on request). 44 show...
With great interest we read the article of Flott et. al. (1), describing the challenges of using patient-reported feedback. We recognize the challenges described and performed a bachelorproject in the intensive care unit (ICU) in the University Medical Center Groningen (UMCG). We think the results from our project provide a potential promising practical solution to make feedback more useful.
Show MoreIn 2013 the UMCG participated in an independent multi-center study conducted among relatives of ICU patients (2). In the open questions of the questionnaire more dissatisfaction than expected was found, which fueled the quest for an alternative, simple and continuous feedback system. In this study we compared the quality and amount of feedback gathered by an oral survey during the first two weeks and an app during the consecutive two weeks.
Between February 20th and March 18th 2017, patients above sixteen years old, listed for discharge from the ICU that day and their relatives were approached to participate in this study. The oral survey consisted of two simple questions: “How satisfied are you with your stay in the ICU? (grade 1-10)” and ”Do you have specific suggestions of improvement for the ICU?”. The RateIt app (Rate It Limited®, Hong Kong) was used consisting of the same two questions as in the oral survey.
A total of 208 responses (133 patients and 75 relatives) were included. The median satisfaction score was 8. Despite this high score many suggestions for...
This study uses rigorous analysis to obtain important insights about the realtime information that our patients are handed at discharge. It is puzzling that the EMRs used were not named. One can infer from a look through the MSU website that they have both Cerner and Epic, but why is that necessary? The heart of quality/safety work is one of transparency balanced by humility, i.e. we shouldn't expect our IT systems to be any more perfect than we are, but they won't improve if we don't have more openness. The lack of scientific foundations and published post-marketing surveillance for our EHRs, especially the ascendant ones, was initially surprising. However, as they achieve complete market dominance, with less overt scientific review and public guidance and commentary, the silence is deafening. Is the BMJQS's failure to simply identify the names (or maybe I missed the citations) an oversight, or part of nondisclosure agreements with the vendors at the MSU institutions or at BMJQS?
As you point out Root Cause Analysis will often fail with hospital adverse event (AE) data because it was not designed to deal with data arising in a complex system.1 The same can be said for Pareto analysis. Statistical process control (SPC) methods are often used to summarise AE data, particularly hospital infection data such as surgical site infections (SSIs) and bacteraemias.2 Standard SPC also frequently fails to summarise these complex data correctly.
Show MoreWith binary SSI data an approximate expected rate is frequently available so cumulative observed minus expected and CUSUM analysis are appropriate.2 However, the changing observed rate is not seen unless the numbers of procedures is large enough for them to be grouped by months or quarters. This is often infrequent. Even when such aggregation is possible difficulties arise as the number of procedures in each month may differ markedly. This problem can be dealt with, at least approximately, by employing a generalised additive model (GAM) analysis to the binary data that predicts the observed AE rate at various places in the time series.
Count and rate data such as bacteraemias or new isolates of an antibiotic-resistant organism will usually not have an expected rate available. These data are often grouped by months and a Shewhat chart used for their display. This chart requires a stable centre-line about which reliable control limits can be drawn. Often the mean value is used as the expected rate even though...
Vindrola-Padros and colleagues provide a helpful examination of co-production of quality improvement knowledge by university-based researchers in cooperation with members of service organizations. Another important type of embedded researcher consists of “fully embedded,” researchers, who are academically trained but employed by large care delivery systems. These individuals typically work in research units in the delivery systems. Their work is funded both by the systems themselves and by external, private and public organizations, such as the Agency for Healthcare Research and Quality (AHRQ). These fully embedded researchers contribute actively to national professional forums and journals and sometimes collaborate with embedded researchers in other systems.
AHRQ leverages relationships with fully embedded researchers because of their deep and nuanced knowledge of internal system data and operations. Health systems-based researchers’ ready access to care sites within which to test new approaches, and to data sources that permit rapid analysis of results of those tests, are of great value to AHRQ as we seek to find solutions to real-world problems in areas of national importance. AHRQ-supported work of this kind demonstrates the value of health delivery organizations becoming “learning health systems”(1) – using their own internal data and resources to drive quality improvement and sharing their findings with other organizations.
AHRQ’s collaboration w...
Show MoreI read with interest the article by Peerally et al (1) on 'The problem with root cause analysis'. I reflected on the recent cases that happened at Royal North Shore Hospital and Sydney Hospital (2,3,4) which led me to consider which investigative tool is best applied to different incidences and identified risks. The use of appropriate tools and involvement of key stakeholders are crucial elements to a successful investig...
Pages