Article Text
PDF
Abstract
Background The positive deviance approach focuses on those who demonstrate exceptional performance, despite facing the same constraints as others. ‘Positive deviants’ are identified and hypotheses about how they succeed are generated. These hypotheses are tested and then disseminated within the wider community. The positive deviance approach is being increasingly applied within healthcare organisations, although limited guidance exists and different methods, of varying quality, are used. This paper systematically reviews healthcare applications of the positive deviance approach to explore how positive deviance is defined, the quality of existing applications and the methods used within them, including the extent to which staff and patients are involved.
Methods Peer-reviewed articles, published prior to September 2014, reporting empirical research on the use of the positive deviance approach within healthcare, were identified from seven electronic databases. A previously defined four-stage process for positive deviance in healthcare was used as the basis for data extraction. Quality assessments were conducted using a validated tool, and a narrative synthesis approach was followed.
Results 37 of 818 articles met the inclusion criteria. The positive deviance approach was most frequently applied within North America, in secondary care, and to address healthcare-associated infections. Research predominantly identified positive deviants and generated hypotheses about how they succeeded. The approach and processes followed were poorly defined. Research quality was low, articles lacked detail and comparison groups were rarely included. Applications of positive deviance typically lacked staff and/or patient involvement, and the methods used often required extensive resources.
Conclusion Further research is required to develop high quality yet practical methods which involve staff and patients in all stages of the positive deviance approach. The efficacy and efficiency of positive deviance must be assessed and compared with other quality improvement approaches.
PROSPERO registration number CRD42014009365.
- Healthcare quality improvement
- Health services research
- Implementation science
- Quality improvement
- Quality improvement methodologies
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
- Healthcare quality improvement
- Health services research
- Implementation science
- Quality improvement
- Quality improvement methodologies
Background
Within healthcare, various approaches to patient safety and quality improvement exist. Traditionally these approaches are deficit-based; they focus on identifying and learning from past harm. Their effectiveness is limited as only two-thirds of improvement projects achieve their objectives and deliver sustainable change.1 Improvements are often short-lived, fail to reach the most disadvantaged and can create unintended consequences.2 ,3 Furthermore, various challenges are faced while using these approaches such as engaging front-line staff, addressing their most pertinent issues and adequately accounting for context.2 ,3 Change is often introduced from the top of organisations and/or by external experts, and additional resources are rarely provided to support this.1
The need to ‘flip healthcare on its head’ has recently been suggested.4 Despite our negativity, safe, high-quality care is reliably delivered the majority of the time.5 Asset-based approaches, which focus on the strengths and resources of a community, recognise this and explore how, and why, things go right in order to learn from these successes. One such approach, ‘positive deviance’, is increasingly being applied within healthcare settings and has the potential to address a number of the challenges faced when trying to improve quality.
An alternative approach to quality improvement
Positive deviance is a bottom–up approach which identifies and learns from those who demonstrate exceptional performance on an outcome of interest. The approach assumes that problems can be overcome using solutions that already exist within communities.6 ,7 Despite facing the same constraints as others, ‘positive deviants’ identify these solutions and succeed by demonstrating uncommon or different behaviours. Community involvement is integral to the approach, for example, staff select the problem to address, identify the positive deviants and explore how they succeed. Solutions are internally generated rather than externally imposed, ensuring that they are feasible within current resources, acceptable to others and sustainable over time.8
Specifically within healthcare, Bradley et al have proposed a four-stage process for adopting the positive deviance approach (figure 1).7 Positive deviants with exceptionally high performance are identified using widely endorsed routinely collected data (stage 1). Qualitative methods are used to generate hypotheses about how positive deviants succeed (stage 2). These hypotheses are tested within larger, more representative samples (stage 3) and, finally, the successful, positively deviant practises are disseminated widely (stage 4).
The positive deviance process for healthcare organisations (adapted from ref. 7).
Positive deviance in practise
The positive deviance approach originated within international public health. It has been used within settings such as business9 and more recently has been applied to healthcare.8 Bradley et al7 used the approach to increase guideline adherence for the treatment of acute myocardial infarction. Positively deviant hospitals were identified using national registry data and factors that facilitated success were explored. Those which statistically improved outcomes were disseminated through a public campaign, and guideline adherence rose by 25%, which, in turn, increased patient survival.7
Despite successes, current understanding of how the positive deviance approach works, and evidence regarding its effectiveness is limited. Although Bradley et al's healthcare-specific process exists, there is limited guidance on how to operationalise each step.8 Positive deviants are identified using many different methods, some of which appear to lack validity and/or reliability such as selecting annual award winners.10 Furthermore, the extent to which each stage of the process is implemented may be limited, hindering assessment of the approach's efficacy.8 For example, Kim et al.11 explored how positively deviant nurses and patients effectively communicated family planning issues, but did not explain how they would assess whether these behaviours improved outcomes. Further guidance is required to help identify and classify positive deviants, select the methods used at each stage, involve front-line staff and patients in the process and effectively disseminate findings.8
Objectives
A previous systematic review assessed the effectiveness of positive deviance in reducing childhood malnutrition.12 Although the author described study methods, the research settings (rural villages and low/middle-income countries) differed dramatically from well-developed, complex healthcare organisations. The current systematic review synthesises applications of the positive deviance approach within healthcare organisations to better characterise the challenges faced, and to provide guidance for those implementing the approach. The following questions will be addressed:
How is positive deviance defined?
What study designs and methods are used at each stage of the positive deviance process?
What is the quality of existing research?
To what extent are staff and patients involved in the approach?
Methods
Search strategy
This systematic review adheres to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement (PRISMA—see online supplementary file 1),13 and the protocol was published on PROSPERO.14 The search term, ‘positive devian*’, identified articles relating to positive deviance and positive deviants. Search terms for ‘high performance’ and ‘positive outliers’ were excluded as they lacked specificity and identified large numbers of irrelevant articles. Studies conducted within healthcare organisations were selected for inclusion. The search strategy was applied to PsycINFO, MEDLINE, Web of Science, Cochrane Library, Embase, CINAHL and Global Health Database in January 2014 and updated in September 2014. Time restrictions were excluded to maximise the identification of relevant literature. The search strategy, time periods searched for each database and full results are detailed in online supplementary file 2.
Eligibility criteria and study selection
The inclusion criteria are outlined in table 1. One reviewer (RB) screened titles and abstracts and then conducted a full-text review, meeting regularly with second reviewers to discuss article eligibility. At both stages, 10% of randomly selected articles were independently second reviewed by IK, RL and NT (title and abstract, n=83; full text review, n=36). Inter-rater reliability was assessed using a Kappa statistic.15 Substantial agreement (k=0.64) existed between reviewers for the title and abstract review, and strong agreement (k=0.87) existed for the full-text review. Discrepancies were resolved either through a full-text review or by discussion. Reasons for exclusion were recorded, and reference list and citation searches were conducted for all included articles.
Eligibility criteria for inclusion of articles in the review
Study quality assessment
The positive deviance approach uses quantitative and qualitative methods; however, quality assessment tools typically evaluate these study designs separately.16 The Quality Assessment Tool for Studies with Diverse Designs (QATSDD) is a validated tool that standardises the quality assessment of research with heterogeneous study designs.16 A total of 16 items are scored using 4-point Likert scales and guidance notes to reduce subjectivity. All items are relevant to mixed-methods research, 14 items are relevant to qualitative research and 14 items are relevant to quantitative research. Included articles were assessed using QATSDD and quality was expressed as a percentage. All reviewers assessed three articles and compared results to ensure that the tool was applied consistently. RB completed the remaining quality assessments which were second reviewed by IK, RL and NT. Discrepancies were resolved by discussion and articles were included regardless of outcomes.
Data extraction and synthesis
A data extraction form was piloted to ensure effective and consistent use. Data were extracted for the following broad areas (see online supplementary file 3 which provides full details): (1) general information on the positive deviance project including the aims, setting and outcomes/behaviours explored; (2) the definition of positive deviance used and the process followed and (3) the methods used to apply the positive deviance approach at each stage of the Bradley et al process (figure 1—all studies could be coded according to these four stages).7 Data were extracted by RB, second reviewed by RL, IK or NT, and discrepancies were resolved by discussion.
The heterogeneous study designs, settings, behaviours and outcomes precluded a meta-analysis or effectiveness review; therefore where relevant, Popay et al's guidance for narrative synthesis was followed.17–19 Their iterative framework is complemented by tools and techniques which can be used to synthesise literature.17 Initially a theory is developed of how, why and for whom an intervention works. This aspect of the synthesis is not always conducted, and for this review it lacked relevance to the aims and heterogeneous articles. Groupings and clusters, tabulation, vote counting and thematic analysis were then used to develop a preliminary synthesis. Relationships within the data were explored using textual/qualitative case descriptions, and finally, the robustness of the synthesis was assessed using critical reflections and validity assessments.17
Results
The search strategy yielded 818 articles excluding duplicates and 7 articles were identified through reference list and citation searches. In total, 37 articles were included representing 22 distinct positive deviance projects (figure 2). Articles were primarily excluded for not explicitly using the positive deviance approach.
Flowchart summarising study selection.
The key characteristics of included articles are outlined in table 2. The positive deviance approach was most frequently applied in North America, within secondary care settings, and to address healthcare-associated infections and/or hand hygiene problems. Other applications include nurse–patient communication within Indonesian public clinics,11 clinical achievement within Pakistani medical schools41 and immunisation coverage across Africa.52 A vote count highlighted that stages 1 and 2 of the Bradley et al process7 were most frequently addressed—identifying positive deviants and generating hypotheses about how they succeed (table 2). Hypotheses were rarely tested or disseminated (stages 3 and 4). About 73% of articles were published after 2011, and study quality was predominantly low, ranging from 2.1% to 50.0%.
Key characteristics of positive deviance applications within healthcare organisations
Positive deviance definitions
Definitions of the positive deviance approach were thematically analysed to reveal four key themes (table 3). Positive deviants were defined as high performers who demonstrated different or uncommon behaviours. Community involvement is integral to the approach and positively deviant behaviours should be sustainable and feasible within current resources. Most definitions lacked detail with few containing all four themes.24 ,34 ,36 ,43 ,46 Some articles did not define positive deviance at all.20 ,30–32 ,42 ,45 ,54 Conceptualisations of the approach also varied. Community involvement was central to Anzarut et al's definition,28 while Kennedy et al33 emphasised that determinants of success do not necessarily oppose determinants of failure. Positive deviance was commonly used as a single improvement method, but 26 articles did not explicitly state which process had been followed (see online supplementary file 4). Where details were provided, the Bradley et al's four-stage process7 was most commonly followed (six articles—see online supplementary file 4).
Key themes within healthcare definitions of positive deviance
Study design and methods
Stage 1—identifying positive deviants
Positively deviant organisations, teams and/or individuals were not explicitly identified in 2 of the 22 distinct projects.26–28 Instead, success was explored without prior assessment or knowledge of performance (stage 2). It was unclear whether positive deviants were identified within some of the Veterans Affairs literature,42 ,43 ,45 ,47 and Lindberg and Schneider34 identified positively deviant behaviours rather than individuals or groups.
Positive deviants were identified quantitatively in 13 projects using both single10 ,22 ,23 ,25 ,29 ,30 ,52 ,54 and composite measures21 ,20 ,41 ,49 ,53 (see online supplementary file 4). Eight of these projects used routinely collected data, although, case notes, nurse–patient consultations, non-routine data and national awards were also used.10 ,11 ,33 ,41 Positive deviants were identified less frequently using qualitative methods including peer recommendation, document analysis, observation and mixed-method combinations of the above (see online supplementary file 4).
Although limited detail in articles hindered assessment, positive deviants were most frequently identified as organisations (eg, high-performing hospitals29 and primary healthcare units54) or individuals (eg, physicians22 or nurses and patients11). Only one study explicitly identified positively deviant teams.49 When identifying positive deviants, various characteristics were accounted for including the context and inclusion of high-risk settings,24 ,50 ,51 ensuring coverage of diverse characteristics and confounding variables20 ,21 ,23 ,29 ,30 and selecting a convenient sample.52 ,53
Many articles provided limited or no detail about what criteria constituted positive deviance (see online supplementary file 4). Performance was typically ranked and positive deviants were classified as the highest performers, or those among the highest performers.10 ,20 ,21 ,29 ,30 ,54 Qualitative criteria included vague descriptions of staff attitudes37 ,38 and more thorough descriptions of health status and behaviours, for example, being a thriving newborn.24 Although positive deviants were typically classified by extreme high performance, one study identified 40% of their sample.41 Nine projects assessed performance over time—commonly between 1 and 2 years. For these studies, positive deviance was therefore classified as consistent rather than one of success (see online supplementary file 4).11 ,20–22 ,25 ,29 ,30 ,33 ,41 ,52 ,54
Stage 2—generating hypotheses about how positive deviants succeed
Stage 2 was addressed in 29 articles (table 2), the majority of which used qualitative methods to explore how positive deviants succeed (see online supplementary file 4). All but four of these studies conducted individual interviews,10 ,34 ,36 ,46 and 10 articles used focus groups or Discovery and Action Dialogues (DADs—facilitated group conversations).34 Individual/group interviews were often combined with observation, site visits and document analysis. Many studies used extensive resources, for example, conducting 158 interviews with 11 site visits lasting 1 or 2 days each.29 ,30 ,32 Only five projects used single or less-intensive qualitative methods.10 ,20 ,26 ,27 ,36 ,50 ,51
Stage 2 was conducted using quantitative, routinely collected data and/or surveys in four projects.22 ,23 ,28 ,33 Mixed methods were used in four additional projects, typically combining interviews, focus groups or DADs with surveys and routinely collected data.11 ,21 ,35 ,37–39 Twelve projects included comparison groups to assess how positive deviants differed from others (see online supplementary file 4). These usually comprised negative deviants (worst performers) and those of varying performance levels. Interestingly six projects indiscriminately included everyone regardless of performance level, and seven projects only sampled positive deviants.
While exploring how positive deviants succeed, six projects did not outline which factors had been assessed. 22 ,33 ,37–39 ,41 ,44 ,46 ,48 This review intended to classify positively deviant behaviours according to the Systems Engineering Initiative for Patient Safety 2 model;55 however, limited detail about how positive deviants achieved success prevented this.
Stage 3—testing positively deviant strategies
Stage 3 was conducted to a limited extent in six studies (table 2). Surveys or quantitative data collection following an intervention were the most commonly used methods, although one study combined this with focus groups.41 Bradley et al31 were the only authors to truly test positively deviant hypotheses within larger, more representative samples. They scaled up from 11 to 533 hospitals using a web-based survey. Half of the studies did not test hypotheses beyond the initial study site.28 ,41 ,48
Stage 4—disseminating positively deviant strategies
Dissemination was reported in six articles (table 1), although they lacked detail about how interventions were designed and implemented.34 ,48 The most comprehensive account reviewed positively deviant findings at community meetings and created action plans to address high infant mortality ratios.24 Three studies disseminated a methicillin-resistant Staphylococcus aureus (MRSA) prevention bundle but did not report how positive deviance was applied or what results were gained.42 ,45 ,47
Involvement of healthcare staff and patients
Textual, qualitative descriptions of studies were used to explore whether staff and patients or external research teams typically set up and conducted the positive deviance projects. Healthcare staff were involved solely as participants for interviews and focus groups and the like in 18 articles (for examples see Gabbay et al,21 Abrahamson et al,26 and Klaiman et al.50 Beyond this, staff were not integral to implementing the positive deviance approach. They did not choose the problem, identify the positive deviants or conduct the qualitative enquiries. Limited staff involvement was facilitated through designing materials,31 identifying positive deviants 24 ,30 ,32 ,52 and consulting on the success strategies identified. 28 ,41 Front-line staff were integral throughout four unique projects (12 articles) which used DADs to explore success.34–40 ,43–47 These articles though lacked detail about how the DADs were conducted and tended to be of lower quality. This was particularly pertinent for the Veterans Affairs research where quality ranged from 2.1% to 8.3%.42–47
Patients were involved in two unique projects. One study identified and interviewed positively deviant patients,11 while the other engaged patients in identifying positively deviant solutions, but did not explain how this was done.44 ,46
Quality assessment
Overall study quality was low, ranging from 2.1% to 50.0%, with an average score of 23.3%. Some common concerns arose. Few studies justified their sample size, data collection tools or analysis methods. Detailed recruitment data were not provided, for example, studies using DADs did not report the number of positive deviants and/or staff involved.34–40 ,42–47 At times limited detail made it difficult to identify which stage/s of the positive deviance process had been conducted. This was especially pertinent for stages 3 and 4, and is exemplified by the Veterans Affairs project. Here it was unclear how studies linked together, what methods were used to implement the approach, whether a process was followed and, in most cases, what positively deviant behaviours were identified.42–47
Only a handful of studies used theory or frameworks to guide their qualitative enquiry,10 ,34 ,50 ,51 and the factors investigated were rarely justified. Finally, data collection procedures were inadequately described in most articles. This is concerning as limited guidance on the approach currently exists.8
Discussion
This systematic review synthesises healthcare applications of the positive deviance approach. Although studies vary in their focus, setting and location, positive deviance is frequently applied within secondary care, as is common within the quality improvement literature.56
Applications lack quality and detail
Using a validated tool, studies applying the positive deviance approach in healthcare were found to be low in quality; consideration and justification for study designs and methods were frequently missing, and key details were omitted. Interestingly, the positive deviance systematic review on childhood malnutrition also highlighted incomplete reporting and poor quality literature.12
The multi-method nature of the positive deviance approach precludes the use of randomised control trials and purely quantitative designs which are typically coveted within healthcare.57 In addition, researchers are yet to agree on universal quality indicators and guidance for reporting qualitative methods.58 This may have contributed to the poor quality and lack of detail observed, although the problem is likely compounded by limited guidance on how to implement the approach. Consequently, we cannot conclude whether study limitations are due to poor quality design and methods, insufficient reporting or inadequate guidance.
As seen more widely within the quality improvement literature,56 details were particularly lacking where the positive deviance approach had been applied within complex interventions. Although it is often difficult to disentangle the effects of multiple interventions, as a minimum, researchers should assess and report whether positive deviance has been implemented appropriately.
Defining positive deviance
Healthcare definitions of positive deviance shared similarities with each other, and with those used in other industries and settings.9 ,59 Nevertheless, it is concerning the frequency with which limited or no definitions and/or processes were reported. Detailed definitions and explanations of how to implement positive deviance are paramount due to the novelty of this approach within healthcare. An exemplar definition would fully describe all aspects of the approach including its focus on exceptional performance, the importance of community involvement and the ability to succeed through different or deviant behaviours while facing the same resource constraints as others. Information about the process followed must also be provided. Without this the ability to critically assess literature and build on previous shortcomings is limited. If researchers wish to understand the effectiveness of improvement approaches, then precise definitions, categorisation and operationalisation are required.56 Furthermore, research is required to understand the mechanisms and/or theories of change which underpin the positive deviance approach.
Further exploration of how to define ‘deviance’ is warranted. Positive deviants—whether they be individuals, teams or organisations—can be defined and identified in four different ways: statistically, based on their extreme conformity, through others’ reactions, or in comparison to norms.60 Within healthcare there may be implications to the definitions used; for example, despite an individual's honourable intentions, deviating from clinical guidelines could result in the loss of professional registration. Within this review, limited detail hindered assessments of whether positive deviants succeed through truly ‘deviant’/‘different’ behaviours or whether they simply performed better along a continuum. If success is achieved through non-deviant means, then one might question whether the positive deviance approach is being applied. We may just be learning from high performers61 or those with resilience5 and the approach would therefore be better served by a more appropriate title.
Study design and methods used
Research focused on the first two stages of the positive deviance process using quantitative and qualitative methods as suggested by Bradley et al.7 Despite this, various concerns arose from the study designs and methods chosen. Some studies did not clarify who the positive deviants were and how they had been identified, if indeed, they had been identified at all. The criteria used often appeared arbitrary and cut-off points were not justified, that is, it was unclear which individuals, teams or organisations were or were not classified as positively deviant. Vague definitions of the approach compound this problem making it difficult to generate criteria and thus identify positive deviants. In addition, a lack of comparison groups restricted assessments of whether success strategies were unique to positive deviants or in fact common across communities.
Theory and/or frameworks were rarely used to explore positively deviant behaviours. Consequently we cannot conclude whether the factors influencing performance have been comprehensively assessed or whether success was achieved through unobserved or unmeasured behaviours.62 Theory can also help structure literature and facilitate comparisons between studies of a similar nature.62
The third and fourth stages of the positive deviance process were rarely conducted, or even acknowledged as subsequent steps. The novelty of the literature field may mean that this research is ongoing. Alternatively, the resources required to ‘scale up’ projects may have reduced the feasibility of conducting these stages. Where stages 3 and 4 have been conducted, more rigorous designs and methods should have been used. Bradley et al31 report the most comprehensive testing of positively deviant strategies (stage 3), although attempts should be made to assess causality, not just correlation.63 More research addressing these stages is required to evaluate the effectiveness of the approach.
Community involvement
The short-lived, modest or negligible effects of top–down, complex interventions are frequently attributed to differing contexts and inadequate community involvement.3 ,64 The positive deviance approach involves healthcare staff throughout the process and identifies context-specific behaviours that are already used to succeed. This review however observed very little community involvement, a finding which was replicated by the previous systematic review on childhood malnutrition.12 Engaging staff more broadly in quality improvement projects is known to be difficult;2 therefore, applying positive deviance within complex and demanding healthcare settings is likely to present further challenges. Research must identify practical, yet robust methods to facilitate staff involvement and should explore the level of community involvement required to maximise outcomes.
Relationships between quality, methods and involvement
Two polarised observations emerged through this review. Studies which intensively involved healthcare staff commonly used word of mouth/observation and DADs to conduct stages 1 and 2. These studies were of lower quality, predominantly due to a lack of detail. In contrast, higher quality studies were typically conducted by external research teams who used extensive methods and resources. Staff involvement was minimal other than as participants.
Quality improvement approaches should be practical enough for clinical health professionals to implement on the front line. The positive deviance approach requires feasible and efficient methods which maintain rigour and quality while effectively involving staff and patients. Within the current literature, this balance is yet to be struck.
Review limitations
Limitations of this review should be considered alongside its findings. Despite an inclusive search strategy, relevant articles may not have been identified. Articles may not have explicitly stated that positive deviance was applied, and publication lags may have biased the research available for stages three and four of the process. Excluding grey literature and non-peer-reviewed articles may have overestimated the quality of the literature field. This however supports findings that the approach is inadequately defined, and the quality of applications is low.
Poor reporting may have led to an unduly negative assessment of quality. Future applications of positive deviance should provide sufficient detail so that methods can be replicated and refined. Finally, this review cannot assess how study designs and methods are associated with the effectiveness of the approach. Calculations of effect sizes are precluded by the limited number of applications, the focus on heterogeneous outcomes and use of qualitative methods.
Implication and recommendations
The positive deviance approach has great potential to improve the quality of healthcare, as solutions are likely to be sustainable, acceptable to staff and feasible within current resources.6 Despite the ‘bottom up’ philosophy, most applications have been conducted by external research teams. The following recommendations are put forward to develop the positive deviance approach and make it more accessible to front-line clinical health professionals and the wider improvement community.
Studies must clearly define the positive deviance approach and specific process followed.
The methods and criteria used to identify positive deviants must always be stated regardless of whether they are exceptionally performing individuals, teams or organisations. Issues regarding reliability and validity of the data analysed should also be discussed.
The quality and reporting of literature can be improved by using relevant elements of research reporting guidelines such as CONSORT and SQUIRE.65 ,66
Authors should clarify whether the success strategies identified are considered deviant, different or just better than those used by others.
A theoretical approach should be taken to identify and define positively deviant success strategies in order to facilitate appropriate generalisations across problems and topics.
Conclusion
Various shortcomings are observed within healthcare applications of the positive deviance approach, not all of which are unique to this setting.12 The quality of methods and reporting needs to improve, theories and frameworks should be applied and comparison groups must be used to ensure factors are comprehensively assessed and that hypotheses can be attributed solely to positive deviants. Additional research and discussion among academics and clinicians is required to find a balance between using practicable methods, maintaining quality and involving healthcare staff throughout the positive deviance process.
Finally, research targeting the latter stages of the process is required to assess and compare the effectiveness of positive deviance with alternative improvement approaches. Effectiveness reviews are rarely conducted within quality improvement research, but they are necessary to help organisations decide which approach to use and how best to invest their scarce resources.56
Acknowledgments
The authors thank The Health Foundation for funding the PhD studentship through which this systematic review was completed. RB, IK and RL are members of the Evidence-Based Transformation Theme of the National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care Yorkshire and Humber (NIHR CLAHRC YH). This report presents independent research by the NIHR CLAHRC YH (http://www.clahrc-yh.nir.ac.uk). The views and opinions expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.
References
Supplementary materials
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
- Data supplement 1 - Online 1-PRISMA checklist
- Data supplement 2 - Online 2-Search strategy
- Data supplement 3 - Online 3-Data extraction
- Data supplement 4 - Online 4-Extended table of results
Footnotes
Twitter Follow Natalie Taylor at @njt14, Ruth Baxter at @RuthMBaxter, Ian Kellar at @DrIanKellar, Rebecca Lawton at @LawtonRebecca
Contributors All authors developed the concept for this systematic review. RB designed the study and conducted the searches, screening, data extraction and analysis with input at all stages from IK, NT and RL. RB drafted the manuscript and all authors provided comments and approved the final version.
Funding Health Foundation (PhDs in Improvement Science).
Competing interests None declared.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement Supporting documents relevant to the results of this review have been submitted as supplementary files. Extracted data, which are not included within this report, are available on request.