Article Text

How to co-design a prototype of a clinical practice tool: a framework with practical guidance and a case study
  1. Matthew Woodward1,
  2. Mary Dixon-Woods1,
  3. Wendy Randall2,
  4. Caroline Walker2,
  5. Chloe Hughes2,
  6. Sarah Blackwell2,
  7. Louise Dewick3,
  8. Rachna Bahl3,4,
  9. Tim Draycott3,5,
  10. Cathy Winter6,
  11. Akbar Ansari1,
  12. Alison Powell1,
  13. Janet Willars1,
  14. Imogen A F Brown1,
  15. Annabelle Olsson1,
  16. Natalie Richards1,
  17. Joann Leeding1,
  18. Lisa Hinton1,
  19. Jenni Burt1,
  20. Giulia Maistrello7,
  21. Charlotte Davies7,
  22. Thiscovery Authorship Group,
  23. ABC Contributor Group,
  24. Jan W van der Scheer1
      1. 1 THIS Institute (The Healthcare Improvement Studies Institute), Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
      2. 2 The Royal College of Midwives, London, UK
      3. 3 Royal College of Obstetricians and Gynaecologists, London, UK
      4. 4 University Hospitals Bristol and Weston NHS Foundation Trust, Bristol, UK
      5. 5 North Bristol NHS Trust, Westbury on Trym, UK
      6. 6 PROMPT Maternity Foundation, Bristol, UK
      7. 7 RAND Europe, Cambridge, UK
      1. Correspondence to Dr Jan W van der Scheer, THIS Institute (The Healthcare Improvement Studies Institute), University of Cambridge, Cambridge, CB1 8RN, UK; jan.vanderscheer{at}thisinstitute.cam.ac.uk

      Abstract

      Clinical tools for use in practice—such as medicine reconciliation charts, diagnosis support tools and track-and-trigger charts—are endemic in healthcare, but relatively little attention is given to how to optimise their design. User-centred design approaches and co-design principles offer potential for improving usability and acceptability of clinical tools, but limited practical guidance is currently available. We propose a framework (FRamework for co-dESign of Clinical practice tOols or ‘FRESCO’) offering practical guidance based on user-centred methods and co-design principles, organised in five steps: (1) establish a multidisciplinary advisory group; (2) develop initial drafts of the prototype; (3) conduct think-aloud usability evaluations; (4) test in clinical simulations; (5) generate a final prototype informed by workshops. We applied the framework in a case study to support co-design of a prototype track-and-trigger chart for detecting and responding to possible fetal deterioration during labour. This started with establishing an advisory group of 22 members with varied expertise. Two initial draft prototypes were developed—one based on a version produced by national bodies, and the other with similar content but designed using human factors principles. Think-aloud usability evaluations of these prototypes were conducted with 15 professionals, and the findings used to inform co-design of an improved draft prototype. This was tested with 52 maternity professionals from five maternity units through clinical simulations. Analysis of these simulations and six workshops were used to co-design the final prototype to the point of readiness for large-scale testing. By codifying existing methods and principles into a single framework, FRESCO supported mobilisation of the expertise and ingenuity of diverse stakeholders to co-design a prototype track-and-trigger chart in an area of pressing service need. Subject to further evaluation, the framework has potential for application beyond the area of clinical practice in which it was applied.

      • Healthcare quality improvement
      • Human factors
      • Obstetrics and gynecology
      • Quality improvement methodologies
      • Trigger tools
      https://creativecommons.org/licenses/by/4.0/

      This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.

      Statistics from Altmetric.com

      Request Permissions

      If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

      Key messages

      • Much research and debate focuses on the validity and reliability of clinical tools for practice, but far less attention has been given to how to optimise their design and usability.

      • We propose a framework (FRamework for co-dESign of Clinical practice tOols or ‘FRESCO’) offering practical guidance for developing prototype clinical tools, drawing on user-centred design methods and co-design principles.

      • FRESCO successfully supported co-design of a prototype chart for detecting and responding to possible fetal deterioration during labour.

      • By codifying existing methods and principles into a single framework, FRESCO has potential to facilitate pragmatic, flexible and inclusive co-design of clinical practice tools, but will require further evaluation.

      Background

      Clinical practice tools—ranging from medicine reconciliation charts through to diagnosis support tools and track-and-trigger charts—are endemic in healthcare.1–3 While much research and debate focus on the validity and reliability of such tools,4 far less attention has been given to how to optimise their design.5–8 Yet, features of design, including usability,9–11 are among the most important influences on effective implementation.3 7 12 It is now clear that merely meeting technical specifications is insufficient.6 Critical to the effective deployment, implementation, and impact of clinical practice tools is early and continued engagement with end-users and broader stakeholders so that their priorities are addressed through design processes.6 13 Currently, however, thinking about how to optimise design of clinical practice tools either does not happen at all, or is deferred until far too late in the process of tool development, leading to a high level of waste associated with non-adoption or poor implementation.14 15 Though a range of design methods is available and widely used in other industries,8 their use in development of clinical practice tools has been strikingly limited.5 6 12 In this article, we propose that practical, action-oriented guidance could help to address this problem.

      User-centred design is among the most well established of the various approaches that can support better usability of clinical tools,16 and is already a staple in the development of medical devices.6 9 10 17 18 Seeking to enhance usability of products and systems through a focus on user needs and perspectives,16 user-centred methods are distinguished by their systematic and typically iterative approach to optimising design through consideration of contexts of use, usability goals, user characteristics, environment, tasks, and workflow.16 19–21 By taking into account human capacities and limitations such as effects of stress on cognition, influence of fatigue, overload through multitasking, and limited memory capacity,9 19 21 user-centred approaches have potential to enable systematic consideration of safety, effectiveness, and efficiency when designing clinical practice tools.22–24

      A user-centred approach to development of clinical practice tools is valuably complemented by co-design principles.6 18 25 Such principles encourage developers and users—including, for example, healthcare professionals, patients, human factors engineers, and graphic designers—to nurture collective creativity and to work in partnership.25–27 Application of these principles to development of clinical practice tools could strengthen or expand user-centred approaches,6 18 in particular by emphasising the need for early and continued engagement of end-users and broader stakeholders throughout the design process,6 17 18 28 29 and mobilisation of multiple forms of expertise.6 17 One established methodological framework for co-design describes involvement of users and developers across pre-design, generative, evaluative, and post-design phases (table 1).28 Some evidence has already demonstrated the usefulness of this approach to developing products and systems for healthcare.29 30

      Table 1

      The methodological framework for co-design by Sanders and Stappers28

      One example of a pressing need for improving usability and design processes is found in track-and-trigger charts for detecting and responding to patient deterioration.12 31 32 These widely used charts are based on the principle that there may be periods during which clinical deterioration is detectable by ‘tracking’ a predefined set of clinical parameters over time, with specific thresholds ‘triggering’ action.33 Track-and-trigger charts are particularly likely to benefit from user-centred design, since they seek to support clinical decision-making and action in often pressurised situations where clarity around responding to a potentially deteriorating situation is essential, and where human capacities and limitations (eg, memory capacity, effects of stress on cognition) are key influences on patient safety.12 34 Despite their potential value, track-and-trigger charts have been challenged by issues in acceptability, adoption, and use.35–37 These issues are likely to be linked to suboptimal design,12 34 including inadequate user involvement prior to implementation.32 37 38

      Despite burgeoning literature on both user-centred design (and variants, including human-centred design) and co-design,17 18 22–24 26–30 39 practical guidance for combined use of these methods and principles in the development of clinical practice tools remains limited. In this article, we address this gap. We propose a five-step framework with recommended actions for each step, and we describe a case study of its application in developing a prototype track-and-trigger chart.

      Methods

      The FRamework for co-dESign of Clinical practice tOols (FRESCO) we propose seeks to codify existing user-centred design methods and co-design principles into a single framework to guide the development of clinical practice tools to the point of readiness for large-scale testing (table 2). FRESCO recognises that development of tools usually benefits from iterative prototyping. Accordingly, it includes user-centred methods for formal prototype testing,11 13 19 40 and application of the co-design principle of using prototypes as tools for discovery, understanding, and learning.28 41 42

      Table 2

      The FRamework for co-dESign of Clinical tOols

      Using five steps outlined in table 2, FRESCO aims to facilitate a process of collective creativity through structured co-design activities,17 18 29 39 with involvement of users, developers, and other stakeholders in roles of design partners, informants, or testers.18 This process is informed throughout by findings from systematic user-centred evaluations (see steps 2–4 in table 2).

      The first step is to establish a multidisciplinary advisory group that offers voice to a diversity of experience and expertise throughout the process (see step 1). Following a pre-design phase of co-design (see steps 1 and 2), FRESCO facilitates proceeding through a generative phase (including gathering ideas from users based on concept prototypes produced by developers, see steps 2 and 3) to an evaluative co-design phase (including testing of co-designed prototypes, see steps 4 and 5). The movements from pre-design to generative to evaluative co-design phases align with, and are informed by, key user-centred design techniques such as heuristic evaluation (see step 2), think-aloud usability evaluations (see step 3) and simulations (see step 4). The last step of FRESCO aligns with completing the evaluative phase of co-design (see step 5), working towards a final prototype ready for further testing in real-life settings as part of the post-design phase (see table 1).

      We used FRESCO in a case study, aiming to co-design a track-and-trigger chart for detection and response to suspected intrapartum fetal deterioration (Box 1).

      Box 1

      Case study: Avoiding Brain Injury in Childbirth (ABC) programme

      In 2021, the UK’s Department of Health and Social Care commissioned the Avoiding Brain Injury in Childbirth (ABC) programme, a collaboration between the Royal College of Midwives (RCM), Royal College of Obstetricians and Gynaecologists (RCOG), and The Healthcare Improvement Studies Institute at the University of Cambridge. Colleagues from these institutions formed the ABC programme team.

      A key aim of the ABC Programme was to co-design a standardised approach for detecting and responding to possible fetal deterioration during labour, including a track-and-trigger chart. The need for this work had been identified as critical and urgent because problems in intrapartum monitoring and response remain major and persistent hazards in maternity care, contributing to poor outcomes at birth and clinical negligence claims.

      Current approaches to fetal monitoring during labour focus primarily on assessment of fetal heart rate features, which can be done either using intermittent auscultation (for lower-risk labours) or electronic fetal monitoring with cardiotocography (for higher-risk labours). A key innovation of the ABC programme was to combine monitoring of fetal heart rate features with other evidence-based intrapartum risk factors into a track-and-trigger tool, informed by earlier work of a task force of the RCM and RCOG. The intention of the ABC programme was to co-design an improved prototype tool, ready for deployment in a future national programme of testing, implementation, and evaluation.

      Results

      Below, we explain how each step of the framework guided the Avoiding Brain Injury in Childbirth (ABC) programme’s co-design of a prototype chart for detecting and responding to suspected fetal deterioration during labour (figure 1).

      Step 1: establish a multidisciplinary advisory group

      Optimising a tool for detecting and responding to possible fetal deterioration during labour requires access to a range of expertise and experience, including scientific knowledge, clinical expertise, lived experience of labour and using maternity services, graphic design, human factors/ergonomics, and social science. We identified individuals with one or more of these forms of expertise or experience using intentional outreach and inclusive methods of recruitment.43 We sought to be purposeful in ensuring diversity as well as addressing the potential for power imbalances.43 44 For example, we included a mix of seniority among the maternity professionals and ensured that service user representation included multiple viewpoints. As detailed in online supplemental file 1, the group included the following:

      Supplemental material

      • twelve maternity professionals (six midwives and six obstetricians),

      • five maternity service users (representing a range of maternity experiences and experience of advocating for improvement and inclusion of under-represented voices), and

      • five other specialists (human factors engineer with expertise in user-centred design, graphic designer, consensus-building specialist, and two specialists in facilitating patient and public involvement [PPI]).

      As part of the pre-design phase (including preparation of the group for the co-design process),28 roles and responsibilities across different stages of work were explicitly allocated to support efficient and effective decision-making.45 46 This, for example, meant that not all advisory group members needed to be involved in all activities of all steps, as further detailed in figure 1 and across steps 2–5 below.

      The group’s specialists in human factors engineering, consensus-building, and PPI facilitated or led exchanges, meetings, workshops, and other co-design activities.47 48 The PPI facilitators were particularly important in ensuring that everyone’s voices could be heard during meetings,43 44 as well as facilitating separate activities for maternity service users, in the interests of addressing potential power imbalances. The activities of the advisory group that were part of the generative and evaluative co-design phases28 are further detailed across steps 2–5 below.

      Step 2: develop initial drafts of the prototype

      In accordance with the pre-design and generative phase of co-design,28 41 we set out to understand stakeholders’ experiences of the work system under consideration.19–21 49 This included developing two alternative prototypes of the track-and-trigger tool to explore which design elements worked best for maternity professionals.13 49

      Prior to the programme, a task force from two national bodies (Box 1) had developed an initial draft prototype (‘Design 1’, see figure 1 and online supplemental file 2). It included the evidence-based clinical information required for detection and responding to possible fetal deterioration, but was focused more on clinical content than on design. A human factors engineer evaluated the draft prototype against usability heuristics,34 50 51 while alert to the contexts of use20 such as intended or expected users, tasks, physical environment, social and organisational milieu, and technical and environmental constraints.19–21

      A second prototype (‘Design 2’, see figure 1 and online supplemental file 2) was then developed with support of the graphic designer, based on the clinical information and heuristic evaluation of Design 1 as well as the factors identified in analysis of the context of use description of the tool (see overview in online supplemental file 3).20 Design 2 applied established user-interface design principles (detailed in online supplemental file 3), such as the need to be attentive to limitations of memory and attention while executing a task,51–53 and the need for consistent use of colour coding and for grouping-related information together.34 50–54

      Though the clinical content of both designs was the same, they used alternative page formats, colours, font types and sizes, ways of recording observations, visuals indicating actions and information structures (see details in online supplemental file 3). These alternatives were designed to enable comparison and to prompt discussions with participants about preferences in subsequent think-aloud usability evaluation (see step 3 below).55

      Step 3: conduct think-aloud usability evaluations

      As part of the generative co-design phase,13 28 41 we conducted think-aloud formative usability sessions with 15 maternity professionals of varied backgrounds (online supplemental file 4).10 11 19 Asking people to work with designs 1 and 2 (see figure 1), the sessions were aimed at understanding processes of cognition and identifying usability flaws (and their causes) with a small group of representative end-users.11 19 46

      In advance of the session, participants received print-outs of the two draft prototypes, examples of the drafts with recorded observations, and clinical scenarios. Each session took part during a video call hosted on an online platform1, and was facilitated by a moderator (trained interviewer or human factors engineer). Sessions were organised so that designs 1 and 2 were covered in a sequence counterbalanced across participants to mitigate order effects. The moderator started with an exercise to encourage the participant to think aloud in describing their experiences while interacting with the prototype,10 11 19 with prompts used to elicit experiences of particular design elements. Following this think-aloud exercise, the moderator used a semistructured interview guide (see online supplemental file 4) to ask about preferences for elements of one of the designs, elicit further views on design aspects that could be improved and use of the chart in practice.6 10 29 56

      The sessions took about one hour each. They were audio-recorded and transcribed verbatim. Analysis focused on preferences for elements of the two designs and identification of design principles to guide future prototype iterations.56–58 Participants preferred the detail contained within Design 1, but found Design 2 easier to complete and interpret (table 3). These findings reflected the tension between high data density and information overload.54 They highlight that a particular consideration in developing clinical practical tools is striking a balance between: (1) including sufficient information to support task completion, and (2) preventing high data density that can increase search times and mental workload, particularly if information is poorly structured.59 Further qualitative analysis identified five requirements to inform further prototype iterations and future implementation (table 4), such as the need for optimising flow of information.54

      Table 3

      Examples of analysis on the number of participants who preferred specific design elements of Design 1 versus Design 2 (see online supplemental file 1 for details on design elements)

      Table 4

      Identified requirements to inform further prototype iterations based on qualitative analysis of the think-aloud exercises and follow-up interviews

      The analysis informed a set of co-design activities with advisory group maternity professionals for the next prototype iteration.13 41 42 46 This included structured email exchange and online meetings facilitated by the human factors engineer or consensus facilitator to reach a professional consensus on which elements of designs 1 and 2 to incorporate in an improved draft prototype (‘Design 3’, see figure 1). Design 3 combined these elements—guided by the heuristic evaluation of step 2, the think-aloud evaluation findings of step 3 and clinical expertise—to feature:

      • selective use of colour to indicate trigger values and trend lines used for recording observations,

      • showing a ‘start of labour risk assessment’ on the same page as the intrapartum risk factors recorded during labour,

      • an A3-sized format to improve legibility while accommodating for the content detail preferred by participants, and

      • implementation of a simplified action diagram for escalation.

      Step 4: test the prototype in clinical simulations

      The evaluative phase of co-design included clinical simulation,13 28 41 which is increasingly valued for its ability to support quality improvement in health systems.60 61 Simulations have a role in both user-centred7 40 60 61 and co-design approaches.28 41 One key advantage of clinical simulation is that rare but potentially catastrophic events or conditions can be reproduced.62 Design 3 (see figure 1) was tested in close approximations of real-life settings, since this is critical to safety checks, understanding how a tool might be used in practice and identifying how to improve work systems.61

      We conducted clinical simulations involving 52 maternity professionals from five different National Health Service maternity units (online supplemental file 5). These units were recruited through convenience sampling based on availability. The simulations were designed as quality improvement activities (see Ethics approval below) guided by the ‘TEACH Sim’ framework,63 focusing on: (1) testing usability of the Design 3 prototype, (2) comparing care with the prototype with usual care with the unit’s existing documentation, and (3) informing the next iteration of the prototype. TEACH Sim helped to specify the simulation’s objectives, audience, scenario script, equipment, actors, and team composition.63

      As simulation is especially well suited for conducting controlled tests exposing one group but not the other to a new prototype,60 64 we employed the same clinical scenario twice in each round of simulation: first with a team using usual care and the second time with a different team using the Design 3 prototype (figure 1). Facilitated by an experienced midwife from the advisory group, simulations in two units took place in situ, that is, in the participants’ own clinical settings where care is routinely performed.60 61 Due to clinical pressures, simulations in other units took place in a dedicated simulation laboratory or a clinical teaching setting.

      Simulations were audio and video-recorded, with one camera fixed above the desk to capture participants making recordings on intrapartum tools. A trained ethnographer65 used a fieldnote form to record observations on aspects such as teamwork, professional roles and boundaries, communication, and social atmosphere during the simulation, with a focus on use of the intrapartum tools.

      Each simulation was followed by an audio-recorded, verbatim-transcribed debrief7 66 67 and focus group6 10 65 session with the participants, facilitated by the ethnographer and an advisory group midwife using a topic guide (online supplemental file 5). The debriefing and focus group discussions with the teams involved in the simulation aided learning, through reflecting on experiences of the scenario, contextual and environment issues, safety concerns, acceptability and usability of the usual care and prototype tools, as well as identifying opportunities for better teamwork, equipment set-ups, escalation systems, and design of tools.61 67 The focus group discussions also helped generate further ideas to improve the draft prototype.6 10 65

      Following the focus group, participants completed the Ottawa Acceptability of Decision Rules Instrument.68 This validated survey instrument further complemented assessment of reported usability,10 and comparison between groups providing usual care and prototype care.68 69

      Analysis57 70 focused on four areas: (1) recording errors and corrections made on the prototype charts, (2) if triggers during the simulation safety checks consistently led to the required actions for safe care, (3) the role of the intrapartum tools in communication (both within the team and with those in labour and their birth partners), and (4) suggestions for improving the usability of the draft prototype. Data analysis used narrative summaries and observational checklists to code the behaviour of simulation participants based on video recordings or direct observations of the sociotechnical system during the simulations.70 Quantitative usability analysis assessed use errors and corrections on the charts.19 58 71

      The findings of the simulations (table 5) informed meetings with maternity professionals from the advisory group, facilitated by the human factors engineer and consensus specialist. One key discussion point was the need to support transfer across settings, that is, from low-risk settings where intermittent auscultation is used to higher-risk settings where cardiotocography is used. The group reached a consensus on a single prototype (‘Design 4’, see figure 1). Design 4 required users to refer to a second page for actions (compared with the original single-page format—see online supplemental files 2 and 3). The group viewed this as an acceptable trade-off given that the single prototype would support transfer across settings.

      Table 5

      Examples and key findings of the analysis of the simulations

      Step 5: generating a final prototype using co-design workshops

      Step 4 identified a need for further input to (i) improve use of the prototype in terms of communication with the person in labour and (ii) finalise the action diagram. To complete the evaluative co-design phase,28 this was addressed with the advisory group through workshops. These have shown potential for practical and effective ways to finalise a prototype.13 17 18 39 41 46 To address potential power imbalances, workshops were organised with subgroups (figure 1). Facilitators supported agenda-setting, procedures, and consensus rules,72 73 and were mindful of power dynamics.44

      The PPI facilitators introduced Design 4 to the five service user representatives and gained feedback on it during three discussion workshops (figure 1), exploring in particular how the prototype might impact communication with those in labour. The maternity professionals and human factors engineer joined the discussions upon invitation by the PPI facilitators or service users. These workshops led to the inclusion of an additional item—‘is the woman concerned?’—in the final prototype, as this was a key proposal made by the representatives.

      To address the identified use difficulties with the flow chart actions, an alternative grid format (vs the original flow chart format) was developed.10 46 The human factors engineer facilitated three workshops with maternity professionals from the advisory group, in which the flow chart and grid formats were used alongside each other with reference to written clinical scenarios (figure 1).10 They reached a consensus that the grid layout provided better usability—through its better conveyance of the data34 54—and should be implemented in the final prototype. The final prototype (see online supplemental file 6) was prepared by the human factors engineer and graphic designer, reviewed by the advisory group and considered ready for use in large-scale testing.

      Discussion

      Clinical practice tools have not routinely benefited from systematic combination of user-centred design methods and co-design principles applied to their development,6 17 18 despite the availability of well-established techniques with a good track record in improving design and usability in a range of clinical applications.11 13 16 29 30 One likely reason for this is the limited practical guidance about how to deploy these approaches in a pragmatic yet systematic manner for development of clinical practice tools. The framework (FRESCO) proposed in this article codifies existing user-centred design methods and co-design principles into practical guidance for enabling mobilisation of multiple forms of expertise for development of clinical practice tools. Our case study illustrates application of the framework in an area of pressing need, leading to a viable track-and-trigger prototype tool ready for large-scale testing. The study also helps to address the call for better reporting of healthcare improvement activities that align with principles of co-design.18 39 74

      FRESCO builds on an established co-design framework (table 1),28–30 including use of pre-design, generative, and evaluative phases that can inform future post-design implementation phases with the produced prototype. One of its contributions is in sensitising developers of clinical practice tools to systematic consideration of the needs and priorities of users—through application of principles of collective creativity and inclusivity central to co-design into a series of actionable steps25–27—while employing a user-centred design approach that supports safety, effectiveness, and efficiency.22–24 The case study also illustrates that employment of FRESCO is consistent with a design process moving from medium to high structural restrictiveness.55 The generative phase started with various concept prototypes that encouraged the co-design group to explore alternative ideas, which helped prevent the risk of premature closure around one solution. During the evaluative phase, the best elements of the concept prototypes were then integrated through iterative cycles into a single prototype, using high structural restrictiveness to increase decision-making precision.55

      Findings of the case study suggest that FRESCO supports inclusive ways of co-designing prototype clinical practice tools and enabled improvements based on voices that are often under-represented in development of clinical practice tools. As an example, a novel prompt—‘is the woman concerned?’—was included in the prototype to help ensure optimal communication with those in labour and their birth partners, following input of service user representatives. This helped address the imperative to include patient/family concern in track-and-trigger systems75 as well as the broader concern to listen better to families and involve them in their own care.76 The in situ simulations helped to understand how the prompt could be best used in practice. Key to achieving co-design in this way is commitment to inclusion, facilitation that focuses on hearing everyone’s voices and managing power dynamics through, for example, organising separate activities for service users when needed. These findings suggest that FRESCO can contribute to the need for effective ways of co-design with patients, as called for in models for co-creation of healthcare services.77

      Strengths and limitations of the framework

      While FRESCO helped develop a prototype track-and-trigger tool, further evaluation will be needed to determine clinical and service user experience, efficiency, implementability, sustainability of change, impact on clinical outcomes, and any unintended consequences.78 79 Piloting and large-scale, national testing will be important in supporting this. Further examples of use cases outside of this context would help to refine and test the framework, for example to: (1) determine whether clinical practice tools produced using the framework offer advantages over others, (2) establish the resourcing needed for minimal and optimal execution of each step, and (3) assess the extent to which steps may need to be adapted for use in lower-resourced settings. There is also a need to generate learning on how to sustain engagement and involvement of users in the design process.

      Although the resource implications of using FRESCO are significant, so too are the costs of developing the technical components of clinical practice tools.14 Moreover, deploying suboptimally designed tools introduces multiple risks and potential for waste.3 5 12 71 Ultimately, FRESCO could help to prevent the characteristic dysfunctions associated with exclusively bottom-up or top-down innovation for quality improvement,80 such as lack of access to specific expertise common in locally led, bottom-up approaches,15 and risk of perverse incentives associated with top-down approaches.81 For example, using the framework as a practical guide to developing a prototype clinical practice tool could help prevent suboptimal implementation owing to inadequate or absent exploration of usability or acceptability,7 38 78 82 83 or waiting until the end of the development cycle when the sunk costs may limit improvement.7 12 83

      Limitations of the case study

      The pandemic conditions in which the case study was conducted imposed some limitations, including the need to adapt established in-person think-aloud methods and conduct of observations. These adaptations did highlight the flexibility inherent to our proposed framework. Ongoing pressures caused by the pandemic also required the use of convenience sampling of units for the simulations and use of clinical simulation laboratories instead of in situ settings in some units, so representativeness was difficult to determine.

      Conclusion

      The proposed framework (FRESCO), combining user-centred design methods and co-design principles, was successfully deployed to develop a prototype clinical practice tool for detecting and responding to possible fetal deterioration during labour. By codifying existing methods and principles into a single actionable framework, FRESCO has potential to facilitate pragmatic, flexible, and inclusive co-design of clinical practice tools using methods that can be standardised, replicated, and potentially scaled when needed, but will require further evaluation. Future work can also help identify the kinds of applications the framework works best for and where its limits lie.

      Ethics statements

      Patient consent for publication

      Ethics approval

      This study involves human participants. The usability evaluations received ethics approval from the University of Cambridge Psychology Research Ethics Committee (PRE.2021.067). All participants provided written informed consent and were invited to join the ABC authorship group. The UK’s Health Research Authority decision tool (http://www.hra-decisiontools.org.uk/research/) showed that ethics approval was not required for the simulations, as they were classified as quality improvement activities, in which all of the participants provided written informed consent and were invited to join the ABC authorship group.

      Acknowledgments

      For recruitment and communications support, we thank the Avoiding Brain Injury in Childbirth (ABC) communications team including members from THIS Institute, RCOG and RCM. We are grateful for the many and varied contributions from colleagues across the ABC programme team and external to the team, including the graphic designers (Dan Gould Design, Soapbox) and video agency (Hobson Curtis).

      References

      Supplementary materials

      • Supplementary Data

        This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

      Footnotes

      • Twitter @MaryDixonWoods & @THIS_Institute, @LisaHinton4, @janvdscheer

      • Collaborators Thiscovery Authorship Group: Ruth Cousens, Jordan Moxey, Luke Steer, Andy Paterson, André Sartori. ABC Contributor Group: Aiesha Lake, Amar M Karia, Anna MA Croot, Bethan Everson, Bothaina Attal, Carlo Personeni, Charity Khoo, Charity LK Khoo, Charlotte Vale, Clare Shakespeare, Cossor Anwar, Daniel Wolstenholme, Daisy V Westaway, Emma Crookes, Evleen Price, Georgina Brehaut, Hannah K Twinney, Hannah Sharpe, Helena Bull, Ilaria Medda, Jayden J Mills, Jennifer Jardine, Julia F Bodle, Julie McKay, Karen Hooper, Katarina Tvarozkova, Katie Cornthwaite, Libby Shaw, Louise Houghton, Lucy M Saunders, M Nwandison, Margaret Blott, Mary Edmondson, Megan Gailey, Nina Johns, Pauline Hewitt, Phil Steer, Sophie Relph, Subhadeep Roy, Susanna Stanford, Theresa Fitzpatrick, Zeba Ismaeljibai, Zenab Barry.

      • Contributors All authors read and approved the final manuscript. Their specific contributions, following CRediT (Contributor Roles Taxonomy), are as follows: MW contributed to conceptualisation, formal analysis, investigation, methodology, project administration, writing (original draft preparation) and writing (review and editing). MD-W contributed to conceptualisation, funding acquisition, methodology, project administration, supervision, writing (original draft preparation) and writing (review and editing). WR contributed to investigation, methodology, project administration, resources, supervision and writing (review and editing). CW contributed to investigation, project administration, resources and writing (review and editing). CH contributed to investigation, project administration, resources and writing (review and editing). SB contributed to investigation, project administration, resources and writing (review and editing). LD contributed to investigation, project administration, resources and writing (review and editing). RB contributed to conceptualisation, methodology, supervision and writing (review and editing). TD contributed to conceptualisation, funding acquisition, methodology, project administration, supervision and writing (review and editing). CW contributed to methodology, resources and writing (review and editing). AP contributed to formal analysis, project administration, investigation, methodology and writing (review and editing). AA contributed to formal analysis, project administration and writing (review and editing). JW contributed to formal analysis, investigation, methodology and writing (review and editing). IAFB contributed to formal analysis and writing (review and editing). AO contributed to formal analysis and writing (review and editing). NR contributed to formal analysis and writing (review and editing). JL contributed to formal analysis, investigation, methodology, project administration and writing (review and editing). LH contributed to formal analysis, conceptualisation, investigation, methodology, project administration, supervision and writing (review and editing). JB contributed to conceptualisation, formal analysis, funding acquisition, methodology, project administration, supervision, writing (original draft preparation) and writing (review and editing). GM contributed to formal analysis, project administration and writing (review and editing). CD contributed to formal analysis and writing (review and editing). JWvdS contributed to conceptualisation, formal analysis, methodology, project administration, supervision, writing (original draft preparation) and writing (review and editing). The final version of the manuscript was also read and approved by the members of the Thiscovery Authorship Group and the ABC Contributor Group (see the Acknowledgements section). JWvdS is the guarantor of the study.

      • Funding The Department of Health and Social Care (UK) provided funding for the Avoiding Brain Injury in Childbirth (ABC) programme. The methodological work presented in this paper was supported by THIS Institute, which is funded by the Health Foundation (Grant/Award Number: RHZF/001 - RG88620), an independent charity committed to bringing about better health and health care for people in the UK. Contributions of Mary Dixon-Woods to the work were supported by the National Institute for Health and Care Research (MD-W was an NIHR Senior Investigator [NF-SI-0617-10026] during conduct of the study).

      • Competing interests None declared.

      • Provenance and peer review Not commissioned; externally peer reviewed.

      • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

      • https://thiscovery.org/about

      Linked Articles