Article Text

PDF

Safety culture assessment in community pharmacy: development, face validity, and feasibility of the Manchester Patient Safety Assessment Framework
  1. D M Ashcroft1,
  2. C Morecroft1,
  3. D Parker2,
  4. P R Noyce1
  1. 1School of Pharmacy and Pharmaceutical Sciences, University of Manchester, UK
  2. 2School of Psychological Sciences, University of Manchester, UK
  1. Correspondence to:
 Dr D M Ashcroft
 Senior Clinical Lecturer, School of Pharmacy and Pharmaceutical Sciences, University of Manchester, Oxford Road, Manchester M13 9PL, UK; darren.ashcroft{at}manchester.ac.uk

Abstract

Objective: To develop a framework that could be used by community pharmacies to self-assess their current level of safety culture maturity, which has high face validity and is both acceptable and feasible for use in this setting.

Design: An iterative review process in which the framework was developed and evaluated through a series of 10 focus groups with a purposive sample of 67 community pharmacists and support staff in the UK.

Main outcome measures: Development of the framework and qualitative process feedback on its acceptability, face validity, and feasibility for use in community pharmacies.

Results: Using this process, a version of the Manchester Patient Safety Assessment Framework (MaPSAF) was developed that is suitable for application to community pharmacies. The participants were able to understand the concepts, recognised differences between the five stages of safety culture maturity, and concurred with the descriptions from personal experience. They also indicated that they would be willing to use the framework but recognised that staff would require protected time in order to complete the assessment.

Conclusions: In practice the MaPSAF is likely to have a number of uses including raising awareness about patient safety and illustrating any differences in perception between staff, stimulating discussion about the strengths and weaknesses of patient safety culture within the pharmacy, identifying areas for improvement, and evaluating patient safety interventions and tracking changes over time. This will support the development of a mature safety culture in community pharmacies.

  • patient safety
  • organisational culture
  • community pharmacy

Statistics from Altmetric.com

Organisational culture has been defined as “a complex framework of national, organisational and professional attitudes and values within which groups and individuals function”.1 In health care a number of quantitative measures of organisational culture have been developed, but differ in terms of their applicability, scope, and ease of use.2 Typically, these instruments assess the values, attitudes, behaviours, and norms of organisation members. They may also focus on perceptions of the organisational context such as managerial priorities, adequacy of training and resources, or policies and procedures.3 Safety culture forms a subset of organisational culture relating specifically to the beliefs and values concerning health and safety within an organisation.4 In other words, safety culture reflects the “ability of individuals or organisations to deal with risks and hazards so as to avoid damage or losses and yet still achieve their goals”.5

In recent years there has been growing recognition within health care of the importance of transforming organisational culture to improve patient safety. Major health care policy documents have openly acknowledged that there is a need to move away from the current “blame and shame” culture that prevents acknowledgement of errors and therefore obstructs any possibility of learning.6–9 According to the US Institute of Medicine, “the biggest challenge to moving toward a safer health system is changing the culture from one of blaming individuals for errors to one in which errors are treated not as personal failures, but as opportunities to improve the system and prevent harm”.7 However, in order to transform culture there is a need to acknowledge and understand it, and safety culture assessment tools provide an avenue towards such understanding.3

Safety culture assessments have been developed in a range of high risk industries.10 In health care, assessments of safety culture have predominantly focused on the hospital setting,11–13 although recent developments have resulted in tools aimed at assessing the prevailing safety culture in general practice.14 The aim of this study was to develop a framework that could be used by community pharmacies to self-assess their current level of safety culture maturity. Specifically, we aimed to develop a self-assessment framework that had high face validity and was both acceptable and feasible for use in community pharmacies.

METHODS

Theoretical framework

In 1993 Westrum15 developed the original theoretical framework underpinning the Manchester Patient Safety Assessment Framework (MaPSAF). He proposed that one way of distinguishing between organisational cultures is the way in which information is handled by organisations. He identified three levels of organisational culture: pathological, bureaucratic (calculative), and generative. In pathological organisations, failure is often concealed and people refuse to acknowledge that problems exist. In contrast, bureaucratic organisations do not suppress problems but they sometimes make light of them or deal with only the presenting symptoms, while in generative organisations, people have a “licence to think”, investigating the root causes of problems, taking responsibility for the findings, and disseminating solutions.16,17

Reason18 and, more recently, Parker and Hudson19 extended this framework and applied it to safety culture, incorporating a range of safety behaviours at five levels of organisational safety culture (table 1). The additional levels added more depth to the original framework, allowing for more subtle classification and clarifying the idea that organisations would be expected to progress with increasing maturity through the different levels of safety culture.

Table 1

 Levels of organisational safety culture

Applying the framework to community pharmacy

Orientation with the framework

The MaPSAF has previously been developed in health care for use in primary care trusts (PCTs) and their constituent general practices in the UK.14 The process used to apply the framework to safety culture in community pharmacy was iterative. Firstly, we held a focus group with four practising community pharmacists who reviewed the framework that had been developed for PCTs and general practices with a view to developing a version suitable for use in community pharmacies. Written comments were also received from two further community pharmacists who were unable to attend the meeting. All of the pharmacists felt that the framework could be adapted for use in community pharmacy and subsequently identified the following eight dimensions of patient safety that were considered to be applicable to community pharmacy:

  • Commitment to patient safety

  • Perceptions of the causes of incidents and their reporting

  • Investigating incidents

  • Learning following an incident

  • Communication within the pharmacy

  • Staff management

  • Staff education and training about risk management

  • Team working

Focus group discussions

Ten focus group discussions with community pharmacists and support staff were then used to further develop and evaluate the framework. The focus groups sought to reflect the diversity of staff working in community pharmacies, and this was achieved by purposively selecting participants to ensure broad coverage of the different staff groups (pharmacy owners, employed pharmacists, locum pharmacists, preregistration pharmacists, pharmacy technicians, and pharmacy assistants). Participants were drawn from seven health localities (PCTs) in England. In all, 67 pharmacists and support staff participated in the study, with each focus group containing 4–10 participants. All the focus groups were undertaken between December 2003 and April 2004 at venues local to the participants.

Development of the framework

In the first six focus groups the content of the framework was refined. In essence, the framework was split into four sections, each covering two of the eight safety dimensions. Participants were asked to review in detail the descriptions contained within one of the sections of the framework to decide if they agreed with the content and to provide any suggestions on how the framework could be improved for use in community pharmacies. All of the four sections of the framework were reviewed in detail over the course of the six focus group meetings. Following each focus group, two members of the research team (DMA, CM) considered all of the issues raised by the participants and made any necessary revisions to the framework. The revised version was circulated at the next focus group meeting.

Evaluation of the framework

As part of the last four focus groups we presented the framework in its entirety to different participants and asked them to comment on its acceptability, face validity, and feasibility for use in community pharmacies. Each focus group was tape recorded and fully transcribed. All transcripts were read by two members of the research team (DMA, CM) and key themes and areas of interest were identified using content analysis techniques and constant comparative methods.20

NVivo software (Version 2.0) was used to apply codes to the transcripts, which allowed subsequent examination of the data for particular themes. The University of Manchester Senate Committee on the Ethics of Research on Human Beings granted ethical approval for the study.

RESULTS

Using this process, a version of the MaPSAF was developed which was suitable for use in community pharmacies. The framework consists of a matrix in which the five levels of organisational safety culture have been mapped against qualitative statements characterising the eight dimensions of patient safety. For illustrative purposes, the descriptions characterising one of the dimensions (Learning following an incident) are shown in table 2.

Table 2

 Descriptions of the levels of safety culture for one of the dimensions

Acceptability

Feedback from the focus group discussions indicated that the MaPSAF was acceptable to the participants who also suggested that the framework would serve to raise awareness about risk management within their workplace.

I think it makes you think about the whole risk management.”

It’s a breakdown of our different reactions and it makes you reflect on your work and your practice.”

Face validity

The participants were able to understand the concepts, recognised differences between the five stages of safety culture maturity, and concurred with the descriptions from personal experience. Furthermore, they felt that the prevailing risk management culture in the majority of community pharmacies could be characterised as pathological.

I couldn’t think of a single pharmacy where they got any further than pathological.”

Most places are still on this pathological stage and they’re stuck there, and all they want to do is sort the error out and forget about it. If they can, they sort out an error and if nobody complains about it, then forget it.”

I think from my experience I’ve probably fitted into all five categories somewhere along the line. You know, we’ve all been pathological in our time, I’m sure, and then we’ve all sort of changed the way we put stock on the shelf. We’ve separated two strengths by another drug, for example.”

Nonetheless, they recognised that there was a need for an improvement in safety culture within community pharmacy, and the descriptions of more mature cultures presented within the framework provided an indication of where these improvements were required.

I think I’ve actually got up to calculative in some areas, but I don’t think anybody has got up to the top bit yet at all anywhere.”

I kind of fitted my experience as a locum pharmacist in the community to where I find myself, and it’s quite shocking to think that you never ever reach the idea which is generative. And whilst often in pathological, not pathological in terms of myself, but in terms of the support you would get from the organisation, especially if you’re a locum pharmacist.”

It tells you where you should be, and I think we then have to think for ourselves how we’re going to get into that square.

It appeared that the pharmacy manager or owner had a prime influence on the prevailing safety culture within their organisations.

He’s one step down from God isn’t he?”

In a pharmacy, the staff look up to the pharmacist to do anything.”

In some cases, staff reported that they had to comply with the wishes of the pharmacy manager or owner in relation to the reporting of safety incidents.

Some managers don’t like errors being reported and sort of push them under the carpet and you tend to just think, ‘Well I can’t cause trouble, I can’t make trouble’, and you tend to keep it to yourself, even when you see something that is wholly unacceptable.”

Participants also often referred to the impact that reporting would have on working relationships between colleagues.

If you were working at a branch five days a week and you want to get along well with the rest of the staff, then it’s that element of, you know, if I start reporting them, they’re going to start, you know, causing an atmosphere.”

The participants repeatedly identified team working in relation to safety issues as an important area for future development, and emphasised the importance of staff training and its impact on patient safety.

I’ve got some really good technicians, but in the past they have said ‘You made an error, you gave the wrong strength’ and it’s as if it’s the pharmacist’s fault. I know we do the end check [on the prescription] and it’s our responsibility, but the technician did [assemble] the wrong strength first, so they need to change their practice as well, not just the pharmacist.”

Having staff doing the investigation I think is good, because it empowers them, so they get involved instead of just the pharmacist saying ‘Well, this is what we need to do, we need to change things’ and then two weeks down the line they’ve forgotten about it. I think in that respect it’s very good, because it’s not just one person, not just the pharmacist.”

It’s good for team building as well. Everyone’s going to aspire to be at the top end … they are all going to work towards it.”

Feasibility

Most of the participants indicated that they would be willing to use the framework but recognised that staff would require protected time in order to complete the assessment.

I think if you did give them the time to do it, because that’s what you always find when you walk into a community pharmacy and you say, ‘Right, I want you to do this’. They’ll look at it and go ‘And when?’ and they will always say that to you. But if you said, ‘Sit down and read it’, I think a lot of the dispensers could actually do that and do it well.”

However, some of the participants did not embrace the concept wholeheartedly, suggesting that other factors were of a higher priority than risk management in the pharmacy.

Clinical governance, we’re doing just this at the moment and it seems very laborious to me.”

Even though I like the idea, even though I think it’s a good idea, and if at the end of the day it stops mistakes happening, great, I’m all for it, that’s the last thing you want. But there has to be a balance somewhere along the line, and it’s getting the balance right, isn’t it?

The participants also recognised that all relevant members of staff needed to complete the framework. Not surprisingly, some of the locum pharmacists explained that, as they were not regularly based in the same community pharmacy, they were not well placed to use the framework as part of a team exercise to evaluate the prevailing safety culture in specific pharmacies.

I do find that this is great if you are in one place all the time. I work in some stores regularly and others I just wander around, but when you wander around you walk into whatever you see and that’s what you get, and they [the staff] will not necessarily change the way they dispense to fit you, you’ve got to change your way within reason to fit them.”

However, in general the participants recognised that there was a need for a cultural shift within the community pharmacy with regard to patient safety, and felt that the framework could be used to facilitate this process, particularly if it was used in a focus group setting. It was acknowledged, however, that one of the key challenges would be to overcome the sensitivities around sharing information between different pharmacies.

I think it’s a culture change. It’s moving towards the right on your tool really. It’s fostering an attitude towards clinical governance, so that you’re continually reflecting on your practice, whether that is in a dispensary setting or an OTC (over the counter) setting. Looking at the standards, looking at the patient outcomes, and looking at how those can be improved. Not getting hung up on the nature of your protocol, but getting hung up on the fact that you have to go through those thought patterns and not just you but all your employees, your staff, your technicians. Everybody should be thinking about it in a clinical governance way or is what we’re doing the best way of doing it. So it’s how you get that philosophy from top right down to the bottom, without getting too hung up on the processes in between. You know, have we got this written down, let’s write all that, but making that culture change in your mind and in your staffs’ minds. Then also, the next bit, the exciting bit after that is then having some kind of group, like this one, where you then share those experiences and you start to benchmark, you start to say, ‘Well, these are our experiences, is that good or bad?’ And then you try and work it out. Now, whether that would happen, because we’re all in competition with each other, I’m not so sure. But it’s a way of trying to work that out so it can be done in a way to drive quality.”

DISCUSSION

The safety culture approach to risk management emphasises the role played by social forces within an organisation and their impact on the individual operator’s cognitions, perceptions, and behaviour with respect to safety at work.4 Schein21 suggests that the way in which managers instruct, reward, allocate their attention, and behave under pressure are particularly important in shaping organisational culture. The perceptions of managers’ attitudes and behaviours in relation to safety and well being of the workforce will therefore form the basis for the safety behaviour of workers and the safety performance of the company.4 Reason5 proposed that an organisation’s safety culture takes on a profound significance at the point where accident rates reach a “plateau”. In order to go beyond this “low but [seemingly] unassailable” plateau and to continue improvement in safety performance, it is necessary to address the hearts and minds of the management and workers.22 In high hazard and complex working environments, effective leadership has been shown to improve safety performance.17,23

This study is concerned with the safety culture in community pharmacies. In a typical pharmacy 1–3 staff members are involved in dispensing 20–60 prescription items per hour. The process is demand driven with patients randomly presenting prescriptions and waiting in the pharmacy for their dispensed medicines. For most pharmacies, maintaining an adequate volume of dispensing determines their viability. Speed of dispensing is therefore a priority, resulting in bursts of intense dispensing activity. Organisation and participation of different players in the dispensing process significantly depends on the level of activity.

Two key influences on the safety culture of a particular pharmacy are its ownership and staffing. Community pharmacies may be owned and managed by an individual pharmacist or be in corporate ownership. Some pharmacy companies sustain strong company cultures and reporting systems, and others much less so. Every pharmacy has to have a pharmacist directly supervising the dispensing operation who, if he or she is the permanent manager, may be the primary influence in determining the safety culture or, if simply providing cover for the day as a locum, may have little influence. Earlier work has shown the difference in professional autonomy exercised by community pharmacists of different occupational status, with locums being significantly less assertive than owners.24

By involving pharmacy staff, we have developed a version of the MaPSAF that will enable community pharmacies to evaluate their patient safety culture. In practice, we anticipate that the MaPSAF will have a range of uses which include: (1) raising awareness about patient safety and illustrating any differences in perception between staff; (2) stimulating discussion about the strengths and weaknesses of patient safety culture within the pharmacy; (3) identifying areas for improvement; (4) evaluating patient safety interventions and tracking changes over time; and (5) conducting internal and external benchmarking exercises.3 However, the assessment process will require the commitment of staff and time. It will be important to ensure that all regular members of staff are involved in the assessment process as the findings are likely to point to many different areas in which the prevailing safety culture could be improved.

The effectiveness of the MaPSAF will also depend on the development of a shared understanding among staff of the underlying meanings of the results of the assessment, and subsequently identifying the means by which improvements in patient safety culture can be achieved. Rather than viewing the assessment results as the end point, the information should be considered the starting point from which action and patient safety changes emerge.3 In other high risk industries, improvements in safety have largely been achieved by the stepwise implementation of hundreds of small changes in procedures, equipment, training, and organisation that have culminated in establishing effective working practices and a strong safety culture.25 Likewise, in order to improve the prevailing safety culture in community pharmacy, it is expected that incremental changes will need to be implemented and tested on a small scale, changing and evaluating the impact of one process or practice at a time.

Community pharmacists and support staff helped to develop this framework for use in their own workplace by modifying an existing instrument developed in ambulatory care using an iterative review process. Face validity is therefore high, and comments from the focus group participants also indicate that the framework is both acceptable and feasible for use in this setting. Furthermore, the qualitative findings suggest that there is room for improvement in the prevailing safety culture within a community pharmacy. Other empirical evidence also suggests that under-reporting of patient safety incidents is likely to be a significant problem in this setting.26

Safety improvement strategies require that organisations have ready access to information that supports learning from experience in order to promote systems that both prevent and mitigate the impact of errors.27 In contrast to a pathological culture where failure is concealed and people refuse to acknowledge that problems exist, a generative safety culture recognises the inevitability of error and proactively seeks to identify latent threats.3,15 It is encouraging that the participants felt that the descriptions of more mature safety cultures pointed to areas for further improvement, suggesting that the framework might encourage users to engage in “double loop” organisational learning at the higher levels of safety maturity whereby learning from experience becomes second nature and part of routine practice.28 However, further work will be needed to address these issues fully, in particular to examine in greater depth the instrument’s other psychometric properties including measures of internal consistency, reliability and construct validity. In the meantime, it is hoped that the framework will assist community pharmacists and their support staff in their efforts to improve the safety culture within community pharmacies.

Acknowledgments

The authors thank all the pharmacists and support staff who helped to develop and evaluate the MaPSAF.

REFERENCES

View Abstract

Footnotes

  • This study was funded by the Community Pharmacy Research Consortium.

  • Conflicts of interest: none

  • The community pharmacy version of the MaPSAF can be obtained from the Centre for Innovation in Practice, School of Pharmacy and Pharmaceutical Sciences, University of Manchester at www.manchester.ac.uk/CIP.

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.