Article Text
Abstract
Background Ethnic minorities and some other patient groups consistently report lower scores on patient surveys, but the reasons for this are unclear. This study examined whether low scores of ethnic minority and other socio-demographic groups reflect their concentration in poorly performing primary care practices, and whether any remaining differences are consistent across practices.
Methods Using data from the 2009 English General Practice Patient Survey (2 163 456 respondents from 8267 general practices) this study examined associations between patient socio-demographic characteristics and 11 measures of patient-reported experience.
Findings South Asian and Chinese patients, younger patients, and those in poor health reported a less positive primary care experience than White patients, older patients and those in better health. For doctor communication, about half of the overall difference associated with South Asian patients (ranging from −6 to −9 percentage points) could be explained by their concentration in practices with low scores, but the other half arose because they reported less positive experiences than White patients in the same practices. Practices varied considerably in the direction and extent of ethnic differences. In some practices ethnic minority patients reported better experience than White patients. Differences associated with gender, Black ethnicity and deprivation were small and inconsistent.
Conclusion Substantial ethnic differences in patient experience exist in a national healthcare system providing universal coverage. Improving the experience of patients in low-scoring practices would not only improve the quality of care provided to their White patients but it would also substantially reduce ethnic group differences in patient experience. There were large variations in the experiences reported by ethnic minority patients in different practices: practices with high patient experience scores from ethnic minority patients could be studied as models for quality improvement.
- Health services research
- healthcare quality improvement
- primary care
- pay for performance
- patient satisfaction
- information technology
- evidence-based medicine
- healthcare quality improvement
- patient safety
- diagnostic errors
- communication
- health professions education
- crew resource management
- failure modes and effects analysis (FMEA)
- safety culture
This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/2.0/ and http://creativecommons.org/licenses/by-nc/2.0/legalcode.
Statistics from Altmetric.com
- Health services research
- healthcare quality improvement
- primary care
- pay for performance
- patient satisfaction
- information technology
- evidence-based medicine
- healthcare quality improvement
- patient safety
- diagnostic errors
- communication
- health professions education
- crew resource management
- failure modes and effects analysis (FMEA)
- safety culture
Introduction
Patient experience surveys are increasingly used to help assess the quality of primary and hospital care, alongside the evaluation of clinical outcomes.1–4 As with clinical measures of quality, there are systematic differences in how patients from different socio-demographic groups assess their care: younger patients, those belonging to ethnic minorities, those with higher socioeconomic status and those with poorer self-rated health report less positive experiences of healthcare.5–11 The causes of these differences are unclear, and may vary across healthcare systems.
In England, primary care is delivered through general practices (‘practices’ hereafter) with primary care practitioners (GPs) responsible for the care of an average of 6000 patients per practice. In recent years, random samples of patients registered with each practice have been invited to take part in nationally administered patient experience surveys (the General Practice Patient Survey), and details of scores for individual practices are publicly reported.2 The survey questionnaire was developed iteratively with four rounds of testing involving 50 cognitive interviews with people from varied socioeconomic and ethnic backgrounds and analysis of the survey's psychometric properties on a sample of 1500 patients. The survey questionnaire is available in English and also online and by phone in another 13 languages and the British sign language. The majority of respondents completed the survey in English, either by post (96%) or online (3.9%). Two access measures from this survey were used during 2009–2011 as part of pay-for-performance schemes providing additional income to practices meeting pre-specified quality thresholds.12
Policy makers attribute great importance to equality in healthcare access and outcomes among all population groups.13 14 In the UK, 99% of the resident population is registered with a general practice and access to care is universal.15 Therefore, insights about the causes of socio-demographic differences in patient experience of primary care can be gained without potential confounding by variation in healthcare coverage.
Using data from the English General Practice Patient Survey we investigated causes of socio-demographic differences in patient experience. We specifically aimed to provide insights to help address two areas of uncertainty.5 7 9 First, whether overall ethnic differences in experience of care arise from the concentration of ethnic minority patients in practices with lower than average performance; and second, whether ethnic differences vary substantially across practices. Different policy implications arising from these two research questions are summarised in table 1.
Methods
Data
We analysed data from patients responding to the 2009 English General Practice Patient Survey (2 163 456 respondents from 8267 general practices, response rate 38%). As reported for other patient experience surveys,11 23 women, middle-aged patients and those living in more affluent areas were more likely to respond to the survey, but we found no evidence of non-response bias attributable to these variables for scores of two questions linked to financial rewards.12 The response rate is comparable with similar patient surveys.3 4
Patient experience measures
We used 11 patient experience measures: healthcare professional communication (questions 4, 20a-g, 21, 24a-g); access to care (questions 5a, 7, 10, 14, 17); continuity of care (question 16); and overall satisfaction with care (question 25). Binary (‘yes/no’) and ordinal (Likert) scale response options were linearly rescaled to a 0–100 range (100=most favourable response) to facilitate comparisons of socio-demographic associations across different patient measures.5 7 9 Questions 20a-g and 24a-g each encompassed seven items about doctor or nurse communication respectively (eg, provision of sufficient time, explanation of tests and treatments, etc). For these, a single composite score was calculated as the mean of these items for all respondents who answered at least four of the seven sub-questions.5
Patient characteristics
Patient characteristics were considered as potentially important predictors of patient-reported experience based on evidence indicating associations with ethnicity, socioeconomic status and self-rated health status.5–7 9 We analysed information on patient gender (men used as the reference group), age (eight groups from 18–24 to 85+, 55–64 reference), ethnic group (using either 16-group or six-group classifications from the UK Office of National Statistics,24 with either the ‘White British’ or the ‘White’ group as reference, respectively), self-rated health status (five ordinal groups from ‘excellent’ to ‘poor’ health, ‘excellent’ used as reference) and presence of a longstanding psychological or emotional condition (‘no’ such condition used as reference)—all these items were self-reported by the survey respondents. In addition, socioeconomic status information based on the postal codes of patient residential area was available (quintiles of deprivation,25 with the least deprived group used as reference).
Analysis
Our first objective was to distinguish the effects of the concentration of some population groups in low-scoring practices (table 1), from the variation of scores of different population groups within practices.9 To examine this question, we combined two analytical strategies:
Initially, we used fixed effects multivariable linear regression models to predict patient experience measures only from patient socio-demographic characteristics. These models estimate overall socio-demographic differences in patient experience which arise both because some patient groups are concentrated in low-performing practices and because the scores of patients of different groups vary within the same practices.9
Subsequently, we used mixed effects models that included patient socio-demographic variables as fixed effects plus a random effect for practice. They estimate only the socio-demographic differences that arise because the scores of patients of different groups vary within the same practices.5 8 9 26
Therefore, for a given socio-demographic group, the difference between the respective coefficients of the first and the second models indicates the amount of overall difference arising from the concentration of this population group in practices with low scores. Such a difference may be positive (ie, the co-efficient obtained from the fixed effects model being greater than that obtained by the mixed effects model) or negative. A positive difference indicates the proportion of the overall difference associated with concentration of patients of that socio-demographic group within practices with lower mean scores, and vice versa.
Our second objective was to assess whether socio-demographic differences are consistent among practices. We used models that built on the multi-level models described above, adding random effects corresponding to the interaction of each patient characteristic variable with the ‘practice’ random effect (random slope random intercept models). From those models, using a normal approximation, we derived the ‘95% midrange of practice-level coefficients’ for each socio-demographic group, which indicates the range of practice-level socio-demographic differences within which 95% of all practices lie. If the fixed effect for women (vs men) is a and the random effect for women by practice random effects has a variance of b, approximately 95% of practices will have women (vs men) coefficients between a-1.96×sqrt(b) and a+1.96×sqrt(b).10 For example, if women evaluated their patient experience less positively than men by an average difference of −3 percentile points across all practices and the 95% midrange limits ranged from −1 points to −5 points, then for 95% of practices, true mean differences between women and men would range from −1 to −5 points. In this hypothetical example, although the magnitude of the gender difference among practices varies substantially, almost all practices have care that is rated worse by women. SAS V.9.2 was used for random slope random intercept models and STATA V.11 for all other analyses.
Results
The characteristics of survey respondents appear in table 2. Except where noted, we present socio-demographic differences for doctor communication (question 20) as the measure with the strongest partial correlation with overall satisfaction with care. Results for all other questions were similar and are shown in online appendix s1.
Socio-demographic differences
For all measures of patient experience, there were relatively large and statistically significant differences in the mean scores of patients of different age, health status and ethnicity. Conversely, differences associated with gender, area deprivation and presence of longstanding psychological or emotional condition were generally smaller and inconsistent in their direction.
Overall Bangladeshi, Pakistani, Indian and Chinese patients reported experiences of doctor communication (question 20) that were −9, −7, −6 and −8 percentile points more negative than White British patients (table 3). As indicated by the comparison of coefficients obtained from the fixed and mixed effects model, concentration of ethnic minorities in low-scoring practices was responsible for about 50% of the difference for South Asian patients and 14% of the difference for Chinese patients. However, even when the effect of concentration of these groups in practices with lower scores was accounted for, relatively large differences (−7 to −3 percentile points) remained when comparing South Asian and Chinese with White patients cared for by the same practices. Conversely, Black versus White differences were typically small (<2 percentile points) and inconsistent in their direction. For doctor communication, more than 80% of Black/White differences related to the concentration of Black patients in low-scoring practices (table 3). Thus within-practice Black/White differences were small.
Differences by age were large—typically a difference of approximately −16 percentile points between patients aged 18–24 and those aged 75–84 across all experience measures (online appendix s1). In general, increasing age was strongly associated with more positive patient experiences, except for patients in the oldest age group (85+) who reported slightly worse experiences than those aged 75–84. The proportion of overall age differences explained by differences among practices was very limited (ie, <10% of overall differences), reflecting similar age distributions across practices.
Patients with poorer self-rated health reported worse experiences than patients in better health, following an ordinal trend (online appendix s1). Typically there was a difference of −10 percentile points in reported experience between individuals reporting ‘poor’ and ‘excellent’ health status. As with age, differences among practices explained little of the differences among patients with different self-rated health status (ie, <10%).
The association of area socioeconomic deprivation with healthcare professional communication (questions 4, 20, 21, 24) and other patient experience measures was generally limited and inconsistent in direction (online appendix 1). Gender had a small and inconsistent association (typically differences of <1 percentile point) (online appendix s1). As reported previously,27 presence of longstanding psychological or emotional condition was associated with more positive evaluation of patient experience for most questions, although the size of associated differences was small.
Consistency of socio-demographic differences across practices
Within-practice ethnic group differences varied substantially across practices (table 4, online appendix s2). For example, although on average South Asian and Chinese patients evaluated doctor communication more negatively than White patients (−4 and −9 percentile points respectively), in some practices South Asian and Chinese patients reported more positive experiences of doctor communication than the White patients cared for by the same practice (95% practice midrange for differences in doctor communication: −13 to +4 percentile points for South Asian/White differences; and −18 to +1 for Chinese/White differences—positive values indicate better patient experience reported by ethnic minority patients).
Age-related differences in patient experience were highly consistent across practices. Practices varied substantially with respect to within-practice differences in self-rated health, with a 95% midrange of −12 to 0 percentile points for differences between patients with ‘poor’ compared with ‘excellent’ self-rated health. Although overall differences among patients of different gender, longstanding psychological or emotional condition status and deprivation quintiles (lowest vs highest) were relatively small (<1 percentile point) there was clear variation in these differences across practices (95% midranges of −3 to +2, −5 to +7 and −4 to +3 percentile points, respectively).
Discussion
Using data from a large national English patient survey we found substantially more negative experiences reported by ethnic minorities (particularly South Asians and Chinese), younger patients and those with poor self-rated health. Differences by gender and socioeconomic deprivation were limited and inconsistent. A substantial proportion of ethnic differences reflected concentration of ethnic minority patients in low-performing practices (consistent with the ‘minorities concentrated in poor practices’ hypothesis, table 1), but concentration in low-scoring practices explained little of the large differences observed among patients of different age and self-rated health. In spite of large within-practice differences among patients of different ethnicity and self-rated health, primary care practices varied substantially in respect of these differences and in some practices South Asian and Chinese patients evaluated their experience similarly or more positively compared with White patients. This finding suggests that differences in care (‘worse care’ hypothesis, table 1) may at least in part be responsible for the observed ethnic differences.20
The largest ethnic differences in patient experience were comparable in magnitude to the differences observed between patients in ‘poor’ and ‘excellent’ self-rated health. Although South Asian and Chinese patients reported substantially more negative experiences than White patients, Black/White differences were small and inconsistent in direction. These findings are similar to previous UK findings,5 6 8 and could point to linguistic proficiency as one determinant of ethnic differences (consistent with the ‘receive same care but report worse experience’ hypothesis, table 1).7 Most UK Black patients are descendents of immigrants from English-speaking countries, which contrasts sharply with the distinct linguistic heritage of many South Asian and Chinese patients. Further research about the interaction between English language proficiency (‘linguistic acculturation’) of ethnic minorities and ethnic differences in patient experience would be useful.28 However, socio-cultural aspects of ethnic identity other than linguistic competency may also be responsible. For South Asian patients, ethnic differences were consistent across different measures of patient experience (online appendix s1 and s2). For Chinese patients, however, reported differences were smaller for access questions and larger for all other questions (including doctor communication and overall satisfaction). These findings may reflect differences in care or in the understanding of the meaning of questions among patients of different ethnic minority groups, which may particularly occur for general as opposed to specific (report-like) questions (table 1).20 We plan to conduct primary research on the understanding of different questions from the General Practice Patient Survey by patients of different ethnic groups.
In common with other studies, we found that older patients evaluate their experience more positively compared with younger patients.6 11 Like two other UK studies (measuring socioeconomic status either with individual measures,6 or practice area deprivation8) we found that socioeconomic differences in patient experience of primary care were limited and inconsistent.6 8 These UK findings contrast with many US studies reporting that higher levels of patient education are associated with lower patient experience scores.7 11 19
A particular strength of our study is its UK setting, where there is universal access to healthcare, so our findings indicate that large ethnic group differences in patient experience may be present even within countries with universal healthcare coverage. Another strength of the study is its large sample size, enabling the precise measurement of the experience of patients belonging to relatively small ethnic groups; and of the variation in such differences across practices. For example, we were able to determine that the less positive experiences reported by South Asian patients held for Indian, Pakistani and Bangladeshi patients, and that Black patient subgroups (defined by national origin) reported similar experiences.
A limitation of our study is that although we provide some insight about potential causes of ethnic differences, we were not able to directly measure whether expectations of healthcare quality or survey responses tendencies varied among patients of different ethnic groups20; nor whether the quality of care provided (particularly the standard of inter-personal care and doctor communication quality) was actually different.28 Another limitation is that the overall average response rate was 38%. Groves and Peytcheva, in recent reviews of the survey methodology literature, suggest that among probability sample surveys adhering to typical process standards of survey methodology, response rates are only weakly associated with non-response bias,29 a conclusion consistent with our previous analysis of non-response bias for the two questions associated with payments to practices.12
Our findings have clear policy implications (box 1). First, they indicate that large differences in healthcare experiences may exist among patients belonging to different socio-demographic groups, even when arrangements for universal coverage of healthcare are in place. However, such differences are not inevitable because we found that minority ethnic group patients reported a range of experience scores in different primary care practices, sometimes comparable with, or even better than those reported by White patients. Providers could seek to mitigate potential ethnic inequalities by introducing measures such as access to translation or interpreting services for non-native speaker patients, and interventions to increase the cultural competency of healthcare professionals.
Putting the findings into context
Previous evidence
Previous studies have indicated that patient experience of either primary or hospital care varies among different socio-demographic groups,3–11 17 26 27 (see also online appendix s3). Most available evidence relates to studies of sub-national healthcare systems. There is evidence from various contexts that concentration of patients of different groups in healthcare provider organisations with lower than average performance is responsible for a proportion of socio-demographic differences. Variation in differences among organisations across a national healthcare system with universal coverage has not been previously described.
Interpretation
In England, a country with universal healthcare coverage, ethnic minority patients (particularly South Asians and Chinese), younger patients and those with poor self-rated health reported substantially more negative experiences of primary care than White patients, older patients and those in better health. Ethnic differences in patient experience were comparable in magnitude to the differences observed among patients in ‘poor’ and ‘excellent’ self-rated health. A substantial proportion of ethnic differences reflected concentration of ethnic minority patients in low-performing practices. Primary care practices showed substantial ethnic differences. In some practices ethnic minority patients evaluated their experience similarly or more positively compared with White patients, and such practices could be studied as models for quality improvement.
Second, a substantial proportion of the observed lower patient experience scores of South Asian and Chinese ethnic group patients in England reflects their concentration in practices with lower than average scores. Therefore, if the overall performance of low-performing practices were improved (as is the goal of a series of major UK government policy initiatives) this would also help improve the patient experiences of South Asian and Chinese patients and reduce ethnic inequalities. Previous UK research indicates that national primary care quality improvement schemes could help reduce variability and socioeconomic inequalities in technical processes of primary care,30 though whether such improvements can also be expected for non-technical dimensions of care quality such as patient experience is currently uncertain. Alternatively, if patients were able to change their practice (ie, moving from practices with low to high mean patient experience scores) this could in principle also reduce ethnic differences. Current policy initiatives of the UK government aim to support patients by giving them a wider choice of practice.14 However, the impact of such policies may be limited by the potential geographical clustering of low-performing practices; by patient preference for geographical proximity to their practice (particularly in rural areas); or other trade-offs between preferences for quality of patient experience and other aspects of care quality.
Third, the fact that within-practice ethnic differences varied markedly from practice to practice suggests that, at least in part, ethnic differences arise from differences in what practices do (‘worse care’ hypothesis, table 1). Practices that provide uniformly positive experiences to patients of all socio-demographic groups (including ethnic minorities and patients with poor self-rated health) could be studied as models for quality improvement in other practices.
References
Supplementary materials
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Files in this Data Supplement:
- Download Supplementary Data (PDF) - Manuscript file of format pdf
Footnotes
Funding The study was funded with a grant from the UK Department of Health. The opinions expressed are those of the authors and not of the funder. The UK Department of Health had no direct involvement in the design and conduct of the study; nor the collection, management, analysis and interpretation of the data, nor in the preparation, review or approval of the manuscript. All authors had full access to the data and take responsibility for the integrity of the data and the accuracy of the data analysis.
Competing interests MR and JC act as academic advisers to Ipsos MORI for the survey. All other authors have no conflict of interest to declare.
Provenance and peer review Not commissioned; externally peer reviewed.