Article Text
Abstract
Objective: To examine if the quality of primary medical care varies with remoteness from urban settlements.
Design: Cross-sectional analysis of publicly available data of 18 process and intermediate outcome measures for people with coronary heart disease (CHD), diabetes and stroke.
Setting and participants: Populations registered with 912 general practices in Scotland grouped into three categories by level of remoteness from urban settlements: not remote, remote and very remote.
Main outcome measures: Mean percentages achieving quality indicators and interquartile range scores.
Results: Remote and very remote practices were more likely to have characteristics associated with low Quality and Outcomes Framework (QOF) total points score (smaller, higher capitation income, dispensing practice, and had lower statin prescribing despite higher prevalence of cardiovascular disease and diabetes). However, in contrast with previous research, there was little evidence that quality of care was lower in more remote areas for the 18 process and intermediate outcome measures examined. The exception was significantly lower cholesterol measurement and control in people with CHD, diabetes and stroke attending very remote practices (p<0.01) and β-blocker prescription in CHD (p = 0.01).
Conclusions: Under QOF, there are few differences in the quality of care delivered to patients in practices with different degrees of remoteness. The differences in achievement for cholesterol were consistent with lower rates of statin prescribing relative to disease burden in very remote practices. No differences were found for complex process measures such as retinopathy screening, implying that differences under QOF are more likely to be due to slower adoption of evidence-based practice than access problems. Examining this will require analysis of individual patient data.
Statistics from Altmetric.com
The influence of remoteness on the delivery and quality of primary care is given particular prominence in Scottish health policy, reflected in the weighting for the higher costs of service delivery in the weighted capitation formula for general practice (the global sum), which is the single largest determinant of practice income.12 However, recent changes to the provision of healthcare through the 2004 General Medical Services (GMS) contract and working time directives have impacted on the viability of maintaining and recruiting medical staff in remote and rural areas.3 Concerns have been raised on how such changes may impact on quality of care in rural areas.4 Remote residents have a relatively high need for healthcare, which may be compounded by changes in service provision through closure of rural hospitals and general practices.5 Remote areas have historically had fewer female general practitioners (GPs), leading to reduced choice for patients and poorer access to some treatments.6 The trade-off between economies of scale and geographical access presents a major challenge to healthcare delivery in remote areas and leads to the possibility that some services may not be provided due to cost.7 Distance from health services has been shown to inhibit use of primary care, as patients face higher costs to get to practices and may be less likely to attend for routine treatment, and access to specialist investigation and advice may be more limited.7–9 Practitioners in more remote areas may also have less access to education.10
The Quality and Outcomes Framework (QOF) of the 2004 GMS contract links up to 25% of UK GPs’ pay to performance measured against 146 clinical and organisational quality indicators. The QOF offers a data source that allows for comparisons of performance on a range of indicators between urban and remote areas. Many factors may impact on the performance of remote areas in the QOF. On average, practices in more remote areas receive more money under the global sum, have older GPs,11 fewer staff and smaller practice teams,11 all of which have been shown to have a negative impact on achievement in the QOF.12
Achievement on each indicator in QOF is transformed into a point’s score, with the points for each indicator representing the relative importance of the indicator, and a maximum of 1050 points available. Research undertaken on QOF data so far has for the most part concentrated on points’ achievement.12–14 However, practices can achieve full points without achieving 100% coverage of their patients. Moreover, practices are allowed to exception report patients who are unsuitable, excluding them from measurement either from entire clinical areas or from particular indicators. Reasons to exception report are likely to vary depending on location and demography. Measuring quality using percentages of non-excluded patients has been shown to conceal continuing socioeconomic inequalities in service provision15 and the same may be true of remoteness.
The aim of the present study was therefore to examine how the quality of primary care varies by remoteness, measuring quality using the percentage of all patients with the disease who achieve a particular target irrespective of whether they have been exception reported (“delivered” quality, in contrast with “payment” quality, in which exceptions are allowed).
METHODS
Remoteness was measured using the Scottish Executive Urban-Rural Classification.16 This eight-category measure is available for 42 000 output areas with average populations of 117 residents and stratifies the population by the size of settlement and drive times from large urban settlements (see supplementary material available at http://qshc.bmj.com/supplemental). We examined the locations of residence of practice populations and assigned practices to the category containing the largest proportion of their registered population as at September 2004. On the basis of our preliminary analysis we categorised practices into three groups defined by remoteness:
not remote practices—primary cities, urban settlements, accessible small towns and accessible rural areas;
remote practices—remote small towns and remote rural areas;
very remote practices—very remote small towns and very remote rural areas.
Using routine data for 2004/5 from the Information and Statistic Division of NHS Scotland (ISDScotland), we characterised practices in terms of list size, whole-time equivalent numbers of principals and non-principals (a variable reflecting the size of the practice team), GP sex, dispensing status, and global sum payment (a weighted capitation payment for essential and additional services provided by the practice and reflecting practice population age and sex structure, and associated clinical need and service cost), disease prevalence and statin prescribing.
We use data returned via the Quality Management and Analysis System to ISDScotland for all general practices in Scotland. The analysis is restricted to 912 GMS practices, and focuses on care for people with established cardiovascular disease or diabetes. The indicators examined are either intermediate outcomes tightly linked to long-term outcomes17 or process and treatment indicators strongly recommended in national guidelines. The 18 indicators selected account for 168 (16%) of the total points, reflecting their high importance in the QOF points weighting. We present mean percentages for “delivered” quality (based on the care delivered to all patients) and interquartile scores for indicators in five of the 10 clinical domains where the denominator is for all patients with the disease. This method has been explained in more detail elsewhere.15 Regression analysis was used to analyse differences between the categories. We compare each mean value to the reference category of not remote practices. Significance testing is based on practice-level data using a threshold of p<0.01 as our measurement of significance. The analysis was undertaken in STATA (version 8.2), using robust standard errors.
RESULTS
Table 1 shows mean values for a range of practice characteristics. Very remote practices had the smallest lists, the fewest whole-time equivalent GPs, the highest average age for GPs, and the lowest proportion of female GPs. They had the highest proportion of dispensing practices, and received higher capitation under the global sum. Very remote practices were less income and health deprived, but had a higher access deprivation score. Lower defined daily doses of statins per capita were prescribed in very remote practices even though they have significantly higher raw prevalence rates (p<0.001) for diabetes, coronary heart disease (CHD), stroke, and hypertension than not remote practices (although the highest prevalences for diabetes, CHD and stroke are found in remote practices).
Table 2 shows the mean values for 11 process indicators. The trend for performance was for higher scores in not remote practices and lower scores for very remote practices. Remote and remote practices did not differ significantly with regard to delivered quality, but very remote practices had significantly lower quality for cholesterol recording in CHD and stroke (p<0.01; absolute differences 7.1% and 8.6%). The interquartile range was higher in very remote areas for all process indicators with the exception of blood pressure recording in people with diabetes.
Table 3 shows the mean values for delivered quality for outcome indicators. Not remote and remote practices did not differ significantly. Of the nine process indicators delivered quality was significantly lower in very remote practices for all three of the cholesterol-controlled indicators (absolute differences for CHD 11.5%; for stroke 11.1%; and for diabetes 5.9%). The interquartile range was higher in very remote areas for all outcome indicators.
Table 4 shows the mean values for treatment indicators. Influenza immunisation was lowest in not remote practices although the differences were not significant. β-Blocker prescription for people with CHD was of significantly lower quality in very remote practices compared with not remote ones (p = 0.01). The interquartile range was higher in very remote areas for all treatment indicators.
DISCUSSION
This is the first study to have examined variations in quality by remoteness using 2004 GMS contract data, and to measure quality in terms of the actual care delivered. Its major limitation reflects the way in which data are held in the payment system. “Delivered quality”, or the actual proportions of patients who achieve quality targets ignoring exclusions, can only be estimated for a limited number of indicators because the Quality Management and Analysis System in 2004/5 did not record either the true denominators for every indicator, or the register size on the same date that indicator data were extracted. However, the 18 indicators examined are among those with the greatest evidence of long-term benefit, reflected in their high points weighting.
Variables such as smaller clinical teams, higher average GP age and higher levels of income received from the global sum that have previously been shown to have a negative impact on performance in the QOF measured in terms of total points scores,12 were significantly associated with very remote areas. However, for most of the indicators examined here, quality in terms of the percentage of patients receiving care or achieving intermediate outcome targets did not differ by remoteness. The lack of differences in complex process indicators such as foot and eye screening in diabetes, and for treatments that have to be delivered in a specific timeframe such as influenza immunisation is surprising, given that greater problems of accessibility in more remote areas would be expected to be most apparent for such measures.679 Overall, the data are therefore consistent with QOF ensuring better access to services than has been found in previous research, although there is greater heterogeneity of performance in more remote areas.67 This is not to deny the particular access problems of more remote practices, but rather to recognise that with large financial incentives motivating service delivery, high quality is achievable even where there are considerable access barriers.
In contrast, differences were seen in simple process indicators for cholesterol measurement and control that can be done opportunistically, or intermediate outcome indicators that largely depend on prescription which might be expected to be less dependent on accessibility. The lower rates of statin prescribing relative to disease burden in very remote practices is consistent with the 6–11% differences in patients achieving a cholesterol of ⩽5 mmol/l, and is clinically important given the impact of statin prescribing and cholesterol control on longer -term outcomes. One possible explanation is that under QOF, differences in quality are more related to slower diffusion of evidence-based practice in more remote, and therefore professionally isolated areas, where practitioners have less access to continuing professional development. Examining this issue further will require individual patient data, which would allow for casemix adjustment and direct examination of prescribing patterns in a way that is not possible with practice-aggregate QMAS data.
REFERENCES
Supplementary materials
web only table 16/6/446
Files in this Data Supplement:
Footnotes
Ethics approval: The analysis used publicly available data, and no approval was required.
Funding: GM is funded by Glasgow University. MS is funded by Health Research Economics Unit (Aberdeen University), which receives funding from the Chief Scientist Office of the Scottish Executive Health Department. BG is funded by the Health Foundation and the Chief Scientist Office of the Scottish Executive Health Department.
Competing interests: None.
- Abbreviations:
- CHD
- coronary heart disease
- GMS
- General Medical Services
- GP
- general practitioner
- QOF
- Quality and Outcomes Framework