Article Text

Outcomes for surgical procedures funded by the English health service but carried out in public versus independent hospitals: a database study
  1. Hannah Crothers1,
  2. Adiba Liaqat1,
  3. Katharine Reeves1,
  4. Samuel I Watson2,
  5. Suzy Gallier1,
  6. Kamlesh Khunti3,
  7. Paul Bird4,5,
  8. Richard Lilford2
  1. 1Health Informatics, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
  2. 2Institute of Applied Health Research, University of Birmingham, Birmingham, UK
  3. 3Diabetes Research Centre, University of Leicester, Leicester, UK
  4. 4Institute for Translational Medicine, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
  5. 5West Midlands Academic Health Science Network, Birmingham, UK
  1. Correspondence to Prof Richard Lilford, Institute of Applied Health Research, University of Birmingham, Birmingham B15 2TT, UK; r.j.lilford{at}bham.ac.uk

Abstract

Background The outcomes of elective surgery in public versus Independent Sector Healthcare Providers (ISHPs) are a matter of policy relevance and theoretical interest.

Methods Retrospective study of all National Health Service (NHS) hospitals and ISHPs in England that provided NHS-funded elective surgery. We used data from the England-wide Hospital Episode Statistics to study 18 common surgical procedures performed between 2006 and 2019. In-hospital outcomes included length of stay, emergency transfers to another hospital or death. Posthospital outcomes included readmission or death within 28 days. Outcomes were compared for each operation type by propensity score matching and survival analysis.

Results The data set included 3 203 331 operations in 734 NHS hospitals and 468 259 operations in 274 ISHPs.

In-hospital outcomes: Across all 18 included operation types, length of stay was significantly longer for patients treated in NHS hospitals compared with ISHPs. Effect sizes ranged from a hazard ratio (HR) of 2.15 (95% CI 1.72 to 2.68) for total hip replacement to 1.07 (95% CI 1.05 to 1.09) for wisdom tooth removal; a mean difference of 2.49 and 0.02 days, respectively.

Postdischarge outcomes: Treatment at an ISHP was associated with a lower risk of emergency readmission compared with NHS treatment. HRs ranged from 0.36 (95% CI 0.28 to 0.46) for lumbar decompression to 0.75 (95% CI 0.67 to 0.85) for cholecystectomy; absolute risk differences of 1.5 and 1.3 percentage points. There was no difference in mortality.

Conclusion Elective surgery in an ISHP is associated with shorter lengths of stay and lower readmission rates than treatment in NHS hospitals across 18 operation types. The data were matched on observable covariates, but we cannot exclude selection bias due to unobserved confounders.

  • patient safety
  • quality measurement
  • surgery

Data availability statement

Data may be obtained from a third party and are not publicly available. Linked HES and ONS data may be obtained from NHS Digital via the Data Access Request Service (DARS) and are not publicly available.

https://creativecommons.org/licenses/by/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.

Statistics from Altmetric.com

Introduction

An Independent Sector Healthcare Provider (ISHP) is a private sector healthcare company that is contracted by the National Health Service (NHS) for the provision of healthcare.1 NHS spending on ISHPs, as a proportion of total NHS revenue spending, increased steadily from 3% in 2006/2007 to 7.5% in 2015/2016.2 Purchase of elective care from ISHPs by NHS hospitals is one of the fastest growing areas of expenditure on the independent sector.3 In 2009, the NHS constitution made it a right for patients in England referred for non-urgent hospital treatment to be able to choose to be treated by any provider (including an ISHP) listed in a national directory.4 The result is that people whose treatment is funded by one third-party payment system (the NHS) come to be treated by two different types of provider: public (NHS) and independent. The independent providers may be either for profit or not for profit. Reimbursement levels are the same irrespective of which type of organisation provides treatment, and providing data to NHS Digital is a prerequisite for reimbursement irrespective of provider type. This arrangement, where one commissioner funds treatment from more than one provider type, entails a ‘natural experiment’ for comparison of outcomes across different types of provider. Further details on the operation of the system are provided in online supplemental text 1.

Supplemental material

Concerns have been raised about whether NHS patients treated by ISHPs receive the same standard of care as they would in an NHS hospital. The following factors have been highlighted as potential risks of elective surgery in ISHPs5 6: (A) the need for emergency transfer to an NHS hospital should complications arise in settings where intensive care is not provided; (B) working in an unfamiliar environment and having to use equipment with which the surgeon is unfamiliar; (C) putatively weaker governance arrangements and quality control processes; (D) frequent reliance on a single on-call resident medical officer to provide postoperative care; (E) permitting surgeons to exceed the NHS standard, whereby they should be available within 45 min having carried out an operation.

We found four research papers that have compared outcomes for NHS-funded patients undergoing specific types of surgical procedure in NHS hospitals compared with ISHPs (online supplemental table 1).7–10 These studies reported that case-mix adjusted outcomes, including persistent pain following joint replacement, postoperative complications, length of stay and quality of life, were better for NHS patients treated in private hospitals than in NHS hospitals. In addition, the Independent Healthcare Providers Network, which represents a wide range of ISHPs, has reported better performance for ISHPs when compared with NHS hospitals on overall patient satisfaction and, for hip and knee replacements, on patient-reported outcome measures.11 Our study has three main advantages over previous work. First, we cover a variety of operation types rather than being restricted to one or two classes of operations. Second, we cover an entire heath system (the whole of England). Third, we include operations over an extended period of nearly one and a half decades.

Supplemental material

Methods

Our study used data extracted from the Hospital Episode Statistics database (HES; NHS Digital) for April 2001 onwards, linked to mortality data from the Office for National Statistics (ONS). Socioeconomic deprivation was represented by Index of Multiple Deprivation (IMD) rankings for the patient’s residential address.12 This observational study was registered with the local Clinical Audit Department (Clinical Audit Registration and Management System number 15675). Data were used in line with the data sharing agreement with NHS Digital. The HES database comprises all episodes of care for patients who access care that is free at the point of use in England, including those treated at centres run by the independent sector.13 HES data include information on diagnoses (including comorbidities) and operations, patient demographics (such as age, sex, ethnicity and postcode) and administrative data (hospital provider, admission/discharge method, consultant specialty). The accuracy of the primary procedure and primary diagnosis fields in HES data is known to be high.14 Hospital episodes are linked by patients through derived HES ID values, which are matched to patient records based on NHS number and other patient identifiable details.15 This enables readmissions to be identified wherever they occur in England. We report our results in line with the Strengthening the Reporting of Observational Studies in Epidemiology criteria.16

Data extraction and cleaning

The full list of operations carried out across both the NHS and the independent sector is very long and includes operations that are done infrequently or that carry minimal risk (eg, injections of therapeutic substances or diagnostic procedures). We therefore confined our attention to more commonly performed operations (a minimum of 4000 records in each provider-type group from the period 2001 to 2019) and those that had more than negligible risk. This selection preceded any analysis. The full list of operations that fulfilled the first criterion is given in online supplemental table 2. We retained 18 operations that satisfied both eligibility criteria (table 1).

Supplemental material

Table 1

A list of operations passing both criteria for inclusion in this study

Table 2

Data set characteristics

Our data comprised all spells of care that began between 1 April 2006 and 31 December 2019, which contained one of the included operations and that were the first operation of its type for the patient. By taking 1 April 2006 as the start of our study we were able to use at least 5 years of data (from 1 April 2001 onwards) to check whether a patient had undergone a prior operation of the same type. Following this, an operation was included only if it was listed as the primary operation undergone during the inpatient spell and if it took place as part of a non-emergency admission. Further data cleaning involved removing records with missing primary diagnosis information, records with unknown age, sex or provider type and any cases where patients were recorded as having the same operation on the same day as part of separate inpatient spells. The cohort selection process is shown in online supplemental figure 1.

Supplemental material

Calculation of derived variables

Patient residential address was matched to a quintile of the IMD using the following IMD versions12: IMD v2004 for activity within the 2006–2007 financial year, IMD v2007 for activity between 2007–2008 and 2009–2010, IMD v2010 for activity between 2010–2011 and 2013–2014, IMD v2015 for activity from 2014–2015 to present.

All patient diagnoses (up to 24) recorded during the index spell were used to calculate the Charlson Comorbidity Index.17 The presence of Elixhauser comorbidities was calculated based on all diagnoses from the first episode of the index spell and any spells occurring in the year prior to the index admission. International Classification of Diseases 10th Revision (ICD-10) codes for Elixhauser comorbidities were taken from Quan et al,18 with the addition of a category for dementia (ICD-10 F00–F03 and F05.1). Length of stay was calculated as the difference between the operation date and discharge date. We defined within-specialty readmissions as an emergency inpatient admission coded within the same specialty as the operation (see online supplemental table 3 for specialties relevant to each operation type). For all-cause readmissions, the specialty requirement was removed. For both categories of readmissions, the readmission date had to follow the initial admission date and take place within 28 days of the discharge date. The readmission could be to the same or a different hospital (of either provider type) as the initial admission. Data on in-hospital deaths (during the index admission) were obtained from the HES database, whereas data on deaths following discharge were obtained via linkage to death records from the ONS.

Supplemental material

Propensity score matching

For each operation type, propensity score matching was used to create comparable control (NHS) and treatment (ISHP) groups. We implemented the nearest neighbour method of propensity score matching in R using the package ‘MatchIt’,19 specifying a calliper of 0.1. Propensity scores were calculated using a logistic regression model. Categorical variables included in the model were sex, ethnicity (including ‘unknown’), IMD quintile (including ‘unknown’) and operation year; while age and Charlson Comorbidity Score were included as (linear) continuous variables. All variables were determined from data recorded at the time of admission for the operation of interest. Since there were many more operations in NHS hospitals than ISHPs for all operation types, no ISHP records were excluded by the matching algorithm—one NHS record was chosen for every ISHP record and no ‘pruning’ was required as all matches were within the prespecified matching threshold. However, the matching process was computationally expensive; therefore, for operation types where more than 20 000 operations had taken place in ISHPs, the whole data set for that operation type was randomly subsampled prior to matching.

To validate the quality of the matching, the standardised mean difference was calculated before and after the propensity score matching. We judged standardised mean difference values greater than 0.1 to indicate significant imbalance between matched groups with regard to the covariate under consideration. Additionally, we visualised the effect of propensity score matching by plotting histograms of propensity scores in the NHS hospital versus ISHP groups before and after matching.

Statistical analyses

Grouping outcomes

In figure 1, possible outcomes are represented diagrammatically according to where they come in the patient pathway. On the basis of the logic represented in the figure, outcomes are classified into two groups: ‘in-hospital outcomes’ and ‘outcomes with 28 days post discharge’.

Figure 1

Diagram showing possible outcomes. Outcomes included in the in-hospital survival analyses are highlighted with a green box. Outcomes included in the postdischarge survival analyses are highlighted with an orange box. The blue box indicates that only patients discharged from hospital within 60 days are included in the postdischarge analyses. Only 65 patients (0.01%) remained in hospital beyond 60 days (category C2; table 3).

In-hospital outcomes

We used survival analysis methods to analyse the time from operation to one of three competing outcomes that terminated a spell of care: discharge, death or transfer to another hospital. We further split transfers into emergency or non-emergency transfer according to how they had been coded by the receiving hospital. We graphically examined the cumulative incidence of each outcome with respect to time postoperation, allowing for competing risks using a multistate model formulation in the R ‘survival’ package.20 We estimated adjusted hazard ratios (HRs) for each outcome by fitting a Cox proportional hazards model for each outcome separately, with provider type as the sole predictor, right censoring if a different outcome occurred before the outcome of analysis and accounting for clustering within treatment provider sites.

Outcomes within 28 days postdischarge

The approach for examining differences in postdischarge events was similar. Here, emergency readmission (either within specialty or all cause) and death were the events under consideration, and all patients were censored at 28 days after discharge if they had not experienced an event by this point. When fitting Cox proportional hazards models for death within 28 days, we considered all deaths regardless of whether they were preceded by an emergency readmission. The ‘denominator’ population, that is, those used in the postdischarge analyses, was considered to be all patients who were discharged alive within 60 days of their index admission, without having been transferred to another hospital provider since their operation.

Subgroup analysis

NHS versus for-profit hospitals

We repeated the propensity score matching and statistical analyses, restricting the data to only episodes of care in NHS hospitals or for-profit ISHPs to compare outcomes between these two provider types. The breakdown of ISHPs into not-for-profit and for-profit categories is given in online supplemental table 4 for all ISHPs contributing at least 10 operations to the data set.

Supplemental material

Time epochs

Given the increasing use of ISHPs as a proportion of all NHS-funded operations, we tested the stability of our findings over time by examining cumulative incidence curves, stratified by time period within which the operation occurred (with ‘early’ defined as prior to 1 January 2014 and ‘late’ defined as 1 January 2014 onwards).

Interactions between place of surgery and propensity score

We examined heterogeneous effects of provider type by estimating a proportional hazards model that included provider type interacted with quartile of the propensity score.21 We used a χ2 test to test the null of no difference in treatment effects between propensity score quartiles against the alternative hypothesis of at least one quartile being different from the rest.22

Sensitivity analyses

To check whether our results were sensitive to the choice of comorbidity index, we repeated the main survival analyses on a matched data set, obtained by including binary variables for each of the Elixhauser comorbidity categories in the logistic regression rather than the Charlson score.

Lastly, to examine whether our results were sensitive to the choice of propensity score matching as a method for removing bias, we repeated the main survival analyses on the raw data and instead adjusted for all the covariates (sex, ethnicity, IMD quintile, operation year, age and Charlson Comorbidity Score) within the Cox proportional hazards models in order to obtain adjusted HRs.

Results

Data set

We analysed 3 671 590 operations taking place between 1 April 2006 and 31 December 2019 from 274 ISHP sites and 734 NHS hospitals. Characteristics of the data set are shown in table 2. The proportion of operations taking place at ISHPs has increased over time from 2% in 2006 to 27% in 2019. A large majority (393 086; 84%) of operations that took place in ISHPs were in for-profit organisations (online supplemental table 4). Patients undergoing an operation at ISHPs were on average older, but with lower levels of comorbidity; lived in more affluent areas; and were more predominantly White (or had no ethnicity recorded), compared with those treated in NHS hospitals. These observations on patient demographics were confirmed by our propensity score model (online supplemental table 5).

Supplemental material

Matching

Online supplemental table 6 shows standardised mean differences between the two provider-type groups calculated for the factors sex, ethnicity, age, operation year, Charlson Comorbidity Index and deprivation. Prior to matching, the standardised mean difference was >0.1 for the majority of operation types for all factors except sex, indicating a noticeable imbalance between provider types for each of these factors. In the matched samples, no standardised mean difference exceeded 0.1. The matched groups were well balanced with respect to all covariates included in the model, as illustrated by the histograms of propensity scores before and after matching (online supplemental figure 2).

Supplemental material

Supplemental material

Frequency of outcomes

The following results all compare the matched samples. Table 3 reports the number of events occurring for all 18 operation types combined and across the outcome types represented in figure 1. Event counts for individual operation types are included in online supplemental table 7. More than 99.5% of patients were discharged alive within 60 days of admission. In-hospital death and 28-day emergency readmission occurred more frequently for operations undergone in NHS hospitals, whereas emergency transfer to another hospital and death within 28 days of discharge (or within 28 days of transfer) occurred more frequently following operations in ISHPs.

Supplemental material

Table 3

Event counts in the matched data

In-hospital outcomes

For all 18 types of operation, treatment in ISHPs was associated with shorter lengths of stay than treatment in NHS hospitals, resulting in HRs for discharge greater than 1, as shown in figure 2. Patterns of earlier discharge at ISHPs are also visible in the plots of cumulative incidence of in-hospital outcomes (figure 3 and online supplemental figure 3; left-hand panels). This difference was smallest in magnitude for wisdom tooth operations, cholecystectomy and inguinal or umbilical hernia repair, all of which had an HR for discharge and upper CI limit <1.5 (online supplemental table 8), as well as a mean difference in length of stay <0.4 days (figure 2). The difference was greatest in magnitude for hip and knee replacements, with HRs varying from 1.75 (95% CI 1.40 to 2.19) to 2.15 (95% CI 1.72 to 2.68), and mean differences in length of stay varying from 1.3 to 1.5 days across specific hip and knee operation types. For some types of hip and knee replacement the practice of discharging patients on the same day was a regular occurrence at ISHPs, while remaining very rare at NHS hospitals (online supplemental figure 3). For example, for total hip replacement (THR) (not elsewhere classified, NEC) nearly 40% of patients in our matched data set treated at ISHPs were discharged on the same day, compared with <5% of patients treated at NHS hospitals (figure 3C). The mean length of stay in the NHS-treated subsample matched to those discharged on the same day from ISHPs was approximately 5 days, which was comparable to the mean length of stay for all NHS patients undergoing this operation type.

Supplemental material

Supplemental material

Figure 2

HRs and 95% CIs for the effect of provider type on time to discharge. Unadjusted Cox regression was used, with clustering of operations within hospital sites accounted for in order to calculate robust SEs. An HR greater than 1 indicates shorter times from operation to discharge in Independent Sector Healthcare Providers (ISHP). On the right-hand side, the corresponding mean difference in length of stay is given. This is defined as the mean length of stay for patients treated in National Health Service (NHS) hospitals minus the mean length of stay for patients treated at ISHPs. The means are calculated based on patients discharged alive within 60 days (category C1 in figure 1). IH, inguinal hernia; NEC, not elsewhere classified; THR, total hip replacement; TKR, total knee replacement; UH, umbilical hernia; VH, ventral hernia.

Figure 3

Cumulative incidences of all in-hospital and postdischarge events. Part A shows data for endoscopic resection of prostate NEC; Part B shows data for repair of recurrent inguinal hernia using insert of prosthetic material; Part C shows data for primary total prosthetic replacement of hip joint NEC. Left-hand side: cumulative incidence of all in-hospital events after operation, split by provider type (NHS hospital=blue; ISHP=red) and event type (between hospital transfers=dotted; in-hospital death=solid; discharge=dashed). Events are considered as competing risks, formulated as a multistate model. Right-hand side: similar plots for postdischarge events (death=long dashed; within-specialty emergency readmission=dot dashed). The three operation types shown here were chosen so as to best represent together all 18 sets of results (the full set is shown in online supplemental figure 3). IH, inguinal hernia; ISHP, Independent Sector Healthcare Provider; NEC, not elsewhere classified; NHS, National Health Service; THR, total hip replacement.

The incidence of other in-hospital events (transfers and deaths) is very low in both groups of hospitals (table 3). Emergency transfers were more common after treatment in an ISHP than in an NHS hospital for seven of the 18 operation types, and in no case was the opposite effect observed. However, when it came to non-emergency transfers, the overall effect was reversed with more transfers following NHS than ISHP treatment for eight of the 18 operation types. There was only one operation where death rates differed and this was in favour of ISHPs. These data are shown in online supplemental table 8.

Outcomes within 28 days postdischarge

Figure 4 shows the adjusted HRs for emergency readmission for outcomes up to 28 days following discharge. For all operation types the hazard for within-specialty readmission is significantly lower for operations taking place at ISHPs than for those taking place at NHS hospitals. The same holds for all-cause readmission, with the exception of impacted wisdom tooth removal where there is little to no evidence of a difference (online supplemental table 9). For some operation types the incidence of within-specialty readmission was similar between providers in the first 2–3 days following discharge, but for all 18 operation types the cumulative incidence showed a clear divergence after this point (figure 3 and online supplemental figure 3; right-hand panels). There were three operation types for which there was strong evidence that HR for within-specialty readmission was less than 0.5: umbilical hernia repair using insert of prosthetic material, ventral hernia repair and lumbar decompression (online supplemental table 9). For these three operations the absolute difference in readmissions within 28 days of discharge varied from 1.5 to 2.5 percentage points (figure 4). The smallest effect sizes were 0.74 (0.61–0.88) and 0.75 (0.67–0.85) for THR using cement and cholecystectomy, respectively. The corresponding absolute differences in readmissions within 28 days of discharge were 0.6 and 1.3 percentage points, respectively. Effect sizes were somewhat smaller when all-cause rather than within-specialty readmissions were considered. For all operation types there was no evidence of a difference between the risks of death in patients discharged from ISHPs versus NHS hospitals (online supplemental table 9).

Supplemental material

Figure 4

HRs and 95% CIs for the effect of provider type on time to emergency readmission. Unadjusted Cox regression was used, with clustering of operations within hospital sites accounted for in order to calculate robust SEs. Within-specialty admissions are shown in light green while all-cause readmissions are shown in dark green. An HR less than 1 indicates a lower risk of such a readmission for patients treated in Independent Sector Healthcare Providers (ISHP). On the right-hand side, the corresponding absolute difference in the number of patients readmitted within 28 days of discharge is given (category E in figure 1), as a percentage of the total number of patients discharged alive within 60 days of their operation (category C1 in figure 1). Since the number of 28-day emergency readmissions is always (for all 18 operations) greatest for patients treated at National Health Service (NHS) hospitals, this number represents the additional readmissions among patients treated at NHS hospitals, per 100 patients. The left-hand column is for all-cause readmissions while the right-hand column is for within-specialty readmissions. IH, inguinal hernia; NEC, not elsewhere classified; THR, total hip replacement; TKR, total knee replacement; UH, umbilical hernia; VH, ventral hernia.

Subgroups: for-profit ISHPs, early versus late epoch and propensity score quartiles

When restricting the comparison to for-profit ISHPs and NHS hospitals we found that the direction and magnitude of effects were qualitatively very similar to the original comparison with all ISHPs (online supplemental figure 4 and online supplemental tables 10 and 11).

Supplemental material

Supplemental material

Supplemental material

We stratified the data into two time windows: early (2006–2013) and late (2014–2019). Overall, qualitatively similar patterns in time to discharge and time to emergency within-specialty readmission were observed in both two time windows (online supplemental figure 5). However, the practice of same-day discharge for hip and knee replacements was only identifiable in ISHPs in the early time period data; patterns of time to discharge were more similar between ISHPs and NHS hospitals in the late period data. Turning our attention to within-specialty readmissions, there were some operations for which the magnitude of the effect of provider type was smaller in the late time period data (such as THR not using cement and hybrid hip replacement using cemented femoral component), and some for which the magnitude was larger in the late time period data (such as prostate resection and THR using cement).

Supplemental material

We examined the heterogeneity of the effect of provider type with respect to the propensity of being treated in an ISHP (online supplemental figure 6). In other words, we looked to see whether, in a model with an interaction between provider type and propensity score, the estimated HR varied by propensity score quartile. The overall picture was that HRs for all outcomes were similar across the four quartiles of the propensity score within an operation type. When we examined the outcomes and operation types for which HRs did noticeably vary by propensity score quartile, we found no consistent pattern. For example, where there was evidence of an interaction between provider type and propensity score quartile, there were roughly equal numbers of operation types for which the effect of provider type increased versus decreased in magnitude with increasing propensity score. Further details are provided in online supplemental figure 6.

Supplemental material

Sensitivity analyses

When using the Elixhauser comorbidity categories instead of Charlson score as part of the matching algorithm, we found there was little change to the estimated HRs for in-hospital or postdischarge outcomes (online supplemental tables 12 and 13).

Supplemental material

Supplemental material

Lastly, we obtained HRs for provider type from survival analyses performed on the raw (ie, unmatched) data, adjusting for the same list of covariates that had been used in the original matching algorithm. The resulting effect estimates were again qualitatively similar to the original estimates, but in this case the magnitude was, in general, somewhat increased (online supplemental tables 14 and 15). The larger number of records in the models meant it was possible to estimate HRs for rare events, such as death, for a few more of the operation types. However, CIs were still large. There was some evidence that the hazard of death in hospital was lower for some hip and knee replacement types when they took place in ISHPs (THR cemented: HR 0.2, 95% CI 0.1 to 0.4; THR no cement: HR 0.2, 95% CI 0.0 to 0.7; total knee replacement (TKR) cemented: HR 0.2, 95% CI 0.1 to 0.4), but for other hip and knee replacement types death within 28 days of discharge had a higher hazard at ISHPs (TKR NEC: HR 3.0, 95% CI 1.4 to 6.5; THR cemented acetabulum: HR 4.7, 95% CI 1.8 to 12.7).

Supplemental material

Supplemental material

Discussion

Main finding

Our analysis suggests that, across the range of operation types studied, patients treated in ISHPs are more likely to be discharged from hospital sooner (figure 2) and are less likely to be readmitted (figure 4). These findings are consistent across all 18 operation types, and the effect sizes in many instances are large. For instance, the risk of within-specialty readmission after lumbar decompression in an ISHP is about a third of that in an NHS hospital, changing to about a half when all-cause readmissions are considered. There is evidence that patients in ISHPs were more likely to be transferred to another hospital as an emergency, while in-hospital death and non-emergency transfer were more likely for patients treated in NHS hospitals.

Strengths and limitations

This study includes over three and a half million operations, covers an entire country, and many operation types. However, precise as our study may be, it has two main limitations. First, the study is observational, so by itself it cannot prove that the better outcomes in ISHP hospitals were causal. Second, we were able to evaluate only a limited selection of outcomes. We now discuss these two issues.

Selection effects

A number of factors determine whether a patient will have their operation in an independent facility. These are largely operational factors related to capacity in the NHS, but patient and clinician choice also plays a part (online supplemental text 1), opening the door for selection effects. We adjusted for differences in the observable characteristics of patients treated in ISHPs versus NHS hospitals by creating matched cohorts with respect to age, sex, deprivation, ethnicity and comorbidity score, as well as year of operation. However, there are differences in case complexity that are not captured by (fairly granular) ICD-10 codes recorded in HES data. Additionally, calculation of the comorbidity score relies on secondary diagnosis coding, which is more variable than primary diagnosis coding,23 and may be less complete in ISHPs than NHS hospitals.24 A selection mechanism might lead to a correlation between risk and probability of being treated in an ISHP. This may translate into heterogeneity of ‘treatment’ effect with respect to the propensity score.25 We did not find evidence of such an effect, but this does not disprove the possibility of residual confounding.

Outcome measures

The range of outcome measures that we observed was limited by those available in the data set to which we had access. Our results do, however, complement the study quoted earlier,11 showing improved satisfaction among NHS-funded patients treated in ISHPs compared with NHS hospitals. As routine data sets mature we will be able to evaluate more, and arguably better, outcomes such as patient-reported outcome measures. For example, a recent cohort study compared the generic quality of life following hip replacement where the outcomes were slightly in favour of independent providers.7

Possible causal mechanisms

In so far as outcomes may be causal, we speculate that length of stay and readmissions may be influenced by different causal mechanisms—operational efficiency with respect to length of stay and technical competence with respect to readmission. Regarding length of stay, time of discharge is influenced by the patient’s condition and by hospital policy and operational factors. For example, independent providers might have more incentives to implement same-day discharge policies, and there is evidence in the data that some ISHPs followed a policy, perhaps fashion, for day-case hip surgery for a period of time. Regarding readmission, we cited a number of reasons why outcomes may be worse in ISHPs, such as the effect of operating in a less familiar environment. However, it is also the case that admission rights to ISHPs are usually restricted to registered specialists, while less experienced trainees provide a high proportion of care in the NHS. We can thus speculate that greater technical efficiency may explain some of the findings in our study.

The finding that emergency hospital transfers were more common in ISHPs does not necessarily reflect on the safety of care. Many ISHPs lack the full range of services, including intensive care, required for management of an emergency case. Thus, given an emergency, a patient in an ISHP is more likely to be transferred than an equivalent patient in the NHS who is already likely to be in the institution of last resort.

Interpretation

As stated in the Introduction section, plausible concerns have been expressed regarding the safety of elective surgery in the independent sector. Taken in the round, our findings provide a measure of reassurance that Independent Sector Healthcare Providers are providing an acceptable service. In the context of meeting the backlog of cases following the COVID-19 pandemic this may be a useful finding. But our results stop short of total reassurance, and ongoing scrutiny of a richer set of outcomes and further investigation of practice is required in both the NHS and ISHPs.

Data availability statement

Data may be obtained from a third party and are not publicly available. Linked HES and ONS data may be obtained from NHS Digital via the Data Access Request Service (DARS) and are not publicly available.

Ethics statements

References

Supplementary materials

Footnotes

  • Contributors RL, SG and PB conceived the study. KR, RL and HC drafted the analysis protocol. HC and AL extracted the data and conducted the statistical analyses, with guidance from SIW. HC wrote the first draft of the manuscript. All authors reviewed and contributed to the writing of the manuscript.

  • Funding This research was funded by the National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) West Midlands and NIHR ARC East Midlands through the Margaret Peters Centre at University Hospitals Birmingham NHS Foundation Trust.

  • Disclaimer The views expressed are those of the authors and not necessarily those of the NIHR, the NHS or the Department of Health and Social Care.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; internally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Linked Articles