Quality effects of operative delay on mortality in hip fracture treatment
- National Research and Development Centre for Welfare and Health (STAKES), Outcomes and Equity Research, Helsinki, Finland
- Correspondence to: R Sund STAKES, P O Box 220, FIN-00531 Helsinki, Finland;
- Accepted 7 August 2005
Background: Most hip fracture patients undergo surgery, but there is conflicting evidence on the relation between the timing of surgery and the outcome of treatment. There is considerable variation in the length of surgical delays between hospitals, possibly reflecting the quality of care.
Aim: To examine the associations between in-hospital surgical delay and the mortality of hip fracture patients from a practical quality assessment perspective.
Methods: The effects of operative delay on mortality were estimated using various statistical methods applied to observational data from 16 881 first time hip fracture patients aged 65 or older from 47 hospitals (providers) in Finland in 1998–2001.
Results: A prolonged in-hospital operative delay was associated with a higher mortality of hip fracture patients in individual level analyses, but the instrumental variable approach indicated that the individual level effect was not caused by the operative delay but by inappropriate methodological assumptions. There was extensive variation between providers in the proportion of late surgery patients. Provider level analyses showed that the effects of the provider of operative delay on mortality are quite small, but there is a clear association between the proportion of late surgery patients and non-optimal treatment.
Conclusions: If provider level heterogeneity is not explicitly taken into account, studies of the effects of surgical delay on outcomes are prone to serious bias. The proportion of patients with prolonged waiting time for surgery at the provider level seems to work as an effective evidence-based quality indicator. Providers should reduce unnecessary delays to surgery and identify more carefully patients not suitable for early surgery.
Hip fractures are common injuries among older people and are associated with substantial morbidity and mortality.1–3 Ageing of the population has resulted in an increase in the mean age of hip fracture patients which is likely to cause additional problems in the treatment and rehabilitation of patients in the future.4,5 A surgical operation is performed for most patients during the acute management of hip fracture. A typical hip fracture patient is confined to hospital bed rest before surgery. A fairly short operative delay is suggested in the clinical guidelines,6,7,8,9,10 but it is known that there is considerable variation in the operative delays between providers.11–17 In fact, operative delay is a commonly used process measure in health system performance assessment.18 Minimisation of unnecessary preoperative inpatient care can be used as an economic justification for shorter operative delays. For quality measurement purposes, the operative delay should also have confirmed effects on outcomes otherwise improvements may possibly be targeted to issues which do not improve health.19 The evidence concerning the optimal timing of surgery in relation to the overall outcomes of hip fracture treatment is quite mixed.20–29 In short, the main reasons for variations in the operative delay are provider level system factors (availability of required resources such as operating rooms, support services, or personnel with expertise) and clinical decisions based on patient specific factors (co-morbidity, medical stabilisation). In some studies conflicting results may be due to methodological shortcomings (small numbers of observations, no adjustment for confounding factors), but more sophisticated evidence as to whether operative delay has an independent effect on primary outcomes is also conflicting.30–38 Another open question is the definition of the time period for delayed surgery.18 The impact of provider level heterogeneity on the effects of operative delay on outcomes has also not received sufficient attention.
This study was undertaken to examine the associations between the in-hospital operative delay and the mortality of hip fracture patients in Finland in 1998–2001. Since previous studies concerning the effect of operative delay on mortality had reported conflicting results, special attention was paid to methodological issues. More specific goals for empirical analyses were (1) to identify a suitable definition for early and late surgery groups, (2) to describe the postoperative excess mortality associated with prolonged operative delay, (3) to illustrate in which respect the early and late surgery groups differ from each other and whether adjustment of these observed factors changes the association between operative delay and mortality, (4) to compare the risk adjusted proportion of late surgery patients between providers, and (5) to investigate provider level heterogeneity in terms of 1 year mortality and the proportion of patients with late surgery.
The total population of hip fracture patients in 1998–2001 was identified in the Finnish Health Care Register. The medical histories (1987–2002) and deaths (1998–2002) of the hip fracture population were extracted from the Finnish Hospital Discharge Register, Finnish Health Care Register, and from the National Causes of Death Register using the unique personal identification numbers of the patient population. Each record in these registers includes data such as patient and provider ID numbers, age, sex, area codes, and diagnosis and operation codes, as well as dates of admission, operation, and discharge (or death). The completeness and accuracy of the registers is known to be good.39–41
Data were preprocessed so that information concerning patients aged 65 or older with a first hip fracture could be accurately identified.42 For the purposes of this study, the data were restricted to patients operated on using an internal fixation, a prosthesis, or a total hip replacement. Patients with incomplete data were excluded from the analyses. A few providers (hospitals) had not reported operation dates for the years 1998–1999, but otherwise no systematic bias was found in the sensitivity analyses. The final study population consisted of 16 881 patients, which represents 83.3% of all first time hip fracture patients aged 65 or older. Forty six providers had at least 50 cases, while the remaining 154 cases from other providers were combined into a single figure. The existence of possible co-morbidities was extracted for each patient from his or her medical history using the diagnosis codes recorded in the data.34,43 The extraction method was adapted and updated from the original Charlson co-morbidity categories44 and applied to the current data set.
Cumulative probabilities of unadjusted mortality were calculated using the product limit estimators. Excess risk of death was defined as difference in cumulative probabilities of mortality between two comparable groups. Hazard ratios were obtained using the proportional hazards model allowing the adjustment of observed confounders. Since only a limited number of covariates were observed, the biasing influence of unobserved heterogeneity was statistically controlled by incorporating the gamma frailty term into the model.45
The significance of the differences between the unadjusted patient characteristics was determined using the z test (binary variables) or χ2 test (categorical variables). The logistic regression model was used to calculate odds ratios and significances of differences between adjusted patient characteristics. The same logistic model was also used for predicting the late surgery probability for each patient. These probabilities were then aggregated to the provider level, resulting in the expected number of late surgery patients for each provider.46 The provider specific ratios between observed and expected numbers of late surgery patients were further modelled using the hierarchical gamma-Poisson model to obtain the comparable risk adjusted proportions of late surgery patients for providers.47 The weekday adjusted proportion was calculated using the predictive margin technique.48 In the instrumental variables analysis49 the 1 year adjusted mortality was calculated for each admission day of the week and the null hypothesis of equal mortalities was tested using the χ2 goodness of fit test.30
Provider level heterogeneity was examined in terms of the proportion of late surgery patients and 1 year mortality. The provider specific overall mortality rates were stratified according to early and late surgery, recognising the fact that the weighted average of these mortalities gives the overall mortality. The provider level associations between these three mortality rates and the proportions of late surgery patients were estimated using Stein estimation with an assumption of linear trends for overall and early surgery mortality rates.50 The associations were also analysed separately according to severity. The five severity groups were established by classifying the patients into five equal sized groups in terms of their predicted 1 year mortality based on the logistic regression model.51
Effect of length of operative delay on mortality
The cumulative probabilities of unadjusted mortality rates attributable to different lengths of operative delay are shown in fig 1. Waiting times of 0–2 nights had the same effect on mortality, but there was a significant increase in mortality with waiting times of 3–4 nights (p<0.001), and waiting times of 5 or more nights resulted in an even higher mortality rate. Early surgery was defined as a waiting time of 0–2 nights (n = 14 426, 85.5%) and late surgery as a waiting time of at least 3 nights (n = 2455, 14.5%). The unadjusted hazard ratio between late and early surgery was 1.24 (95% confidence interval (CI) 1.15 to 1.34, p<0.0001).
Excess risk of death
The unadjusted excess risk of death for late surgery compared with early surgery quickly rose to 3%, then slowly increased during follow up to about 5% at 1 year (fig 2). Complementary analyses revealed that the excess risk was quite stable and near to its maximum at 1–3 years and then began to decrease slowly. As the lower confidence limits in fig 2 indicate, the unadjusted excess risk of death became statistically significant 2 weeks after the operation.
Characteristics of early and late surgery groups
Characteristics of the patients with hip fracture classified into early and late surgery groups are shown in table 1, together with the corresponding odds ratios for late surgery adjusted for the other characteristics in the table. Early surgery was associated with being 85 years or older, of female sex, having a pertrochanteric fracture, and receiving long term inpatient care during the year preceding the admission. Admission on a Wednesday and a medical history of dementia or cataract were also associated with early surgery. The risks for late surgery were likely to be increased by admission from a nursing home, health centre or readmission shortly after discharge, admission between Thursday and Saturday, and co-morbidities including cardiovascular disease and peripheral vascular disease (and, prior to adjustment, diabetes, cerebrovascular disease, chronic pulmonary disease, hypertension, and anaemia). The proportion of patients having late surgery substantially decreased during the period of the study.
Adjusted effect of operative delay on mortality
The hazard ratio for the late surgery reduced to 1.18 (95% CI 1.09 to 1.28, p<0.0001) after adjusting for the provider and the characteristics in table 1. Even after controlling for the unobserved covariates, the hazard ratio remained significant, indicating an increased mortality for late surgery. However, after the pseudo randomised assignment of patients into early and late surgery groups using admission day of the week as an instrumental variable, the difference in the adjusted 1 year mortality rate was found not to be attributable to operative delay (p = 0.069).
Proportions of late surgery patients
There was extensive variation in the proportions of late surgery patients between providers (fig 3). The conservative 95% confidence interval crosses the potentially achievable (20th centile)52 92.3% share of patients undergoing early surgery for less than 50% of the providers.
Trend analysis at provider level
The simultaneous examination of the provider level proportions of late surgery patients and 1 year mortality rates showed that there was a statistically significant positive trend for an association between a larger share of late surgery patients and 1 year overall mortality (p<0.05), and that a smaller proportion of late surgery patients was (non-linearly) associated with a higher mortality rate for these patients (fig 4).
Trend analyses for severity groups
The associations were further analysed according to severity (measured as predicted 1 year mortality based on the same observed patient characteristics as in table 1) in five severity groups of patients (table 2). The proportion of patients undergoing late surgery was only slightly higher in the more severe patient groups but the 1 year mortality rate increased significantly with severity, as expected. The slope of the trend of overall mortality increased with the severity but was statistically significant only for the most severe patients. The positive slope of early surgery mortality was statistically significant in severity groups 3 and 4, but for the most severe patients this association disappeared. A smaller proportion of late surgery patients was associated with a higher late surgery mortality rate in all groups except the most severe patients.
In this study the definition of late surgery turned out to be 3 or more nights in hospital after admission, since shorter waiting times were not associated with higher unadjusted mortality. A similar “long” delay is commonly used as the definition of late surgery in other studies.17,18,20,34
The unadjusted excess mortality for late surgery patients increased during the year following the operation. It is interesting that the short term mortality differed only slightly between early and late surgery groups, but the difference became much clearer after the perioperative period. This may be partly due to the fact that almost half the perioperative deaths are unavoidable in an unselected population.53 If patients are going to die shortly after the fracture—regardless of the quality of the hip fracture treatment provided—it is obvious that the treatment effect turns out to be small. The treatment effect becomes observable for long term mortality but is potentially biased because of heterogeneity between the early and late surgery groups in patient characteristics affecting the outcome.20,30,33,36
Several patient characteristics differed between the early and late surgery groups, but the prolonged operative delay seemed to increase the (long term) mortality significantly even after adjustment for these observed patient characteristics. There were no detailed clinical data available which obviously makes the adjustments only partial. The bias attributable to the unobserved covariates was controlled by allowing extra variation in the model, but the treatment effect remained significant. However, this kind of model is still prone to bias if the relationships between the risk factors and mortality are not correctly specified in the model.54 The pseudo randomizing instrumental variable approach was therefore applied and indicated that the increased mortality was not due to operative delay. Since the interpretations based on the instrumental variable approach also require strong and questionable assumptions,30,33 the sizeable difference in the estimates of the effect of operative delay on mortality between methods means that there is a need for hypotheses to explain such differences.
For instance, one could try to separate the acceptable delays from the unacceptable ones27,36 or one could record the reason for the delay in the data.17,31,32 In the strictest sense, this kind of approach needs the assumption that the acceptable and unacceptable delays can be defined and measured uniquely.55–57 In practice, an acceptable delay corresponds to a clinical decision to postpone the operation and the assumption is approximately fulfilled if the clinical practice remains constant. Because the data used in this study did not include the reason for the delay, the hypothesis of constant clinical practice was examined indirectly using provider level analyses.
The provider specific proportion of late surgery patients, adjusted for observed patient characteristics, showed that there was extensive variation between providers, which is a common finding.11–17 A simple performance assessment interpretation is that the percentage of late surgery patients can be reduced to a potentially achievable level52 that can also be interpreted as the upper limit for the proportion of acceptable delayed patients. Correspondingly, the expected proportion of unacceptable delayed patients is the proportion of late surgery patients exceeding this upper limit. This leads to the hypothesis that the overall mortality of hip fracture patients should increase with an increasing proportion of late surgery patients given that the longer operative delay would have an adverse effect on mortality. In fact, a statistically significant trend between the provider specific proportions of late surgery patients and overall 1 year mortality gives empirical evidence for the hypothesis, but the actual volume of the effect was small. Another provider level hypothesis is that the long term mortality of late surgery patients is higher if only the patients unfit for surgery are delayed, since the unfit condition for surgery is also a risk factor for 1 year mortality. This hypothesis was also supported by empirical evidence which revealed a non-linear association between the provider specific proportion of late surgery patients and the 1 year mortality rate for these patients.
A more careful examination of the groups of patients with different predicted mortality (severity) gave even more insight into the provider level association between the proportion of late surgery patients and mortality. Intuitively speaking, the least severe patients are young, come from home, and are without severe medical conditions. Correspondingly, the most severe patients are older with much co-morbidity and come from residential care.21,31,53 For patients in the least severe group, mortality was higher in the late surgery patients for all providers. This probably indicates that, in this group, hip fracture related mortality is caused by the medical problems which require late surgery and the prolonged surgical delay does not itself increase the mortality.28,30,31,36 For patients in the most severe group mortality was also higher for the late surgery patients for all providers. However, in this group the mortality rate in the late surgery patients was lower in the providers with a small proportion of late surgery patients and there were no differences in mortality rates among early surgery patients between providers. This means that, in this group, it is essential to perform early surgery in all patients who can withstand it because the significantly prolonged surgical delay makes the patient’s condition worse and increases mortality.22,23,29,32,33 For groups 2–4 the interpretation is more difficult than for patients in the extreme groups. Since the mortality rate in early surgery patients increases significantly and is higher even than the mortality rate of late surgery patients for providers with a large proportion of late surgery patients, it seems that in these groups an operation performed too early may cause more harm than the prolonged waiting time.21,22,26
Other differences between providers in the proportion of patients with late surgery result mainly from lack of resources such as temporary unavailability of the operating rooms or surgeons and problems with obtaining medical clearance from other specialities in off hours.57,58 The importance of these factors can be illustrated using the effect of the admission day on the in-hospital operation delay; the mean proportion of patients undergoing late surgery would be reduced from 14.5% to 9.0% (p<0.0001) if all patients had been admitted on “the best day”.
In spite of the large nationwide database and the advanced methods, the observational study design and administrative data require a special orientation to the analyses and caution should be exercised when interpreting the results. Data were available for 1998–2001 and the practices may have disproportionately changed for the different providers during that time. The results must therefore be interpreted as the mean situation between the years 1998–2001 for each provider. Non-operated patients were excluded from the analyses since the operative delay was not defined uniquely for these patients. Inclusion of these patients would certainly increase the mortality rate since the typical non-operated patient is in a worse condition and dies before any operation can even take place. The trend analyses are intended to summarise the systematic parts of the variation between the providers. However, there seems to be some unexplained variation, especially in the proportions of late surgery patients, because of the small number of patients for some providers, so the results of the trend analyses need to be confirmed and validated in further studies.
Study designs which explicitly take into account the heterogeneity at the provider level are a prerequisite for unbiased results since the selection bias may vary between providers. One could also include the provider level characteristics in the analyses,35,37 but easily observable characteristics such as hospital type or number of surgeons typically allow only indirect interpretations. A more direct approach would be to observe the performance of providers continuously and to ask the providers themselves to clarify the reasons for their performance.12,58,59
In Finland the mean proportion of late surgery patients has decreased during the years of the study, but extensive variation between providers exists. In addition to possible system problems, there also seems to be variation in the clinical practices for judging which patients are suitable for early surgery. Identification of good practices and the release of a national clinical guideline for hip fracture treatment will probably improve the situation. In this sense, the proportion of patients with a prolonged waiting time for a hip fracture operation seems to be an effective evidence based quality indicator, since it clearly indicates an area for improvement. The effects of operative delay on mortality at the patient level are quite small, but at the provider level the association between the proportion of late surgery patients and non-optimal treatment is clear.
This research was supported by a research grant from the Academy of Finland.