You are here

Article Text

Article menu

Download PDFPDF

Original research
Valuing hospital investments in nursing: multistate matched-cohort study of surgical patients
  1. Karen B Lasater1,2,
  2. Matthew McHugh1,2,
  3. Paul R Rosenbaum2,3,
  4. Linda H Aiken1,2,
  5. Herbert Smith1,4,
  6. Joseph G Reiter5,
  7. Bijan A Niknam5,
  8. Alexander S Hill5,
  9. Lauren L Hochman5,
  10. Siddharth Jain2,5,
  11. Jeffrey H Silber5,6
  1. 1 School of Nursing, Center for Health Outcomes and Policy Research, University of Pennsylvania, Philadelphia, Pennsylvania, USA
  2. 2 The Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pennsylvania, USA
  3. 3 The Wharton School, University of Pennsylvania, Philadelphia, Pennsylvania, USA
  4. 4 Population Studies Center, University of Pennsylvania, Philadelphia, Pennsylvania, USA
  5. 5 Center for Outcomes Research, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
  6. 6 School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
  1. Correspondence to Dr Karen B Lasater, School of Nursing, Center for Health Outcomes and Policy Research, University of Pennsylvania, Philadelphia, PA 19104, USA; karenbl{at}nursing.upenn.edu

Abstract

Background There are known clinical benefits associated with investments in nursing. Less is known about their value.

Aims To compare surgical patient outcomes and costs in hospitals with better versus worse nursing resources and to determine if value differs across these hospitals for patients with different mortality risks.

Methods Retrospective matched-cohort design of patient outcomes at hospitals with better versus worse nursing resources, defined by patient-to-nurse ratios, skill mix, proportions of bachelors-degree nurses and nurse work environments. The sample included 62 715 pairs of surgical patients in 76 better nursing resourced hospitals and 230 worse nursing resourced hospitals from 2013 to 2015. Patients were exactly matched on principal procedures and their hospital’s size category, teaching and technology status, and were closely matched on comorbidities and other risk factors.

Results Patients in hospitals with better nursing resources had lower 30-day mortality: 2.7% vs 3.1% (p<0.001), lower failure-to-rescue: 5.4% vs 6.2% (p<0.001), lower readmissions: 12.6% vs 13.5% (p<0.001), shorter lengths of stay: 4.70 days vs 4.76 days (p<0.001), more intensive care unit admissions: 17.2% vs 15.4% (p<0.001) and marginally higher nurse-adjusted costs (which account for the costs of better nursing resources): $20 096 vs $19 358 (p<0.001), as compared with patients in worse nursing resourced hospitals. The nurse-adjusted cost associated with a 1% improvement in mortality at better nursing hospitals was $2035. Patients with the highest mortality risk realised the greatest value from nursing resources.

Conclusion Hospitals with better nursing resources provided better clinical outcomes for surgical patients at a small additional cost. Generally, the sicker the patient, the greater the value at better nursing resourced hospitals.

  • health services research
  • nurses
  • patient safety

https://doi.org/10.1136/bmjqs-2019-010534

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Introduction

    Better nursing resources in hospitals have substantial clinical benefits for patients. Lower patient-to-registered nurse (RN) staffing ratios, higher proportions of bachelor’s educated RNs (ie, education), higher proportions of RNs to total nursing staff (ie, skill mix) and better nursing work environments are associated with more favourable patient outcomes.1–8 Less is known about the value (ie, outcomes benefit relative to costs) resulting from investments in nursing.9–13 Given ubiquitous resource constraints within healthcare organisations, we examine whether there are differential clinical outcomes, costs and value at hospitals characterised by better or worse nursing resources.

    We use analytical methods that allow for comparisons of very similar patients in hospitals that are similar with respect to size, teaching status and technological capabilities but that are markedly dissimilar with respect to nursing resources, including staffing, education, skill mix and work environments. By pairing patients who underwent the same surgical procedures in hospitals that differed in their nursing resources and who were otherwise similar with respect to over 30 clinical and demographic variables, we disentangle associations among patient factors, hospital characteristics and nursing resources, and focus on how outcomes and costs differ as a function of nursing resources.

    We asked whether surgical patients in hospitals with better nursing resources experience differential outcomes, including mortality, failure-to-rescue, readmissions and costs of care (unadjusted and adjusted for nursing costs), even when accounting for fixed hospital characteristics, like size. We examined differences in outcomes and costs among patients undergoing general, orthopaedic and vascular surgeries, and among patients with varying levels of mortality risk. We determine the extent to which better nursing resources translate into greater value in terms of patient mortality relative to costs of care, thereby providing critical evidence for guiding management, policy and resource allocation decisions for healthcare organisations.

    Methods

    Study population

    Study participants included Medicare fee-for-service beneficiaries, 65.5 years or older, who were admitted for general, orthopaedic or vascular surgery between 1 January 2013 and 30 September 2015 to an acute care hospital in California, Florida, New Jersey or Pennsylvania. These states were chosen based on availability of secondary data on nursing resources from the RN4CAST-US survey. To determine clinical outcomes and costs of care incurred 30 days from the index admission date, we used Centers for Medicare & Medicaid Services research identifiable files: inpatient, outpatient, carrier (physician part B), hospice, skilled nursing facility, durable medical equipment and the master beneficiary summary file. We excluded admissions where patients had missing age, sex and invalid date of death, or were enrolled in a health maintenance organisation or lacked part B coverage at any point in the 6 months prior to admission.

    Patient characteristics

    Patients characteristics were identified using the index admission, defined as the first surgical admission in the study period to a study hospital, and a 180-day look-back across all use files (online supplementary appendix 1). Patient characteristics included age, sex, race, transfer-in status, emergent admission, secondary procedure codes and 30 comorbidities. We estimated each patient’s probability of death at the time of admission by constructing a 30-day mortality risk model using a 10% random sample of data that did not overlap with our matched sample (online supplementary appendix 2).14 Propensity scores for care in a hospital with better nursing resources were estimated using all of the matching covariates.15

    Supplemental material

    Hospital characteristics

    We defined hospitals as having better or worse nursing resources according to four dimensions: patient-to-RN staffing level, per cent of RNs among all nursing personnel (ie, skill mix), RN education and quality of the nurse work environment. These dimensions were constructed from the 2016 RN4CAST-US study, a survey of over 20 000 RNs in four states who reported on organisational features of their hospitals. Nurse responses were aggregated within hospitals. Details of these data are described elsewhere.16–18

    Nurse staffing is the number of patients per direct care RN on medical–surgical or equivalent units during the RN’s last shift. Nurse skill mix is the proportion of RNs to all nursing staff (ie, RNs, licensed practical nurses and unlicensed assistive personnel). Nurse education is the hospital proportion of RNs with a bachelor’s degree in nursing or higher. The nurse work environment was measured using the Practice Environment Scale of the Nursing Work Index (PES-NWI), a 31-item scale endorsed by the National Quality Forum.19 20 The PES-NWI is composed of five subscales which measure aspects of hospital environment and resources and include nurse participation in hospital affairs; nursing foundations for quality of care; nurse manager ability, leadership and support of nurses; staffing and resource adequacy; and collegial nurse–physician relations.

    Healthcare Cost Report Information System data were used to categorise hospital teaching status and size. Teaching status was defined as non-teaching, <0.05 residents to bed (RB); minor, ≥0.05 and <0.25 RB; and major, ≥0.25 RB. Small hospitals had <250 beds. Large hospitals had ≥250 beds. Hospitals were defined as high technology if they provided major organ transplant or open-heart surgery, as reported in the Medicare Provider of Service file.

    Outcomes

    Outcome measures were 30-day mortality, 30-day complications,21 30-day failure-to-rescue,22 30-day readmissions (or death),5 length of stay, intensive care unit (ICU) admission and ICU length of stay (online supplementary appendix 3). Economic performance was evaluated using two 30-day resource use-based cost measures (ie, 30-day costs and 30-day nurse-adjusted costs, the latter an extension of the former).5 23 Thirty-day nurse-adjusted cost additionally accounts for hospitals’ cost of investing in higher levels of RN staffing and skill mix in the better nursing resourced hospitals. Using national average RN salary data from the Bureau of Labour and Statistics and adjustments for benefits, we adjusted costs to reflect whether each hospital was above or below the average staffing and accounted for salary differences based on skill mix compositions unique to each hospital (online supplementary appendix 4). Patients’ costs were adjusted higher or lower based on their hospital’s nursing costs per day and multiplied by the patient’s length of stay on a general floor.

    Both 30-day costs and 30-day nurse-adjusted costs include the costs of resources used both in-hospital and 30 days postadmission. If a rehospitalisation occurred within 30 days of the index admission date, all costs accrued during the readmission (even those beyond 30 days) were included in 30-day costs. Postdischarge emergency department visits within 30 days of admission were also counted. Costs accrued in the hospital were a function of length of stay, level of care (ie, ICU vs general unit), and total relative value units from acute care bills, procedures and anaesthesia (and in the case of 30-day nurse-adjusted costs, the costs of better RN staffing and skill mix). Our resource use-based cost measures have advantages over alternative cost measures such as cost-to-charge ratios, which are based on negotiated pricing agreements between insurers and providers. Instead, our measures of resource use-based costs are calculated using standardised national prices for resources, which enables meaningful comparisons between hospitals with respect to costs and value.

    We define value as the difference in 30-day cost between matched patient pairs in better and worse nursing resourced hospitals divided by the difference in 30-day mortality. Consistent with the literature, value was defined only with the 30-day mortality outcome.5 24 If there was no statistical difference in mortality, then a value estimate could not be defined. Ninety-five per cent CIs for value estimates were derived using the jackknife.25 Value is reported as the cost associated with a 1% improvement in mortality. Multiplying the value estimate by 100% allows for the value estimate to be interpreted as the cost per life saved. The cost per 1% improvement in mortality is a more useful interpretation of our findings for policymakers who are interested in understanding the incremental cost of improving mortality over a population.

    Statistical analysis

    Defining hospitals with better and worse nursing resources

    To define study hospitals as having either better or worse nursing resources, each hospital was assigned a coherence rank score26 27 based on four dimensions of nursing (ie, RN staffing, skill mix, education and work environment; online supplementary appendix 5). The coherence rank score was calculated by comparing each of 512 hospitals to all other hospitals, with equal importance given to each dimension of nursing. Details of the clinical coherence method are described elsewhere.26 In brief, hospital i was compared with hospital j, such that each of the 512 hospitals were assigned a score based on 511 comparisons. If hospital i had better nursing across all four dimensions than hospital j, it was scored 1; if hospital i had worse nursing than hospital j, it was scored a −1; and if hospital i was better on some dimensions and worse on others, it was scored 0. The score for hospital i was then the sum of its 1, 0 and –1 scores when compared with the remaining 511 hospitals, so a score of 511 would mean that hospital i was better than all other hospitals on all four dimensions. Hospitals in the top 15% were defined as better nursing resourced hospitals (n=76). Hospitals in the bottom 45% were defined as worse nursing resourced hospitals (n=230). Principal component analysis produced similar results in terms of which hospitals were categorised as better and worse.

    Matching algorithm

    Each patient admitted to a better nursing resourced hospital was matched to a patient admitted to a worse nursing resourced hospital using DesignMatch in R.28–31 Our algorithm exactly matched pairs on International Classification of Diseases, Ninth Revision (ICD-9) principal procedure code (online supplementary appendix 6), mortality risk quintile and hospital characteristics, including categories for teaching status, size and technology status. Subject to those constraints, we used fine balance and distance minimisation techniques to make the matched pairs as similar as possible on covariates such as continuous risk of 30-day mortality on admission, age, sex, race, emergent admission status, transfer-in status, propensity score for attending a better nursing hospital, 30 comorbidities and continuous measures of the hospital’s number of beds and resident-to-bed ratio (online supplementary appendix 1). Outcomes were compared within pairs using the McNemar test for binary outcomes,32 while continuous outcomes were reported using m-statistics similar to a 1% trim for each tail.33 34

    Results

    Final patient and hospital sample

    Our initial sample included 621 587 surgical patients in 512 general acute care hospitals. The focal group consisted of 87 847 surgical patients (22 054 general, 55 645 orthopaedic and 10 148 vascular) in 76 hospitals with better nursing resources. The control group included 212 683 surgical patients (52 886 general, 135 148 orthopaedic and 24 649 vascular) in 230 hospitals with worse resources.

    Better nursing resourced hospitals were superior to the worse nursing resourced hospitals on the four nursing characteristics (table 1). For example, RNs in better hospitals cared for 1.5 fewer patients on average (4.30 vs 5.79) than RNs in worse hospitals. Better resourced hospitals had a nursing skill mix that consisted of a greater proportion of RNs, a higher proportion of Bachelor of Science in Nursing-educated RNs and more favourable average ratings of the nurse work environment. Prior to matching on hospital characteristics, better nursing resourced hospitals were, on average, larger and more likely to be major teaching, high technology hospitals (table 1).

    View this table:
    Table 1

    Hospital characteristics

    Quality of patient matches

    From the 87 847 focal cases (ie, patients in the better hospitals), 62 715 cases were matched with control cases (ie, patients in the worse hospitals). Pairs were matched exactly for principal procedure, mortality risk and hospital size category, teaching status category and technology status category, and then balanced on over 30 covariates. Table 2 presents key covariates for the focal and control cases, before and after matching. After matching, standardised differences did not exceed 0.05 SD, better than our desired goal of 0.1–0.2 SDs (online supplementary appendix 7). For example, prior to matching, 83.5% of patients in the better nursing resourced hospitals had hypertension, compared with 87.4% of patients in the worse resourced hospitals. After matching, the per cent of patients with hypertension in the better and worse nursing resourced hospitals were 85.0% and 85.8%, respectively. The standardised difference before matching (−0.11) was substantially reduced after matching (−0.02), indicating balance was achieved for that covariate.

    View this table:
    Table 2

    Selected matched patient and hospital characteristics

    Our matching algorithm required perfect balance on hospital categories for size, teaching status and technology status, as demonstrated by standardised differences of 0.00 (table 2). Through distance minimisation techniques, we further balanced patient pairs within size and teaching status categories using continuous measures of the hospital’s number of beds and resident-to-bed ratios. Slight imbalances were observed on these continuous measures; however, our main study findings persisted after conducting postmatch conditional logit models adjusting for continuous measures of hospital size and teaching status (online supplementary appendix 8).

    Outcomes

    Table 3 presents differences in outcomes among focal patients in the better nursing resourced hospitals and matched control patients in the worse nursing resourced hospitals. Among general surgical patients in better versus worse nursing resourced hospitals, lower 30-day mortality (4.54% vs 5.23%, p=0.003), lower failure-to-rescue (7.34% vs 8.64%, p=0.007) and lower 30-day readmissions (17.86% vs 18.82%, p=0.022) were observed. There were no differences in complications, ICU admission or length of stay among general surgery patients. The paired difference in 30-day costs per patient was marginally higher among focal patients ($428, p 0.048). Accounting for the expense of more RNs in better resourced hospitals, the paired difference in 30-day nurse-adjusted costs was $1300 (p<0.001).

    View this table:
    Table 3

    Comparison of outcomes between matched focal and control patients

    Among orthopaedic patients, 30-day mortality (1.58% vs 1.91%, p<0.001), failure-to-rescue (3.52% vs 4.18%, p<0.001), readmissions (9.19% vs 10.04%, p<0.001) and complications (56.19% vs 58.15%, p<0.001) were lower for patients in better nursing resourced hospitals. Orthopaedic focal patients were significantly more likely to be admitted to the ICU (7.05% vs 5.93%, p<0.001). Despite observing statistical differences in overall and ICU lengths of stay among focal and control patients, the differences were not clinically meaningful. Overall length of stay was significantly shorter among orthopaedic focal patients, but the actual difference was small (3.68 days vs 3.77 days, p<0.001). The paired difference in 30-day nurse-adjusted costs was $579 (p<0.001).

    Vascular patients in better nursing resourced hospitals experienced significantly more complications (66.77% vs 64.76%, p<0.002) and were more likely to be admitted to the ICU (55.52% vs 46.49%, p<0.001). Statistically significant differences were not observed in 30-day mortality (5.09% vs 5.39%, p 0.390), failure-to-rescue (8.96% vs 10.05%, p 0.191) and readmissions (20.06% vs 20.91%, p 0.172); however, the magnitude of the differences in effect sizes between matched pairs in the better and worse nursing resourced hospitals was large. The paired difference in 30-day nurse-adjusted costs was $1349 (p<0.001). The paired differences in costs were marginal when considered in the context of the overall costs. For example, the paired difference in costs of $1349 was roughly 5% of the overall costs for vascular surgery in better nursing resourced hospitals.

    Outcomes by patient risk

    To examine whether outcomes and costs varied by patient clinical risk on admission, we aggregated the surgical specialty groups. As patient risk increased, patients in better nursing hospitals had better clinical outcomes with only marginally higher costs, as compared with patients in hospitals with fewer nursing resources (table 4). Focal patients—those in the better nursing resourced hospitals—had lower 30-day mortality than their matched controls, with the largest differences observed in patients with the highest clinical risk (10.84% vs 12.32%, p<0.001). Thirty-day complications and failure-to-rescue were lower in focal patients overall, with lower-risk focal patients experiencing significantly less complication than matched controls and higher-risk focal patients experiencing significantly less failure-to-rescue. Focal patients also had lower 30-day readmission overall and in each risk quintile, with the greatest outcome advantage seen in patients with the highest clinical risk. Focal patients in all risk quintiles were more likely to be admitted to the ICU, except those in the highest-risk quintile for whom there were no statistical differences. Differences in overall and ICU length of stay were statistically but not clinically different in the overall group. The greatest difference in length of stay was observed in the lowest clinical risk group, where focal patients stayed 0.14 days less than their matched pairs, or approximately 3.4 fewer hours.

    View this table:
    Table 4

    Comparison of outcomes between matched cases in better and worse nursing hospitals across risk quintiles

    Value

    The nurse-adjusted cost per 1% fewer deaths was $2,035, among all surgical patients (table 5) or $203 500 per life saved (multiplying the value estimate by 100 changes the interpretation to the cost per life saved). Among patients with the highest risk of mortality, the nurse-adjusted cost per 1% fewer deaths was considerably smaller at $947, or $94 700 per life saved. The nurse-adjusted costs per 1% fewer deaths among general and orthopaedic surgical patients were $1887 and $1,766, respectively. A value estimate could not be produced among vascular surgical patients for whom statistically significant mortality differences were not found.

    View this table:
    Table 5

    Cost for a 1% improvement in mortality

    Limitations

    Our study is cross-sectional, which limits causal inferences. However, studies of nursing and patient outcomes with panel designs show that hospitals that improve nurse education and nurse work environments over time experience more favourable patient outcomes, including lower mortality.35–37 Also recent research shows in the case of nursing variables studied here that results from cross-sectional research closely approximate findings in a panel study of hospitals.16 We analysed outcomes and costs of care among Medicare beneficiaries in four large states in the USA, which may not be generalisable to all older adults and international contexts. While our matched-cohort design makes transparent the comparisons between patients in better and worse nursing resourced hospitals, we are only able to match patients on measurable characteristics available in our data, and thus it is possible that we did not account for all the possible explanations for the observed outcomes and cost differences.

    We conducted stability analyses to test whether our findings were robust to alternative model specifications. In our main analysis, we allowed patient pairs to be matched across states; however, others have matched within state.38 Postmatch adjustments for state differences within matched pairs did not account for the lower mortality observed in better nursing hospitals (online supplementary appendix 9). In our main analysis, we assigned the cost of an admission to an intermediate care (or stepdown) unit the same cost as an admission to a general unit, as others have done, since staffing in intermediate care is closer to general units than ICUs.39 Our stability analysis shows that assigning intermediate care units the same cost as an ICU, or the average of general unit and ICU costs, did not meaningfully change our results (online supplementary appendix 10). In our main analysis, we focused on hospitals that were distinctly different based on their nursing resources: the bottom 45% and top 15% of hospitals. Comparisons of matched patients in the middle 40% of hospitals with mixed nursing resources can be found in online supplementary appendix 11. Patients in the bottom 45% of hospitals had higher mortality and higher costs than their matched pairs in the middle 40% of hospitals. Patients in the best 15% of hospitals had slightly higher costs but no significant differences in mortality compared with patients in hospitals with mixed nursing resources. Nursing resources in the middle 40% of hospitals more closely resemble the nursing resources in the top 15% of hospitals than the bottom 45% of hospitals (online supplementary appendix 12). We also examined mortality differences among the most common procedures, but group sizes were too small to be meaningful (online supplementary appendix 13). Lastly, we examined whether patients’ dual-eligible status differed between matched pairs, since hospitals serving higher proportions of socioeconomically disadvantaged patients may have fewer resources to invest in nursing. In our matched patient sample, the better nursing resourced hospitals had slightly more dual-eligible patients than worse nursing resourced hospitals (17.0% vs 15.8%, online supplementary appendix 7).

    Discussion

    By creating matched pairs of similar patients undergoing the same surgical procedures in distinctly different types of hospitals (defined by their nursing resources), we identified an advantage for undergoing surgery in hospitals with better nursing resources. Patients in hospitals with better nursing resources experienced lower mortality, complications, failure-to-rescue and readmission, and had shorter lengths of stay with marginally higher costs.

    Our characterisation of hospitals with better nursing resources uses four measures of nursing (ie, staffing, skill mix, education and work environment) constructed from a representative sample of staff RNs, an advance on previous research which also identified better nursing as a signal for better surgical patient outcomes.5 In that study, hospitals with better nursing were defined by Magnet designation, which is a voluntary accreditation and therefore does not include all hospitals with good nursing resources,40 41 and also relied on a measure of nurse staffing (ie, full-time equivalent RNs and licensed practice nurses to number of total beds), which includes non-direct care nursing staff,5 and likely resulted in an underestimation of nurse staffing.

    In this study, we also employed additional restrictions, compared with previous work,5 by exactly matching patient pairs on characteristics of their hospital, including indicators of size, teaching status and technological capabilities, to disentangle the relationships between better nursing being disproportionately available in larger academic medical centres. It has long been suggested that there is a relationship between hospital characteristics and quality of care,42 with studies concluding that teaching hospitals are associated with lower mortality for common medical and surgical conditions43–46; however, the mechanisms by which teaching hospitals confer better quality have thus far been largely unexplained. Our findings demonstrate that patient outcomes are associated with nursing resources, even after these adjustments for fixed hospital characteristics like teaching status and size.

    All hospitals, regardless of size, teaching status or technology capability, employ a workforce primarily composed of bedside RNs. Nurses provide the majority of around-the-clock care to hospitalised patients and are often the first providers to identify and intervene on early warning signs of clinical deterioration and complication. Improving hospital nursing factors by reducing the number of patients an RN cares for, increasing the proportion of RNs to total nursing staff, increasing the proportion of bachelor’s educated RNs, supporting RNs’ clinical autonomy, encouraging collegial nurse–physician relationships and engaging RNs in the highest levels of leadership are achievable objectives for all types of hospitals.

    However, is there a value case for investing in nursing resources? We found that the sickest (and most expensive) surgical patients, those presenting with the poorest health, experienced better outcomes at the better nursing resourced hospitals, including lower mortality, complications, failure-to-rescue and readmissions, with only small differences in costs. Among all general, orthopaedic and vascular surgery patients, the mortality difference between the best and worst resourced hospitals was −0.413%, and costs were $840 higher, a value estimate of $2035 per 1% lower mortality, which translates to $203 500 per life saved. Among the highest-risk patients, the mortality difference was −1.486%, and costs were $1407 higher, a value estimate of $947 per 1% lower mortality, or about $94 700 per life saved. Thus, while all patients experienced a benefit from better nursing resources at modest costs, value was greatest for the highest-risk patients.

    Our findings have implications for management and policy decisions regarding the allocation of resources for patients, such as safe nurse staffing ratio mandates. For example, in 2018, Massachusetts voted against a proposal to mandate nurse staffing levels in acute care hospitals in large part due to concerns raised by hospital associations that such a requirement could lower access and quality for patients and be financially untenable for some organisations. Similar concerns have been raised in European countries reluctant to establish a safe nurse staffing standard, even though major multinational studies of European hospitals show the patient outcomes advantage of better nursing resources.4 47 These quality and cost concerns are difficult to reconcile with what we observed: hospitals that invested in their nursing resources provided superior outcomes for patients at a nominal difference in cost.

    Conclusion

    Hospitals with better nursing resources—measured by RN staffing, skill mix, proportion of RNs with a bachelor’s degree or higher, and nurse work environment—were associated with more favourable patient outcomes, especially among higher-risk patients, even after accounting for differences in hospital size, teaching status and technological capabilities. Somewhat greater costs were observed in better nursing resourced hospitals. Outcomes and costs were generally in line with better value across all levels of risk but displayed the best value in the sickest patients.

    References

    1. ↵
      2. Aiken LH ,
      3. Smith HL ,
      4. Lake ET
      . Lower Medicare mortality among a set of hospitals known for good nursing care. Med Care 1994;32:771–87.doi:10.1097/00005650-199408000-00002 pmid:http://www.ncbi.nlm.nih.gov/pubmed/8057694
      OpenUrlCrossRefPubMedWeb of Science
    2. ↵
      2. Aiken LH ,
      3. Clarke SP ,
      4. Sloane DM , et al
      . Hospital nurse staffing and patient mortality, nurse burnout, and job dissatisfaction. JAMA 2002;288:1987–93.doi:10.1001/jama.288.16.1987 pmid:http://www.ncbi.nlm.nih.gov/pubmed/12387650
      OpenUrlCrossRefPubMedWeb of Science
    3. ↵
      2. Aiken LH ,
      3. Clarke SP ,
      4. Cheung RB , et al
      . Educational levels of hospital nurses and surgical patient mortality. JAMA 2003;290:1617–23.doi:10.1001/jama.290.12.1617 pmid:http://www.ncbi.nlm.nih.gov/pubmed/14506121
      OpenUrlCrossRefPubMedWeb of Science
    4. ↵
      2. Aiken LH ,
      3. Sloane DM ,
      4. Bruyneel L , et al
      . Nurse staffing and education and hospital mortality in nine European countries: a retrospective observational study. Lancet 2014;383:1824–30.doi:10.1016/S0140-6736(13)62631-8 pmid:http://www.ncbi.nlm.nih.gov/pubmed/24581683
      OpenUrlCrossRefPubMedWeb of Science
    5. ↵
      2. Silber JH ,
      3. Rosenbaum PR ,
      4. McHugh MD , et al
      . Comparison of the value of nursing work environments in hospitals across different levels of patient risk. JAMA Surg 2016;151:527–36.doi:10.1001/jamasurg.2015.4908 pmid:http://www.ncbi.nlm.nih.gov/pubmed/26791112
      OpenUrlPubMed
    6. ↵
      2. Lasater KB ,
      3. Mchugh MD
      . Nurse staffing and the work environment linked to readmissions among older adults following elective total hip and knee replacement. Int J Qual Health Care 2016;28:253–8.doi:10.1093/intqhc/mzw007 pmid:http://www.ncbi.nlm.nih.gov/pubmed/26843548
      OpenUrlCrossRefPubMed
    7. ↵
      2. Kane RL ,
      3. Shamliyan TA ,
      4. Mueller C , et al
      . The association of registered nurse staffing levels and patient outcomes: systematic review and meta-analysis. Med Care 2007;45:1195–204.doi:10.1097/MLR.0b013e3181468ca3 pmid:http://www.ncbi.nlm.nih.gov/pubmed/18007170
      OpenUrlCrossRefPubMedWeb of Science
    8. ↵
      2. Shekelle PG
      . Nurse-patient ratios as a patient safety strategy: a systematic review. Ann Intern Med 2013;158:404–9.doi:10.7326/0003-4819-158-5-201303051-00007 pmid:http://www.ncbi.nlm.nih.gov/pubmed/23460097
      OpenUrlCrossRefPubMedWeb of Science
    9. ↵
      2. Kane NM ,
      3. Siegrist RB
      . Understanding rising Hospital inpatient costs: key components of cost and the impact of poor quality, 2002. Available: http://www.selectqualitycare.com/SQC/Understanding%20Rising%20Hospital%20Inpatient%20Costs.pdf [Accessed 12 Aug 2012].
    10. ↵
      2. Spetz J ,
      3. Bates T
      . Is a baccalaureate in nursing worth it? the return to education, 2000-2008. Health Serv Res 2013;48:1859–78.doi:10.1111/1475-6773.12104 pmid:http://www.ncbi.nlm.nih.gov/pubmed/24102422
      OpenUrlPubMed
    11. ↵
      2. Dall TM ,
      3. Chen YJ ,
      4. Seifert RF , et al
      . The economic value of professional nursing. Med Care 2009;47:97–104.doi:10.1097/MLR.0b013e3181844da8 pmid:http://www.ncbi.nlm.nih.gov/pubmed/19106737
      OpenUrlCrossRefPubMedWeb of Science
    12. ↵
      2. Martsolf GR ,
      3. Auerbach D ,
      4. Benevent R , et al
      . Examining the value of inpatient nurse staffing: an assessment of quality and patient care costs. Med Care 2014;52:982–8.doi:10.1097/MLR.0000000000000248 pmid:http://www.ncbi.nlm.nih.gov/pubmed/25304017
      OpenUrlCrossRefPubMed
    13. ↵
      2. Needleman J ,
      3. Buerhaus PI ,
      4. Stewart M , et al
      . Nurse staffing in hospitals: is there a business case for quality? Health Aff 2006;25:204–11.doi:10.1377/hlthaff.25.1.204 pmid:http://www.ncbi.nlm.nih.gov/pubmed/16403755
      OpenUrlAbstract/FREE Full Text
    14. ↵
      2. Hansen BB
      . The prognostic analogue of the propensity score. Biometrika 2008;95:481–8.doi:10.1093/biomet/asn004
      OpenUrlCrossRefWeb of Science
    15. ↵
      2. Rosenbaum PR ,
      3. Rubin DB
      . The central role of the propensity score in observational studies for causal effects. Biometrika 1983;70:41–55.doi:10.1093/biomet/70.1.41
      OpenUrlCrossRefWeb of Science
    16. ↵
      2. Sloane DM ,
      3. Smith HL ,
      4. McHugh MD , et al
      . Effect of changes in hospital nursing resources on improvements in patient safety and quality of care: a panel study. Med Care 2018;56:1001–8.doi:10.1097/MLR.0000000000001002 pmid:http://www.ncbi.nlm.nih.gov/pubmed/30363019
      OpenUrlPubMed
    17. ↵
      2. Lasater KB ,
      3. Sloane DM ,
      4. McHugh MD , et al
      . Quality of end-of-life care and its association with nurse practice environments in U.S. hospitals. J Am Geriatr Soc 2019;67:302–8.doi:10.1111/jgs.15671 pmid:http://www.ncbi.nlm.nih.gov/pubmed/30506666
      OpenUrlPubMed
    18. ↵
      2. Lasater KB ,
      3. Jarrín OF ,
      4. Aiken LH , et al
      . A methodology for studying organizational performance: a multistate survey of front-line providers. Med Care 2019;57:742–9.doi:10.1097/MLR.0000000000001167 pmid:http://www.ncbi.nlm.nih.gov/pubmed/31274782
      OpenUrlPubMed
    19. ↵
      2. Lake ET
      . Development of the practice environment scale of the nursing work index. Res Nurs Health 2002;25:176–88.doi:10.1002/nur.10032 pmid:http://www.ncbi.nlm.nih.gov/pubmed/12015780
      OpenUrlCrossRefPubMedWeb of Science
    20. ↵
      2. Lake ET ,
      3. Sanders J ,
      4. Duan R , et al
      . A meta-analysis of the associations between the nurse work environment in hospitals and 4 sets of outcomes. Med Care 2019;57:353–61.doi:10.1097/MLR.0000000000001109 pmid:http://www.ncbi.nlm.nih.gov/pubmed/30908381
      OpenUrlPubMed
    21. ↵
      2. Silber JH ,
      3. Romano PS ,
      4. Rosen AK , et al
      . Failure-To-Rescue: comparing definitions to measure quality of care. Med Care 2007;45:918–25.doi:10.1097/MLR.0b013e31812e01cc pmid:http://www.ncbi.nlm.nih.gov/pubmed/17890988
      OpenUrlCrossRefPubMedWeb of Science
    22. ↵
      2. Silber JH ,
      3. Williams SV ,
      4. Krakauer H , et al
      . Hospital and patient characteristics associated with death after surgery. A study of adverse occurrence and failure to rescue. Med Care 1992;30:615–29.doi:10.1097/00005650-199207000-00004 pmid:http://www.ncbi.nlm.nih.gov/pubmed/1614231
      OpenUrlCrossRefPubMedWeb of Science
    23. ↵
      2. Silber JH ,
      3. Rosenbaum PR ,
      4. Kelz RR , et al
      . Medical and financial risks associated with surgery in the elderly obese. Ann Surg 2012;256:79–86.doi:10.1097/SLA.0b013e31825375ef pmid:http://www.ncbi.nlm.nih.gov/pubmed/22566017
      OpenUrlCrossRefPubMed
    24. ↵
      2. Silber JH ,
      3. Rosenbaum PR ,
      4. Niknam BA , et al
      . Comparing outcomes and costs of medical patients treated at major teaching and non-teaching hospitals: a national matched analysis. J Gen Intern Med 2020;35:743–52.doi:10.1007/s11606-019-05449-x pmid:http://www.ncbi.nlm.nih.gov/pubmed/31720965
      OpenUrlPubMed
    25. ↵
      2. Efron B ,
      3. Gong G
      . A leisurely look at the bootstrap, the jackknife, and cross-validation. Am Stat 1983;37:36–48.
      OpenUrlCrossRefWeb of Science
    26. ↵
      2. Rosenbaum PR
      . Coherence in observational studies. Biometrics 1994;50:368–74.doi:10.2307/2533380 pmid:http://www.ncbi.nlm.nih.gov/pubmed/8068837
      OpenUrlPubMed
    27. ↵
      2. Silber JH ,
      3. Lorch SA ,
      4. Rosenbaum PR , et al
      . Time to send the preemie home? additional maturity at discharge and subsequent health care costs and outcomes. Health Serv Res 2009;44:444–63.doi:10.1111/j.1475-6773.2008.00938.x pmid:http://www.ncbi.nlm.nih.gov/pubmed/19207592
      OpenUrlCrossRefPubMedWeb of Science
    28. ↵
      2. Zubizarreta JR ,
      3. Kilcioglu C ,
      4. Vielma JP
      . Package ‘designmatch’. Matched Samples that are Balanced and Representative by Design Version 0.3.0, 2018. Available: https://cran.r-project.org/web/packages/designmatch/designmatch.pdf [Accessed 16 Jul 2018].
    29. ↵
      2. Zubizarreta JR
      . Using mixed integer programming for matching in an observational study of kidney failure after surgery. J Am Stat Assoc 2012;107:1360–71.doi:10.1080/01621459.2012.703874
      OpenUrlCrossRef
    30. ↵
      1. R Development Core Team
      . R: a language and environment for statistical computing, 2018. Available: http://www.R-project.org [Accessed 20 Apr 2018].
    31. ↵
      2. Rosenbaum PR ,
      3. Ross RN ,
      4. Silber JH
      . Minimum distance matched sampling with fine balance in an observational study of treatment for ovarian cancer. J Am Stat Assoc 2007;102:75–83.doi:10.1198/016214506000001059
      OpenUrlCrossRefWeb of Science
    32. ↵
      2. Bishop YMM ,
      3. Fienberg SE ,
      4. Holland PW
      . Discrete multivariate analysis: theory and practice. Cambridge, MA: The MIT Press, 1975.
    33. ↵
      2. Rosenbaum PR
      . Sensitivity analysis for m-estimates, tests, and confidence intervals in matched observational studies. Biometrics 2007;63:456–64. R package sensitivitymv and sensitivitymw.doi:10.1111/j.1541-0420.2006.00717.x pmid:http://www.ncbi.nlm.nih.gov/pubmed/17688498
      OpenUrlCrossRefPubMed
    34. ↵
      2. Huber PJ
      . Robust statistics. Hoboken, NJ: John Wiley & Sons, 1981.
    35. ↵
      2. Kutney-Lee A ,
      3. Stimpfel AW ,
      4. Sloane DM , et al
      . Changes in patient and nurse outcomes associated with magnet Hospital recognition. Med Care 2015;53:550–7.doi:10.1097/MLR.0000000000000355 pmid:http://www.ncbi.nlm.nih.gov/pubmed/25906016
      OpenUrlCrossRefPubMed
    36. ↵
      2. Kutney-Lee A ,
      3. Sloane DM ,
      4. Aiken LH
      . An increase in the number of nurses with baccalaureate degrees is linked to lower rates of postsurgery mortality. Health Aff 2013;32:579–86.doi:10.1377/hlthaff.2012.0504 pmid:http://www.ncbi.nlm.nih.gov/pubmed/23459738
      OpenUrlAbstract/FREE Full Text
    37. ↵
      2. Aiken LH ,
      3. Sloane DM ,
      4. Barnes H , et al
      . Nurses' and patients' appraisals show patient safety in hospitals remains a concern. Health Aff 2018;37:1744–51.doi:10.1377/hlthaff.2018.0711 pmid:http://www.ncbi.nlm.nih.gov/pubmed/30395515
      OpenUrlPubMed
    38. ↵
      2. Silber JH ,
      3. Rosenbaum PR ,
      4. Ross RN , et al
      . Disparities in breast cancer survival by socioeconomic status despite Medicare and Medicaid insurance. Milbank Q 2018;96:706–54.doi:10.1111/1468-0009.12355 pmid:http://www.ncbi.nlm.nih.gov/pubmed/30537364
      OpenUrlPubMed
    39. ↵
      2. Anesi GL ,
      3. Liu VX ,
      4. Gabler NB , et al
      . Associations of intensive care unit capacity strain with disposition and outcomes of patients with sepsis presenting to the emergency department. Ann Am Thorac Soc 2018;15:1328–35.doi:10.1513/AnnalsATS.201804-241OC pmid:http://www.ncbi.nlm.nih.gov/pubmed/30113865
      OpenUrlCrossRefPubMed
    40. ↵
      2. McHugh MD ,
      3. Kelly LA ,
      4. Smith HL , et al
      . Lower mortality in magnet hospitals. Med Care 2013;51:382–8.doi:10.1097/MLR.0b013e3182726cc5 pmid:http://www.ncbi.nlm.nih.gov/pubmed/23047129
      OpenUrlCrossRefPubMed
    41. ↵
      2. Aiken LH ,
      3. Havens DS ,
      4. Sloane DM
      . The magnet nursing services recognition program. Am J Nurs 2000;100:26–36. quiz 35-6.doi:10.1097/00000446-200003000-00040 pmid:http://www.ncbi.nlm.nih.gov/pubmed/10738398
      OpenUrlPubMedWeb of Science
    42. ↵
      2. Keeler EB ,
      3. Rubenstein LV ,
      4. Kahn KL , et al
      . Hospital characteristics and quality of care. JAMA 1992;268:1709–14.doi:10.1001/jama.1992.03490130097037 pmid:http://www.ncbi.nlm.nih.gov/pubmed/1527880
      OpenUrlCrossRefPubMedWeb of Science
    43. ↵
      2. Burke LG ,
      3. Frakt AB ,
      4. Khullar D , et al
      . Association between teaching status and mortality in US hospitals. JAMA 2017;317:2105–13.doi:10.1001/jama.2017.5702 pmid:http://www.ncbi.nlm.nih.gov/pubmed/28535236
      OpenUrlCrossRefPubMed
    44. ↵
      2. Burke L ,
      3. Khullar D ,
      4. Orav EJ , et al
      . Do academic medical centers disproportionately benefit the sickest patients? Health Aff 2018;37:864–72.doi:10.1377/hlthaff.2017.1250 pmid:http://www.ncbi.nlm.nih.gov/pubmed/29863940
      OpenUrlPubMed
    45. ↵
      2. Allison JJ ,
      3. Kiefe CI ,
      4. Weissman NW , et al
      . Relationship of hospital teaching status with quality of care and mortality for Medicare patients with acute MI. JAMA 2000;284:1256–62.doi:10.1001/jama.284.10.1256 pmid:http://www.ncbi.nlm.nih.gov/pubmed/10979112
      OpenUrlCrossRefPubMedWeb of Science
    46. ↵
      2. Taylor DH ,
      3. Whellan DJ ,
      4. Sloan FA
      . Effects of admission to a teaching hospital on the cost and quality of care for Medicare beneficiaries. N Engl J Med 1999;340:293–9.doi:10.1056/NEJM199901283400408 pmid:http://www.ncbi.nlm.nih.gov/pubmed/9920955
      OpenUrlCrossRefPubMedWeb of Science
    47. ↵
      2. Aiken LH ,
      3. Sermeus W ,
      4. Van den Heede K , et al
      . Patient safety, satisfaction, and quality of hospital care: cross sectional surveys of nurses and patients in 12 countries in Europe and the United States. BMJ 2012;344:e1717. doi:10.1136/bmj.e1717 pmid:http://www.ncbi.nlm.nih.gov/pubmed/22434089
      OpenUrlPubMed

    Footnotes

    • Twitter @k_lasater, @LindaAiken_Penn

    • Funding This study was funded by National Institute of Nursing Research (R01 NR014855R01 and NR016019).

    • Competing interests None declared.

    • Patient consent for publication Not required.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Data availability statement Data are available upon reasonable request. Data may be obtained from a third party and are not publicly available. RN4CAST-US Nurse survey data: These data were collected under the primary grants (NR004513 and NR014855; LHA, principal investigator) for purposes of improving nurse and patient outcomes and were granted a certificate of confidentiality through the National Institute of Nursing Research/Department of Health and Human Services as per section 301(d) of the Public Health Service Act 42 U.S.C. 241(d).