Article Text

other Versions


Outcomes in patients with heart failure treated in hospitals with varying admission rates: population-based cohort study
  1. R Sacha Bhatia1,2,3,4,
  2. Peter C Austin1,3,
  3. Therese A Stukel1,3,
  4. Michael J Schull1,4,5,
  5. Alice Chong1,
  6. Jack V Tu1,3,4,6,
  7. Douglas S Lee1,3,4,7
  1. 1Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada
  2. 2Women's College Hospital Institute for Health Systems Solutions and Virtual Care, University of Toronto, Toronto, Ontario, Canada
  3. 3Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada
  4. 4Department of Medicine, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
  5. 5Department of Emergency Medicine, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, Ontario, Canada
  6. 6Division of Cardiology, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, Ontario, Canada
  7. 7Peter Munk Cardiac Centre and the Joint Department of Medical Imaging of the University Health Network—Toronto General Hospital, University of Toronto, Toronto, Ontario, Canada
  1. Correspondence to Dr Douglas S Lee, Senior Scientist, Institute for Clinical Evaluative Sciences, Division of Cardiology, University Health Network, Associate Professor of Medicine, University of Toronto, ICES, Rm G-106, 2075 Bayview Avenue, Toronto, Ontario, Canada M4N 3M5; dlee{at}


Study objectives Hospital admission rates for patients with heart failure (HF) presenting for emergency department (ED) care vary, and the implications of direct discharge home from the ED are unknown. We examined whether patients treated in hospitals with low admission rates exhibit higher rates of repeat ED visits, hospital readmissions and death.

Methods We divided EDs into low-, medium- and high-admission-rate tertiles by their standardised HF admission rate in Ontario, Canada. Among adults (≥18 years) with HF discharged from an ED between April 2004 and March 2010, we evaluated the primary outcomes of repeat ED visits or hospitalisations for HF, and secondary outcomes, which included death, within 30 days stratified by HF admission-rate tertile.

Results 89 878 patients with HF presented to low- (n=29 929), medium- (n=30 900) or high- (n=29 049) admission-rate institutions, with hospitalisation rates of <67%, 67–75% and >75%, respectively. Among 28 175 ED-discharged patients, the multivariable-adjusted HR for repeat ED visit or hospitalisation for HF at low-admission-rate institutions was 1.18 (95% CI 1.07 to 1.29, p<0.001) compared with high-admission institutions. Similarly, the HR for repeat ED visits for HF was 1.28 (95% CI 1.14 to 1.44, p<0.001) at low-admission hospitals. Compared with discharged patients in the high-admission-rate tertile, adjusted HR for 30-day mortality was 1.19 (95% CI 0.95 to 1.47) at low-admission-rate hospitals. The HRs for all of the above outcomes were not significantly increased at medium-admission-rate hospitals.

Discussion Patients seeking care at institutions with lower rates of HF admission showed higher rates of repeat ED visits or hospitalisations after previous ED discharge.

  • Health Services Research
  • Emergency Department
  • Quality Improvement

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 3.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See:

Statistics from


Heart failure (HF) is associated with substantial morbidity and high rates of hospital admission and readmission. Consequently, a large proportion of the costs of HF care are incurred by patients who receive care in the hospital setting.1 ,2 The health system impact of HF admissions has been a focus of system-wide quality improvement efforts world-wide. High rates of HF readmission prompted its use as a performance metric for hospitals, and the Center for Medicare and Medicaid Services in the United States began publicly reporting on 30-day readmission rates in 2009.3 ,4 Subsequent evaluation demonstrated that readmission rates are complex metrics that may be affected by system-level factors.5

There is substantial economic burden of HF admissions and a focus on readmissions as a quality of care measure.6 However, there is little appreciation of the pitfalls of using readmissions as a quality metric and the system factors that contribute to variations in hospitalisations. For example, lower regional admission rates have been associated with reduced HF readmission rates,5 and it is unknown if this ecological relationship extends to hospitals. Understanding variations in hospitalisations and resultant outcomes requires improved knowledge of admission decisions that are made in the emergency department (ED), since it is most often the point of initial contact with the healthcare system and the portal of entry into the hospital.7 Since risk stratification is not routinely used in emergency care of acute HF, it is possible that greater numbers of patients discharged from the ED may result in more return hospital visits and admissions.

In this study we explored whether the hospitalisation rate of patients with HF presenting to the ED varies across EDs in a single-payer health system. Furthermore, we determined whether patients with HF discharged from the ED, who were treated at hospitals with lower rates of admission, experienced higher rates of adverse outcomes. We hypothesised that patients cared for and discharged from EDs with lower hospital admission rates would exhibit higher rates of early repeat emergency visits and hospitalisations for recurrent HF.


Selection of participants and hospitals

We conducted a retrospective cohort study of patients (aged ≥18 years) who visited an ED in Ontario, Canada, for HF between 1 April 2004 and 31 March 2010. Included patients were Ontario residents with a valid health card number. To determine crude admission rates, we calculated the proportion of patients with HF admitted relative to all patients who visited the ED for HF at each institution. To evaluate the impact of hospital admission rate on outcome, we examined patients who were discharged home from the ED since this group is at risk of early repeat hospital visits and death.8 We excluded patients with HF that were admitted to hospital by any route other than the ED (ie, inter-hospital transfer). Institutions with fewer than 20 HF visits to the ED annually and urgent care centres (ie, ambulatory care centres that treat patients seeking emergency care but do not have on-site acute care hospital beds) were excluded. Urgent care centres were included in a sensitivity analysis. Research ethics board approval was obtained from Sunnybrook Health Sciences Centre.


The primary outcomes were HF-specific, since readmissions for HF after an initial ED discharge for the same condition may indicate poor quality of care. The primary outcome was the occurrence of repeat ED visits or hospitalisations for HF within 30 days after the initial ED discharge. The co-primary outcome was repeat ED visits for HF. Secondary outcomes included 30-day mortality and the composite of (i) ED visits or hospitalisations for cardiovascular disease and (ii) all-cause ED visits and hospitalisations. We also examined whether physician care, use of diagnostic tests, and revascularisation procedures were differentially performed after discharge from low-, medium- or high-admission-rate EDs.

Data sources

Multiple administrative databases were linked deterministically by using each patient's unique, encrypted health card number. We used the National Ambulatory Care Reporting System (NACRS) database, which contains information on all ED visits, to identify patients with HF seeking emergency care. Patients with HF were identified using the International Classification of Diseases 10th revision ICD-10-CA code I50; validation studies have found high predictive value of HF diagnostic codes compared with the Framingham criteria.9 Hospital admissions were identified using the Canadian Institute for Health Information Discharge Abstract Database (CIHI-DAD). In the case of multiple emergency records, only the first visit was counted as the index encounter for the purposes of determining repeat emergency visits and hospitalisations.

The Ontario Health Insurance Plan (OHIP) claims database and the CIHI-DAD were used to identify diagnostic or interventional cardiac procedures performed within 30 days after emergency discharge, while the former was used to identify physician visits. Physician visits and procedures are billed on the date of service, with random audits conducted by the Ministry of Health and Long-Term Care, the single payer of health services. Physician specialty was determined from the Ontario Physician Human Resource Data Centre database. Physician specialty was defined by the ‘functional specialty’ determined, via telephone survey, by the type of care constituting the majority of the physician's practice. Therefore, internal medicine specialists who provided primarily cardiology care were also considered cardiac specialists.10 Performance of the following procedures was examined as markers of patient care: (i) testing of left ventricular ejection fraction by echocardiography or radionuclide angiography; (ii) stress testing; (iii) cardiac catheterisation; and (iv) coronary revascularisation, including percutaneous coronary intervention or coronary artery bypass graft surgery (procedure codes shown in online supplementary appendix 1). Deaths were determined from the Registered Persons Database.

Statistical analysis

The distributions of continuous variables were compared across hospital admission categories using the Kruskal–Wallis test, and categorical variables were compared using the Mantel–Haenszel χ2 test for trend. The age- and sex-standardised hospital HF admission rate was the primary exposure variable and was calculated as follows:Embedded Image

where the expected number of admitted patients was the sum of the product of the number of patients in each age/sex stratum in the hospital and the crude admission rate in each age/sex stratum in the overall cohort. We divided institutions into low-, medium- and high-admission-rate tertiles based on the standardised hospital admission rate, with a similar number of patients per tertile as performed previously.11 ,12

Age/sex-adjusted event rates were reported as rates per person-time and compared using Cox proportional hazards regression analysis. The effect of admission-rate tertile on time-to-event outcomes was evaluated using multiple Cox proportional hazards analyses, with adjustment for previously published HF-specific risk-adjustment models for prediction of death or morbidity (see online supplementary appendices 2 and 3).13 ,14 We also adjusted for hospital type (small community, large community or academic hospital), rurality and residential neighbourhood income quintile. Finally, we adjusted for visit-specific factors, such as time of presentation (eg, daytime 08:00–17:00, evening 17:01–24:00, or morning 00:01–07:59), ED length of stay, chief complaint (eg, suspected HF, dyspnoea), number of previous ED visits for HF in past 3 years, and the Canadian Triage Acuity Score, which signified the acuity of the emergency patient as judged by the nurse at triage. For each outcome, including repeat ED visits and hospitalisations for HF, patients were censored at 30 days or upon death, whichever occurred earlier if the event of interest had not yet occurred. Comorbidities were determined by examining all diagnosis codes in the CIHI-DAD in the 3 years before the index ED visit. A summary-predicted tertile-specific 30-day mortality rate was calculated using multiple logistic regression, with adjustment for the clinical covariates and ED-specific factors described above. Analyses were performed at the patient level, clustered hierarchically within EDs. The Cox regression models used robust, sandwich-type variance estimators to account for the clustering of patients within EDs.15

We determined if patients discharged from medium- and low-admission-rate hospitals were less likely to receive care by any physician, family physician or cardiac specialist or received shared care (family physician+cardiac specialist) than high-admission-rate hospitals within 30 days using previously published methods.10 We also examined diagnostic tests and revascularisation procedures using multiple Cox regression analysis to compare differences after ED discharge. All of the above analyses were adjusted for the risk-adjustment variables predictive of morbidity and mortality shown in online supplementary appendix 3,13 ,14 and the ED-specific factors listed above. Statistical significance was indicated by a two-tailed p value <0.05. All analyses were performed with SAS V.9.2.


Characteristics of study subjects

After identification of unique ED visits (figure 1), 89 878 patients remained, of whom 28 175 (31.3%) were discharged and 61 703 (68.7%) were admitted. The discharged patients comprising the primary cohort presented to one of 162 EDs, and were divided into tertiles based on institutional admission rates. The median (25th, 75th centiles) HF hospital admission rates for low-, medium- and high-rate tertiles were 57.9% (51.2, 62.2.), 70.2% (67.8, 73.7) and 78.5% (76.3, 81.4), respectively. There was higher predicted probability of 30-day mortality for all patients with HF who presented to an ED at high- and medium- (reflecting higher-risk case mix) than low-admission-rate institutions (table 1, p<0.001).

Table 1

Patient characteristics by admission tertile

Figure 1

Study cohort flow diagram.


Low-admission-rate EDs were less likely to be teaching institutions and had fewer acute care and intensive care unit beds (table 2). High-admission-rate institutions were more likely to be larger urban, community or teaching hospitals with greater numbers of acute care and intensive care unit beds.

Table 2

Hospital characteristics by admission-rate tertile


Age- and sex-adjusted 30-day event rates for patients discharged from the ED in each of the three admission-rate tertiles are shown in figure 2. The composite 30-day age/sex-adjusted event rates were highest at low-admission-rate hospitals and were driven by repeat ED visits for HF.

Figure 2

Age/sex-adjusted outcomes at 30 days for discharged patients by admission-rate (blue, high; green, medium; red, low) tertile. ED, emergency department; HF, heart failure.

Of the 28 175 patients who were initially discharged without hospitalisation, 3001 (10.7%) revisited the ED for HF within 30 days, with 87.6% returning to the same institution. When initially discharged patients returned to the same ED (n=2628), the admission rates for the repeat visit remained lowest at low- and highest at high-admission-rate institutions, with second-visit admission rates of 40.8%, 57.5% and 66.4% (p<0.001). Of the 373 initially discharged patients who sought care in a different ED, there were similar gradients but higher rates of admission overall: 54.5% vs 71.6% vs 82.2% (p<0.001).

After adjustment for multiple covariates including patient and hospital characteristics, patients discharged from low-admission-rate EDs had a higher risk of the primary outcome of repeat emergency visits or hospitalisations for HF at 30 days (table 3). Compared with visiting a high-admission-rate hospital, the relative HR of the primary outcome was 1.06 (95% CI 0.96 to 1.16, p=0.25) for those discharged from medium-admission-rate institutions and 1.18 (95% CI 1.07 to 1.29, p<0.001) for those discharged from low-admission-rate institutions.

Table 3

Effect of HF admission rate on repeat emergency visits and hospitalisations at 30 days

In secondary analyses, patients discharged from low-admission-rate institutions were also more likely to experience repeat ED visits and hospitalisations for cardiovascular disease and for all causes (table 3). The adjusted 30-day mortality risks were similar for admitted and discharged patients at low-admission-rate hospitals. Among admitted patients, adjusted HRs for 30-day mortality were 1.11 (95% CI 0.99 to 1.24, p=0.07) for low- and 1.06 (95% CI 0.95 to 1.18, p=0.29) for medium- compared with high-admission-rate hospitals (referent). Among discharged patients, adjusted HRs for 30-day mortality were 1.19 (95% CI 0.95 to 1.47, p=0.12) for low- and 0.97 (95% CI 0.78 to 1.21, p=0.81) for medium- compared with high-admission-rate hospitals.

The likelihood of any physician visit within 30 days after discharge was not significantly different at medium- and low- compared with high-admission-rate hospitals (table 4). However, patients treated at medium- and low-admission-rate hospitals were less likely to be assessed by a cardiac specialist and less likely to experience shared care after discharge than those with high admission rates. Patients discharged from low-admission-rate institutions were less likely to undergo assessment of left ventricular function and stress testing than those discharged from high-admission-rate institutions (table 4).

Table 4

Physician visits, diagnostic and therapeutic procedures within 30 days of ED discharge

We conducted a sensitivity analysis, and found that the study findings were robust when urgent care centres were included in the analysis (see online supplementary appendix 4 and appendix figure A).


The decision to admit or discharge a patient with HF from the ED is a significant clinical challenge for physicians. In the absence of acute risk stratification for HF, emergent decisions pertaining to hospitalisation are based primarily on the physician's perception of the clinical status of the patient.16 ,17 In this study, we found that institutions varied in their threshold to admit patients with HF presenting to the ED irrespective of whether the visit was an initial or repeat presentation. Patients who were discharged from low-admission-rate institutions experienced the highest rates of early repeat ED visits or hospitalisations.

While there have been an increasing number of studies pertaining to HF readmissions, few have examined hospital and patient level factors in conjunction with emergency visits. Hospitalised cohorts were reported in the ADHERE registry and the OPTIMIZE-HF study, and high-risk patient characteristics that predict adverse outcomes were identified.18 ,19 Other studies focused on hospitalised patients who were readmitted after in-hospital treatment6 ,20 or provided an incomplete picture of system-wide HF patient flow.21 ,22 While the overall themes were consistent, our study approached this issue in a novel way by examining hospital-specific rates of HF admission among patients presenting to the ED, emphasising the need for institutions to re-examine their rationale for admission–discharge decisions for acute HF.

Hospital readmissions exhibit complexity that is not elucidated. Previous studies have demonstrated that the risk of death increases progressively with each HF hospitalisation.23 ,24 As suggested by our study, the threshold to admit may be an inherent institutional characteristic which may partly explain variations in hospitalisation rates. Indeed, initially discharged patients who presented to the same ED within 30 days for HF were more likely to be discharged again at low-admission-rate institutions. During the time period of our study, admission decisions for HF were not based on formal prognostic risk stratification,25 and early post-discharge collaborative care, which is associated with improved patient outcomes and processes of care, was not systematically employed.10

There were differences in hospital characteristics between admission-rate tertiles. Low-admission-rate hospitals had fewer acute care and intensive care unit beds than medium- and high-admission-rate hospitals. However, bed availability was unlikely to fully explain our findings, since the decision to admit patients to hospital depends on perceived clinical need rather than maintaining high occupancy rates. Low-admission-rate hospitals tended to be in non-urban areas, where specialty care may not be as accessible as in urban regions, which may affect the quality of HF management. Furthermore, while collaborative care by primary care physicians and cardiac specialists early after discharge improves HF outcomes,10 this form of management also occurred less frequently after discharge from low-admission-rate hospitals. The lack of rapid post-ED care may have partly explained the higher rates of repeat ED visits observed in this study. It is also possible that more immediate access to rapid response transitional care clinics and allied healthcare that stresses the importance of medication adherence, sodium and fluid restriction, smoking cessation and self-care may reduce ED visits.26 ,27

This study has significant clinical and public policy implications. It suggests that the outcomes experienced by patients who are discharged from the ED should not be ignored in quality-of-care evaluations. Discharge of non-low-risk patients with HF from the ED reflects poor care quality despite paradoxically improving hospitals’ admission or readmission statistics. Our study supports the need for broader use of clinical risk stratification tools to prognosticate patients who present to the ED with acute HF.7 ,28 ,29 Use of validated risk stratification tools, such as the Emergency Heart failure Mortality Risk Grade (EHMRG,,30 may reduce variations by identifying (a) low-risk patients who could potentially be discharged home, and (b) higher-risk patients who are likely to experience early adverse outcomes if discharged from the ED. Adverse events experienced by emergency-discharged patients may be contributed by defects in decision-making in the ED. However, our findings also support the growing notion that post-hospital outcomes may also be affected by health system factors such as hospital resource availability and post-discharge transitional care.


Our study should be interpreted in the context of its limitations. We used large, administrative databases that did not include clinical information such as blood pressure, echocardiographic data or therapy provided. However, the system-wide, population-based data available in large administrative databases are ideal for broad examinations of health systems and outcomes. In addition, we were unable to assess some hospital-specific factors, such as presence of a cardiology service, informal referral networks between hospitals, and availability of ambulatory HF services within the community.


In conclusion, HF admission rates exhibited variability between institutions, and patients who presented to EDs with low admission rates experienced higher rates of subsequent adverse outcomes in a single-payer health system. In the absence of systematic approaches to ED-based risk stratification and well-established post-discharge ambulatory transitional care, lower rates of HF admission were associated with more repeat hospital visits. The use of systematic methods, such as validated risk scores, may reduce interinstitutional variations in HF admission rates and improve the quality of post-ED care.


View Abstract
  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

    Files in this Data Supplement:


  • Contributors All authors participated in the conception, design and interpretation of data. RSB and DSL led the drafting of the article, but all authors participated in critical revisions and granted final approval of the submitted version.

  • Funding Supported by operating grant MOP 114937 from the Canadian Institutes of Health Research (CIHR), Career Investigator Awards from the Heart and Stroke Foundation of Ontario (PCA, JVT), a Canada Research Chair in Health Services Research (JVT), and a CIHR Clinician-Scientist Award (DSL).

  • Competing interests None.

  • Ethics approval Sunnybrook Research Ethics Board.

  • Provenance and peer review Not commissioned; internally peer reviewed.

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Linked Articles