Skip to main content

A meta-analysis to derive literature-based benchmarks for readmission and hospital mortality after patient discharge from intensive care

Abstract

Introduction

We sought to derive literature-based summary estimates of readmission to the ICU and hospital mortality among patients discharged alive from the ICU.

Methods

We searched MEDLINE, Embase, CINAHL and the Cochrane Central Register of Controlled Trials from inception to March 2013, as well as the reference lists in the publications of the included studies. We selected cohort studies of ICU discharge prognostic factors that in which readmission to the ICU or hospital mortality among patients discharged alive from the ICU was reported. Two reviewers independently abstracted the number of patients readmitted to the ICU and hospital deaths among patients discharged alive from the ICU. Fixed effects and random effects models were used to estimate the pooled cumulative incidence of ICU readmission and the pooled cumulative incidence of hospital mortality.

Results

The analysis included 58 studies (n = 2,073,170 patients). The majority of studies followed patients until hospital discharge (n = 46 studies) and reported readmission to the ICU (n = 46 studies) or hospital mortality (n = 49 studies). The cumulative incidence of ICU readmission was 4.0 readmissions (95% confidence interval (CI), 3.9 to 4.0) per 100 patient discharges using fixed effects pooling and 6.3 readmissions (95% CI, 5.6 to 6.9) per 100 patient discharges using random effects pooling. The cumulative incidence of hospital mortality was 3.3 deaths (95% CI, 3.3 to 3.3) per 100 patient discharges using fixed effects pooling and 6.8 deaths (95% CI, 6.1 to 7.6) per 100 patient discharges using random effects pooling. There was significant heterogeneity for the pooled estimates, which was partially explained by patient, institution and study methodological characteristics.

Conclusions

Using current literature estimates, for every 100 patients discharged alive from the ICU, between 4 and 6 patients on average will be readmitted to the ICU and between 3 and 7 patients on average will die prior to hospital discharge. These estimates can inform the selection of benchmarks for quality metrics of transitions of patient care between the ICU and the hospital ward.

Introduction

Transitions of patient care between providers are vulnerable periods in health care delivery that expose patients to preventable errors and adverse events [1]. The discharge of patients from the intensive care unit (ICU) to a hospital ward is one of the highest-risk transitions of care [1]. This has been attributed to the sickest patients in the hospital being transitioned from a resource-rich environment to one with fewer resources, the number of providers involved, a lack of standardized discharge procedures and the complexity of verbal and written communication between providers and patients and/or their families as well as between providers themselves [2]-[5].

Opportunities exist to improve the quality of care during ICU discharge, and measures of ICU readmission and hospital mortality following patient discharge from the ICU have been proposed as quality metrics [6]-[10]. However, the reported incidences of readmission and hospital mortality vary widely, and there are currently no established benchmarks to guide quality improvement efforts [11],[12].

Therefore, we performed a secondary meta-analysis of studies by conducting a systematic review of prognostic factors for readmission to the ICU and hospital mortality in patients discharged alive from the ICU to derive literature-based estimates of these outcomes.

Material and methods

We followed the recommendations set forth in the Preferred Reporting Items in Systematic Reviews and Meta-Analysis and Meta-Analysis of Observational Studies in Epidemiology statements [13],[14]. This study did not require research ethics approval, as all of the data are in the public domain. Similarly, no consent was required from patients, as all of the data were abstracted in aggregate and are available in the public domain.

Search strategy and data sources

We systematically searched the following four databases for articles published between the inception dates of the databases and March 2013: MEDLINE, Embase, CINAHL and Cochrane Central Register of Controlled Trials. Searches were completed using a combination of the following terms: “intensive care unit,” “patient discharge” and readmission/mortality/medical emergency team activation, with appropriate wildcards and variations in spelling. We identified additional articles by reviewing the reference lists of studies identified for inclusion.

Inclusion criteria

We selected all studies in which prognostic factors for ICU readmission and hospital mortality were reported. The following were the inclusion criteria: (1) study design was a cohort study, (2) study participants were adult patients (>16 years old) who were discharged alive from the ICU, (3) prognostic factors for ICU discharge were reported and (4) raw data were reported that allowed calculation of the cumulative incidence of ICU readmission or the cumulative incidence of hospital mortality for patients discharged alive from the ICU prior to hospital discharge. Because there is no widely accepted time period for measuring readmission and mortality after patient discharge from the ICU (for example, 24 hours), and because authors of previous reviews have reported the use of different time periods, we included all follow-up periods [15]. We excluded articles that described discharge from a high-dependency or step-down unit. Two reviewers independently and in duplicate reviewed the titles and abstracts of retrieved publications and subsequently the full text of relevant articles. Agreement between reviewers for inclusion of full-text articles was good (κ = 0.84, 95% confidence interval (CI), 0.67 to 1.00).

Data abstraction

Two reviewers independently and in duplicate abstracted data describing study purpose, design, setting (country, type of ICU), sample size, study population (age, length of follow-up, severity of illness), outcomes (readmission to the ICU and hospital mortality following patient discharge alive from the ICU) and study quality. Disagreements were resolved through consensus. Authors of the included studies were contacted to gather missing data.

Risk of bias assessment

Study quality was evaluated using 11 characteristics: ethical approval reported, eligibility criteria described, definition of cohort timing provided, demographics described, comorbidities reported, severity of illness score reported, study duration reported, completeness of follow-up, adjustment for potential confounders, sample size calculation reported and study limitations reported. Studies that satisfied six or more of the criteria were classified as being of high quality.

Analysis

In the primary analysis, we focused on describing the cumulative incidence of readmission to the ICU and the cumulative incidence of hospital mortality for patients discharged alive from the ICU. Readmissions to the ICU and hospital mortality were calculated using data from each article on raw events (total number of events) and study population (total number of patients discharged alive from the ICU). The cumulative incidence was pooled using both Mantel-Haenszel fixed effects (assumes a single common incidence across studies) and DerSimonian and Laird random effects models (does not assume a single common incidence across studies) [16],[17].

Statistical heterogeneity was examined by calculating I 2-statistics, wherein a P-value <0.05 and an I 2-value >50% indicated the presence of heterogeneity among the included studies [18]. Stratified analyses were performed to examine for potential sources of heterogeneity between studies using prespecified subgroups that included geographic region (North America, Europe, Australasia, other region), ICU type (medical-surgical, cardiovascular, other ICU), patient characteristics (age <60 years vs. ≥60 years, predicted mortality <10% vs. ≥10% according to illness severity score) and study characteristics (patients with do-not-resuscitate (DNR) goals of care included, adjustment for confounding factors, duration of follow up ≤21 days vs. >21 days, sample size <1,000 patients vs. ≥1,000 patients, number of ICUs 1 vs. >1 and a composite measure of study quality).

All data analysis was conducted using Stata version 11.0 software (StataCorp, College Station, TX, USA).

Results

We identified 58 studies that satisfied the inclusion criteria and that had data which allowed calculation of the cumulative incidence of readmission to the ICU (n = 46 studies) or the cumulative incidence of hospital mortality (n = 49 studies) for patients discharged alive from the ICU (Figure 1) [2],[4],[5],[8],[11],[12],[19]-[70]. The characteristics of the studies are summarized in Table 1. The studies were published between 1986 and 2013 and represented 18 countries, including the United States (n = 12), the United Kingdom (n = 8), Australia (n = 6), Canada (n = 6) and Germany (n = 4). The number of patients within the studies ranged from 86 to 704,963, with an aggregate total of 2,073,170 patients included in our meta-analysis. The majority of studies were conducted in mixed medical-surgical ICUs (n = 34), with fewer studies conducted in cardiac ICUs (n = 7) or exclusively medical ICUs (n = 4) or surgical ICUs (n = 3). The mean (standard deviation) age of patients was 59.7 (5.4) years among the 44 studies in which a mean age was reported. Patient illness severity in most studies was reported based on the Acute Physiology and Chronic Health Evaluation score (n = 31) or the Simplified Acute Physiology Score (n = 12). The majority of studies were single-centered (n = 32), included patients with DNR orders (n = 42) and used multivariable adjustment (n = 49) in their data analysis. Most studies followed patients until hospital discharge (n = 46). In three studies, the investigators reported readmission to the ICU and hospital mortality at fixed time periods following patient discharge from the ICU (48 hours [26], 7 days [44] and 2 weeks [36]).

Figure 1
figure 1

Selection process for articles for review. CI, Confidence interval; ICU, Intensive care unit.

Table 1 Description of included studies a

The pooled cumulative incidence of readmission to the ICU and cumulative incidence of hospital mortality using both fixed effects models and random effects models are summarized in Figure 2 and Figure 3, respectively. In patients discharged alive from the ICU, the fixed effects pooled cumulative incidence of readmission to the ICU during the same hospitalization was 4.0 readmissions per 100 patient discharges (95% CI, 3.9 to 4.0), whereas the random effects pooled cumulative incidence was 6.3 readmissions per 100 patients (95% CI, 5.6 to 6.9). In patients discharged alive from the ICU, the fixed effects pooled hospital mortality cumulative incidence during the same hospitalization was 3.3 deaths per 100 patient discharges (95% CI, 3.3 to 3.3), whereas the random effects pooled cumulative incidence was 6.8 deaths per 100 patient discharges (95% CI, 6.1 to 7.6). Heterogeneity among these estimates was high, with I 2-values of 99.7% and P < 0.001 for all estimates.

Figure 2
figure 2

Incidence of readmission to the intensive care unit (ICU) for patients discharged alive from the ICU. CI, Confidence interval.

Figure 3
figure 3

Incidence of hospital mortality for patients discharged alive from the intensive care unit. CI, Confidence interval.

The stratified pooled cumulative incidence of readmission to the ICU and the stratified pooled cumulative incidence of hospital mortality for patients discharged alive from the ICU varied by geographic region, ICU type, patient characteristics and study characteristics (Table 2). Compared to medical-surgical ICUs, lower cumulative incidences of readmission (3.8 vs. 5.6 readmissions per 100 patient discharges) and hospital mortality (0.1 vs. 4.4 deaths per 100 patient discharges) were reported for cardiovascular ICUs. The cumulative incidence of ICU readmission and hospital mortality varied according to age, severity of illness and goals of care designations of the patients included in the studies. For example, studies that excluded patients with DNRs had lower cumulative incidences of readmission (3.5 vs. 5.5 readmissions per 100 patient discharges) and hospital mortality (2.2 vs. 3.5 deaths per 100 patient discharges) compared to studies that included DNR patients.

Table 2 Pooled cumulative incidence of ICU readmission and hospital mortality after patient discharge from ICU a

Discussion

In this meta-analysis, we report the first pooled estimates of readmission to the ICU and hospital mortality for patients discharged alive from the ICU. These estimates suggest that, on average, for every 100 patients discharged alive from the ICU, between 4 and 6 patients will be readmitted to the ICU and between 3 and 7 patients will die prior to hospital discharge. Important variations in the incidence of readmission and mortality were observed according to geographic regions and patient-related, institutional and study methodological characteristics.

Our study underscores important opportunities and challenges in improving the quality of care provided to patients discharged from intensive care. We identified estimates of readmission and death for patients discharged alive from the ICU that are similar in magnitude to the estimates of adverse events reported in an Institute of Medicine report, To Err Is Human, that prompted major efforts to improve the safety and quality of care [71],[72]. Although readmission to the ICU and hospital mortality after ICU discharge do not equate to medical errors or adverse events and are not necessarily preventable [12], our data highlight that patient discharge from the ICU is a high-risk transition of care. There are opportunities to reduce the risks pertaining to patients (for example, relapsing and/or remitting comorbid illness), providers (for example, differential continuity of care), institutions (for example, availability of transition resources) and health systems (for example, ICU capacity) [73]. Our analysis reinforces the importance of measuring performance and considering internal (that is, monitoring performance over time) and external (that is, monitoring performance across institutions) benchmarking to guide quality improvement activities. For example, deviations from anticipated performance could be used to trigger audits of patient care to identify potentially preventable events and their root causes and thereby implement locally tailored interventions.

Our results can be used to inform quality metrics designed to measure the incidence of readmission to the ICU and the incidence of hospital mortality after patient discharge from the ICU. Currently, there is no consensus on ICU benchmarks for readmission and post-ICU mortality. ICU readmission was initially identified by Cooper et al. as an important indicator that captured complementary aspects of hospital-related performance [8]. Rosenberg et al. identified a readmission incidence of 7% and suggested its use as a quality-of-care indicator [5]. More recently, professional societies [6], provider groups [74] and accreditation organizations [75] across multiple countries [76] have proposed ICU readmission as a quality indicator, but they have not specified benchmark values. Measures of ICU and hospital mortality have similarly been proposed [10],[76]. Systematic reviews and meta-analyses have been used to derive quality improvement benchmarks [77], and our present study provides literature-based estimates of readmission to the ICU and hospital mortality that could be used by institutions to select potential benchmark values.

So, which literature-based estimates should be considered? Our analyses provide two sets of pooled estimates for both ICU readmission and hospital mortality that offer a range of potential benchmarks. The fixed effects model assumes that ICU readmission incidence is the same from study to study and provides a weighted average that gives large studies greater weight [78]. The random effects model does not assume that the ICU readmission incidence is the same from study to study (that is, that it may vary from study to study) and provides a weighted average that gives studies of different sizes similar weights [79]. Although the random effects model does better justice to the full range of data available, it does potentially allow a larger weight to be given to smaller studies that may have been selected for publication on the basis of their higher event rates [18]. Therefore, one approach would be to consider ICU readmission incidence (6 patients per 100 patient discharges) and hospital mortality incidence (7 patients per 100 patient discharges) above the random effects estimates to represent suboptimal quality of care. To represent adequate quality of care accurately, it may be necessary to consider ICU readmission incidence (4 to 6 patients per 100 patient discharges) and hospital mortality incidence (3 to 7 patients per 100 patient discharges) using both the fixed effects and random effects models. It may also be necessary to consider ICU readmission incidence (4 patients per 100 patient discharges) and hospital mortality incidence (3 patients per 100 patient discharges) below the fixed effects estimates as high-quality care and benchmark targets. The stratified analyses can be used to further refine benchmark selection to more closely represent different organizations’ patient and institutional characteristics. As an important caveat, the data highlight the complexity of identifying appropriate benchmarks, reinforce the importance of a cautious approach to adopting benchmarks and suggest potential value in employing benchmark ranges as opposed to individual values in quality improvement initiatives.

Our data also highlight that hospital mortality is common among patients discharged from the ICU. This reinforces observations that the utilization of intensive care resources by patients with life-limiting illnesses is steadily rising and that end-of-life care is increasingly initiated in the ICU [80],[81]. Whereas many of these patients will die during their ICU stay, others will be discharged from the ICU before dying. This suggests that consideration needs to be given to ensure that end-of-life care is effectively delivered during transitions of care. Incorporating joint metrics for goals of care reconciliation at the time of patient discharge from the ICU, as well as both ICU readmission and hospital mortality following patient discharge from the ICU, may help in the evaluation and monitoring of the care provided to patients discharged from the ICU who are at the end of life [82].

There are caveats to our study findings. First, the studies included in this analysis were identified by conducting a literature search targeted for studies in which associations between prognostic factors and the risk of readmission to ICU and hospital mortality for patients discharged alive from the ICU were examined. Nevertheless, it is unlikely that the incidence in other studies reporting readmission and death after patient discharge would be different from ours. Second, we identified heterogeneity that is not fully explained. This is an expected finding, given the diversity of geographic locations (for example, health systems, available resources), institutions (for example, procedures for discharge and post-ICU care), providers (for example, discharge practices) and patient populations (for example, severity of illness, patient and family care preferences) in the included studies. We have discussed the relative merits and limitations of using fixed effects models and random effects models to interpret benchmarks. Against this backdrop of heterogeneity, our meta-analysis summarizes what other institutions are reporting. Third, in the majority of studies, patients were followed to hospital discharge and data at fixed time periods following patient discharge from the ICU were not reported. Although measuring readmission to the ICU and hospital mortality during the remainder of a patient’s hospital stay provides valuable information, the implications of these events likely vary by time period (that is, implication of patient readmission within 24 hours is likely different from readmission within 7 days [15]) and may introduce bias into external benchmarking activities if the hospitals being compared employ different discharge practices (for example, timing of discharge or disposition to home, to rehabilitation, to long-term care [83]). Establishing consensus time periods for measuring quality metrics of transitions of patient care between the ICU and hospital ward would facilitate future research and quality improvement initiatives.

Conclusions

On the basis of our analysis of the literature, for every 100 patients discharged alive from the ICU, on average, between 4 and 6 patients will be readmitted to the ICU and between 3 and 7 patients will die prior to hospital discharge. Opportunities exist to improve the quality of care provided to patients discharged from intensive care. The literature-based estimates derived from this systematic review and meta-analysis can be used to inform the selection of benchmarks for quality metrics of transitions of patient care between the ICU and the hospital ward.

Key messages

  • The discharge of patients from the ICU to a hospital ward is a vulnerable period in health care delivery.

  • Estimates suggest that for every 100 patients discharged alive from the ICU, on average, between 4 and 6 patients will be readmitted to the ICU and between 3 and 7 patients will die prior to hospital discharge.

  • The literature-based estimates derived from this systematic review and meta-analysis can be used to inform the selection of benchmarks for quality metrics of transitions of patient care between the ICU and the hospital ward.

Abbreviations

APACHE:

Acute Physiology and Chronic Health Evaluation

APS:

Acute Physiology Score

CI:

Confidence interval

DNR:

Do not resuscitate

ICU:

Intensive care unit

MICU:

Medical intensive care unit

MPMO-III:

Mortality Probability Admission Model

NICU:

Neurosurgical intensive care unit

SAPS:

Simplified Acute Physiology Score

SICU:

Surgical intensive care unit

SOI:

Severity of illness

References

  1. Kripalani S, Jackson AT, Schnipper JL, Coleman EA: Promoting effective transitions of care at hospital discharge: a review of key issues for hospitalists. J Hosp Med. 2007, 2: 314-323. 10.1002/jhm.228.

    Article  Google Scholar 

  2. Azoulay É, Alberti C, Legendre I, Buisson CB, Le Gall JR, European Sepsis Group: Post-ICU mortality in critically ill infected patients: an international study. Intensive Care Med. 2005, 31: 56-63. 10.1007/s00134-004-2532-x. A published erratum appears in Intensive Care Med 2005, 31:318–320

    Article  Google Scholar 

  3. Hosein FS, Bobrovitz N, Berthelot S, Zygun D, Ghali WA, Stelfox HT: A systematic review of tools for predicting severe adverse events following patient discharge from intensive care units. Crit Care. 2013, 17: R102-10.1186/cc12747.

    Article  Google Scholar 

  4. Kramer AA, Higgins TL, Zimmerman JE: The association between ICU readmission rate and patient outcomes. Crit Care Med. 2013, 41: 24-33. 10.1097/CCM.0b013e3182657b8a.

    Article  Google Scholar 

  5. Rosenberg AL, Hofer TP, Hayward RA, Strachan C, Watts CM: Who bounces back? Physiologic and other predictors of intensive care unit readmission. Crit Care Med. 2001, 29: 511-518. 10.1097/00003246-200103000-00008.

    Article  Google Scholar 

  6. Rhodes A, Moreno RP, Azoulay É, Capuzzo M, Chiche JD, Eddleston J, Endacott R, Ferdinande P, Flaatten H, Guidet B, Kuhlen R, León-Gil C, Martin Delgado MC, Metnitz PG, Soares M, Sprung CL, Timsit JF, Valentin A: Prospectively defined indicators to improve the safety and quality of care for critically ill patients: a report from the Task Force on Safety and Quality of the European Society of Intensive Care Medicine (ESICM). Intensive Care Med. 2012, 38: 598-605. 10.1007/s00134-011-2462-3.

    Article  Google Scholar 

  7. American Thoracic So: Fair allocation of intensive care unit resources. Am J Respir Crit Care Med. 1997, 156: 1282-1301. 10.1164/ajrccm.156.4.ats7-97.

    Article  Google Scholar 

  8. Cooper GS, Sirio CA, Rotondi AJ, Shepardson LB, Rosenthal GE: Are readmissions to the intensive care unit a useful measure of hospital performance?. Med Care. 1999, 37: 399-408. 10.1097/00005650-199904000-00009.

    Article  Google Scholar 

  9. Valentin A, Ferdinande P, ESICM Working Group on Quality Improvement: Recommendations on basic requirements for intensive care units: structural and organizational aspects. Intensive Care Med. 2011, 37: 1575-1587. 10.1007/s00134-011-2300-7.

    Article  Google Scholar 

  10. Pronovost PJ, Miller MR, Dorman T, Berenholtz SM, Rubin H: Developing and implementing measures of quality of care in the intensive care unit. Curr Opin Crit Care. 2001, 7: 297-303. 10.1097/00075198-200108000-00014.

    Article  Google Scholar 

  11. Kramer AA, Higgins TL, Zimmerman JE: Intensive care unit readmissions in U.S. hospitals: patient characteristics, risk factors, and outcomes. Crit Care Med. 2011, 40: 3-10. 10.1097/CCM.0b013e31822d751e.

    Article  Google Scholar 

  12. Campbell AJ, Cook JA, Adey G, Cuthbertson BH: Predicting death and readmission after intensive care discharge. Br J Anaesth. 2008, 100: 656-662. 10.1093/bja/aen069.

    Article  Google Scholar 

  13. Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surg. 2010, 8: 336-341. 10.1016/j.ijsu.2010.02.007.

    Article  Google Scholar 

  14. Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, Moher D, Becker BJ, Sipe TA, Thacker SB, for the Meta-analysis of Observational Studies in Epidemiology (MOOSE) Group: Meta-analysis Of Observational Studies in Epidemiology: a proposal for reporting. JAMA. 2000, 283: 2008-2012. 10.1001/jama.283.15.2008.

    Article  Google Scholar 

  15. Elliott M, Worrall-Carter L, Page K: Intensive care readmission: a contemporary review of the literature. Intensive Crit Care Nurs. 2014, 30: 121-137. 10.1016/j.iccn.2013.10.005.

    Article  Google Scholar 

  16. Mantel N, Haenszel W: Statistical aspects of the analysis of data from retrospective studies of disease. J Natl Cancer Inst. 1959, 22: 719-748.

    Google Scholar 

  17. DerSimonian R, Laird N: Meta-analysis in clinical trials. Control Clin Trials. 1986, 7: 177-188. 10.1016/0197-2456(86)90046-2.

    Article  Google Scholar 

  18. Thompson SG: Why and how sources of heterogeneity should be investigated. Systematic Reviews in Health Care: Meta-Analysis in Context. Edited by: Egger M, Smith GD, Altman DG. 2001, BMJ Publishing Group, London, 157-175. 10.1002/9780470693926.ch9. 2

    Chapter  Google Scholar 

  19. Yip B, Ho K: Eosinopenia as a predictor of unexpected re-admission and mortality after intensive care unit discharge. Anaesth Intensive Care. 2013, 41: 231-241.

    Google Scholar 

  20. Timmers TK, Verhofstad MHJ, Moons KGM, Leenen LPH: Patients’ characteristics associated with readmission to a surgical intensive care unit. Am J Crit Care. 2012, 21: e120-e128. 10.4037/ajcc2012773.

    Article  Google Scholar 

  21. Reini K, Fredrikson M, Oscarsson A: The prognostic value of the Modified Early Warning Score in critically ill patients: a prospective, observational study. Eur J Anaesthesiol. 2012, 29: 152-157. 10.1097/EJA.0b013e32835032d8.

    Article  Google Scholar 

  22. Ranzani OT, Prada LF, Zampieri FG, Battaini LC, Pinaffi JV, Setogute YC, Salluh JI, Povoa P, Forte DN, Azevedo LC, Park M: Failure to reduce C-reactive protein levels more than 25% in the last 24 hours before intensive care unit discharge predicts higher in-hospital mortality: a cohort study. J Crit Care. 2012, 27: 525-10.1016/j.jcrc.2011.10.013. e9–e15

    Article  Google Scholar 

  23. Mahesh B, Choong CK, Goldsmith K, Gerrard C, Nashef SA, Vuylsteke A: Prolonged stay in intensive care unit is a powerful predictor of adverse outcomes after cardiac operations. Ann Thorac Surg. 2012, 94: 109-116. 10.1016/j.athoracsur.2012.02.010.

    Article  Google Scholar 

  24. Joskowiak D, Wilbring M, Szlapka M, Georgi C, Kappert U, Matschke K, Tugtekin SM: Readmission to the intensive care unit after cardiac surgery: a single-center experience with 7105 patients. J Cardiovasc Surg (Torino). 2012, 53: 671-676.

    Google Scholar 

  25. Brown SE, Ratcliffe SJ, Kahn JM, Halpern SD: The epidemiology of intensive care unit readmissions in the United States. Am J Respir Crit Care Med. 2012, 185: 955-964. 10.1164/rccm.201109-1720OC.

    Article  Google Scholar 

  26. Badawi O, Breslow MJ: Readmissions and death after ICU discharge: development and validation of two predictive models. PLoS One. 2012, 7: e48758-10.1371/journal.pone.0048758.

    Article  Google Scholar 

  27. Araújo I, Gonçalves-Pereira J, Teixeira S, Nazareth R, Silvestre J, Mendes V, Tapadinhas C, Póvoa P: Assessment of risk factors for in-hospital mortality after intensive care unit discharge. Biomarkers. 2012, 17: 180-185. 10.3109/1354750X.2012.654407.

    Article  Google Scholar 

  28. da Silva MC M, de Sousa RM C, Padilha KG: Factors associated with death and readmission into the intensive care unit. Rev Lat Am Enfermagem. 2011, 19: 911-919. 10.1590/S0104-11692011000400009.

    Article  Google Scholar 

  29. Renton J, Pilcher DV, Santamaria JD, Stow P, Bailey M, Hart G, Duke G: Factors associated with increased risk of readmission to intensive care in Australia. Intensive Care Med. 2011, 37: 1800-1808. 10.1007/s00134-011-2318-x.

    Article  Google Scholar 

  30. Ouanes I, Schwebel C, Français A, Bruel C, Philippart F, Vesin A, Soufir L, Adrie C, Garrouste-Orgeas M, Timsit JF, Misset B, Outcomerea Study Group: A model to predict short-term death or readmission after intensive care unit discharge. J Crit Care. 2012, 27: 422-10.1016/j.jcrc.2011.08.003. e1–e9

    Article  Google Scholar 

  31. Laupland KB, Misset B, Souweine B, Tabah A, Azoulay É, Goldgran-Toledano D, Dumenil AS, Vésin A, Jamali S, Kallel H, Clec’h C, Darmon M, Schwebel C, Timsit JF: Mortality associated with timing of admission to and discharge from ICU: a retrospective cohort study. BMC Health Serv Res. 2011, 11: 321-10.1186/1472-6963-11-321.

    Article  Google Scholar 

  32. Fernandez R, Tizon AI, Gonzalez J, Monedero P, Garcia-Sanchez M, de la Torre MV, Ibañez P, Frutos F, del Nogal F, Gomez MJ, Marcos A, Hernández G, Sabadell Score Group: Intensive care unit discharge to the ward with a tracheostomy cannula as a risk factor for mortality: a prospective, multicenter propensity analysis. Crit Care Med. 2011, 39: 2240-2245. 10.1097/CCM.0b013e3182227533.

    Article  Google Scholar 

  33. Utzolino S, Kaffarnik M, Keck T, Berlet M, Hopt UT: Unplanned discharges from a surgical intensive care unit: readmissions and mortality. J Crit Care. 2010, 25: 375-381. 10.1016/j.jcrc.2009.09.009.

    Article  Google Scholar 

  34. Silvestre J, Coelho L, Póvoa P: Should C-reactive protein concentration at ICU discharge be used as a prognostic marker?. BMC Anesthesiol. 2010, 10: 17-10.1186/1471-2253-10-17.

    Article  Google Scholar 

  35. Fernandez R, Serrano JM, Umaran I, Abizanda R, Carrillo A, Lopez-Pueyo MJ, Rascado P, Balerdi B, Suberviola B, Hernandez G, Sabadell Score Study Group: Ward mortality after ICU discharge: a multicenter validation of the Sabadell score. Intensive Care Med. 2010, 36: 1196-1201. 10.1007/s00134-010-1825-5.

    Article  Google Scholar 

  36. Al-Subaie N, Reynolds T, Myers A, Sunderland R, Rhodes A, Grounds RM, Hall GM: C-reactive protein as a predictor of outcome after discharge from the intensive care: a prospective observational study. Br J Anaesth. 2010, 105: 318-325. 10.1093/bja/aeq171.

    Article  Google Scholar 

  37. Litmathe J, Kurt M, Feindt P, Gams E, Boeken U: Predictors and outcome of ICU readmission after cardiac surgery. Thorac Cardiovasc Surg. 2009, 57: 391-394. 10.1055/s-0029-1185852.

    Article  Google Scholar 

  38. Chrusch CA, Olafson KP, McMillan PM, Roberts DE, Gray PR: High occupancy increases the risk of early death or readmission after transfer from intensive care. Crit Care Med. 2009, 37: 2753-2758. 10.1097/CCM.0b013e3181a57b0c.

    Article  Google Scholar 

  39. Sakr Y, Vincent J, Ruokonen E, Pizzamiglio M, Installe E, Reinhart K, Moreno R, the Sepsis Occurrence in Acutely Ill Patients Investigators: Sepsis and organ system failure are major determinants of post–intensive care unit mortality. J Crit Care. 2008, 23: 475-483. 10.1016/j.jcrc.2007.09.006.

    Article  Google Scholar 

  40. Laupland KB, Shahpori R, Kirkpatrick AW, Stelfox HT: Hospital mortality among adults admitted to and discharged from intensive care on weekends and evenings. J Crit Care. 2008, 23: 317-324. 10.1016/j.jcrc.2007.09.001.

    Article  Google Scholar 

  41. Kaben A, Correa F, Reinhart K, Settmacher U, Gummert J, Kalff R, Sakr Y: Readmission to a surgical intensive care unit: incidence, outcome and risk factors. Crit Care. 2008, 12: R123-10.1186/cc7023.

    Article  Google Scholar 

  42. Ho KM, Lee KY, Dobb GJ, Webb SA: C-reactive protein concentration as a predictor of in-hospital mortality after ICU discharge: a prospective cohort study. Intensive Care Med. 2008, 34: 481-487. 10.1007/s00134-007-0928-0.

    Article  Google Scholar 

  43. Hanane T, Keegan MT, Seferian EG, Gajic O, Afessa B: The association between nighttime transfer from the intensive care unit and patient outcome. Crit Care Med. 2008, 36: 2232-2237. 10.1097/CCM.0b013e3181809ca9.

    Article  Google Scholar 

  44. Gajic O, Malinchoc M, Comfere TB, Harris MR, Achouiti A, Yilmaz M, Schultz MJ, Hubmayr RD, Afessa B, Farmer JC: The Stability and Workload Index for Transfer score predicts unplanned intensive care unit patient readmission: initial development and validation. Crit Care Med. 2008, 36: 676-682. 10.1097/CCM.0B013E318164E3B0.

    Article  Google Scholar 

  45. Song SW, Lee HS, Kim JH, Kim MS, Lee JM, Zo JI: Readmission to intensive care unit after initial recovery from major thoracic oncology surgery. Ann Thorac Surg. 2007, 84: 1838-1846. 10.1016/j.athoracsur.2007.06.074.

    Article  Google Scholar 

  46. Pilcher DV, Duke GJ, George C, Bailey MJ, Hart G: After-hours discharge from intensive care increases the risk of readmission and death. Anaesth Intensive Care. 2007, 35: 477-485.

    Google Scholar 

  47. Tobin AE, Santamaria JD: After-hours discharges from intensive care are associated with increased mortality. Med J Aust. 2006, 184: 334-337.

    Google Scholar 

  48. Priestap FA, Martin CM: Impact of intensive care unit discharge time on patient outcome. Crit Care Med. 2006, 34: 2946-2951.

    Google Scholar 

  49. Mayr VD, Dünser MW, Greil V, Jochberger S, Luckner G, Ulmer H, Friesenecker BE, Takala J, Hasibeder WR: Causes of death and determinants of outcome in critically ill patients. Crit Care. 2006, 10: R154-10.1186/cc5086.

    Article  Google Scholar 

  50. Fernandez R, Baigorri F, Navarro G, Artigas A: A modified McCabe score for stratification of patients after intensive care unit discharge: the Sabadell score. Crit Care. 2006, 10: R179-10.1186/cc5136.

    Article  Google Scholar 

  51. Alban RF, Nisim AA, Ho J, Nishi GK, Shabot MM: Readmission to surgical intensive care increases severity-adjusted patient mortality. J Trauma. 2006, 60: 1027-1031. 10.1097/01.ta.0000218217.42861.b7.

    Article  Google Scholar 

  52. Vohra HA, Goldsmith IRA, Rosin MD, Briffa NP, Patel RL: The predictors and outcome of recidivism in cardiac ICUs. Eur J Cardiothorac Surg. 2005, 27: 508-511. 10.1016/j.ejcts.2004.11.016.

    Article  Google Scholar 

  53. Yoon KB, Koh SO, Han DW, Kang OC: Discharge decision-making by intensivists on readmission to the intensive care unit. Yonsei Med J. 2004, 45: 193-198. 10.3349/ymj.2004.45.2.193.

    Article  Google Scholar 

  54. Fortis A, Mathas C, Laskou M, Kolias S, Maguina N: Therapeutic Intervention Scoring System-28 as a tool of post ICU outcome prognosis and prevention. Minerva Anestesiol. 2004, 70: 71-81.

    Google Scholar 

  55. Duke GJ, Green JV, Briedis JH: Night-shift discharge from intensive care unit increases the mortality-risk of ICU survivors. Anaesth Intensive Care. 2004, 32: 697-701.

    Google Scholar 

  56. Uusaro A, Kari A, Ruokonen E: The effects of ICU admission and discharge times on mortality in Finland. Intensive Care Med. 2003, 29: 2144-2148. 10.1007/s00134-003-2035-1.

    Article  Google Scholar 

  57. Metnitz PGH, Fieux F, Jordan B, Lang T, Moreno R, Gall JR: Critically ill patients readmitted to intensive care units–lessons to learn?. Intensive Care Med. 2003, 29: 241-248.

    Google Scholar 

  58. Kogan A, Cohen J, Raanani E, Sahar G, Orlov B, Singer P, Vinde BA: Readmission to the intensive care unit after “fast-track” cardiac surgery: risk factors and outcomes. Ann Thorac Surg. 2003, 76: 503-507. 10.1016/S0003-4975(03)00510-1.

    Article  Google Scholar 

  59. Bardell T, Legare JF, Buth KJ, Hirsch GM, Ali IS: ICU readmission after cardiac surgery. Eur J Cardiothorac Surg. 2003, 23: 354-359. 10.1016/s1010-7940(02)00767-4.

    Article  Google Scholar 

  60. Azoulay É, Adrie C, De Lassence A, Pochard F, Moreau D, Thiery G, Cheval C, Moine P, Garrouste-Orgeas M, Alberti C, Cohen Y, Timsit JF: Determinants of postintensive care unit mortality: a prospective multicenter study. Crit Care Med. 2003, 31: 428-432. 10.1097/01.CCM.0000048622.01013.88.

    Article  Google Scholar 

  61. Calafiore AM, Scipioni G, Teodori G, Di Giammarco G, Di Mauro M, Canosa C, Iacò AL, Vitolla G: Day 0 intensive care unit discharge - risk or benefit for the patient who undergoes myocardial revascularization?. Eur J Cardiothorac Surg. 2002, 21: 377-384. 10.1016/S1010-7940(01)01151-4.

    Article  Google Scholar 

  62. Beck DH, McQuillan P, Smith GB: Waiting for the break of dawn? The effects of discharge time, discharge TISS scores and discharge facility on hospital mortality after intensive care. Intensive Care Med. 2002, 28: 1287-1293. 10.1007/s00134-002-1412-5.

    Article  Google Scholar 

  63. Moreno R, Miranda D, Matos R, Fevereiro T: Mortality after discharge from intensive care: the impact of organ system failure and nursing workload use at discharge. Intensive Care Med. 2001, 27: 999-1004. 10.1007/s001340100966.

    Article  Google Scholar 

  64. Daly K, Beale R, Chang RW: Reduction in mortality after inappropriate early discharge from intensive care unit: logistic regression triage model. BMJ. 2001, 322: 1274-1276. 10.1136/bmj.322.7297.1274.

    Article  Google Scholar 

  65. Goldfrad C, Rowan K: Consequences of discharges from intensive care at night. Lancet. 2000, 355: 1138-1142. 10.1016/S0140-6736(00)02062-6.

    Article  Google Scholar 

  66. Smith L, Orts CM, O’Neil I, Batchelor AM, Gascoigne AD, Baudouin SV: TISS and mortality after discharge from intensive care. Intensive Care Med. 1999, 25: 1061-1065. 10.1007/s001340051012.

    Article  Google Scholar 

  67. Cohn WE, Sellke FW, Sirois C, Lisbon A, Johnson RG: Surgical ICU recidivism after cardiac operations. Chest. 1999, 116: 688-692. 10.1378/chest.116.3.688.

    Article  Google Scholar 

  68. Chen LM, Martin CM, Keenan SP, Sibbald WJ: Patients readmitted to the intensive care unit during the same hospitalization: clinical features and outcomes. Crit Care Med. 1998, 26: 1834-1841. 10.1097/00003246-199811000-00025.

    Article  Google Scholar 

  69. Rubins HB, Moskowitz MA: Discharge decision-making in a medical intensive care unit: identifying patients at high risk of unexpected death or unit readmission. Am J Med. 1988, 84: 863-869. 10.1016/0002-9343(88)90064-2.

    Article  Google Scholar 

  70. Strauss MJ, LoGerfo JP, Yeltatzie JA, Temkin N, Hudson LD: Rationing of intensive care unit services: an everyday occurrence. JAMA. 1986, 255: 1143-1146. 10.1001/jama.1986.03370090065021.

    Article  Google Scholar 

  71. Leape LL, Berwick DM: Five years after To Err Is Human: What have we learned?. JAMA. 2005, 293: 2384-2390. 10.1001/jama.293.19.2384.

    Article  Google Scholar 

  72. Kohn LT, Corrigan JM, Donaldson MS: To Err Is Human: Building a Safer Health System. 2000, The National Academies Press, Washington, DC

    Google Scholar 

  73. Committee on Quality of Health Care in America, Institute of Medicine: Crossing the Quality Chasm: A New Health System for the 21st Century. 2001, The National Academies Press, Washington, DC

    Google Scholar 

  74. de Vos M, Graafmans W, Keesman E, Westert G, van der Voort PH: Quality measurement at intensive care units: Which indicators should we use?. J Crit Care. 2007, 22: 267-274. 10.1016/j.jcrc.2007.01.002.

    Article  Google Scholar 

  75. Australian Council on Healthcare Standards (ACHS): ACHS Clinical Indicator Users’ Manual 2012. 2012, ACHS, Ultimo, NSW, Australia

    Google Scholar 

  76. Flaatten H: The present use of quality indicators in the intensive care unit. Acta Anaesthesiol Scand. 2012, 56: 1078-1083. 10.1111/j.1399-6576.2012.02656.x.

    Article  Google Scholar 

  77. Januel JM, Chen G, Ruffieux C, Quan H, Douketis JD, Crowther MA, Colin C, Ghali WA, Burnand B, IMECCHI Group: Symptomatic in-hospital deep vein thrombosis and pulmonary embolism following hip and knee arthroplasty among patients receiving recommended prophylaxis: a systematic review. JAMA. 2012, 307: 294-303. 10.1001/jama.2011.2029.

    Article  Google Scholar 

  78. Thompson SG: Meta-analysis of clinical trials. Encyclopedia of Biostatistics. Edited by: Armitage P, Colton E. 2005, John Wiley & Sons, Ltd, Chichester, UK, 2

    Google Scholar 

  79. Berkey CS, Hoaglin DC, Mosteller F, Colditz GA: A random-effects regression model for meta-analysis. Stat Med. 1995, 14: 395-411. 10.1002/sim.4780140406.

    Article  Google Scholar 

  80. Pisani MA: Considerations in caring for the critically ill older patient. J Intensive Care Med. 2009, 24: 83-95. 10.1177/0885066608329942.

    Article  Google Scholar 

  81. Angus DC, Barnato AE, Linde-Zwirble WT, Weissfeld LA, Watson RS, Rickert T, Rubenfeld GD, Robert Wood Johnson Foundation ICU End-Of-Life Peer Group: Use of intensive care at the end of life in the United States: an epidemiologic study. Crit Care Med. 2004, 32: 638-643. 10.1097/01.CCM.0000114816.62331.08.

    Article  Google Scholar 

  82. Jin J: Clinicians examine advances and challenges in improving quality of end-of-life care in the ICU. JAMA. 2013, 310: 2493-2495. 10.1001/jama.2013.283830.

    Article  Google Scholar 

  83. Reineck LA, Pike F, Le TQ, Cicero BD, Iwashyna TJ, Kahn JM: Hospital factors associated with discharge bias in ICU performance measurement. Crit Care Med. 2014, 42: 1055-1064. 10.1097/CCM.0000000000000132.

    Article  Google Scholar 

Download references

Acknowledgements

The project was supported by an Establishment Grant (20100368) from Alberta Innovates Health Solutions. WAG and HTS are supported by Population Health Investigator Awards from Alberta Innovates Health Solutions. HTS is supported by a New Investigator Award from the Canadian Institutes of Health Research. DR is supported by an Alberta – Innovates Health Solutions Clinician Fellowship Award, a Knowledge Translation Canada Strategic Training in Health Research Fellowship and funding from the Canadian Institutes of Health Research. The funding sources had no role in the design, conduct or reporting of this study. FSH, DR and HTS had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. We would like to thank Simon Berthelot for aiding with the literature search and reviewing abstracts and Nik Bobrovitz for aiding in the selection and critical appraisal of publications.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Henry T Stelfox.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

All six authors contributed to the study’s conception, design and interpretation. FSH was responsible for searching the literature, reviewing the abstracts and selecting publications and critically appraising them. FSH, DR and HTS performed the analyses. FSH, DR, TCT, DZ, WAG and HTS assisted in the successive revisions of the manuscript. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hosein, F.S., Roberts, D.J., Turin, T.C. et al. A meta-analysis to derive literature-based benchmarks for readmission and hospital mortality after patient discharge from intensive care. Crit Care 18, 715 (2014). https://doi.org/10.1186/s13054-014-0715-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13054-014-0715-6

Keywords