Skip to main content
  • Original research
  • Open access
  • Published:

Prognostic ability of the sequential organ failure assessment score in accidental hypothermia: a multi-institutional retrospective cohort study

Abstract

Background

Severe accidental hypothermia (AH) is life threatening. Thus, prognostic prediction in AH is essential to rapidly initiate intensive care. Several studies on prognostic factors for AH are known, but none have been established. We clarified the prognostic ability of the Sequential Organ Failure Assessment (SOFA) score in comparison with previously reported prognostic factors among patients with AH.

Methods

The J-point registry database is a multi-institutional retrospective cohort study for AH in 12 Japanese emergency departments. From this registry, we enrolled patients who were treated at the intensive care unit (ICU) in various critical care medical centers. In-hospital mortality was the primary outcome. We investigated the discrimination ability of each candidate prognostic factor and the in-hospital mortality by applying the logistic regression models with areas under the receiver operating characteristic curve (AUROC) with 95% confidence interval (CI).

Results

Of the 572 patients with AH registered in the J-point registry, 220 were eligible for the analyses. The in-hospital mortality was 23.2%. The AUROC of the SOFA score (0.80; 95% CI: 0.72–0.86) was the highest among all factors. The other factors were serum potassium (0.65; 95% CI: 0.55–0.73), lactate (0.67; 95% CI: 0.57–0.75), quick SOFA (qSOFA) (0.55; 95% CI: 0.46–0.65), systemic inflammatory response syndrome (SIRS) (0.60; 95% CI: 0.50–0.69), and 5A severity scale (0.77; 95% CI: 0.68–0.84).

Discussion

Although serum potassium and lactate had relatively good discrimination ability as mortality predictors, the SOFA score had slightly better discrimination ability. The reason is that lactate and serum potassium were mainly reflected by the hemodynamic state; conversely, the SOFA score is a comprehensive score of organ failure, basing on six different scores from the respiratory, cardiovascular, hepatic, coagulation, renal, and neurological systems. Meanwhile, the qSOFA and SIRS scores underestimated the severity, with low discrimination abilities for mortality.

Conclusions

The SOFA score demonstrated better discrimination ability as a mortality predictor among all known prognostic factors in patients with AH.

Background

Accidental hypothermia (AH) is an unintentional decrease in core body temperature (BT) to 35 °C or less [1]. Generally, AH happens among the elderly people, and it can be fatal, thereby suggesting an important problem in a super-aging society [2,3,4]. Patients with AH are at risk of fatal arrhythmias and hemodynamic collapse; therefore, they must be assessed immediately assessed to determine their severity, and a rapid and aggressive intensive care intervention should be performed. Prognostic prediction in AH is essential to rapidly initiate intensive care, thereby, saving the lives of patients having severe condition. Therefore, research on the prognosis prediction of AH is required.

Several prognostic factors, such as age, sex, activities of daily living, BT, blood potassium level, and lactate level, for AH have been extensively studied [5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20]. Recently, 5A severity scale has also been proposed [21]. However, none of the factors have been established. Meanwhile, the Sequential Organ Failure Assessment (SOFA) score is widely accepted as a severity and prognostic factor in the field of emergency and intensive care, especially in patients suffering from sepsis [22, 23].

This study aimed to clarify the prognostic ability of the SOFA score in comparison with previously reported prognostic factors in patients with AH.

Methods

Study design and setting

This study is a multi-institutional retrospective cohort study, and the setting was the J-point registry. The J-point registry is a database for patients with AH transferred to the emergency departments, and it was conducted in the emergency department of eight critical care medical centers (CCMCs) and four non-CCMCs in Kyoto, Osaka, and Shiga Prefecture in Japan. In Japan, CCMCs are certified by the Ministry of Health, Labour and Welfare based on emergency departments that treat patients for shock, trauma, resuscitation, and critical care which serve approximately 500,000 residents in each region; in these CCMCs, advanced treatment such as extracorporeal membrane oxygenation (ECMO) is generally available. The median annual emergency department visit volume for participating institutions was 19,651 (interquartile range [IQR], 13,281–27,554). We retrospectively identified and registered eligible patients using the International Classification of Diseases, Tenth Revision (ICD-10) code T68: “Hypothermia”, who were diagnosed during the study period, from April 1, 2011, to March 31, 2016. We excluded the patients from the registry if they or their family members explicitly refused to be included in the registry. Clinical data were extracted by emergency physicians using a predefined data extraction sheet. The collected data were rechecked by the J-point Registry Working Group members and were either confirmed or checked with the appropriate institution if concerns regarding the data’s validity are known. On the basis of these factors, 572 patients were registered in the J-point registry. The clinical research ethics committee of each institution approved the conduct of this research.

Study patients

The subjects of this study were patients with AH enrolled in the J-point registry and treated at the intensive care unit (ICU) in eight CCMCs. The study was limited to patients admitted to ICU in order to exclude patients who died as outpatients or who were admitted without indication for an aggressive treatment at the time of first treatment.

Data collection

Based on the medical record review of the researcher at each facility, the following baseline patient characteristics were collected: sex, age, activities of daily living before hypothermia, and a comprehensive past medical history, including cardiovascular diseases (ischemic heart diseases, heart failure, arrhythmia, hypertension, and others), neurological diseases (stroke, epilepsy, Parkinson disease or syndrome, and others), endocrine diseases (diabetes, thyroid diseases, adrenal insufficiency, and others), psychiatric diseases (chronic alcoholism, depression, schizophrenia, and others), malignant diseases, dementia, and others. With regard to in-hospital measurements, the data included were as follows: vital signs during hospital arrival [core BT, systolic blood pressure, heart rate, Glasgow (GCS), and Japan Coma Scales (JCS)], blood test [complete blood count, total bilirubin (mg/dL), and creatinine (mg/dL), serum lactate (mmol/L), potassium (mEq/L), glucose (mg/dL)], cold exposure, treatment process (external and minimally invasive rewarming methods: warming intravenous fluid, warm air, warm blanket, and others; active internal rewarming methods: lavage, intravascular rewarming device, and veno-venous and veno-arterial ECMO), and the outcome. The JCS, a grading system that evaluates disturbed consciousness, was first published in 1974 and since then has been certified as a standard field tool assessing the level of consciousness by the Japan Fire and Disaster Management Agency.

Outcome measurements

The primary outcome of this study was in-hospital mortality.

Statistical analysis

We described the data on patient characteristics as medians with IQRs for continuous variables and as numbers with percentages for categorical variables. For the primary analysis, we set the SOFA score and the primary outcome (in-hospital mortality) as explanatory and objective variables, respectively, and we employed the logistic regression model. The discrimination ability of the score was assessed using the area under the receiver operating characteristic curve (AUROC) curve with 95% confidence interval (CI). We also calculated the AUROC of the following prognostic factors: age, BT, serum potassium, lactate, quick SOFA (qSOFA), systemic inflammatory response syndrome (SIRS) scores and 5A severity scale. Then, we compared the individual discrimination ability of these factors. Such comparison was demonstrated because age, BT, serum potassium, and lactate are associated with the mortality of patients with AH [5, 7, 8, 11, 13,14,15,16,17,18]; in addition, the qSOFA, SIRS, and especially the SOFA score are widely accepted to assess the severity of sepsis [23, 24]. In recent years, a 5A severity scale has been developed to predict in-hospital mortality after AH. We compared the AUROC of SOFA with those of the other factors. All P value analyses were two-sided, and a P value of less than 0.05 was considered significant. Moreover, the statistical analysis was performed using the JMP Pro 14 for Mac (SAS Institute, Tokyo, Japan).

Results

Patient characteristics

Of all the 572 patients with AH registered in the J-point registry database, we excluded 52 patients whose BT was above 35 °C or unknown at admission, 91 who were treated at non-CCMCs, 208 who were treated outside the ICU of CCMCs, and 1 with missing data. No one was refused to participate in the registry. Ultimately, we included 220 patients, with an overall in-hospital mortality of 23.2% (Fig. 1). The patient characteristics are shown in Table 1.

Fig. 1
figure 1

Study flowchart. BT, body temperature; CCMC, critical care medical center; ICU, intensive care unit

Table 1 Patient characteristics

Outcome

Logistic regression analysis showed that the AUROC in the SOFA, qSOFA, SIRS, and a 5A severity scale were 0.80 (95% CI: 0.72–0.86), 0.55 (95% CI: 0.46–0.65), 0.60 (95% CI: 0.50–0.69), and 0.77 (95% CI: 0.68–0.84), respectively. In addition, the AUROC of the other factors was as follows: age, 0.56 (95% CI: 0.47–0.64); BT, 0.53 (95% CI: 0.44–0.62); serum potassium, 0.65 (95% CI: 0.55–0.73); and lactate, 0.67 (95% CI: 0.57–0.75). Therefore, the AUROC of the SOFA score was the highest except 5A severity scale (Table 2 and Fig. 2). The AUROC of the SOFA score and a 5A severity scale was almost same.

Table 2 AUROC value for discrimination ability for in-hospital mortality of each variable
Fig. 2
figure 2

Area under the receiver operating characteristic curves for SOFA, qSOFA, SIRS, and 5A severity scale to discriminate the capacity for in-hospital mortality of accidental hypothermia

Discussion

To the best of our knowledge, this study is the first to evaluate the performance of the SOFA score in patients with AH. In particular, we highlighted that the SOFA score had better ability to predict mortality in AH among all the reported prognostic factors.

We suggested possible explanation regarding the good performance of the SOFA score in predicting mortality among patients with AH. In this study, the SOFA score demonstrated good discrimination ability in predicting AH mortality. In previous studies, factors such as age, gender, BT at admission, potassium, and lactate were considered mortality predictors [5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20]. Although serum potassium and lactate had relatively good discrimination abilities as mortality predictors, as shown in our study, the SOFA score was slightly better than others (Table 2). Serum lactate and potassium were mainly and only reflected the hemodynamic state, whereas the SOFA score is a comprehensive assessment of multiple organ failure including six domains; respiratory, cardiovascular, hepatic, coagulation, renal, and neurological systems. In addition, organ failure caused by hypo-perfusion to vital organ or sepsis is considered to be the possible cause of mortality in patients with moderate to severe AH. Therefore, we believe that the SOFA score can assess the severity more appropriately than serum lactate or potassium.

The discrimination abilities of the qSOFA and SIRS scores were not as high as that of the SOFA score (Fig. 2), possibly because the items, such as respiratory rate, consciousness, and BT, of these scores are not sensitive for the mortality in patients with AH. With regard to the respiratory rate, patients with AH with lower BT tend to experience bradypnea [2]. However, in the qSOFA and SIRS scores, the respiratory condition is only assessed by the presence of tachypnea. Therefore, these scores cannot evaluate the respiratory condition appropriately in patients with severe AH. In contrast, the SOFA score uses PaO2/FIO2 for the respiratory condition; this rate is independent from the respiratory rate. Thus, the SOFA score can more accurately assess the respiratory condition in patients with AH than the qSOFA and SIRS scores. Regarding consciousness, the change in mental status is evaluated in the qSOFA; however, only binary variables (yes or no) are required as answers, and qSOFA cannot discriminate the minor and severe disturbances of consciousness in patients with AH. Conversely, the SOFA score includes five grades by using the GCS; thus, it enables to assess consciousness more exactly than qSOFA. In the SIRS score, BT is an item evaluated as more than 38 °C or lower than 36 °C, but in patients with AH, BT is basically lower than 35 °C; thus, it cannot distinguish the severity. Therefore, the qSOFA and SIRS scores underestimated the severity of AH in this study, and their discrimination abilities for mortality were low.

The SOFA score and 5A severity scale (Table 3) had almost similar discrimination ability for predicting in-hospital mortality after AH. However, SOFA score is widely accepted; thus, it may be more useful and generalized than 5A severity scale.

Table 3 Variables of the SOFA and 5A score

This study indicated that the SOFA score may be validated to predict in-hospital mortality and assess the severity objectively among the patients with AH admitted to ICU. Therefore, it may be helpful in selecting the appropriate patients for ICU admission and shared-decision making with the patients/their families. Generally, a scoring system is useful to generalize the severity for comparing the quality of the care in different settings or for selecting patients in clinical research [25]. Thus, in patients with AH, the SOFA score may also be useful in quality management and research.

Limitations

This study has several limitations. First, it is a retrospective cohort study. Considering that patients were selected according to the ICD-10, possibly not all patients with BT of 35 °C or less could be incorporated into this study. Second, trauma patients were also included in this study. We considered that in many cases, elderly people became accidental hypothermia because they could not move after they got injury due to fall, however the detail of trauma was unknown. Third, we obtained SOFA score by using the worst value for each physiological variable within the past 24 h after admission to ICU. Therefore, the time of scoring SOFA was not strictly uniform. Forth, although the target case was a patient with AH requiring ICU management, there was an absence of a protocol for care which was used consistently and contents of the treatment were left to the individual physicians. Furthermore, regarding the details of the cause of death, although there was a record, most of these were inadequate or missing data. Hence, setting a unified treatment indication and contents for patients with AH and considering further research are necessary.

Conclusions

This study indicated that the SOFA score may be validated for predicting in-hospital mortality among patients with AH admitted to ICU. Therefore, we believe that SOFA score may be useful for risk stratification in order to select appropriate patients for ICU admission.

Availability of data and materials

No data is available.

Abbreviations

AH:

Accidental hypothermia

AUROC:

Area under the receiver operating characteristic curve

BT:

Body temperature

CCMC:

Critical care medical center

CI:

Confidence interval

ECMO:

Extracorporeal membrane oxygenation

GCS:

Glasgow Coma Scale

ICD-10:

International Classification of Diseases, Tenth Revision

ICU:

Intensive care unit

IQR:

Interquartile range

JCS:

Japan Coma Scale

qSOFA:

quick SOFA

SIRS:

Systemic inflammatory response syndrome

SOFA:

Sequential Organ Failure Assessment

References

  1. Danzl DF, Pozos RS. Accidental hypothermia. N Engl J Med. 1994;331(26):1756–60.

    Article  CAS  Google Scholar 

  2. Paal P, Gordon L, Strapazzon G, Brodmann Maeder M, Putzer G, Walpoth B, et al. Accidental hypothermia-an update: the content of this review is endorsed by the International Commission for Mountain Emergency Medicine (ICAR MEDCOM). Scand J Trauma Resusc Emerg Med. 2016;24(1):111.

    Article  Google Scholar 

  3. Stares J, Kosatsky T. Hypothermia as a cause of death in British Columbia, 1998-2012: a descriptive assessment. CMAJ Open. 2015;3(4):E352–8.

    Article  Google Scholar 

  4. Young AJ, Lee DT. Aging and human cold tolerance. Exp Aging Res. 1997;23(1):45–67.

    Article  CAS  Google Scholar 

  5. Hauty MG, Esrig BC, Hill JG, Long WB. Prognostic factors in severe accidental hypothermia: experience from the Mt. Hood tragedy. J Trauma. 1987;27(10):1107–12.

    Article  CAS  Google Scholar 

  6. Danzl DF, Pozos RS, Auerbach PS, Glazer S, Goetz W, Johnson E, et al. Multicenter hypothermia survey. Ann Emerg Med. 1987;16(9):1042–55.

    Article  CAS  Google Scholar 

  7. Schaller MD, Fischer AP, Perret CH. Hyperkalemia. A prognostic factor during acute severe hypothermia. JAMA. 1990;264(14):1842–5.

    Article  CAS  Google Scholar 

  8. Mair P, Kornberger E, Furtwaengler W, Balogh D, Antretter H. Prognostic markers in patients with severe accidental hypothermia and cardiocirculatory arrest. Resuscitation. 1994;27(1):47–54.

    Article  CAS  Google Scholar 

  9. Vassal T, Benoit-Gonin B, Carrat F, Guidet B, Maury E, Offenstadt G. Severe accidental hypothermia treated in an ICU: prognosis and outcome. Chest. 2001;120(6):1998–2003.

    Article  CAS  Google Scholar 

  10. Farstad M, Andersen KS, Koller ME, Grong K, Segadal L, Husby P. Rewarming from accidental hypothermia by extracorporeal circulation. A retrospective study. Eur J Cardiothorac Surg. 2001;20(1):58–64.

    Article  CAS  Google Scholar 

  11. Silfvast T, Pettilä V. Outcome from severe accidental hypothermia in southern Finland--a 10-year review. Resuscitation. 2003;59(3):285–90.

    Article  Google Scholar 

  12. Ruttmann E, Weissenbacher A, Ulmer H, Müller L, Höfer D, Kilo J, et al. Prolonged extracorporeal membrane oxygenation-assisted support provides improved survival in hypothermic patients with cardiocirculatory arrest. J Thorac Cardiovasc Surg. 2007;134(3):594–600.

    Article  Google Scholar 

  13. van der Ploeg GJ, Goslings JC, Walpoth BH, Bierens JJ. Accidental hypothermia: rewarming treatments, complications and outcomes from one university medical Centre. Resuscitation. 2010;81(11):1550–5.

    Article  Google Scholar 

  14. Sawamoto K, Bird SB, Katayama Y, Maekawa K, Uemura S, Tanno K, et al. Outcome from severe accidental hypothermia with cardiac arrest resuscitated with extracorporeal cardiopulmonary resuscitation. Am J Emerg Med. 2014;32(4):320–4.

    Article  Google Scholar 

  15. Hilmo J, Naesheim T, Gilbert M. “Nobody is dead until warm and dead”: prolonged resuscitation is warranted in arrested hypothermic victims also in remote areas--a retrospective study from northern Norway. Resuscitation. 2014;85(9):1204–11.

    Article  Google Scholar 

  16. Schober A, Sterz F, Handler C, Kürkciyan I, Laggner A, Röggla M, et al. Cardiac arrest due to accidental hypothermia--a 20 year review of a rare condition in an urban area. Resuscitation. 2014;85(6):749–56.

    Article  CAS  Google Scholar 

  17. Debaty G, Moustapha I, Bouzat P, Maignan M, Blancher M, Rallo A, et al. Outcome after severe accidental hypothermia in the French Alps: a 10-year review. Resuscitation. 2015;93:118–23.

    Article  Google Scholar 

  18. Svendsen Ø, Grong K, Andersen KS, Husby P. Outcome after rewarming from accidental hypothermia by use of extracorporeal circulation. Ann Thorac Surg. 2017;103(3):920–5.

    Article  Google Scholar 

  19. Wiberg S, Kjaergaard J, Kjærgaard B, Møller B, Nørnberg B, Sørensen AM, et al. The biomarkers neuron-specific enolase and S100b measured the day following admission for severe accidental hypothermia have high predictive values for poor outcome. Resuscitation. 2017;121:49–53.

    Article  Google Scholar 

  20. Kosiński S, Darocha T, Jarosz A, Zeliaś A, Ziętkiewicz M, Podsiadło P, et al. Clinical course and prognostic factors of patients in severe accidental hypothermia with circulatory instability rewarmed with veno-arterial ECMO - an observational case series study. Scand J Trauma Resusc Emerg Med. 2017;25(1):46.

    Article  Google Scholar 

  21. Okada Y, Matsuyama T, Morita S, Ehara N, Miyamae N, Jo T, et al. The development and validation of a “5A” severity scale for predicting in-hospital mortality after accidental hypothermia from J-point registry data. J Intensive Care. 2019;7:27.

    Article  Google Scholar 

  22. Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for Sepsis and septic shock (Sepsis-3). JAMA. 2016;315(8):801–10.

    Article  CAS  Google Scholar 

  23. Seymour CW, Liu VX, Iwashyna TJ, Brunkhorst FM, Rea TD, Scherag A, et al. Assessment of clinical criteria for Sepsis: for the third international consensus definitions for Sepsis and septic shock (Sepsis-3). JAMA. 2016;315(8):762–74.

    Article  CAS  Google Scholar 

  24. Raith EP, Udy AA, Bailey M, McGloughlin S, MacIsaac C, Bellomo R, et al. Prognostic accuracy of the SOFA score, SIRS criteria, and qSOFA score for in-hospital mortality among adults with suspected infection admitted to the intensive care unit. JAMA. 2017;317(3):290–300.

    Article  Google Scholar 

  25. Moons KG, Royston P, Vergouwe Y, Grobbee DE, Altman DG. Prognosis and prognostic research: what, why, and how? BMJ. 2009;338:b375.

    Article  Google Scholar 

Download references

Acknowledgements

We really appreciate all members of the J-Point registry group for their contributions.

Funding

None.

Author information

Authors and Affiliations

Authors

Contributions

TM is a principal investigator of the J-point registry. KK and YO contributed to the conception and design of this analysis. KK wrote the manuscript. RI and TK supervised the conduct of the trial and data collection. YO, TM, SM, NE, NM, TJ, YS, NO, MW, MN, AT, FY, and YO undertook recruitment of participating centers and patients and managed the data, including quality control. TK provided statistical advice on study design and analyzed the data. KK and YO drafted the manuscript, and all authors contributed substantially to its revision. KK and YO takes responsibility for the paper as a whole. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Yohei Okada.

Ethics declarations

Ethics approval and consent to participate

The ethics committee of each center approved the registry protocol and retrospective analysis of the de-identified data.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kandori, K., Okada, Y., Matsuyama, T. et al. Prognostic ability of the sequential organ failure assessment score in accidental hypothermia: a multi-institutional retrospective cohort study. Scand J Trauma Resusc Emerg Med 27, 103 (2019). https://0-doi-org.brum.beds.ac.uk/10.1186/s13049-019-0681-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s13049-019-0681-8

Keywords