2022, Volume 8, Issue 1
Engineering >> 2022, Volume 8, Issue 1 doi: 10.1016/j.eng.2020.10.013
Development and Validation of a Prognostic Risk Score System for COVID-19 Inpatients: A Multi-Center Retrospective Study in China
a School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China
b School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China
c Luxembourg Centre for Systems Biomedicine, University of Luxembourg, Belval, L-4367, Luxembourg
d Department of Plant Sciences, University of Cambridge, Cambridge CB2 1TN, UK
e Department of Emergency, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, China
f AMITA Health Saint Joseph Hospital Chicago, Chicago, IL 60657, USA
g Department of Anesthesiology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, China
h Huazhong University of Science and Technology-Wuxi Research Institute, Wuxi 214000, China
i Division of Cardiology, Department of Internal Medicine, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, China
j Institute of Health Informatics, University College London, London WC1E 6BT, UK
k Department of Biomedical Engineering, Southern University of Science and Technology, Shenzhen 518055, China
l Department of Infectious Diseases, Shenzhen Key Laboratory of Pathogenic Microbiology and Immunology, National Clinical Research Center for Infectious Disease, The Third People’s
Hospital of Shenzhen (Second Hospital Affiliated with the Southern University of Science and Technology), Shenzhen 518055, China
m Department of Electrical and Computer Engineering & Division of Systems Engineering & Department of Biomedical Engineering, Boston University, Boston, MA 02215, USA
Next Previous
Abstract
Coronavirus disease 2019 (COVID-19) has become a worldwide pandemic. Hospitalized patients of COVID-19 suffer from a high mortality rate, motivating the development of convenient and practical methods that allow clinicians to promptly identify high-risk patients. Here, we have developed a risk score using clinical data from 1479 inpatients admitted to Tongji Hospital, Wuhan, China (development cohort) and externally validated with data from two other centers: 141 inpatients from Jinyintan Hospital, Wuhan, China (validation cohort 1) and 432 inpatients from The Third People's Hospital of Shenzhen, Shenzhen, China (validation cohort 2). The risk score is based on three biomarkers that are readily available in routine blood samples and can easily be translated into a probability of death. The risk score can predict the mortality of individual patients more than 12 d in advance with more than 90% accuracy across all cohorts. Moreover, the Kaplan–Meier score shows that patients can be clearly differentiated upon admission as low, intermediate, or high risk, with an area under the curve (AUC) score of 0.9551. In summary, a simple risk score has been validated to predict death in patients infected with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2); it has also been validated in independent cohorts.
Keywords
SupplementaryMaterials
Figures
Fig. 1
Fig. 2
Fig. 3
Fig. 4
References
[ 1 ] Wang C, Horby PW, Hayden FG, Gao GF. A novel coronavirus outbreak of global health concern. Lancet 2020;395(10223):470–3. link1
[ 2 ] Ostuzzi G, Papola D, Gastaldon C, Schoretsanitis G, Bertolini F, Amaddeo F, et al. Safety of psychotropic medications in people with COVID-19: evidence review and practical recommendations. BMC Med 2020;18:215. link1
[ 3 ] WHO coronavirus disease (COVID-19) dashboard [Internet]. Geneva: World Health Organization; c2020 [cited 2020 Sep 2]. Available from: https://covid19.who.int/.
[ 4 ] Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet 2020;395 (10223):497–506. link1
[ 5 ] Guan W, Ni Z, Hu Y, Liang W, Ou C, He J, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med 2020;382:1708–20. link1
[ 6 ] Oxley TJ, Mocco J, Majidi S, Kellner CP, Shoirah H, Singh IP, et al. Large-vessel stroke as a presenting feature of COVID-19 in the young. N Engl J Med 2020;382:e60. link1
[ 7 ] Zhou F, Yu T, Du R, Fan G, Liu Y, Liu Z, et al. Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study. Lancet 2020;395(10229):1054–62. link1
[ 8 ] Richardson S, Hirsch JS, Narasimhan M, Crawford JM, McGinn T, Davidson KW, et al. Presenting characteristics, comorbidities, and outcomes among 5700 patients hospitalized with COVID-19 in the New York City area. JAMA 2020;323(20):2052–9. link1
[ 9 ] Grasselli G, Zangrillo A, Zanella A, Antonelli M, Cabrini L, Castelli A, et al. Baseline characteristics and outcomes of 1591 patients infected with SARSCoV-2 admitted to ICUs of the Lombardy Region Italy. JAMA 2020;323 (16):1574–81. link1
[10] Dunnmon JA, Yi D, Langlotz CP, Ré C, Rubin DL, Lungren MP. Assessment of convolutional neural networks for automated classification of chest radiographs. Radiology 2019;290(2):537–44. link1
[11] Esteva A, Robicquet A, Ramsundar B, Kuleshov V, DePristo M, Chou K, et al. A guide to deep learning in healthcare. Nat Med 2019;25:24–9. link1
[12] Zhu H, Cheng C, Yin H, Li X, Zuo P, Ding J, et al. Automatic multi-label ECG diagnosis of impulse or conduction abnormalities in patients with deep learning algorithm: a cohort study. Lancet Respir Med. In press.
[13] Ienca M, Vayena E. On the responsible use of digital data to tackle the COVID19 pandemic. Nat Med 2020;26:463–4. link1
[14] Apostolopoulos ID, Mpesiana TA. COVID-19: automatic detection from X-ray images utilizing transfer learning with convolutional neural networks. Australas Phys Eng Sci Med 2020;43:635–40. link1
[15] Santosh KC. AI-driven tools for coronavirus outbreak: need of active learning and cross-population train/test models on multitudinal/multimodal data. J Med Syst 2020;44:93. link1
[16] Ayyoubzadeh SM, Ayyoubzadeh SM, Zahedi H, Ahmadi M, Kalhori SRN. Predicting COVID-19 incidence through analysis of google trends data in Iran: data mining and deep learning pilot study. JMIR Public Health Surveill 2020;6 (2):e18828. link1
[17] Yang Z, Zeng Z, Wang K, Wong SS, Liang W, Zanin M, et al. Modified SEIR and AI prediction of the epidemics trend of COVID-19 in China under public health interventions. J Thorac Dis 2020;12(3):165. link1
[18] Liu F, Zhang Q, Huang C, Shi C, Wang L, Shi N, et al. CT quantification of pneumonia lesions in early days predicts progression to severe illness in a cohort of COVID-19 patients. Theranostics 2020;10(12):5613–22. link1
[19] Yan L, Zhang HT, Goncalves J, Xiao Y, Wang M, Guo Y, et al. An interpretable mortality prediction model for COVID-19 patients. Nat Mach Intell 2020;2:283–8. link1
[20] Cai Q, Yang M, Liu D, Chen J, Shu D, Xia J, et al. Experimental treatment with favipiravir for COVID-19: an open-label control study. Engineering 2020;6 (10):1192–8. link1
[21] Wu C, Chen X, Cai Y, Xia J, Zhou X, Xu S, et al. Risk factors associated with acute respiratory distress syndrome and death in patients with coronavirus disease 2019 pneumonia in Wuhan, China. JAMA Intern Med 2020;180(7):934–43. link1
[22] Shi S, Qin M, Shen B, Cai Y, Liu T, Yang F, et al. Association of cardiac injury with mortality in hospitalized patients with COVID-19 in Wuhan, China. JAMA Cardiol 2020;5(7):802–10. link1
[23] Wu Z, McGoogan JM. Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19): summary of a report of 72 314 cases from the Chinese Center for Disease Control and Prevention. JAMA 2020;323 (13):1239–42. link1
[24] Onder G, Rezza G, Brusaferro S. Case-fatality rate and characteristics of patients dying in relation to COVID-19 in Italy. JAMA 2020;323 (18):1775–6. link1
[25] CDC COVID-19 Response Team. Severe outcomes among patients with coronavirus disease 2019 (COVID-19)—United States, February 12–March 16, 2020. MMWR Morb Mortal Wkly Rep 2020;69:343–6.
[26] Xie J, Shi D, Bao M, Hu X, Wu W, Sheng J, et al. A predictive nomogram for predicting improved clinical outcome probability in patients with COVID-19 in Zhejiang Province, China. Engineering. In press.
[27] National Health Commission of the People’s Republic of China, National Administration of Traditional Chinese Medicine. Diagnosis and treatment protocol for novel coronavirus pneumonia (trial version 7). Chin Med J 2020;133(9):1087–95.
[28] Ruan Q, Yang K, Wang W, Jiang L, Song J. Clinical predictors of mortality due to COVID-19 based on an analysis of data of 150 patients from Wuhan, China. Intensive Care Med 2020;46(5):846–8. link1
[29] Mo P, Xing Y, Xiao Y, Deng L, Zhao Q, Wang H, et al. Clinical characteristics of refractory COVID-19 pneumonia in Wuhan, China. Clin Infect Dis. In press.
[30] Livesey A, Garty F, Shipman A, Shipman K. Lactate dehydrogenase in dermatology practice. Clin Exp Dermatol 2020;45(5):539–43. link1
[31] Lambert J, Chevret S. Summary measure of discrimination in survival models based on cumulative/dynamic time-dependent ROC curves. Stat Methods Med Res 2016;25(5):2088–102. link1
[32] Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA 2016;315(8):801–10. link1
[33] Chen Y, Wang J, Guo S. Use of CRB-65 and quick sepsis-related organ failure assessment to predict site of care and mortality in pneumonia patients in the emergency department: a retrospective study. Crit Care 2016;20:167. link1
[34] Ranzani OT, Prina E, Menéndez R, Ceccato A, Cilloniz C, Mendez R, et al. New sepsis definition (Sepsis-3) and community-acquired pneumonia mortality. A validation and clinical decision-making study. Am J Respir Crit Care Med 2017;196(10):1287–97. link1
[35] Ferreira M, Blin T, Collercandy N, Szychowiak P, Dequin PF, Jouan Y, et al. Critically ill SARS-CoV-2-infected patients are not stratified as sepsis by the qSOFA. Ann Intensive Care 2020;10(1):43. link1
[36] Santana A, Amorim F, Soares F, de Souza GL, de Jesus AL, Rodrigues T, et al. Comparison of CURB-65 and CRB-65 as predictors of death in communityacquired pneumonia in adults admitted to an ICU. Crit Care 2013;17:39. link1
[37] Myers LC, Parodi SM, Escobar GJ, Liu VX. Characteristics of hospitalized adults with COVID-19 in an integrated health care system in California. JAMA 2020;323(21):2195–8. link1
[38] Wang D, Hu B, Hu C, Zhu F, Liu X, Zhang J, et al. Clinical characteristics of 138 hospitalized patients with 2019 novel coronavirus-infected pneumonia in Wuhan, China. JAMA 2020;323(11):1061–9. link1
[39] Xu Z, Shi L, Wang Y, Zhang J, Huang L, Zhang C, et al. Pathological findings of COVID-19 associated with acute respiratory distress syndrome. Lancet Respir Med 2020;8(4):420–2. link1
[40] Yang X, Yu Y, Xu J, Shu H, Liu H, Wu Y, et al. Clinical course and outcomes of critically ill patients with SARS-CoV-2 pneumonia in Wuhan, China: a singlecentered, retrospective, observational study. Lancet Respir Med 2020;8 (5):475–81. link1
[41] Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. Circulation 2015;131:211–9. link1
京公网安备 11010502051620号
