Validation of a Deep Learning-Based Automated Detection Algorithm for Mobile Chest Radiographs of Patients with SARSCoV- 2 Infection in a Field Hospital

Authors

  • Warit Tarathipmon Department of Radiology, Faculty of Medicine, Thammasat University, Pathum Thani 12120, Thailand
  • Amolchaya Kwankua Department of Radiology, Faculty of Medicine, Thammasat University, Pathum Thani 12120, Thailand
  • Utairat Chaumrattanakul Department of Radiology, Faculty of Medicine, Thammasat University, Pathum Thani 12120, Thailand
  • Pisit Wattanaruangkowit Department of Radiology, Faculty of Medicine, Thammasat University, Pathum Thani 12120, Thailand

Keywords:

Chest radiographs, COVID-19 pneumonia, Deep learning-based automatic detection (DLAD) algorithm, SARS-CoV2 infection

Abstract

Due to the rapid spread of SARS-CoV2 infection, many hospitals had an influx patients along with more chest radiographs requiring interpretation. The deep learning- based automatic detection ( DLAD) algorithm was applied to help physicians and radiologists in reading this overwhelming number of chest radiographs. The aim of this study was to validate the diagnostic performance in COVID- 19 pneumonia detection of the DLAD for mobile chest radiographs in patients with SARS- CoV- 2 infection. Chest radiographs of patients with RT-PCR confirmed SARS-CoV- 2 infection were included. The diagnostic performance of DLAD in the detection of COVID- 19 pneumonia with mobile chest radiographs was evaluated in comparison to the prior interpretation by the radiologist. The sensitivity and specificity of DLAD in identification of pneumonia were 27.6% (95%CI 22.3%-33.4%) and 99.8% (95%CI 98.6%-100%) respectively. PPV and NPV were 98.7% (95%CI 92.8%-100%) and 67.4% (95%CI 63.5%-71.2%) respectively, with an AUC of 0.64 (95%CI 0.61-0.66). The duration from the onset of symptoms to the time of chest radiography was a significant predictor of pneumonia (P=0.013) whereas sex, age, BMI, and symptoms were not. DLAD is a tool with excellent specificity and PPV for COVID-19 pneumonia detection but has low sensitivity and AUC.

References

Speets AM, van der Graaf Y, Hoes AW, Kalmijn S, Sachs AP, Rutten MJ, Gratama JW, Montauban van Swijndregt AD, Mali WP. Chest radiography in general practice: indications, diagnostic yield and consequences for patient management. Br J Gen Pract, 2006;56:574-8.

Geoffrey DR, Christopher JR, Linda BH, Nicola S, Jeffrey PK, Suhail R, Neil WS, Annalisa V, Jae-Joon Y, Ian BK, Martin, Deverick JA, Christina K, Talissa A, Andrew B, Sujal RD, onathan G, Jin MG, Marc H, Yoshikazu I, Hans-Ulrich K, Fengming L, Peter JM, Mathias P, Martine RJ, Luca R, Cornelia MS-P, Noriyuki T, Athol UW, Ann NL. The Role of Chest Imaging in Patient Management during the COVID-19 Pandemic: A Multinational Consensus Statement from the Fleischner Society. Radiology, 2020;296:172-80.

Eui JH, Sunggyun P, Kwang-Nam J, Jung IK, So YC, Jong Hyuk L, Jin MG, Jaehong A, Jae-Joon Y, Julien GC, Gilbert RF, Chang MP. Development and Validation of a Deep Learning–Based Automated Detection Algorithm for Major Thoracic Diseases on Chest Radiographs. JAMA Netw Open, 2019;2(3):e191095.

Hwang EJ, Kim H, Yoon SH, Goo JM, Park CM. Implementation of a Deep Learning- Based Computer-Aided Detection System for the Interpretation of Chest Radiographs in Patients Suspected for COVID-19. Korean J Radiol, 2020;21:1150-60.

Inui S, Fujikawa A, Jitsu M, Kunishima N, Watanabe S, Suzuki Y, Umeda S, Uwabe Y. Chest CT Findings in Cases from the Cruise Ship Diamond Princess with Coronavirus Disease (COVID-19). Radiol Cardiothorac Imaging, 2020;17;2(2):e200110.

Jang SB, Lee SH, Lee DE, Park SY, Kim JK, Cho JW, Cho J, Kim KB, Park B, Park J, Lim JK. Deep-learning algorithms for the interpretation of chest radiographs to aid in the triage of COVID-19 patients: A multicenter retrospective study. PLOS ONE, 2020;15(11):e0242759.

Wang L, Zhang Y, Wang D, Tong X, Liu T, Zhang S, Huang J, Zhang L, Chen L, Fan H, Clarke M. Artificial Intelligence for COVID-19: A Systematic Review. Front Med (Lausanne), 2021;30;8:704256.

Lee HW, Yoon SY, Lee JK, Park TY, Kim DK, Chung HS, Heo EY. Clinical implication and risk factor of pneumonia development in mild coronavirus disease 2019 patients. Korean J Intern Med, 2021;36:1-10.

Downloads

Published

2023-12-27

How to Cite

Tarathipmon, W., Amolchaya Kwankua, Utairat Chaumrattanakul, & Pisit Wattanaruangkowit. (2023). Validation of a Deep Learning-Based Automated Detection Algorithm for Mobile Chest Radiographs of Patients with SARSCoV- 2 Infection in a Field Hospital. Science & Technology Asia, 28(4), 305–313. Retrieved from https://ph02.tci-thaijo.org/index.php/SciTechAsia/article/view/249712

Issue

Section

Biological sciences