Computed tomography has gained an important role in the early diagnosis of COVID-19 pneumonia. However, the ever-increasing number of patients has overwhelmed radiology departments and has caused a reduction in quality of services. Artificial intelligence (AI) systems are the remedy to the current situation. However, the lack of application in real-world conditions has limited their consideration in clinical settings. This study validated a clinical AI system, COVIDiag, to aid radiologists in accurate and rapid evaluation of COVID-19 cases. 50 COVID-19 and 50 non-COVID-19 pneumonia cases were included from each of five centers: Argentina, Turkey, Iran, Netherlands, and Italy. The Dutch database included only 50 COVID-19 cases. The performance parameters namely sensitivity, specificity, accuracy, and area under the ROC curve (AUC) were computed for each database using COVIDiag model. The most common pattern of involvement among COVID-19 cases in all databases were bilateral involvement of upper and lower lobes with ground-glass opacities. The best sensitivity of 92.0% was recorded for the Italian database. The system achieved an AUC of 0.983, 0.914, 0.910, and 0.882 for Argentina, Turkey, Iran, and Italy, respectively. The model obtained a sensitivity of 86.0% for the Dutch database. COVIDiag model could diagnose COVID-19 pneumonia in all of cohorts with AUC of 0.921 (sensitivity, specificity, and accuracy of 88.8%, 87.0%, and 88.0%, respectively). Our study confirmed the accuracy of our proposed AI model (COVIDiag) in the diagnosis of COVID-19 cases. Furthermore, the system demonstrated consistent optimal diagnostic performance on multinational databases, which is critical to determine the generalizability and objectivity of the proposed COVIDiag model. Our results are significant as they provide real-world evidence regarding the applicability of AI systems in clinical medicine.

A practical artificial intelligence system to diagnose COVID-19 using computed tomography: A multinational external validation study / Ardakani, A. A.; Kwee, R. M.; Mirza-Aghazadeh-Attari, M.; Castro, H. M.; Kuzan, T. Y.; Altintoprak, K. M.; Besutti, G.; Monelli, F.; Faeghi, F.; Acharya, U. R.; Mohammadi, A.. - In: PATTERN RECOGNITION LETTERS. - ISSN 0167-8655. - 152:(2021), pp. 42-49. [10.1016/j.patrec.2021.09.012]

A practical artificial intelligence system to diagnose COVID-19 using computed tomography: A multinational external validation study

Besutti G.;Monelli F.;
2021

Abstract

Computed tomography has gained an important role in the early diagnosis of COVID-19 pneumonia. However, the ever-increasing number of patients has overwhelmed radiology departments and has caused a reduction in quality of services. Artificial intelligence (AI) systems are the remedy to the current situation. However, the lack of application in real-world conditions has limited their consideration in clinical settings. This study validated a clinical AI system, COVIDiag, to aid radiologists in accurate and rapid evaluation of COVID-19 cases. 50 COVID-19 and 50 non-COVID-19 pneumonia cases were included from each of five centers: Argentina, Turkey, Iran, Netherlands, and Italy. The Dutch database included only 50 COVID-19 cases. The performance parameters namely sensitivity, specificity, accuracy, and area under the ROC curve (AUC) were computed for each database using COVIDiag model. The most common pattern of involvement among COVID-19 cases in all databases were bilateral involvement of upper and lower lobes with ground-glass opacities. The best sensitivity of 92.0% was recorded for the Italian database. The system achieved an AUC of 0.983, 0.914, 0.910, and 0.882 for Argentina, Turkey, Iran, and Italy, respectively. The model obtained a sensitivity of 86.0% for the Dutch database. COVIDiag model could diagnose COVID-19 pneumonia in all of cohorts with AUC of 0.921 (sensitivity, specificity, and accuracy of 88.8%, 87.0%, and 88.0%, respectively). Our study confirmed the accuracy of our proposed AI model (COVIDiag) in the diagnosis of COVID-19 cases. Furthermore, the system demonstrated consistent optimal diagnostic performance on multinational databases, which is critical to determine the generalizability and objectivity of the proposed COVIDiag model. Our results are significant as they provide real-world evidence regarding the applicability of AI systems in clinical medicine.
2021
152
42
49
A practical artificial intelligence system to diagnose COVID-19 using computed tomography: A multinational external validation study / Ardakani, A. A.; Kwee, R. M.; Mirza-Aghazadeh-Attari, M.; Castro, H. M.; Kuzan, T. Y.; Altintoprak, K. M.; Besutti, G.; Monelli, F.; Faeghi, F.; Acharya, U. R.; Mohammadi, A.. - In: PATTERN RECOGNITION LETTERS. - ISSN 0167-8655. - 152:(2021), pp. 42-49. [10.1016/j.patrec.2021.09.012]
Ardakani, A. A.; Kwee, R. M.; Mirza-Aghazadeh-Attari, M.; Castro, H. M.; Kuzan, T. Y.; Altintoprak, K. M.; Besutti, G.; Monelli, F.; Faeghi, F.; Acharya, U. R.; Mohammadi, A.
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1271419
Citazioni
  • ???jsp.display-item.citation.pmc??? 5
  • Scopus 8
  • ???jsp.display-item.citation.isi??? 8
social impact