Neuro-symbolic interpretable AI for automatic COVID-19 patient-stratification based on standardised lung ultrasound data

ABSTRACT

In the current pandemic, being able to efficiently stratify patients depending on their probability to develop a severe form of COVID-19 can improve the outcome of treatments and optimize the use of the available resources. To this end, recent studies proposed to use deep-networks to perform automatic stratification of COVID-19 patients based on lung ultrasound (LUS) data. In this work, we present a novel neuro-symbolic approach able to provide video-level predictions by aggregating results from frame-level analysis made by deep-networks. Specifically, a decision tree was trained, which provides direct access to the decision process and a high-level explainability. This approach was tested on 1808 LUS videos acquired from 100 patients diagnosed as COVID-19 positive by a RT-PCR swab test. Each video was scored by LUS experts according to a 4-level scoring system specifically developed for COVID-19. This information was utilised for both the training and testing of the algorithms. A five-folds cross-validation process was utilised to assess the performance of the presented approach and compare it with results achieved by deep-learning models alone. Results show that this novel approach achieves better performance (82% of mean prognostic agreement) than a threshold-based ensemble of deep-learning models (78% of mean prognostic agreement). © 2022 Acoustical Society of America.