ABSTRACT
Background@#Inactive or old, healed tuberculosis (TB) on chest radiograph (CR) is often found in high TB incidence countries, and to avoid unnecessary evaluation and medication, differentiation from active TB is important. This study develops a deep learning (DL) model to estimate activity in a single chest radiographic analysis. @*Methods@#A total of 3,824 active TB CRs from 511 individuals and 2,277 inactive TB CRs from 558 individuals were retrospectively collected. A pretrained convolutional neural network was fine-tuned to classify active and inactive TB. The model was pretrained with 8,964 pneumonia and 8,525 normal cases from the National Institute of Health (NIH) dataset. During the pretraining phase, the DL model learns the following tasks: pneumonia vs. normal, pneumonia vs. active TB, and active TB vs. normal. The performance of the DL model was validated using three external datasets. Receiver operating characteristic analyses were performed to evaluate the diagnostic performance to determine active TB by DL model and radiologists. Sensitivities and specificities for determining active TB were evaluated for both the DL model and radiologists. @*Results@#The performance of the DL model showed area under the curve (AUC) values of 0.980 in internal validation, and 0.815 and 0.887 in external validation. The AUC values for the DL model, thoracic radiologist, and general radiologist, evaluated using one of the external validation datasets, were 0.815, 0.871, and 0.811, respectively. @*Conclusion@#This DL-based algorithm showed potential as an effective diagnostic tool to identify TB activity, and could be useful for the follow-up of patients with inactive TB in high TB burden countries.
ABSTRACT
Purpose@#This study aimed to investigate whether a deep learning model for automated detection of unruptured intracranial aneurysms on time-of-flight (TOF) magnetic resonance angiography (MRA) can achieve a target diagnostic performance comparable to that of human radiologists for approval from the Korean Ministry of Food and Drug Safety as an artificial intelligence-applied software. @*Materials and Methods@#In this single-center, retrospective, confirmatory clinical trial, the diagnostic performance of the model was evaluated in a predetermined test set. After sample size estimation, the test set consisted of 135 aneurysm-containing examinations with 168 intracranial aneurysms and 197 aneurysm-free examinations. The target sensitivity and specificity were set as 87% and 92%, respectively. The patient-wise sensitivity and specificity of the model were analyzed. Moreover, the lesion-wise sensitivity and false-positive detection rate per case were also investigated. @*Results@#The sensitivity and specificity of the model were 91.11% [95% confidence interval (CI): 84.99, 95.32] and 93.91% (95% CI:89.60, 96.81), respectively, which met the target performance values. The lesion-wise sensitivity was 92.26%. The overall falsepositive detection rate per case was 0.123. Of the 168 aneurysms, 13 aneurysms from 12 examinations were missed by the model. @*Conclusion@#The present deep learning model for automated detection of unruptured intracranial aneurysms on TOF MRA achieved the target diagnostic performance comparable to that of human radiologists. With high standalone performance, this model may be useful for accurate and efficient diagnosis of intracranial aneurysm.
ABSTRACT
Purpose@#This study aimed to investigate whether a deep learning model for automated detection of unruptured intracranial aneurysms on time-of-flight (TOF) magnetic resonance angiography (MRA) can achieve a target diagnostic performance comparable to that of human radiologists for approval from the Korean Ministry of Food and Drug Safety as an artificial intelligence-applied software. @*Materials and Methods@#In this single-center, retrospective, confirmatory clinical trial, the diagnostic performance of the model was evaluated in a predetermined test set. After sample size estimation, the test set consisted of 135 aneurysm-containing examinations with 168 intracranial aneurysms and 197 aneurysm-free examinations. The target sensitivity and specificity were set as 87% and 92%, respectively. The patient-wise sensitivity and specificity of the model were analyzed. Moreover, the lesion-wise sensitivity and false-positive detection rate per case were also investigated. @*Results@#The sensitivity and specificity of the model were 91.11% [95% confidence interval (CI): 84.99, 95.32] and 93.91% (95% CI:89.60, 96.81), respectively, which met the target performance values. The lesion-wise sensitivity was 92.26%. The overall falsepositive detection rate per case was 0.123. Of the 168 aneurysms, 13 aneurysms from 12 examinations were missed by the model. @*Conclusion@#The present deep learning model for automated detection of unruptured intracranial aneurysms on TOF MRA achieved the target diagnostic performance comparable to that of human radiologists. With high standalone performance, this model may be useful for accurate and efficient diagnosis of intracranial aneurysm.
ABSTRACT
Due to rapid developments in the deep learning model, artificial intelligence (AI) models are expected to enhance clinical diagnostic ability and work efficiency by assisting physicians. Therefore, many hospitals and private companies are competing to develop AI-based automatic diagnostic systems using medical images. In the near future, many deep learning-based automatic diagnostic systems would be used clinically. However, the possibility of adversarial attacks exploiting certain vulnerabilities of the deep learning algorithm is a major obstacle to deploying deep learning-based systems in clinical practice. In this paper, we will examine in detail the kinds of principles and methods of adversarial attacks that can be made to deep learning models dealing with medical images, the problems that can arise, and the preventive measures that can be taken against them.