ABSTRACT
RATIONALE AND OBJECTIVES: We present a machine learning and computer vision approach for a localized, automated, and standardized scoring of Crohn's disease (CD) severity in the small bowel, overcoming the current limitations of manual measurements CT enterography (CTE) imaging and qualitative assessments, while also considering the complex anatomy and distribution of the disease. MATERIALS AND METHODS: Two radiologists introduced a severity score and evaluated disease severity at 7.5 mm intervals along the curved planar reconstruction of the distal and terminal ileum using 236 CTE scans. A hybrid model, combining deep-learning, 3-D CNN, and Random Forest model, was developed to classify disease severity at each mini-segment. Precision, sensitivity, weighted Cohen's score, and accuracy were evaluated on a 20% hold-out test set. RESULTS: The hybrid model achieved precision and sensitivity ranging from 42.4% to 84.1% for various severity categories (normal, mild, moderate, and severe) on the test set. The model's Cohen's score (κ = 0.83) and accuracy (70.7%) were comparable to the inter-observer agreement between experienced radiologists (κ = 0.87, accuracy = 76.3%). The model accurately predicted disease length, correlated with radiologist-reported disease length (r = 0.83), and accurately identified the portion of total ileum containing moderate-to-severe disease with an accuracy of 91.51%. CONCLUSION: The proposed automated hybrid model offers a standardized, reproducible, and quantitative local assessment of small bowel CD severity and demonstrates its value in CD severity assessment.
ABSTRACT
Body composition measures derived from already available electronic medical records (computed tomography [CT] scans) can have significant value, but automation of measurements is needed for clinical implementation. We sought to use artificial intelligence to develop an automated method to measure body composition and test the algorithm on a clinical cohort to predict mortality. We constructed a deep learning algorithm using Google's DeepLabv3+ on a cohort of de-identified CT scans (n = 12,067). To test for the accuracy and clinical usefulness of the algorithm, we used a unique cohort of prospectively followed patients with cirrhosis (n = 238) who had CT scans performed. To assess model performance, we used the confusion matrix and calculated the mean accuracy of 0.977 ± 0.02 (0.975 ± 0.018 for the training and test sets, respectively). To assess for spatial overlap, we measured the mean intersection over union and mean boundary contour scores and found excellent overlap between the manual and automated methods with mean scores of 0.954 ± 0.030, 0.987 ± 0.009, and 0.948 ± 0.039 (0.983 ± 0.013 for the training and test set, respectively). Using these automated measurements, we found that body composition features were predictive of mortality in patients with cirrhosis. On multivariate analysis, the addition of body composition measures significantly improved prediction of mortality for patients with cirrhosis over Model for End-Stage Liver Disease alone (P < 0.001). Conclusion: The measurement of body composition can be automated using artificial intelligence and add significant value for incidental CTs performed for other clinical indications. This is proof of concept that this methodology could allow for wider implementation into the clinical arena.
