Development and validation of a multimodal model in predicting severe acute pancreatitis based on radiomics and deep learning.

OBJECTIVE: Aim to establish a multimodal model for predicting severe acute pancreatitis (SAP) using machine learning (ML) and deep learning (DL). METHODS: In this multicentre retrospective study, patients diagnosed with acute pancreatitis at admission were enrolled from January 2017 to December 2021. Clinical information within 24 h and CT scans within 72 h of admission were collected. First, we trained Model α based on clinical features selected by least absolute shrinkage and selection operator analysis. Second, radiomics features were extracted from 3D-CT scans and Model ß was developed on the features after dimensionality reduction using principal component analysis. Third, Model γ was trained on 2D-CT images. Lastly, a multimodal model, namely PrismSAP, was constructed based on aforementioned features in the training set. The predictive accuracy of PrismSAP was verified in the validation and internal test sets and further validated in the external test set. Model performance was evaluated using area under the curve (AUC), accuracy, sensitivity, specificity, recall, precision and F1-score. RESULTS: A total of 1,221 eligible patients were randomly split into a training set (n = 864), a validation set (n = 209) and an internal test set (n = 148). Data of 266 patients were for external testing. In the external test set, PrismSAP performed best with the highest AUC of 0.916 (0.873-0.960) among all models [Model α: 0.709 (0.618-0.800); Model ß: 0.749 (0.675-0.824); Model γ: 0.687 (0.592-0.782); MCTSI: 0.778 (0.698-0.857); RANSON: 0.642 (0.559-0.725); BISAP: 0.751 (0.668-0.833); SABP: 0.710 (0.621-0.798)]. CONCLUSION: The proposed multimodal model outperformed any single-modality models and traditional scoring systems.

Purification of Circulating Tumor Cells Based on Multiantibody-Modified Magnetic Nanoparticles and Molecular Analysis toward Epithelial Ovarian Cancer Detection.

Circulating tumor cells (CTCs) are valuable circulating biomarkers of cancer, which carry primary tumor information and may provide real-time assessment of tumor status as well as treatment response in cancer patients. Herein, we developed a novel assay for accurate diagnosis and dynamic monitoring of epithelial ovarian cancer (EOC) using CTC RNA analysis. Multiantibody-modified magnetic nanoparticles were prepared for purification of EOC CTCs from whole blood samples of clinical patients. Subsequently, nine EOC-specific mRNAs of purified CTCs were quantified using droplet digital PCR. The EOC CTC Score was generated using a multivariate logistic regression model for each sample based on the transcripts of the nine genes. This assay exhibited a distinguishing diagnostic performance for the detection of EOC (n = 17) from benign ovarian tumors (n = 30), with an area under the receiver operating characteristic curve (AUC) of 0.96 (95% CI = 0.91-1.00). Moreover, dynamic changes of the EOC CTC Score were observed in patients undergoing treatment, demonstrating the potential of the assay for monitoring EOC. In conclusion, we present an accurate assay for the diagnosis and monitoring of EOC via CTC RNA analysis, and the results suggest that it may provide a promising solution for the detection and treatment response assessment of EOC.

[Application of machine learning model based on XGBoost algorithm in early prediction of patients with acute severe pancreatitis].

OBJECTIVE: To establish a machine learning model based on extreme gradient boosting (XGBoost) algorithm for early prediction of severe acute pancreatitis (SAP), and explore its predictive efficiency. METHODS: A retrospective cohort study was conducted. The patients with acute pancreatitis (AP) who admitted to the First Affiliated Hospital of Soochow University, the Second Affiliated Hospital of Soochow University and Changshu Hospital Affiliated to Soochow University from January 1, 2020 to December 31, 2021 were enrolled. Demography information, etiology, past history, and clinical indicators and imaging data within 48 hours of admission were collected according to the medical record system and image system, and the modified CT severity index (MCTSI), Ranson score, bedside index for severity in acute pancreatitis (BISAP) and acute pancreatitis risk score (SABP) were calculated. The data sets of the First Affiliated Hospital of Soochow University and Changshu Hospital Affiliated to Soochow University were randomly divided into training set and validation set according to 8 : 2. Based on XGBoost algorithm, the SAP prediction model was constructed on the basis of hyperparameter adjustment by 5-fold cross validation and loss function. The data set of the Second Affiliated Hospital of Soochow University was served as independent test set. The predictive efficacy of the XGBoost model was evaluated by drawing the receiver operator characteristic curve (ROC curve), and compared it with the traditional AP related severity score; variable importance ranking diagram and Shapley additive explanation (SHAP) diagram were drawn to visually explain the model. RESULTS: A total of 1 183 AP patients were enrolled finally, of which 129 (10.9%) developed SAP. Among the patients from the First Affiliated Hospital of Soochow University and Changshu Hospital Affiliated to Soochow University, there were 786 patients in the training set and 197 in the validation set; 200 patients from the Second Affiliated Hospital of Soochow University were used as the test set. Analysis of all three datasets showed that patients who advanced to SAP exhibited pathological manifestation such as abnormal respiratory function, coagulation function, liver and kidney function, and lipid metabolism. Based on the XGBoost algorithm, an SAP prediction model was constructed, and ROC curve analysis showed that the accuracy for prediction of SAP reached 0.830, the area under the ROC curve (AUC) was 0.927, which was significantly improved compared with the traditional scoring systems including MCTSI, Ranson, BISAP and SABP, the accuracy was 0.610, 0.690, 0.763, 0.625, and the AUC was 0.689, 0.631, 0.875, and 0.770, respectively. The feature importance analysis based on the XGBoost model showed that the top ten items ranked by the importance of model features were admission pleural effusion (0.119), albumin (Alb, 0.049), triglycerides (TG, 0.036), Ca2+ (0.034), prothrombin time (PT, 0.031), systemic inflammatory response syndrome (SIRS, 0.031), C-reactive protein (CRP, 0.031), platelet count (PLT, 0.030), lactate dehydrogenase (LDH, 0.029), and alkaline phosphatase (ALP, 0.028). The above indicators were of great significance for the XGBoost model to predict SAP. The SHAP contribution analysis based on the XGBoost model showed that the risk of SAP increased significantly when patients had pleural effusion and decreased Alb. CONCLUSIONS: A SAP prediction scoring system was established based on the machine automatic learning XGBoost algorithm, which can predict the SAP risk of patients within 48 hours of admission with good accuracy.

Automated Machine Learning for the Early Prediction of the Severity of Acute Pancreatitis in Hospitals.

Background: Machine learning (ML) algorithms are widely applied in building models of medicine due to their powerful studying and generalizing ability. This study aims to explore different ML models for early identification of severe acute pancreatitis (SAP) among patients hospitalized for acute pancreatitis. Methods: This retrospective study enrolled patients with acute pancreatitis (AP) from multiple centers. Data from the First Affiliated Hospital and Changshu No. 1 Hospital of Soochow University were adopted for training and internal validation, and data from the Second Affiliated Hospital of Soochow University were adopted for external validation from January 2017 to December 2021. The diagnosis of AP and SAP was based on the 2012 revised Atlanta classification of acute pancreatitis. Models were built using traditional logistic regression (LR) and automated machine learning (AutoML) analysis with five types of algorithms. The performance of models was evaluated by the receiver operating characteristic (ROC) curve, the calibration curve, and the decision curve analysis (DCA) based on LR and feature importance, SHapley Additive exPlanation (SHAP) Plot, and Local Interpretable Model Agnostic Explanation (LIME) based on AutoML. Results: A total of 1,012 patients were included in this study to develop the AutoML models in the training/validation dataset. An independent dataset of 212 patients was used to test the models. The model developed by the gradient boost machine (GBM) outperformed other models with an area under the ROC curve (AUC) of 0.937 in the validation set and an AUC of 0.945 in the test set. Furthermore, the GBM model achieved the highest sensitivity value of 0.583 among these AutoML models. The model developed by eXtreme Gradient Boosting (XGBoost) achieved the highest specificity value of 0.980 and the highest accuracy of 0.958 in the test set. Conclusions: The AutoML model based on the GBM algorithm for early prediction of SAP showed evident clinical practicability.