RESUMO
Background: There are several models that predict the risk of recurrence following resection of localised, primary gastrointestinal stromal tumour (GIST). However, assessment of calibration is not always feasible and when performed, calibration of current GIST models appears to be suboptimal. We aimed to develop a prognostic model to predict the recurrence of GIST after surgery with both good discrimination and calibration by uncovering and harnessing the non-linear relationships among variables that predict recurrence. Methods: In this observational cohort study, the data of 395 adult patients who underwent complete resection (R0 or R1) of a localised, primary GIST in the pre-imatinib era at Memorial Sloan Kettering Cancer Center (NY, USA) (recruited 1982-2001) and a European consortium (Spanish Group for Research in Sarcomas, 80 sites) (recruited 1987-2011) were used to train an interpretable Artificial Intelligence (AI)-based model called Optimal Classification Trees (OCT). The OCT predicted the probability of recurrence after surgery by capturing non-linear relationships among predictors of recurrence. The data of an additional 596 patients from another European consortium (Polish Clinical GIST Registry, 7 sites) (recruited 1981-2013) who were also treated in the pre-imatinib era were used to externally validate the OCT predictions with regard to discrimination (Harrell's C-index and Brier score) and calibration (calibration curve, Brier score, and Hosmer-Lemeshow test). The calibration of the Memorial Sloan Kettering (MSK) GIST nomogram was used as a comparative gold standard. We also evaluated the clinical utility of the OCT and the MSK nomogram by performing a Decision Curve Analysis (DCA). Findings: The internal cohort included 395 patients (median [IQR] age, 63 [54-71] years; 214 men [54.2%]) and the external cohort included 556 patients (median [IQR] age, 60 [52-68] years; 308 men [55.4%]). The Harrell's C-index of the OCT in the external validation cohort was greater than that of the MSK nomogram (0.805 (95% CI: 0.803-0.808) vs 0.788 (95% CI: 0.786-0.791), respectively). In the external validation cohort, the slope and intercept of the calibration curve of the main OCT were 1.041 and 0.038, respectively. In comparison, the slope and intercept of the calibration curve for the MSK nomogram was 0.681 and 0.032, respectively. The MSK nomogram overestimated the recurrence risk throughout the entire calibration curve. Of note, the Brier score was lower for the OCT compared to the MSK nomogram (0.147 vs 0.564, respectively), and the Hosmer-Lemeshow test was insignificant (P = 0.087) for the OCT model but significant (P < 0.001) for the MSK nomogram. Both results confirmed the superior discrimination and calibration of the OCT over the MSK nomogram. A decision curve analysis showed that the AI-based OCT model allowed for superior decision making compared to the MSK nomogram for both patients with 25-50% recurrence risk as well as those with >50% risk of recurrence. Interpretation: We present the first prognostic models of recurrence risk in GIST that demonstrate excellent discrimination, calibration, and clinical utility on external validation. Additional studies for further validation are warranted. With further validation, these tools could potentially improve patient counseling and selection for adjuvant therapy. Funding: The NCI SPORE in Soft Tissue Sarcoma and NCI Cancer Center Support Grants.
RESUMO
Importance: In patients with resectable colorectal cancer liver metastases (CRLM), the choice of surgical technique and resection margin are the only variables that are under the surgeon's direct control and may influence oncologic outcomes. There is currently no consensus on the optimal margin width. Objective: To determine the optimal margin width in CRLM by using artificial intelligence-based techniques developed by the Massachusetts Institute of Technology and to assess whether optimal margin width should be individualized based on patient characteristics. Design, Setting, and Participants: The internal cohort of the study included patients who underwent curative-intent surgery for KRAS-variant CRLM between January 1, 2000, and December 31, 2017, at Johns Hopkins Hospital, Baltimore, Maryland, Memorial Sloan Kettering Cancer Center, New York, New York, and Charité-University of Berlin, Berlin, Germany. Patients from institutions in France, Norway, the US, Austria, Argentina, and Japan were retrospectively identified from institutional databases and formed the external cohort of the study. Data were analyzed from April 15, 2019, to November 11, 2021. Exposures: Hepatectomy. Main Outcomes and Measures: Patients with KRAS-variant CRLM who underwent surgery between 2000 and 2017 at 3 tertiary centers formed the internal cohort (training and testing). In the training cohort, an artificial intelligence-based technique called optimal policy trees (OPTs) was used by building on random forest (RF) predictive models to infer the margin width associated with the maximal decrease in death probability for a given patient (ie, optimal margin width). The RF component was validated by calculating its area under the curve (AUC) in the testing cohort, whereas the OPT component was validated by a game theory-based approach called Shapley additive explanations (SHAP). Patients from international institutions formed an external validation cohort, and a new RF model was trained to externally validate the OPT-based optimal margin values. Results: This cohort study included a total of 1843 patients (internal cohort, 965; external cohort, 878). The internal cohort included 386 patients (median [IQR] age, 58.3 [49.0-68.7] years; 200 men [51.8%]) with KRAS-variant tumors. The AUC of the RF counterfactual model was 0.76 in both the internal training and testing cohorts, which is the highest ever reported. The recommended optimal margin widths for patient subgroups A, B, C, and D were 6, 7, 12, and 7 mm, respectively. The SHAP analysis largely confirmed this by suggesting 6 to 7 mm for subgroup A, 7 mm for subgroup B, 7 to 8 mm for subgroup C, and 7 mm for subgroup D. The external cohort included 375 patients (median [IQR] age, 61.0 [53.0-70.0] years; 218 men [58.1%]) with KRAS-variant tumors. The new RF model had an AUC of 0.78, which allowed for a reliable external validation of the OPT-based optimal margin. The external validation was successful as it confirmed the association of the optimal margin width of 7 mm with a considerable prolongation of survival in the external cohort. Conclusions and Relevance: This cohort study used artificial intelligence-based methodologies to provide a possible resolution to the long-standing debate on optimal margin width in CRLM.
