Region-specific deep learning models for accurate segmentation of rectal structures on post-chemoradiation T2w MRI: a multi-institutional, multi-reader study.

Introduction: For locally advanced rectal cancers, in vivo radiological evaluation of tumor extent and regression after neoadjuvant therapy involves implicit visual identification of rectal structures on magnetic resonance imaging (MRI). Additionally, newer image-based, computational approaches (e.g., radiomics) require more detailed and precise annotations of regions such as the outer rectal wall, lumen, and perirectal fat. Manual annotations of these regions, however, are highly laborious and time-consuming as well as subject to inter-reader variability due to tissue boundaries being obscured by treatment-related changes (e.g., fibrosis, edema). Methods: This study presents the application of U-Net deep learning models that have been uniquely developed with region-specific context to automatically segment each of the outer rectal wall, lumen, and perirectal fat regions on post-treatment, T2-weighted MRI scans. Results: In multi-institutional evaluation, region-specific U-Nets (wall Dice = 0.920, lumen Dice = 0.895) were found to perform comparably to multiple readers (wall inter-reader Dice = 0.946, lumen inter-reader Dice = 0.873). Additionally, when compared to a multi-class U-Net, region-specific U-Nets yielded an average 20% improvement in Dice scores for segmenting each of the wall, lumen, and fat; even when tested on T2-weighted MRI scans that exhibited poorer image quality, or from a different plane, or were accrued from an external institution. Discussion: Developing deep learning segmentation models with region-specific context may thus enable highly accurate, detailed annotations for multiple rectal structures on post-chemoradiation T2-weighted MRI scans, which is critical for improving evaluation of tumor extent in vivo and building accurate image-based analytic tools for rectal cancers.

RADIomic Spatial TexturAl Descriptor (RADISTAT): Quantifying Spatial Organization of Imaging Heterogeneity Associated With Tumor Response to Treatment.

Localized disease heterogeneity on imaging extracted via radiomics approaches have recently been associated with disease prognosis and treatment response. Traditionally, radiomics analyses leverage texture operators to derive voxel- or region-wise feature values towards quantifying subtle variations in image appearance within a region-of-interest (ROI). With the goal of mining additional voxel-wise texture patterns from radiomic "expression maps", we introduce a new RADIomic Spatial TexturAl descripTor (RADISTAT). This was driven by the hypothesis that quantifying spatial organization of texture patterns within an ROI could allow for better capturing interactions between different tissue classes present in a given region; thus enabling more accurate characterization of disease or response phenotypes. RADISTAT involves: (a) robustly identifying sub-compartments of low, intermediate, and high radiomic expression (i.e. heterogeneity) in a feature map and (b) quantifying spatial organization of sub-compartments via graph interactions. RADISTAT was evaluated in two clinically challenging problems: (1) discriminating nodal/distant metastasis from metastasis-free rectal cancer patients on post-chemoradiation T2w MRI, and (2) distinguishing tumor progression from pseudo-progression in glioblastoma multiforme using post-chemoradiation T1w MRI. Across over 800 experiments, RADISTAT yielded a consistent discriminatory signature for tumor progression (GBM) and disease metastasis (RCa); where its sub-compartments were associated with pathologic tissue types (fibrosis or tumor, determined via fusion of MRI and pathology). In a multi-institutional setting for both clinical problems, RADISTAT resulted in higher classifier performance (11% improvement in AUC, on average) compared to radiomic descriptors. Furthermore, combining RADISTAT with radiomic descriptors resulted in significantly improved performance compared to using radiomic descriptors alone.

Technical Note: MRQy - An open-source tool for quality control of MR imaging data.

PURPOSE: There is an increasing availability of large imaging cohorts [such as through The Cancer Imaging Archive (TCIA)] for computational model development and imaging research. To ensure development of generalizable computerized models, there is a need to quickly determine relative quality differences in these cohorts, especially when considering MRI datasets which can exhibit wide variations in image appearance. The purpose of this study is to present a quantitative quality control tool, MRQy, to help interrogate MR imaging datasets for: (a) site- or scanner-specific variations in image resolution or image contrast, and (b) imaging artifacts such as noise or inhomogeneity; which need correction prior to model development. METHODS: Unlike existing imaging quality control tools, MRQy has been generalized to work with images from any body region to efficiently extract a series of quality measures (e.g., noise ratios, variation metrics) and MR image metadata (e.g., voxel resolution and image dimensions). MRQy also offers a specialized HTML5-based front-end designed for real-time filtering and trend visualization of quality measures. RESULTS: MRQy was used to evaluate (a) n = 133 brain MRIs from TCIA (7 sites) and (b) n = 104 rectal MRIs (3 local sites). MRQy measures revealed significant site-specific variations in both cohorts, indicating potential batch effects. Before processing, MRQy measures could be used to identify each of the seven sites within the TCIA cohort with 87.5%, 86.4%, 90%, 93%, 90%, 60%, and 92.9% accuracy and the three sites within the rectal cohort with 91%, 82.8%, and 88.9% accuracy using unsupervised clustering. After processing, none of the sites could be distinctively clustered via MRQy measures in either cohort; suggesting that batch effects had been largely accounted for. Marked differences in specific MRQy measures were also able to identify outlier MRI datasets that needed to be corrected for common acquisition artifacts. CONCLUSIONS: MRQy is designed to be a standalone, unsupervised tool that can be efficiently run on a standard desktop computer. It has been made freely accessible and open-source at http://github.com/ccipd/MRQy for community use and feedback.

Radiomic Texture and Shape Descriptors of the Rectal Environment on Post-Chemoradiation T2-Weighted MRI are Associated with Pathologic Tumor Stage Regression in Rectal Cancers: A Retrospective, Multi-Institution Study.

(1) Background: The relatively poor expert restaging accuracy of MRI in rectal cancer after neoadjuvant chemoradiation may be due to the difficulties in visual assessment of residual tumor on post-treatment MRI. In order to capture underlying tissue alterations and morphologic changes in rectal structures occurring due to the treatment, we hypothesized that radiomics texture and shape descriptors of the rectal environment (e.g., wall, lumen) on post-chemoradiation T2-weighted (T2w) MRI may be associated with tumor regression after neoadjuvant chemoradiation therapy (nCRT). (2) Methods: A total of 94 rectal cancer patients were retrospectively identified from three collaborating institutions, for whom a 1.5 or 3T T2w MRI was available after nCRT and prior to surgical resection. The rectal wall and the lumen were annotated by an expert radiologist on all MRIs, based on which 191 texture descriptors and 198 shape descriptors were extracted for each patient. (3) Results: Top-ranked features associated with pathologic tumor-stage regression were identified via cross-validation on a discovery set (n = 52, 1 institution) and evaluated via discriminant analysis in hold-out validation (n = 42, 2 institutions). The best performing features for distinguishing low (ypT0-2) and high (ypT3-4) pathologic tumor stages after nCRT comprised directional gradient texture expression and morphologic shape differences in the entire rectal wall and lumen. Not only were these radiomic features found to be resilient to variations in magnetic field strength and expert segmentations, a quadratic discriminant model combining them yielded consistent performance across multiple institutions (hold-out AUC of 0.73). (4) Conclusions: Radiomic texture and shape descriptors of the rectal wall from post-treatment T2w MRIs may be associated with low and high pathologic tumor stage after neoadjuvant chemoradiation therapy and generalized across variations between scanners and institutions.

Radiomic Features of Primary Rectal Cancers on Baseline T2 -Weighted MRI Are Associated With Pathologic Complete Response to Neoadjuvant Chemoradiation: A Multisite Study.

BACKGROUND: Twenty-five percent of rectal adenocarcinoma patients achieve pathologic complete response (pCR) to neoadjuvant chemoradiation and could avoid proctectomy. However, pretreatment clinical or imaging markers are lacking in predicting response to chemoradiation. Radiomic texture features from MRI have recently been associated with therapeutic response in other cancers. PURPOSE: To construct a radiomics texture model based on pretreatment MRI for identifying patients who will achieve pCR to neoadjuvant chemoradiation in rectal cancer, including validation across multiple scanners and sites. STUDY TYPE: Retrospective. SUBJECTS: In all, 104 rectal cancer patients staged with MRI prior to long-course chemoradiation followed by proctectomy; curated from three institutions. FIELD STRENGTH/SEQUENCE: 1.5T-3.0T, axial higher resolution T2 -weighted turbo spin echo sequence. ASSESSMENT: Pathologic response was graded on postsurgical specimens. In total, 764 radiomic features were extracted from single-slice sections of rectal tumors on processed pretreatment T2 -weighted MRI. STATISTICAL TESTS: Three feature selection schemes were compared for identifying radiomic texture descriptors associated with pCR via a discovery cohort (one site, N = 60, cross-validation). The top-selected radiomic texture features were used to train and validate a random forest classifier model for pretreatment identification of pCR (two external sites, N = 44). Model performance was evaluated via area under the curve (AUC), accuracy, sensitivity, and specificity. RESULTS: Laws kernel responses and gradient organization features were most associated with pCR (P ≤ 0.01); as well as being commonly identified across all feature selection schemes. The radiomics model yielded a discovery AUC of 0.699 ± 0.076 and a hold-out validation AUC of 0.712 with 70.5% accuracy (70.0% sensitivity, 70.6% specificity) in identifying pCR. Radiomic texture features were resilient to variations in magnetic field strength as well as being consistent between two different expert annotations. Univariate analysis revealed no significant associations of baseline clinicopathologic or MRI findings with pCR (P = 0.07-0.96). DATA CONCLUSION: Radiomic texture features from pretreatment MRIs may enable early identification of potential pCR to neoadjuvant chemoradiation, as well as generalize across sites. LEVEL OF EVIDENCE: 3 TECHNICAL EFFICACY STAGE: 2.

Radiogenomic-Based Survival Risk Stratification of Tumor Habitat on Gd-T1w MRI Is Associated with Biological Processes in Glioblastoma.

PURPOSE: To (i) create a survival risk score using radiomic features from the tumor habitat on routine MRI to predict progression-free survival (PFS) in glioblastoma and (ii) obtain a biological basis for these prognostic radiomic features, by studying their radiogenomic associations with molecular signaling pathways. EXPERIMENTAL DESIGN: Two hundred three patients with pretreatment Gd-T1w, T2w, T2w-FLAIR MRI were obtained from 3 cohorts: The Cancer Imaging Archive (TCIA; n = 130), Ivy GAP (n = 32), and Cleveland Clinic (n = 41). Gene-expression profiles of corresponding patients were obtained for TCIA cohort. For every study, following expert segmentation of tumor subcompartments (necrotic core, enhancing tumor, peritumoral edema), 936 3D radiomic features were extracted from each subcompartment across all MRI protocols. Using Cox regression model, radiomic risk score (RRS) was developed for every protocol to predict PFS on the training cohort (n = 130) and evaluated on the holdout cohort (n = 73). Further, Gene Ontology and single-sample gene set enrichment analysis were used to identify specific molecular signaling pathway networks associated with RRS features. RESULTS: Twenty-five radiomic features from the tumor habitat yielded the RRS. A combination of RRS with clinical (age and gender) and molecular features (MGMT and IDH status) resulted in a concordance index of 0.81 (P < 0.0001) on training and 0.84 (P = 0.03) on the test set. Radiogenomic analysis revealed associations of RRS features with signaling pathways for cell differentiation, cell adhesion, and angiogenesis, which contribute to chemoresistance in GBM. CONCLUSIONS: Our findings suggest that prognostic radiomic features from routine Gd-T1w MRI may also be significantly associated with key biological processes that affect response to chemotherapy in GBM.

Coregistration of Preoperative MRI with Ex Vivo Mesorectal Pathology Specimens to Spatially Map Post-treatment Changes in Rectal Cancer Onto In Vivo Imaging: Preliminary Findings.

RATIONALE AND OBJECTIVES: The objective of this study was to develop and quantitatively evaluate a radiology-pathology fusion method for spatially mapping tissue regions corresponding to different chemoradiation therapy-related effects from surgically excised whole-mount rectal cancer histopathology onto preoperative magnetic resonance imaging (MRI). MATERIALS AND METHODS: This study included six subjects with rectal cancer treated with chemoradiation therapy who were then imaged with a 3-T T2-weighted MRI sequence, before undergoing mesorectal excision surgery. Excised rectal specimens were sectioned, stained, and digitized as two-dimensional (2D) whole-mount slides. Annotations of residual disease, ulceration, fibrosis, muscularis propria, mucosa, fat, inflammation, and pools of mucin were made by an expert pathologist on digitized slide images. An expert radiologist and pathologist jointly established corresponding 2D sections between MRI and pathology images, as well as identified a total of 10 corresponding landmarks per case (based on visually similar structures) on both modalities (five for driving registration and five for evaluating alignment). We spatially fused the in vivo MRI and ex vivo pathology images using landmark-based registration. This allowed us to spatially map detailed annotations from 2D pathology slides onto corresponding 2D MRI sections. RESULTS: Quantitative assessment of coregistered pathology and MRI sections revealed excellent structural alignment, with an overall deviation of 1.50 ± 0.63 mm across five expert-selected anatomic landmarks (in-plane misalignment of two to three pixels at 0.67- to 1.00-mm spatial resolution). Moreover, the T2-weighted intensity distributions were distinctly different when comparing fibrotic tissue to perirectal fat (as expected), but showed a marked overlap when comparing fibrotic tissue and residual rectal cancer. CONCLUSIONS: Our fusion methodology enabled successful and accurate localization of post-treatment effects on in vivo MRI.

Radiomics Analysis on FLT-PET/MRI for Characterization of Early Treatment Response in Renal Cell Carcinoma: A Proof-of-Concept Study.

Studying early response to cancer treatment is significant for patient treatment stratification and follow-up. Although recent advances in positron emission tomography (PET) and magnetic resonance imaging (MRI) allow for evaluation of tumor response, a quantitative objective assessment of treatment-related effects offers localization and quantification of structural and functional changes in the tumor region. Radiomics, the process of computerized extraction of features from radiographic images, is a new strategy for capturing subtle changes in the tumor region that works by quantifying subvisual patterns which might escape human identification. The goal of this study was to demonstrate feasibility for performing radiomics analysis on integrated PET/MRI to characterize early treatment response in metastatic renal cell carcinoma (RCC) undergoing sunitinib therapy. Two patients with advanced RCC were imaged using an integrated PET/MRI scanner. [18 F] fluorothymidine (FLT) was used as the PET radiotracer, which can measure the degree of cell proliferation. Image acquisitions included test/retest scans before sunitinib treatment and one scan 3 weeks into treatment using [18 F] FLT-PET, T2-weighted (T2w), and diffusion-weighted imaging (DWI) protocols, where DWI yielded an apparent diffusion coefficient (ADC) map. Our framework to quantitatively characterize treatment-related changes involved the following analytic steps: 1) intraacquisition and interacquisition registration of protocols to allow voxel-wise comparison of changes in radiomic features, 2) correction and pseudoquantification of T2w images to remove acquisition artifacts and examine tissue-specific response, 3) characterization of information captured by T2w MRI, FLT-PET, and ADC via radiomics, and 4) combining multiparametric information to create a map of integrated changes from PET/MRI radiomic features. Standardized uptake value (from FLT-PET) and ADC textures ranked highest for reproducibility in a test/retest evaluation as well as for capturing treatment response, in comparison to high variability seen in T2w MRI. The highest-ranked radiomic feature yielded a normalized percentage change of 63% within the RCC region and 17% in a spatially distinct normal region relative to its pretreatment value. By comparison, both the original and postprocessed T2w signal intensity appeared to be markedly less sensitive and specific to changes within the tumor. Our preliminary results thus suggest that radiomics analysis could be a powerful tool for characterizing treatment response in integrated PET/MRI.