Automatic quadriceps and patellae segmentation of MRI with cascaded U2 -Net and SASSNet deep learning model.

PURPOSE: Automatic muscle segmentation is critical for advancing our understanding of human physiology, biomechanics, and musculoskeletal pathologies, as it allows for timely exploration of large multi-dimensional image sets. Segmentation models are rarely developed/validated for the pediatric model. As such, autosegmentation is not available to explore how muscle architectural changes during development and how disease/pathology affects the developing musculoskeletal system. Thus, we aimed to develop and validate an end-to-end, fully automated, deep learning model for accurate segmentation of the rectus femoris and vastus lateral, medialis, and intermedialis using a pediatric database. METHODS: We developed a two-stage cascaded deep learning model in a coarse-to-fine manner. In the first stage, the U2 -Net roughly detects the muscle subcompartment region. Then, in the second stage, the shape-aware 3D semantic segmentation method SASSNet refines the cropped target regions to generate the more finer and accurate segmentation masks. We utilized multifeature image maps in both stages to stabilize performance and validated their use with an ablation study. The second-stage SASSNet was independently run and evaluated with three different cropped region resolutions: the original image resolution, and images downsampled 2× and 4× (high, mid, and low). The relationship between image resolution and segmentation accuracy was explored. In addition, the patella was included as a comparator to past work. We evaluated segmentation accuracy using leave-one-out testing on a database of 3D MR images (0.43 × 0.43 × 2 mm) from 40 pediatric participants (age 15.3 ± 1.9 years, 55.8 ± 11.8 kg, 164.2 ± 7.9 cm, 38F/2 M). RESULTS: The mid-resolution second stage produced the best results for the vastus medialis, rectus femoris, and patella (Dice similarity coefficient = 95.0%, 95.1%, 93.7%), whereas the low-resolution second stage produced the best results for the vastus lateralis and vastus intermedialis (DSC = 94.5% and 93.7%). In comparing the low- to mid-resolution cases, the vasti intermedialis, vastus medialis, rectus femoris, and patella produced significant differences (p = 0.0015, p = 0.0101, p < 0.0001, p = 0.0003) and the vasti lateralis did not (p = 0.2177). The high-resolution stage 2 had significantly lower accuracy (1.0 to 4.4 dice percentage points) compared to both the mid- and low-resolution routines (p value ranged from < 0.001 to 0.04). The one exception was the rectus femoris, where there was no difference between the low- and high-resolution cases. The ablation study demonstrated that the multifeature is more reliable than the single feature. CONCLUSIONS: Our successful implementation of this two-stage segmentation pipeline provides a critical tool for expanding pediatric muscle physiology and clinical research. With a relatively small and variable dataset, our fully automatic segmentation technique produces accuracies that matched or exceeded the current state of the art. The two-stage segmentation avoids memory issues and excessive run times by using a first stage focused on cropping out unnecessary data. The excellent Dice similarity coefficients improve upon previous template-based automatic and semiautomatic methodologies targeting the leg musculature. More importantly, with a naturally variable dataset (size, shape, etc.), the proposed model demonstrates slightly improved accuracies, compared to previous neural networks methods.

Fully automated patellofemoral MRI segmentation using holistically nested networks: Implications for evaluating patellofemoral osteoarthritis, pain, injury, pathology, and adolescent development.

PURPOSE: Our clinical understanding of the relationship between 3D bone morphology and knee osteoarthritis, as well as our ability to investigate potential causative factors of osteoarthritis, has been hampered by the time-intensive nature of manually segmenting bone from MR images. Thus, we aim to develop and validate a fully automated deep learning framework for segmenting the patella and distal femur cortex, in both adults and actively growing adolescents. METHODS: Data from 93 subjects, obtained from on institutional review board-approved protocol, formed the study database. 3D sagittal gradient recalled echo and gradient recalled echo with fat saturation images and manual models of the outer cortex were available for 86 femurs and 90 patellae. A deep-learning-based 2D holistically nested network (HNN) architecture was developed to automatically segment the patella and distal femur using both single (sagittal, uniplanar) and 3 cardinal plane (triplanar) methodologies. Errors in the surface-to-surface distances and the Dice coefficient were the primary measures used to quantitatively evaluate segmentation accuracy using a 9-fold cross-validation. RESULTS: Average absolute errors for segmenting both the patella and femur were 0.33 mm. The Dice coefficients were 97% and 94% for the femur and patella. The uniplanar, relative to the triplanar, methodology produced slightly superior segmentation. Neither the presence of active growth plates nor pathology influenced segmentation accuracy. CONCLUSION: The proposed HNN with multi-feature architecture provides a fully automatic technique capable of delineating the often indistinct interfaces between the bone and other joint structures with an accuracy better than nearly all other techniques presented previously, even when active growth plates are present.

Fully automated prostate whole gland and central gland segmentation on MRI using holistically nested networks with short connections.

Accurate and automated prostate whole gland and central gland segmentations on MR images are essential for aiding any prostate cancer diagnosis system. Our work presents a 2-D orthogonal deep learning method to automatically segment the whole prostate and central gland from T2-weighted axial-only MR images. The proposed method can generate high-density 3-D surfaces from low-resolution ( z axis) MR images. In the past, most methods have focused on axial images alone, e.g., 2-D based segmentation of the prostate from each 2-D slice. Those methods suffer the problems of over-segmenting or under-segmenting the prostate at apex and base, which adds a major contribution for errors. The proposed method leverages the orthogonal context to effectively reduce the apex and base segmentation ambiguities. It also overcomes jittering or stair-step surface artifacts when constructing a 3-D surface from 2-D segmentation or direct 3-D segmentation approaches, such as 3-D U-Net. The experimental results demonstrate that the proposed method achieves 92.4 % ± 3 % Dice similarity coefficient (DSC) for prostate and DSC of 90.1 % ± 4.6 % for central gland without trimming any ending contours at apex and base. The experiments illustrate the feasibility and robustness of the 2-D-based holistically nested networks with short connections method for MR prostate and central gland segmentation. The proposed method achieves segmentation results on par with the current literature.

Automatic magnetic resonance prostate segmentation by deep learning with holistically nested networks.

Accurate automatic segmentation of the prostate in magnetic resonance images (MRI) is a challenging task due to the high variability of prostate anatomic structure. Artifacts such as noise and similar signal intensity of tissues around the prostate boundary inhibit traditional segmentation methods from achieving high accuracy. We investigate both patch-based and holistic (image-to-image) deep-learning methods for segmentation of the prostate. First, we introduce a patch-based convolutional network that aims to refine the prostate contour which provides an initialization. Second, we propose a method for end-to-end prostate segmentation by integrating holistically nested edge detection with fully convolutional networks. Holistically nested networks (HNN) automatically learn a hierarchical representation that can improve prostate boundary detection. Quantitative evaluation is performed on the MRI scans of 250 patients in fivefold cross-validation. The proposed enhanced HNN model achieves a mean ± standard deviation. A Dice similarity coefficient (DSC) of [Formula: see text] and a mean Jaccard similarity coefficient (IoU) of [Formula: see text] are used to calculate without trimming any end slices. The proposed holistic model significantly ([Formula: see text]) outperforms a patch-based AlexNet model by 9% in DSC and 13% in IoU. Overall, the method achieves state-of-the-art performance as compared with other MRI prostate segmentation methods in the literature.

Atlas based AAM and SVM model for fully automatic MRI prostate segmentation.

Automatic prostate segmentation in MR images is a challenging task due to inter-patient prostate shape and texture variability, and the lack of a clear prostate boundary. We propose a supervised learning framework that combines the atlas based AAM and SVM model to achieve a relatively high segmentation result of the prostate boundary. The performance of the segmentation is evaluated with cross validation on 40 MR image datasets, yielding an average segmentation accuracy near 90%.

GPU based multi-histogram volume navigation for virtual bronchoscopy.

An interactive navigation system for virtual bronchoscopy is presented, which is based solely on GPU based high performance multi-histogram volume rendering.

Sharing heterogeneous data: the national database for autism research.

The National Database for Autism Research (NDAR) is a secure research data repository designed to promote scientific data sharing and collaboration among autism spectrum disorder investigators. The goal of the project is to accelerate scientific discovery through data sharing, data harmonization, and the reporting of research results. Data from over 25,000 research participants are available to qualified investigators through the NDAR portal. Summary information about the available data is available to everyone through that portal.

Volumetric neuroimage analysis extensions for the MIPAV software package.

We describe a new collection of publicly available software tools for performing quantitative neuroimage analysis. The tools perform semi-automatic brain extraction, tissue classification, Talairach alignment, and atlas-based measurements within a user-friendly graphical environment. They are implemented as plug-ins for MIPAV, a freely available medical image processing software package from the National Institutes of Health. Because the plug-ins and MIPAV are implemented in Java, both can be utilized on nearly any operating system platform. In addition to the software plug-ins, we have also released a digital version of the Talairach atlas that can be used to perform regional volumetric analyses. Several studies are conducted applying the new tools to simulated and real neuroimaging data sets.

Cortical atrophy is relevant in multiple sclerosis at clinical onset.

INTRODUCTION: Increasing evidence suggests relevant cortical gray matter pathology in patients with Multiple Sclerosis (MS), but how early this pathology begins; its impact on clinical disability and which cortical areas are primarily affected needs to be further elucidated. METHODS: 115 consecutive patients (10 Clinically Isolated Syndrome (CIS), 32 possible MS (p-MS), 42 Relapsing Remitting MS (RR-MS), 31 Secondary Progressive MS (SP-MS)), and 40 age/gender-matched healthy volunteers (HV) underwent a neurological examination and a 1.5 T MRI. Global and regional Cortical Thickness (CTh) measurements, brain parenchyma fraction and T2 lesion load were analyzed. RESULTS: We found a significant global cortical thinning in p-MS (2.22 +/- 0.09 mm), RR-MS (2.16 +/- 0.10 mm) and SP-MS (1.98 +/- 0.11 mm) compared to CIS (2.51 +/- 0.11 mm) and HV (2.48 +/- 0.08 mm). The correlations between mean CTh and white matter (WM) lesion load was only moderate in MS (r = -0.393, p = 0.03) and absent in p-MS (r = -0.147, p = 0.422). Analysis of regional CTh revealed that the majority of cortical areas were involved not only in MS, but also in p-MS. The type of clinical picture at onset (in particular, pyramidal signs/symptoms and optic neuritis) correlated with atrophy in the corresponding cortical areas. DISCUSSION: Cortical thinning is a diffuse and early phenomenon in MS already detectable at clinical onset. It correlates with clinical disability and is partially independent from WM inflammatory pathology.

Technologies for guidance of radiofrequency ablation in the multimodality interventional suite of the future.

Several new image-guidance tools and devices are being prototyped, investigated, and compared. These tools are introduced and include prototype software for image registration and fusion, thermal modeling, electromagnetic tracking, semiautomated robotic needle guidance, and multimodality imaging. The integration of treatment planning with computed tomography robot systems or electromagnetic needle-tip tracking allows for seamless, iterative, "see-and-treat," patient-specific tumor ablation. Such automation, navigation, and visualization tools could eventually optimize radiofrequency ablation and other needle-based ablation procedures and decrease variability among operators, thus facilitating the translation of novel image-guided therapies. Much of this new technology is in use or will be available to the interventional radiologist in the near future, and this brief introduction will hopefully encourage research in this emerging area.

Radio frequency ablation registration, segmentation, and fusion tool.

The radio frequency ablation segmentation tool (RFAST) is a software application developed using the National Institutes of Health's medical image processing analysis and visualization (MIPAV) API for the specific purpose of assisting physicians in the planning of radio frequency ablation (RFA) procedures. The RFAST application sequentially leads the physician through the steps necessary to register, fuse, segment, visualize, and plan the RFA treatment. Three-dimensional volume visualization of the CT dataset with segmented three dimensional (3-D) surface models enables the physician to interactively position the ablation probe to simulate burns and to semimanually simulate sphere packing in an attempt to optimize probe placement. This paper describes software systems contained in RFAST to address the needs of clinicians in planning, evaluating, and simulating RFA treatments of malignant hepatic tissue.

Assessing prostate volume by magnetic resonance imaging: a comparison of different measurement approaches for organ volume analysis.

OBJECTIVES: We sought to evaluate the capabilities of different magnetic resonance imaging (MRI)-based methodologies for measuring prostate volume. MATERIALS AND METHODS: Twenty-four male beagles with benign prostatic hyperplasia were enrolled in a drug trial and imaged at 5 time points. A total of 120 prostate volumes were determined by MRI-based semiautomated segmentation. For planimetric assessment, 8 diameter locations were determined in the axial and coronal plane of the MRI slice with maximum extension of the prostate. Thirteen calculation models based on these diameters were determined by comparison to the reference volume and evaluated during treatment. RESULTS: The segmented MRI prostate volume significantly correlated with post necropsy volume. The best diameter-based model also worked very well for monitoring prostate volume of dogs under treatment. CONCLUSIONS: MRI-based segmentation is highly accurate in assessing prostate volume. Diameter-based measurements are closely correlated to the segmented prostate volume and are feasible to monitor therapy.