nnUNet-based Multi-modality Breast MRI Segmentation and Tissue-Delineating Phantom for Robotic Tumor Surgery Planning.

Segmentation of the thoracic region and breast tissues is crucial for analyzing and diagnosing the presence of breast masses. This paper introduces a medical image segmentation architecture that aggregates two neural networks based on the state-of-the-art nnU-Net. Additionally, this study proposes a polyvinyl alcohol cryogel (PVA-C) breast phantom, based on its automated segmentation approach, to enable planning and navigation experiments for robotic breast surgery. The dataset consists of multimodality breast MRI of T2W and STIR images obtained from 10 patients. A statistical analysis of segmentation tasks emphasizes the Dice Similarity Coefficient (DSC), segmentation accuracy, sensitivity, and specificity. We first use a single class labeling to segment the breast region and then exploit it as an input for three-class labeling to segment fatty, fibroglandular (FGT), and tumorous tissues. The first network has a 0.95 DCS, while the second network has a 0.95, 0.83, and 0.41 for fat, FGT, and tumor classes, respectively. Clinical Relevance-This research is relevant to the breast surgery community as it establishes a deep learning-based (DL) algorithmic and phantomic foundation for surgical planning and navigation that will exploit preoperative multimodal MRI and intraoperative ultrasound to achieve highly cosmetic breast surgery. In addition, the planning and navigation will guide a robot that can cut, resect, bag, and grasp a tissue mass that encapsulates breast tumors and positive tissue margins. This image-guided robotic approach promises to potentiate the accuracy of breast surgeons and improve patient outcomes.

Robotically Steered Needles: A Survey of Neurosurgical Applications and Technical Innovations.

This paper surveys both the clinical applications and main technical innovations related to steered needles, with an emphasis on neurosurgery. Technical innovations generally center on curvilinear robots that can adopt a complex path that circumvents critical structures and eloquent brain tissue. These advances include several needle-steering approaches, which consist of tip-based, lengthwise, base motion-driven, and tissue-centered steering strategies. This paper also describes foundational mathematical models for steering, where potential fields, nonholonomic bicycle-like models, spring models, and stochastic approaches are cited. In addition, practical path planning systems are also addressed, where we cite uncertainty modeling in path planning, intraoperative soft tissue shift estimation through imaging scans acquired during the procedure, and simulation-based prediction. Neurosurgical scenarios tend to emphasize straight needles so far, and span deep-brain stimulation (DBS), stereoelectroencephalography (SEEG), intracerebral drug delivery (IDD), stereotactic brain biopsy (SBB), stereotactic needle aspiration for hematoma, cysts and abscesses, and brachytherapy as well as thermal ablation of brain tumors and seizure-generating regions. We emphasize therapeutic considerations and complications that have been documented in conjunction with these applications.

Deformable multisurface segmentation of the spine for orthopedic surgery planning and simulation.

Purpose: We describe a shape-aware multisurface simplex deformable model for the segmentation of healthy as well as pathological lumbar spine in medical image data. Approach: This model provides an accurate and robust segmentation scheme for the identification of intervertebral disc pathologies to enable the minimally supervised planning and patient-specific simulation of spine surgery, in a manner that combines multisurface and shape statistics-based variants of the deformable simplex model. Statistical shape variation within the dataset has been captured by application of principal component analysis and incorporated during the segmentation process to refine results. In the case where shape statistics hinder detection of the pathological region, user assistance is allowed to disable the prior shape influence during deformation. Results: Results demonstrate validation against user-assisted expert segmentation, showing excellent boundary agreement and prevention of spatial overlap between neighboring surfaces. This section also plots the characteristics of the statistical shape model, such as compactness, generalizability and specificity, as a function of the number of modes used to represent the family of shapes. Final results demonstrate a proof-of-concept deformation application based on the open-source surgery simulation Simulation Open Framework Architecture toolkit. Conclusions: To summarize, we present a deformable multisurface model that embeds a shape statistics force, with applications to surgery planning and simulation.

Medial axis segmentation of cranial nerves using shape statistics-aware discrete deformable models.

PURPOSE: We propose a segmentation methodology for brainstem cranial nerves using statistical shape model (SSM)-based deformable 3D contours from T2 MR images. METHODS: We create shape models for ten pairs of cranial nerves. High-resolution T2 MR images are segmented for nerve centerline using a 1-Simplex discrete deformable 3D contour model. These segmented centerlines comprise training datasets for the shape model. Point correspondence for the training dataset is performed using an entropy-based energy minimization framework applied to particles located on the centerline curve. The shape information is incorporated into the 1-Simplex model by introducing a shape-based internal force, making the deformation stable against low resolution and image artifacts. RESULTS: The proposed method is validated through extensive experiments using both synthetic and patient MRI data. The robustness and stability of the proposed method are experimented using synthetic datasets. SSMs are constructed independently for ten pairs (CNIII-CNXII) of brainstem cranial nerves using ten non-pathological image datasets of the brainstem. The constructed ten SSMs are assessed in terms of compactness, specificity and generality. In order to quantify the error distances between segmented results and ground truths, two metrics are used: mean absolute shape distance (MASD) and Hausdorff distance (HD). MASD error using the proposed shape model is 0.19 ± 0.13 (mean ± std. deviation) mm and HD is 0.21 mm which are sub-voxel accuracy given the input image resolution. CONCLUSION: This paper described a probabilistic digital atlas of the ten brainstem-attached cranial nerve pairs by incorporating a statistical shape model with the 1-Simplex deformable contour. The integration of shape information as a priori knowledge results in robust and accurate centerline segmentations from even low-resolution MRI data, which is essential in neurosurgical planning and simulations for accurate and robust 3D patient-specific models of critical tissues including cranial nerves.

MRI-Based Medial Axis Extraction and Boundary Segmentation of Cranial Nerves Through Discrete Deformable 3D Contour and Surface Models.

This paper presents a segmentation technique to identify the medial axis and the boundary of cranial nerves. We utilize a 3-D deformable one-simplex discrete contour model to extract the medial axis of each cranial nerve. This contour model represents a collection of two-connected vertices linked by edges, where vertex position is determined by a Newtonian expression for vertex kinematics featuring internal and external forces, the latter of which include attractive forces toward the nerve medial axis. We exploit multiscale vesselness filtering and minimal path techniques in the medial axis extraction method, which also computes a radius estimate along the path. Once we have the medial axis and the radius function of a nerve, we identify the nerve surface using a two-simplex deformable model, which expands radially and can accommodate any nerve shape. As a result, the method proposed here combines the benefits of explicit contour and surface models, while also achieving a cornerstone for future work that will emphasize shape statistics, static collision with other critical structures, and tree-shape analysis.

3D lumbar spine intervertebral disc segmentation and compression simulation from MRI using shape-aware models.

PURPOSE: More accurate and robust image segmentations are needed for identification of spine pathologies and to assist with spine surgery planning and simulation. A framework for 3D segmentation of healthy and herniated intervertebral discs from T2-weighted magnetic resonance imaging was developed that exploits weak shape priors encoded in simplex mesh active surface models. METHODS: Weak shape priors inherent in simplex mesh deformable models have been exploited to automatically segment intervertebral discs. An ellipsoidal simplex template mesh was initialized within the disc image boundary through affine landmark-based registration and was allowed to deform according to image gradient forces. Coarse-to-fine multi-resolution approach was adopted in conjunction with decreasing shape memory forces to accurately capture the disc boundary. User intervention is allowed to turn off the shape feature and guide model deformation when the internal simplex shape memory influence hinders detection of pathology. A resulting surface mesh was utilized for disc compression simulation under gravitational and weight loads using Simulation Open Framework Architecture. For testing, 16 healthy discs were automatically segmented, and five pathological discs were segmented with minimal supervision. RESULTS: Segmentation results were validated against expert guided segmentation and demonstrate mean absolute shape distance error of <1 mm. Healthy intervertebral disc compression simulation resulted in a bulging disc under vertical pressure of 100 N/cm(2). CONCLUSION: This study presents the application of a simplex active surface model featuring weak shape priors for 3D segmentation of healthy as well as herniated discs. A framework was developed that enables the application of shape priors in the healthy part of disc anatomy, with user intervention when the priors were inapplicable. The surface-mesh-based segmentation method is part of a processing pipeline for anatomical modelling to support interactive surgery simulation.

Integration of a Multigrid ODE solver into an open medical simulation framework.

In this paper, we present the implementation of a Multigrid ODE solver in SOFA framework. By combining the stability advantage of coarse meshes and the transient detail preserving virtue of fine meshes, Multigrid ODE solver computes more efficiently than classic ODE solvers based on a single level discretization. With the ever wider adoption of the SOFA framework in many surgical simulation projects, introducing this Multigrid ODE solver into SOFA's pool of ODE solvers shall benefit the entire community. This contribution potentially has broad ramifications in the surgical simulation research community, given that in a single-resolution system, a constitutively realistic interactive tissue response, which presupposes large elements, is in direct conflict with the need to represent clinically relevant critical tissues in the simulation, which are typically be comprised of small elements.

Approach-specific multi-grid anatomical modeling for neurosurgery simulation with public-domain and open-source software.

We present on-going work on multi-resolution sulcal-separable meshing for approach-specific neurosurgery simulation, in conjunction multi-grid and Total Lagrangian Explicit Dynamics finite elements. Conflicting requirements of interactive nonlinear finite elements and small structures lead to a multi-grid framework. Implications for meshing are explicit control over resolution, and prior knowledge of the intended neurosurgical approach and intended path. This information is used to define a subvolume of clinical interest, within some distance of the path and the target pathology. Restricted to this subvolume are a tetrahedralization of finer resolution, the representation of critical tissues, and sulcal separability constraint for all mesh levels.