Leveraging the Apple Ecosystem: Easy Viewing and Sharing of Three-dimensional Perforator Visualizations via iPad/iPhone-based Augmented Reality.

We introduce a novel technique using augmented reality (AR) on smartphones and tablets, making it possible for surgeons to review perforator anatomy in three dimensions on the go. Autologous breast reconstruction with abdominal flaps remains challenging due to the highly variable anatomy of the deep inferior epigastric artery. Computed tomography angiography has mitigated some but not all challenges. Previously, volume rendering and different headsets were used to enable better three-dimensional (3D) review for surgeons. However, surgeons have been dependent on others to provide 3D imaging data. Leveraging the ubiquity of Apple devices, our approach permits surgeons to review 3D models of deep inferior epigastric artery anatomy segmented from abdominal computed tomography angiography directly on their iPhone/iPad. Segmentation can be performed in common radiology software. The models are converted to the universal scene description zipped format, which allows immediate use on Apple devices without third-party software. They can be easily shared using secure, Health Insurance Portability and Accountability Act-compliant sharing services already provided by most hospitals. Surgeons can simply open the file on their mobile device to explore the images in 3D using "object mode" natively without additional applications or can switch to AR mode to pin the model in their real-world surroundings for intuitive exploration. We believe patient-specific 3D anatomy models are a powerful tool for intuitive understanding and communication of complex perforator anatomy and would be a valuable addition in routine clinical practice and education. Using this one-click solution on existing devices that is simple to implement, we hope to streamline the adoption of AR models by plastic surgeons.

The Reconstructive Metaverse - Collaboration in Real-Time Shared Mixed Reality Environments for Microsurgical Reconstruction.

Plastic surgeons routinely use 3D-models in their clinical practice, from 3D-photography and surface imaging to 3D-segmentations from radiological scans. However, these models continue to be viewed on flattened 2D screens that do not enable an intuitive understanding of 3D-relationships and cause challenges regarding collaboration with colleagues. The Metaverse has been proposed as a new age of applications building on modern Mixed Reality headset technology that allows remote collaboration on virtual 3D-models in a shared physical-virtual space in real-time. We demonstrate the first use of the Metaverse in the context of reconstructive surgery, focusing on preoperative planning discussions and trainee education. Using a HoloLens headset with the Microsoft Mesh application, we performed planning sessions for 4 DIEP-flaps in our reconstructive metaverse on virtual patient-models segmented from routine CT angiography. In these sessions, surgeons discuss perforator anatomy and perforator selection strategies whilst comprehensively assessing the respective models. We demonstrate the workflow for a one-on-one interaction between an attending surgeon and a trainee in a video featuring both viewpoints as seen through the headset. We believe the Metaverse will provide novel opportunities to use the 3D-models that are already created in everyday plastic surgery practice in a more collaborative, immersive, accessible, and educational manner.

Suture Packaging as a Marker for Intraoperative Image Alignment in Augmented Reality on Mobile Devices.

Preoperative vascular imaging has become standard practice in the planning of microsurgical breast reconstruction. Currently, translating perforator locations from radiological findings to a patient's abdomen is often not easy or intuitive. Techniques using three-dimensional printing or patient-specific guides have been introduced to superimpose anatomy onto the abdomen for reference. Augmented and mixed reality is currently actively investigated for perforator mapping by superimposing virtual models directly onto the patient. Most techniques have found only limited adoption due to complexity and price. Additionally, a critical step is aligning virtual models to patients. We propose repurposing suture packaging as an image tracking marker. Tracking markers allow quick and easy alignment of virtual models to the individual patient's anatomy. Current techniques are often complicated or expensive and limit intraoperative use of augmented reality models. Suture packs are sterile, readily available, and can be used to align abdominal models on the patients. Using an iPad, the augmented reality models automatically align in the correct position by using a suture pack as a tracking marker. Given the ubiquity of iPads, the combination of these devices with readily available suture packs will predictably lower the barrier to entry and utilization of this technology. Here, our workflow is presented along with its intraoperative utilization. Additionally, we investigated the accuracy of this technology.

How far are we off? Analyzing the accuracy of surgical margin relocation in the head and neck.

BACKGROUND: Positive surgical margin rates remain high in head and neck cancer surgery. Relocation is challenging given the complex, three-dimensional (3D) anatomy. METHODS: Prospective, multi-institutional study to determine accuracy of head and neck surgeons and pathologists relocating margins on virtual 3D specimen models using written descriptions from pathology reports. Using 3D models of 10 head and neck surgical specimens, each participant relocated 20 mucosal margins (10 perpendicular, 10 shave). RESULTS: A total of 32 participants, 23 surgeons and 9 pathologists, marked 640 margins. Of the 320 marked perpendicular margins, 49.7% were greater than 1 centimeter from the true margin with a mean relocation error of 10.2 mm. Marked shave margins overlapped with the true margin a mean 54% of the time, with no overlap in 44 of 320 (13.8%) shave margins. CONCLUSIONS: Surgical margin relocation is imprecise and challenging even for experienced surgeons and pathologists. New communication technologies are needed.

Increasing DIEA Perforator Detail in 3D Photorealistic Volume Rendering Visualizations with Skin-masking and Cinematic Anatomy.

Preoperative CT angiography (CTA) is increasingly performed prior to perforator flap-based reconstruction. However, radiological 2D thin-slices do not allow for intuitive interpretation and translation to intraoperative findings. 3D volume rendering has been used to alleviate the need for mental 2D-to-3D abstraction. Even though volume rendering allows for a much easier understanding of anatomy, it currently has limited utility as the skin obstructs the view of critical structures. Using free, open-source software, we introduce a new skin-masking technique that allows surgeons to easily create a segmentation mask of the skin that can later be used to toggle the skin on and off. Additionally, the mask can be used in other rendering applications. We use Cinematic Anatomy for photorealistic volume rendering and interactive exploration of the CTA with and without skin. We present results from using this technique to investigate perforator anatomy in deep inferior epigastric perforator flaps and demonstrate that the skin-masking workflow is performed in less than 5 minutes. In Cinematic Anatomy, the view onto the abdominal wall and especially onto perforators becomes significantly sharper and more detailed when no longer obstructed by the skin. We perform a virtual, partial muscle dissection to show the intramuscular and submuscular course of the perforators. The skin-masking workflow allows surgeons to improve arterial and perforator detail in volume renderings easily and quickly by removing skin and could alternatively also be performed solely using open-source and free software. The workflow can be easily expanded to other perforator flaps without the need for modification.

Internal vascular anatomy of the human lacrimal gland: A protocol based on cadaver dissection and three-dimensional micro-computed tomography.

PURPOSE: To evaluate the feasibility of studying the vascular supply of the orbital and palpebral lobes of the human lacrimal gland using micro-computed tomography (micro-CT) and microscopic dissection. METHODS: The lacrimal gland artery of a fresh parasagittalized cadaver head (male, aged 76 years) was infused with a lead oxide-latex mixture near the occipital pole of the gland. The entire lacrimal gland was imaged using micro-CT and 3D cinematic rendering (CR) and then dissected under a surgical microscope. RESULTS: Micro-CT and CR images showed well-demarcated internal vascular branches of the lacrimal artery and their distribution within the orbital and palpebral lobes. The entire course of the artery and its branches could be visualized by CR and microscopic dissection, with the former showing better spatial orientation and finer branching. The main artery runs along the free edge of the aponeurosis of the levator palpebrae superior muscle and lies in the isthmus portion of the gland (between the orbital and palpebral lobes). The branches of the main lacrimal artery include one branch to the orbital adipose tissue just before entering the gland, two branches to the orbital lobe (medial and lateral), and two branches to the palpebral lobe (medial and lateral). The main artery terminates as palpebral and orbital lobe branches in the lateral half of the lacrimal gland. CONCLUSION: Latex and contrast-enhanced micro-CT is very well suited to visualize the vascular anatomy of the lacrimal artery within the gland. A large number of lacrimal gland examinations using the method presented here are required to demonstrate and understand the variability of the vascular anatomy of the human lacrimal gland.

New insights into lacrimal gland anatomy using 7T MRI and electron microscopy: Relevance for lacrimal gland targeted therapies and bioengineering.

PURPOSE: To study the tissue architecture, isthmus (connection between two lobes) of the lacrimal gland using preclinical 7T MRI in combination with histology and electron microscopy. METHODS: Ten lacrimal glands from Caucasian body donors (mean age 78.7 years) were studied using 7T-MRI (N = 5; scanned at 75-µm intervals), histology, and electron microscopy (N = 5) and 3D cinematic rendering (CR) techniques. RESULTS: 3D CR images showed uniform-sized lobules (widest lobule diameter, 1.68 ± 0.19 mm in orbital lobe, 1.68 ± 0.17 mm in palpebral lobe) in both lobes, separated by septae (size, 0.29 ± 0.09 mm). The internal framework of the gland resembled a honeycoomb pattern. In CR and histology, the isthmus contained glandular acini, large blood vessels, nerves, and no more than two ducts having a tortuous course towards the conjunctival surface. On assigning a color display to the rendered lacrimal gland, all glands showed a blood vessel originating from the main lacrimal artery just 5 mm beyond the hilum and making it course to the palpebral lobe via isthmus. The distance between the conjunctiva and the central substance of the orbital and palpebral lobe was 9.4 ± 0.2 mm and 2.8 ± 0.7 mm, respectively. Electron microscopy of the palpebral lobe revealed compact subepithelial layer in the overlying conjunctiva, followed by loosely scattered collagen bundles that contained the gland lobules. CONCLUSION: 3D-CR can be used to study the lacrimal gland microstructure, help fabricate a 3D scaffold for lacrimal gland bioprinting, and serve as guide for transconjunctival lacrimal gland targeted therapies i.e., 2.9 & 9 mm long needle to reach the orbital and palpebral lobe center, respectively in normal-size glands.

Augmented-Reality Surgery to Guide Head and Neck Cancer Re-resection: A Feasibility and Accuracy Study.

BACKGROUND: Given the complex three-dimensional (3D) anatomy of head and neck cancer specimens, head and neck surgeons often have difficulty relocating the site of an initial positive margin to perform re-resection. This cadaveric study aimed to determine the feasibility and accuracy of augmented reality surgery to guide head and neck cancer re-resections. METHODS: This study investigated three cadaveric specimens. The head and neck resection specimen was 3D scanned and exported to the HoloLens augmented reality environment. The surgeon manually aligned the 3D specimen hologram into the resection bed. Accuracy of manual alignment and time intervals throughout the protocol were recorded. RESULTS: The 20 head and neck cancer resections performed in this study included 13 cutaneous and 7 oral cavity resections. The mean relocation error was 4 mm (range, 1-15 mm) with a standard deviation of 3.9 mm. The mean overall protocol time, from the start of 3D scanning to alignment into the resection bed, was 25.3 ± 8.9 min (range, 13.2-43.2 min). Relocation error did not differ significantly when stratified by greatest dimension of the specimen. The mean relocation error of complex oral cavity composite specimens (maxillectomy and mandibulectomy) differed significantly from that of all the other specimen types (10.7 vs 2.8; p < 0.01). CONCLUSIONS: This cadaveric study demonstrated the feasibility and accuracy of augmented reality to guide re-resection of initial positive margins in head and neck cancer surgery.

Cinematic rendering to improve visualization of supplementary and ectopic teeth using CT datasets.

OBJECTIVES: Ectopic, impacted, and supplementary teeth are the number one reason for cross-sectional imaging in pediatric dentistry. The accurate post-processing of acquired data sets is crucial to obtain precise, yet also intuitively understandable three-dimensional (3D) models, which facilitate clinical decision-making and improve treatment outcomes. Cinematic rendering (CR) is anovel visualization technique using physically based volume rendering to create photorealistic images from DICOM data. The aim of the present study was to tailor pre-existing CR reconstruction parameters for use in dental imaging with the example of the diagnostic 3D visualization of ectopic, impacted, and supplementary teeth. METHODS: CR was employed for the volumetric image visualization of midface CT data sets. Predefined reconstruction parameters were specifically modified to visualize the presented dental pathologies, dentulous jaw, and isolated teeth. The 3D spatial relationship of the teeth, as well as their structural relationship with the antagonizing dentition, could immediately be investigated and highlighted by separate, interactive 3D visualization after segmentation through windowing. RESULTS: To the best of our knowledge, CR has not been implemented for the visualization of supplementary and ectopic teeth segmented from the surrounding bone because the software has not yet provided appropriate customized reconstruction parameters for dental imaging. When employing our new, modified reconstruction parameters, its application presents a fast approach to obtain realistic visualizations of both dental and osseous structures. CONCLUSIONS: CR enables dentists and oral surgeons to gain an improved 3D understanding of anatomical structures, allowing for more intuitive treatment planning and patient communication.

Feasibility of percutaneous dural sac puncture via a posterior trans-sacral foraminal conduit approach: a CT morphometric analysis.

We assess the theoretical feasibility of percutaneous posterior sacral foramen (pSF) needle puncture of the sacral dural sac (DS) by studying the three-dimensional imaging anatomy of pSFs relative to the sacral canal (SC). On CT images of 40 healthy subjects, we retrospectively studied sacral alae passageways from SC to pSFs in all three planes to determine if an imaginary spinal needle could theoretically traverse S1 or S2 pSFs in a straight path toward DS. If not straight, we measured multiplane angulations and morphometrics of this route. We found no straight connections between S1 or S2 pSFs and SC. Instead, there were bilateral spatially complex dorsoventral M-shaped "foraminal conduits" (FCs; common, ventral, and dorsal) from SC to anterior SFs and pSFs that would prevent percutaneous straight needle puncture of the DS. This detailed knowledge of the sacral FCs will be useful for accurate imaging interpretation and interventional procedures on the sacrum.

Virtual Resection Specimen Interaction Using Augmented Reality Holograms to Guide Margin Communication and Flap Sizing.

Head and neck surgeons often have difficulty in relocating sites of positive margins due to the complex 3-dimensional (3D) anatomy of the head and neck. We introduce a new technique where resection specimens are 3D scanned with a smartphone, annotated in computer-assisted design software, and immediately visualized on augmented reality (AR) glasses. The 3D virtual specimen can be accurately superimposed onto surgical sites for orientation and sizing applications. During an operative workshop, a surgeon using AR glasses projected virtual, annotated specimen models back into the resection bed onto a cadaver within approximately 10 minutes. Colored annotations can correspond with pathologic annotations and guide the orientation of the virtual 3D specimen. The model was also overlayed onto a flap harvest site to aid in reconstructive planning. We present a new technique allowing interactive, sterile inspection of tissue specimens in AR that could facilitate communication among surgeons and pathologists and assist with reconstructive surgery.

Caudolenticular gray bridges of the brain: A magnetic resonance imaging study.

The caudolenticular (or transcapsular) gray bridges (CLGBs) connect the caudate nucleus (CN) and putamen across the internal capsule. The CLGBs function as the main efferent terminus from premotor and supplementary motor area cortex to the basal ganglia (BG). We conjectured if inherent variations in numbers and sizes of CLGBs could contribute to abnormal cortical-subcortical connectivity in Parkinson's disease (PD), a neurodegenerative disorder featuring a hindrance of BG processing. However, there are no literature accounts of normative anatomy and morphometry of CLGBs. We therefore retrospectively analyzed axial and coronal 3T fast spoiled gradient-echo magnetic resonance images (MRIs) of 34 healthy individuals for bilateral CLGBs symmetry, their numbers, dimensions of thickest and longest bridge, and axial surface areas of CN head and putamen. We calculated Evans' index (EI) to account for any brain atrophy. We statistically tested associations between sex or age and measured dependent variables, and linear correlations between all measured variables (significance at p < 0.05). Study subjects were F:M = 23:11 with mean age 49.9 years. All EI's were normal (<0.3). All but three CLGBs were bilaterally symmetrical with a mean 7.4 CLGBs per side. Mean CLGBs thickness and lengths were 1.0 and 4.6 mm, respectively; CN head and putamen areas were 205 and 382.0 mm2 , respectively. Females had thicker CLGBs (p = 0.02) but we found no significant interactions between sex or age and measured dependent variables, and no correlations between CN head or putamen areas and CLGBs dimensions. These normative MRI dimensions of the CLGBs will help guide future studies on the possible role of CLGBs morphometry in PD predisposition.

The comparison of the morphology of the mid-palatal suture between edentulous individuals and dentate jaws shows morphological differences.

BACKGROUND: A profound understanding of the evolution and anatomy of the viscero- and neurocranium is quintessentially important for orthodontists. This particularly alludes to structures, which are directly targeted by orthodontic therapy such as the maxilla and the mid-palatal suture. The anatomy of the mid-palatal suture of toothed individuals is well described, whereas little is known about sutures' morphological changes after tooth loss. Therefore, the aim of this study was to evaluate the edentulous mid-palatal suture by means of histologic and histomorphometric analysis. METHODS: Ten mid-palatal sutures of edentulous donors as well as six age- and sex matched dentulous controls were examined. For the histological and histomorphometric analysis (sutural width, obliteration, vascularization and interdigitation) conventional staining protocols (HE, Movat-Pentachrome, Sirius Red) and immunofluorescence (vWF, TRAP) were performed. Histomorphometric analysis was carried out using NIS-elements imaging software. RESULTS: When compared to dentulous controls, the edentulous investigation group showed a decreased vascularization and sutural width as well as an increased sutural obliteration. Notably, a high variability and inhomogeneity within regard the histomorphometric parameters was seen in edentulous samples. CONCLUSIONS: The mid-palatal suture of edentulous individuals showed significant morphological differences compared to individuals with toothed jaws. The loss of teeth and thereby functional loading seems to have a considerable impact on sutures' morphology.

Chest CT Cinematic Rendering of SARS-CoV-2 Pneumonia.

Online supplemental material is available for this article.