NextLens-The Next Generation of Surgical Navigation: Proof of Concept of an Augmented Reality System for Surgical Navigation.

Objective The aim of this work was the development of an augmented reality system including the functionality of conventional surgical navigation systems. Methods An application software for the Augmented Reality System HoloLens 2 from Microsoft was developed. It detects the position of the patient as well as position of surgical instruments in real time and displays it within the two-dimensional (2D) magnetic resonance imaging or computed tomography (CT) images. The surgical pointer instrument, including a pattern that is recognized by the HoloLens 2 sensors, was created with three-dimensional (3D) printing. The technical concept was demonstrated at a cadaver skull to identify anatomical landmarks. Results With the help of the HoloLens 2 and its sensors, the real-time position of the surgical pointer instrument could be shown. The position of the 3D-printed pointer with colored pattern could be recognized within 2D-CT images when stationary and in motion at a cadaver skull. Feasibility could be demonstrated for the clinical application of transsphenoidal pituitary surgery. Conclusion The HoloLens 2 has a high potential for use as a surgical navigation system. With subsequent studies, a further accuracy evaluation will be performed receiving valid data for comparison with conventional surgical navigation systems. In addition to transsphenoidal pituitary surgery, it could be also applied for other surgical disciplines.

IMAGINER: improving accuracy with a mixed reality navigation system during placement of external ventricular drains. A feasibility study.

OBJECTIVE: The placement of a ventricular catheter, that is, an external ventricular drain (EVD), is a common and essential neurosurgical procedure. In addition, it is one of the first procedures performed by inexperienced neurosurgeons. With or without surgical experience, the placement of an EVD according to anatomical landmarks only can be difficult, with the potential risk for inaccurate catheter placement. Repeated corrections can lead to avoidable complications. The use of mixed reality could be a helpful guide and improve the accuracy of drain placement, especially in patients with acute pathology leading to the displacement of anatomical structures. Using a human cadaveric model in this feasibility study, the authors aimed to evaluate the accuracy of EVD placement by comparing two techniques: mixed reality and freehand placement. METHODS: Twenty medical students performed the EVD placement procedure with a Cushing's ventricular cannula on the right and left sides of the ventricular system. The cannula was placed according to landmarks on one side and with the assistance of mixed reality (Microsoft HoloLens 2) on the other side. With mixed reality, a planned trajectory was displayed in the field of view that guides the placement of the cannula. Subsequently, the actual position of the cannula was assessed with the help of a CT scan with a 1-mm slice thickness. The bony structure as well as the left and right cannula positions were registered to the CT scan with the planned target point before the placement procedure. CloudCompare software was applied for registration and evaluation of accuracy. RESULTS: EVD placement using mixed reality was easily performed by all medical students. The predefined target point (inside the lateral ventricle) was reached with both techniques. However, the scattering radius of the target point reached through the use of mixed reality (12 mm) was reduced by more than 54% compared with the puncture without mixed reality (26 mm), which represents a doubling of the puncture accuracy. CONCLUSIONS: This feasibility study specifically showed that the integration and use of mixed reality helps to achieve more than double the accuracy in the placement of ventricular catheters. Because of the easy availability of these new tools and their intuitive handling, we see great potential for mixed reality to improve accuracy.

Mixed reality for spine surgery: a step into the future with a human cadaveric accuracy study.

OBJECTIVE: Current application of mixed reality as a navigation aid in the field of spinal navigation points to the potential of this technology in spine surgery. Crucial factors for acceptance include intuitive workflow, system stability, reliability, and accuracy of the method. The authors therefore aimed to investigate the accuracy of the system in visualization of anatomical structures using mixed reality in the example of pedicles of the thoracic spine in a human cadaveric study. Potential difficulties and limitations are discussed. METHODS: CT scans of a human cadaveric spinal column specimen were performed. After segmentation and import into the advanced HoloLens 2 software, the vertebrae were exposed. The vertebral arches were preserved on one side for a landmark-based surface registration, whereas pedicles were exposed on the other side in order to measure and evaluate deviation of the overlay holographs with regard to the exact anatomical structure. Accuracy was measured and statistically evaluated. RESULTS: In this work it was demonstrated that the overlay of the virtual 3D model pedicles with the real anatomical structures with anatomical landmark registration was within an acceptable surgical accuracy with the mean value of 2.1 mm (maximum 3.8 mm, minimum 1.2 mm). The highest accuracy was registered at the medial and lateral pedicle wall, and the measurement results were best in the region of the middle thoracic spine. CONCLUSIONS: The accuracy analysis for mixed reality (i.e., between the virtual and real anatomical situation of the thoracic spine) showed a very good agreement when focus was on the pedicles. This work is thus a rare proof of the precision of segmentation to the potential surgical area. The results encourage researchers to open up mixed reality technology in its development and application for spinal navigation.

Students' perspectives regarding needs for and opportunities with mixed-reality education in neurosurgery at German medical schools.

OBJECTIVE: Despite mixed reality being an emerging tool for tailored neurosurgical treatment and safety enhancement, the use of mixed reality in the education of German medical students is not established in the field of neurosurgery. The present study aimed to investigate medical students' perspectives on the use of mixed reality in neurosurgical medical education. METHODS: Between July 3, 2023, and August 31, 2023, an online survey was completed by German medical students through their affiliated student associations and educational institutions. The survey included 16 items related to mixed reality in neurosurgery, with participants providing ratings on a 4-point Likert scale to indicate their level of agreement with these statements. RESULTS: A total of 150 students from 27 medical schools in Germany took part in the survey. A significant majority comprising 131 (87.3%) students expressed strong to intense interest in mixed-reality courses in neurosurgery, and 108 (72%) reported an interest in incorporating mixed reality into their curriculum. Furthermore, 94.7% agreed that mixed reality may enhance their understanding of operative neuroanatomy and 72.7% agreed with the idea that teaching via mixed-reality methods may increase the probability of the use of mixed reality in their future career. The majority (116/150 [77.3%]) reported that the preferred optimum timepoint for teaching with mixed reality might be within the first 3 years of medical school. In particular, more students in the first 2 years preferred to start mixed-reality courses in the first 2 years of medical school compared to students in their 3rd to 6th years of medical school (71.9% vs 41.5%, p = 0.003). Residents and attending specialists were believed to be appropriate teachers by 118 students (78.7%). CONCLUSIONS: German medical students exhibited significant interest and willingness to engage in mixed reality in neurosurgery. Evidently, there is a high demand for medical schools to provide mixed-reality courses. Students seem to prefer the courses as early as possible in their medical school education in order to transfer preclinical neuroanatomical knowledge into operative neurosurgical anatomy by using this promising technique.

3D-printing of the elbow in complex posttraumatic elbow-stiffness for preoperative planning, surgery-simulation and postoperative control.

BACKGROUND: Restoration of mobility of the elbow after post-traumatic elbow stiffening due to osteophytes is often a problem. METHODS: The anatomical structures were segmented within the CT-scan. Afterwards, the Multi Jet Fusion 3D-printing was applied to create the model made of biocompatible and steam-sterilizable plastic. Preoperative simulation of osteophyte resection at the 3D-model was performed as well as the direct comparison with the patient anatomy intraoperatively. RESULTS: The patient-specific was very helpful for the preoperative simulation of the resection of elbow osteophytes. The 3D anatomical representation improved the preoperative plan its implementation. A high degree of fidelity was found between the 3D Printed Anatomical representation and the actual joint pathology. CONCLUSIONS: Arthrolysis of complex post-traumatic bony changes is an important indication for the use of 3D models for preoperative planning. Due to the use of 3D printing and software simulation, accurate resection planning is feasible and residual bony stiffening can be avoided. 3D printing models can lead to an improvement in surgical quality.

Development of a 3D-printed, patient-specific stereotactic system for bihemispheric deep brain stimulation.

The aim of the project was to develop a patient-specific stereotactic system that allows simultaneous and thus time-saving treatment of both cerebral hemispheres and that contains all spatial axes and can be used as a disposable product. Furthermore, the goal was to reduce the size and weight of the stereotactic system compared to conventional systems to keep the strain on the patient, who is awake during the operation, to a minimum. In addition, the currently mandatory computed tomography should be avoided in order not to expose the patient to harmful X-ray radiation as well as to eliminate errors in the fusion of CT and MRI data.3D printing best meets the requirements in terms of size and weight: on the one hand, the use of plastic has considerable potential for weight reduction. On the other hand, the free choice of the individual components offers the possibility to optimize the size and shape of the stereotactic system and to adapt it to the individual circumstances while maintaining the same precision. The all-in-one stereotactic system was produced by means of the Multi Jet Fusion process. As a result, the components are highly precise, stable in use, lightweight and sterilizable. The number of individual components and interfaces, which in their interaction are potential sources of error, was significantly reduced. In addition, on-site manufacturing leads to faster availability of the system.Within the project, a patient-specific stereotaxy system was developed, printed, and assembled, which enables the execution of deep brain stimulation via only three bone anchors located on the skull. Pre-developed MRI markers, which can be screwed directly onto the bone anchors via the sleeves, eliminate the need for a CT scan completely. The fusion of the data, which is no longer required, suggests an improvement in target accuracy.

Development of an individual helmet orthosis for infants based on a 3D scan.

An early childhood skull deformity can have long-term health and aesthetic consequences for the growing toddler. Individual helmet therapy aims at a healthy growth of the skull shape, although not every helmet shape guarantees an optimal result. To ensure an optimal fit, a scanning procedure based on a hand-held surface scanner was evaluated.The new helmet orthosis has an inner layer adapted to the shape of the head, which can be exchanged depending on the growth stage without changing the outer layer.In collaboration with surgeons and engineers, a new helmet orthosis concept was developed that is intended to offer improvements in wearing comfort, overall weight, fit and user-friendliness compared to conventional systems. In the course of the development process and in constant exchange with parents, a multi-layer helmet system with generous perforations was created using additive manufacturing processes. The new helmet shape promises easier handling, especially through the closure system.The helmet shape developed in this study is of high quality, especially in terms of fitting accuracy. Unpleasant perspiration is significantly reduced. The integration of the closure as a direct component of the helmet represents a secure closure option.

Development of 3D printed patient-specific skull implants based on 3d surface scans.

Sometimes cranioplasty is necessary to reconstruct skull bone defects after a neurosurgical operation. If an autologous bone is unavailable, alloplastic materials are used. The standard technical approach for the fabrication of cranial implants is based on 3D imaging by computed tomography using the defect and the contralateral site. A new approach uses 3D surface scans, which accurately replicate the curvature of the removed bone flap. For this purpose, the removed bone flap is scanned intraoperatively and digitized accordingly. When using a design procedure developed for this purpose creating a patient-specific implant for each bone flap shape in short time is possible. The designed skull implants have complex free-form surfaces analogous to the curvature of the skull, which is why additive manufacturing is the ideal manufacturing technology here. In this study, we will describe the intraoperative procedure for the acquisition of scanned data and its further processing up to the creation of the implant.