µRALP and Beyond: Micro-Technologies and Systems for Robot-Assisted Endoscopic Laser Microsurgery.

Laser microsurgery is the current gold standard surgical technique for the treatment of selected diseases in delicate organs such as the larynx. However, the operations require large surgical expertise and dexterity, and face significant limitations imposed by available technology, such as the requirement for direct line of sight to the surgical field, restricted access, and direct manual control of the surgical instruments. To change this status quo, the European project µRALP pioneered research towards a complete redesign of current laser microsurgery systems, focusing on the development of robotic micro-technologies to enable endoscopic operations. This has fostered awareness and interest in this field, which presents a unique set of needs, requirements and constraints, leading to research and technological developments beyond µRALP and its research consortium. This paper reviews the achievements and key contributions of such research, providing an overview of the current state of the art in robot-assisted endoscopic laser microsurgery. The primary target application considered is phonomicrosurgery, which is a representative use case involving highly challenging microsurgical techniques for the treatment of glottic diseases. The paper starts by presenting the motivations and rationale for endoscopic laser microsurgery, which leads to the introduction of robotics as an enabling technology for improved surgical field accessibility, visualization and management. Then, research goals, achievements, and current state of different technologies that can build-up to an effective robotic system for endoscopic laser microsurgery are presented. This includes research in micro-robotic laser steering, flexible robotic endoscopes, augmented imaging, assistive surgeon-robot interfaces, and cognitive surgical systems. Innovations in each of these areas are shown to provide sizable progress towards more precise, safer and higher quality endoscopic laser microsurgeries. Yet, major impact is really expected from the full integration of such individual contributions into a complete clinical surgical robotic system, as illustrated in the end of this paper with a description of preliminary cadaver trials conducted with the integrated µRALP system. Overall, the contribution of this paper lays in outlining the current state of the art and open challenges in the area of robot-assisted endoscopic laser microsurgery, which has important clinical applications even beyond laryngology.

Detection of Breathing Movements of Preterm Neonates by Recording Their Abdominal Movements with a Time-of-Flight Camera.

In order to deliver an aerosolized drug in a breath-triggered manner, the initiation of the patient's inspiration needs to be detected. The best-known systems monitoring breathing patterns are based on flow sensors. However, due to their large dead space volume, flow sensors are not advisable for monitoring the breathing of (preterm) neonates. Newly-developed respiratory sensors, especially when contact-based (invasive), can be tested on (preterm) neonates only with great effort due to clinical and ethical hurdles. Therefore, a physiological model is highly desirable to validate these sensors. For developing such a system, abdominal movement data of (preterm) neonates are required. We recorded time sequences of five preterm neonates' abdominal movements with a time-of-flight camera and successfully extracted various breathing patterns and respiratory parameters. Several characteristic breathing patterns, such as forced breathing, sighing, apnea and crying, were identified from the movement data. Respiratory parameters, such as duration of inspiration and expiration, as well as respiratory rate and breathing movement over time, were also extracted. This work demonstrated that respiratory parameters of preterm neonates can be determined without contact. Therefore, such a system can be used for breathing detection to provide a trigger signal for breath-triggered drug release systems. Furthermore, based on the recorded data, a physiological abdominal movement model of preterm neonates can now be developed.

Workflow assessment as a preclinical development tool : Surgical process models of three techniques for minimally invasive cochlear implantation.

PURPOSE: Minimally invasive cochlear implant surgery is a challenging procedure due to high demands on accuracy. For clinical success, an according assistance system has to compete against the traditional approach in terms of risk, operating time and cost. It has not yet been determined what kind of system is the most suited. The purpose of this study is a proof of concept of surgical process modeling as a preclinical development tool and the comparison of workflow concepts for this new approach. METHODS: Three preclinical systems (two stereotactic and one robotic) for minimally invasive cochlear implant surgery are compared using the method of surgical process modeling. All three systems were successfully tested with ex vivo human specimen to create minimally invasive surgical access to the cochlea. Those systems where chosen for comparison, because they represent three diverse approaches with different corresponding workflows for the same intervention. The experiments were used to create a process model for each system by recording the interventions. RESULTS: All three conceptual systems developed by our group have shown their eligibility. The recorded process models provide a convenient method for direct comparison. Reduction in the surgical time has a higher impact on the process, than time that is needed for setting up a system beforehand. The stereotactic approaches have little preparation effort and are low cost in terms of hardware compared to the robotic approach, which in return is beneficial in terms of workload reduction for the surgeon. CONCLUSION: Surgical process modeling is suitable for comparison of different assistant systems for minimally invasive cochlear implantation. The benefit of reduced trauma, compared to the traditional mastoidectomy, can now be assessed with consideration of the workflow of each technique. The process models enable an assessment in the regard of surgical time and workload.

A dataset of laryngeal endoscopic images with comparative study on convolution neural network-based semantic segmentation.

PURPOSE: Automated segmentation of anatomical structures in medical image analysis is a prerequisite for autonomous diagnosis as well as various computer- and robot-aided interventions. Recent methods based on deep convolutional neural networks (CNN) have outperformed former heuristic methods. However, those methods were primarily evaluated on rigid, real-world environments. In this study, existing segmentation methods were evaluated for their use on a new dataset of transoral endoscopic exploration. METHODS: Four machine learning-based methods SegNet, UNet, ENet and ErfNet were trained with supervision on a novel 7-class dataset of the human larynx. The dataset contains 536 manually segmented images from two patients during laser incisions. The Intersection-over-Union (IoU) evaluation metric was used to measure the accuracy of each method. Data augmentation and network ensembling were employed to increase segmentation accuracy. Stochastic inference was used to show uncertainties of the individual models. Patient-to-patient transfer was investigated using patient-specific fine-tuning. RESULTS: In this study, a weighted average ensemble network of UNet and ErfNet was best suited for the segmentation of laryngeal soft tissue with a mean IoU of 84.7%. The highest efficiency was achieved by ENet with a mean inference time of 9.22 ms per image. It is shown that 10 additional images from a new patient are sufficient for patient-specific fine-tuning. CONCLUSION: CNN-based methods for semantic segmentation are applicable to endoscopic images of laryngeal soft tissue. The segmentation can be used for active constraints or to monitor morphological changes and autonomously detect pathologies. Further improvements could be achieved by using a larger dataset or training the models in a self-supervised manner on additional unlabeled data.

Feasibility Assessment of Optical Coherence Tomography-Guided Laser Labeling in Middle Cranial Fossa Approach.

INTRODUCTION: Different approaches have been developed to find the position of the internal auditory canal (IAC) in middle cranial fossa approach. A feasibility study was performed to investigate the combination of cone beam computed tomography (CBCT), optical coherence tomography (OCT), and laser ablation to assist a surgeon in a middle cranial fossa approach by outlining the internal auditory canal (IAC). MATERIALS AND METHODS: A combined OCT laser setup was used to outline the position of IAC on the surface of the petrous bone in cadaveric semi-heads. The position of the hidden structures, such as IAC, was determined in MATLAB software using an intraoperative CBCT scan. Four titanium spheres attached to the edge of the craniotomy served as reference markers visible in both CBCT and OCT images in order to transfer the plan to the patient. The integrated erbium-doped yttrium aluminum garnet laser was used to mark the surface of the bone by shallow ablation under OCT-based navigation before the surgeon continued the operation. RESULT: The technical setup was feasible, and the laser marking of the border of the IAC was performed with an overall accuracy of 300 µm. The depth of each ablation phase was 300 µm. The marks indicating a safe path supported the surgeon in the surgery. CONCLUSION: The technique investigated in the present study could decrease the surgical risks for the mentioned structures and improve the pace and precision of operation.

High-accuracy drilling with an image guided light weight robot: autonomous versus intuitive feed control.

PURPOSE: Assistance of robotic systems in the operating room promises higher accuracy and, hence, demanding surgical interventions become realisable (e.g. the direct cochlear access). Additionally, an intuitive user interface is crucial for the use of robots in surgery. Torque sensors in the joints can be employed for intuitive interaction concepts. Regarding the accuracy, they lead to a lower structural stiffness and, thus, to an additional error source. The aim of this contribution is to examine, if an accuracy needed for demanding interventions can be achieved by such a system or not. METHODS: Feasible accuracy results of the robot-assisted process depend on each work-flow step. This work focuses on the determination of the tool coordinate frame. A method for drill axis definition is implemented and analysed. Furthermore, a concept of admittance feed control is developed. This allows the user to control feeding along the planned path by applying a force to the robots structure. The accuracy is researched by drilling experiments with a PMMA phantom and artificial bone blocks. RESULTS: The described drill axis estimation process results in a high angular repeatability ([Formula: see text]). In the first set of drilling results, an accuracy of [Formula: see text] at entrance and [Formula: see text] at target point excluding imaging was achieved. With admittance feed control an accuracy of [Formula: see text] at target point was realised. In a third set twelve holes were drilled in artificial temporal bone phantoms including imaging. In this set-up an error of [Formula: see text] and [Formula: see text] was achieved. CONCLUSION: The results of conducted experiments show that accuracy requirements for demanding procedures such as the direct cochlear access can be fulfilled with compliant systems. Furthermore, it was shown that with the presented admittance feed control an accuracy of less then [Formula: see text] is achievable.

Stereo vision-based tracking of soft tissue motion with application to online ablation control in laser microsurgery.

Recent research has revealed that image-based methods can enhance accuracy and safety in laser microsurgery. In this study, non-rigid tracking using surgical stereo imaging and its application to laser ablation is discussed. A recently developed motion estimation framework based on piecewise affine deformation modeling is extended by a mesh refinement step and considering texture information. This compensates for tracking inaccuracies potentially caused by inconsistent feature matches or drift. To facilitate online application of the method, computational load is reduced by concurrent processing and affine-invariant fusion of tracking and refinement results. The residual latency-dependent tracking error is further minimized by Kalman filter-based upsampling, considering a motion model in disparity space. Accuracy is assessed in laparoscopic, beating heart, and laryngeal sequences with challenging conditions, such as partial occlusions and significant deformation. Performance is compared with that of state-of-the-art methods. In addition, the online capability of the method is evaluated by tracking two motion patterns performed by a high-precision parallel-kinematic platform. Related experiments are discussed for tissue substitute and porcine soft tissue in order to compare performances in an ideal scenario and in a setup mimicking clinical conditions. Regarding the soft tissue trial, the tracking error can be significantly reduced from 0.72 mm to below 0.05 mm with mesh refinement. To demonstrate online laser path adaptation during ablation, the non-rigid tracking framework is integrated into a setup consisting of a surgical Er:YAG laser, a three-axis scanning unit, and a low-noise stereo camera. Regardless of the error source, such as laser-to-camera registration, camera calibration, image-based tracking, and scanning latency, the ablation root mean square error is kept below 0.21 mm when the sample moves according to the aforementioned patterns. Final experiments regarding motion-compensated laser ablation of structurally deforming tissue highlight the potential of the method for vision-guided laser surgery.

Workflow and simulation of image-to-physical registration of holes inside spongy bone.

PURPOSE: Mastoid cells as well as trabecula provide unique bone structures, which can serve as natural landmarks for registration. Preoperative imaging enables sufficient acquisition of these structures, but registration requires an intraoperative counterpart. Since versatile surgical interventions involve drilling into mastoid cells and trabecula, we propose a registration method based on endoscopy inside of these drill holes. METHODS: Recording of the surface of the inner drill hole yields bone-air patterns that provide intraoperative registration features. In this contribution, we discuss an approach that unrolls the drill hole surface into a two-dimensional image. Intraoperative endoscopic recordings are compared to simulated endoscopic views, which originate from preoperative data like computed tomography. Each simulated view corresponds to a different drill pose. The whole registration procedure and workflow is demonstrated, using high-resolution image data to simulate both preoperative and endoscopic image data. RESULTS: As the driving application is minimally invasive cochlear implantation, in which targets are close to the axis of the drill hole, Target Registration Error (TRE) was measured at points near the axis. TRE at increasing depths along the drill trajectory reveals increasing registration accuracy as more bone-air patterns become available as landmarks with the highest accuracy obtained at the center point. At the facial recess and the cochlea, TREs are ([Formula: see text]) mm and ([Formula: see text]) mm, respectively. CONCLUSION: This contribution demonstrates a new method for registration via endoscopic acquisition of small features like trabecula or mastoid cells for image-guided procedures. It has the potential to revolutionize bone registration because it requires only a preoperative dataset and intraoperative endoscopic exploration. Endoscopic recordings of at least 20 mm length and isotropic voxel sizes of 0.2 mm or smaller of the preoperative image data are recommended.

Patient specific pointer tool for corrective osteotomy: Quality of symmetry based planning and case study of ulnar reconstruction surgery.

Malunion after forearm fractures are described to appear in 2% to 10% of cases. Reconstructive surgeries ensure adequate anatomical repositioning. Their importance derives from the fact that malunion can often lead to severe pain as well as deformities causing loss of function and aesthetic issues not only in the forearm, but also the wrist and elbow joint. In this paper a clinical case will be presented using a Patient Specific Instrument (PSI) as navigational aid for reconstructive surgery after malunion of a proximal ulnar fracture combined with allograft surgery of the radial head and radial condyle due to chronic traumatic radial head luxation (Monteggia fracture). A planning method based on symmetry is described and evaluated on twelve Computed Tomographic (CT) data sets of intact forearms. The absolute point to point deviation at distal end of the ulnar styloid process was used as a characteristic value for accuracy evaluation. It is 7.9±4.9mm when using only the proximal end of the ulna for registration. The simulated change of ulnar variance is -1.4±1.9mm. Design and concept of the PSI are proven in a clinical trial.

Experimental Visualization of Labyrinthine Structure with Optical Coherence Tomography.

INTRODUCTION: Visualization of inner ear structures is a valuable strategy for researchers and clinicians working on hearing pathologies. Optical coherence tomography (OCT) is a high-resolution imaging technology which may be used for the visualization of tissues. In this experimental study we aimed to evaluate inner ear anatomy in well-prepared human labyrinthine bones. MATERIALS AND METHODS: Three fresh human explanted temporal bones were trimmed, chemically decalcified with ethylenediaminetetraacetic acid (EDTA), and mechanically drilled under visual control using OCT in order to reveal the remaining bone shell. After confirming decalcification with a computed tomography (CT) scan, the samples were scanned with OCT in different views. The oval window, round window, and remnant part of internal auditory canal and cochlear turn were investigated. RESULTS: Preparation of the labyrinthine bone and visualization under OCT guidance was successfully performed to a remaining bony layer of 300µm thickness. OCT images of the specimen allowed a detailed view of the intra-cochlear anatomy. CONCLUSION: OCT is applicable in the well-prepared human inner ear and allows visualization of soft tissue parts.

Design considerations for patient-specific surgical templates for total hip arthroplasty with respect to acetabular cartilage.

Patient-specific instruments (PSIs) are clinically used to support the surgeon during a planned intervention. The planning is typically done based on volumetric image data from medical imaging systems, e.g. computed tomography (CT). The PSI uses the known surface structure of a bone for orientation during the intervention. Some surfaces of human bone are covered with a layer of cartilage which is hardly visible in clinically applied CT-imaging. This experimental study investigates ten different PSI designs and their effect to the overall accuracy when neglecting the cartilage in the design process. Therefore, a model of an acetabulum is used to simulate the use case of PSI in total hip arthroplasty. The concept of the different designs is to create structural elasticities in the PSI to avoid shifting of the whole instrument and rather have a small part of it deformed by cartilage. A needle array structure, for instance, should also be able to oust or penetrate remaining soft tissue in the acetabulum.

Soft tissue motion tracking with application to tablet-based incision planning in laser surgery.

PURPOSE: Recent research has revealed that incision planning in laser surgery deploying stylus and tablet outperforms micromanipulator control. However, vision-based adaption to dynamic surgical scenes has not been addressed so far. In this study, scene motion compensation for tablet-based planning by means of tissue deformation tracking is discussed. METHODS: A stereo-based method for motion tracking with piecewise affine deformation modeling is presented. Proposed parametrization relies on the epipolar constraint to enforce left-right consistency in the energy minimization problem. Furthermore, the method implements illumination-invariant tracking and appearance-based occlusion detection. Performance is assessed on laparoscopic and laryngeal in vivo data. In particular, tracking accuracy is measured under various conditions such as occlusions and simulated laser cuttings. Experimental validation is extended to a user study conducted on a tablet-based interface that integrates the tracking for image stabilization. RESULTS: Tracking accuracy measurement reveals a root-mean-square error of 2.45 mm for the laparoscopic and 0.41 mm for the laryngeal dataset. Results successfully demonstrate stereoscopic tracking under changes in illumination, translation, rotation and scale. In particular, proposed occlusion detection scheme can increase robustness against tracking failure. Moreover, assessed user performance indicates significantly increased path tracing accuracy and usability if proposed tracking is deployed to stabilize the view during free-hand path definition. CONCLUSION: The presented algorithm successfully extends piecewise affine deformation tracking to stereo vision taking the epipolar constraint into account. Improved surgical performance as demonstrated for laser incision planning highlights the potential of presented method regarding further applications in computer-assisted surgery.

Configuration optimization and experimental accuracy evaluation of a bone-attached, parallel robot for skull surgery.

PURPOSE: Minimally invasive cochlear implantation is a novel surgical technique which requires highly accurate guidance of a drilling tool along a trajectory from the mastoid surface toward the basal turn of the cochlea. The authors propose a passive, reconfigurable, parallel robot which can be directly attached to bone anchors implanted in a patient's skull, avoiding the need for surgical tracking systems. Prior to clinical trials, methods are necessary to patient specifically optimize the configuration of the mechanism with respect to accuracy and stability. Furthermore, the achievable accuracy has to be determined experimentally. METHODS: A comprehensive error model of the proposed mechanism is established, taking into account all relevant error sources identified in previous studies. Two optimization criteria to exploit the given task redundancy and reconfigurability of the passive robot are derived from the model. The achievable accuracy of the optimized robot configurations is first estimated with the help of a Monte Carlo simulation approach and finally evaluated in drilling experiments using synthetic temporal bone specimen. RESULTS: Experimental results demonstrate that the bone-attached mechanism exhibits a mean targeting accuracy of [Formula: see text] mm under realistic conditions. A systematic targeting error is observed, which indicates that accurate identification of the passive robot's kinematic parameters could further reduce deviations from planned drill trajectories. CONCLUSION: The accuracy of the proposed mechanism demonstrates its suitability for minimally invasive cochlear implantation. Future work will focus on further evaluation experiments on temporal bone specimen.

Comparative study on surface reconstruction accuracy of stereo imaging devices for microsurgery.

PURPOSE: Processing stereoscopic image data is an emerging field. Especially in microsurgery that requires sub-millimeter accuracy, application of stereo-based methods on endoscopic and microscopic scenarios is of major interest. In this context, direct comparison of stereo-based surface reconstruction applied to several camera settings is presented. METHODS: A method for stereo matching is proposed and validated on in-vitro data. Demonstrating suitability for surgical scenarios, this method is applied to two custom-made stereo cameras, a miniaturized, bendable surgical endoscope and an operating microscope. Reconstruction accuracy is assessed on a custom-made reference sample. Subsequent to its fabrication, a coordinate measuring arm is used to acquire ground truth. Next, the sample is positioned by a robot at varying distances to each camera. Surface estimation is performed, while the specimen is localized based on. markers. Finally, the error between estimated surface and ground truth is computed. RESULTS: Sample measurement with the coordinate measuring arm yields reliable ground truth data with a root-mean-square error of 11.2 µm. Overall surface reconstruction with analyzed cameras is quantified by a root-mean-square error of less than 0.18 mm. Microscope setting with the highest magnification yields the most accurate measurement, while the maximum deviation does not exceed 0.5 mm. Custom-made stereo cameras perform similar but with outliers of increased magnitude. Miniaturized, bendable surgical endoscope produces the maximum error of approximately 1.2 mm. CONCLUSIONS: Reconstruction results reveal that microscopic imaging outperforms investigated chip-on-the-tip solutions, i.e., at higher magnification. Nonetheless, custom-made cameras are suitable for application in microsurgery. Although reconstruction with the miniaturized endoscope is more inaccurate, it provides a good trade-off between accuracy, outer dimensions and accessibility to hard-to-reach surgical sites.

Cochlear Dummy Electrodes for Insertion Training and Research Purposes: Fabrication, Mechanical Characterization, and Experimental Validation.

To develop skills sufficient for hearing preservation cochlear implant surgery, surgeons need to perform several electrode insertion trials in ex vivo temporal bones, thereby consuming relatively expensive electrode carriers. The objectives of this study were to evaluate the insertion characteristics of cochlear electrodes in a plastic scala tympani model and to fabricate radio opaque polymer filament dummy electrodes of equivalent mechanical properties. In addition, this study should aid the design and development of new cochlear electrodes. Automated insertion force measurement is a new technique to reproducibly analyze and evaluate the insertion dynamics and mechanical characteristics of an electrode. Mechanical properties of MED-EL's FLEX(28), FLEX(24), and FLEX(20) electrodes were assessed with the help of an automated insertion tool. Statistical analysis of the overall mechanical behavior of the electrodes and factors influencing the insertion force are discussed. Radio opaque dummy electrodes of comparable characteristics were fabricated based on insertion force measurements. The platinum-iridium wires were replaced by polymer filament to provide sufficient stiffness to the electrodes and to eradicate the metallic artifacts in X-ray and computed tomography (CT) images. These low-cost dummy electrodes are cheap alternatives for surgical training and for in vitro, ex vivo, and in vivo research purposes.

The "Iceberg Phenomenon": As Soon as One Technological Problem in NOTES Is Solved, the Next One Appears!

PURPOSE: Though already proclaimed about 7 years ago, natural orifice transluminal endoscopic surgery (NOTES) is still in its early stages. A multidisciplinary working team tried to analyze the technical obstacles and identify potential solutions. METHODS: After a comprehensive review of the literature, a group of 3 surgeons, 1 gastroenterologist, 10 engineers, and 1 representative of biomedical industry defined the most important deficiencies within the system and then compiled as well as evaluated innovative technologies that could be used to help overcome these problems. These technologies were classified with regard to the time needed for their implementation and associated hindrances, where priority is based on the level of impact and significance that it would make. RESULTS: Both visualization and actuation require significant improvement. Advanced illumination, mist elimination, image stabilization, view extension, 3-dimensional stereoscopy, and augmented reality are feasible options and could optimize visual information. Advanced mechatronic platforms with miniaturized, powerful actuators, and intuitive human-machine interfaces could optimize dexterity, as long as enabling technologies are used. The latter include depth maps in real time, precise navigation, fast pattern recognition, partial autonomy, and cognition systems. CONCLUSION: The majority of functional deficiencies that still exist in NOTES platforms could be overcome by a broad range of already existing or emerging enabling technologies. To combine them in an optimal manner, a permanent dialogue between researchers and clinicians is mandatory.

Mechanical characterization of bone anchors used with a bone-attached, parallel robot for skull surgery.

Bone-attached robots and microstereotactic frames, intended for deep brain stimulation and minimally invasive cochlear implantation, typically attach to a patient's skull via bone anchors. A rigid and reliable link between such devices and the skull is mandatory in order to fulfill the high accuracy demands of minimally invasive procedures while maintaining patient safety. In this paper, a method is presented to experimentally characterize the mechanical properties of the anchor-bone linkage. A custom-built universal testing machine is used to measure the pullout strength as well as the spring constants of bone anchors seated in four different bone substitutes as well as in human cranial bone. Furthermore, the angles at which forces act on the bone anchors are varied to simulate realistic conditions. Based on the experimental results, a substitute material that has mechanical properties similar to those of cranial bone is identified. The results further reveal that the pullout strength of the investigated anchor design is sufficient with respect to the proposed application. However, both the measured load capacity as well as the spring constants vary depending on the load angles. Based on these findings, an alternative bone anchor design is presented and experimentally validated. Furthermore, the results serve as a basis for stiffness simulation and optimization of bone-attached microstereotactic frames.

An experimental evaluation of loads occurring during guided drilling for cochlear implantation.

PURPOSE: During guided drilling for minimally invasive cochlear implantation and related applications, typically forces and torques act on the employed tool guides, which result from both the surgeon's interaction and the bone drilling process. Such loads propagate through the rigid mechanisms and result in deformations of compliant parts, which in turn affect the achievable accuracy. In this paper, the order of magnitude as well as the factors influencing such loads are studied experimentally to facilitate design and optimization of future drill guide prototypes. METHODS: The experimental setup to evaluate the occurring loads comprises two six degree of freedom force/torque sensors: one mounted between a manually operated, linearly guided drill handpiece and one below the specimens into which the drilling is carried out. This setup is used to analyze the influences of drilling tool geometry, spindle speed as well as experience of the operator on the resulting loads. RESULTS: The results reveal that using a spiral drill results in lower process loads compared with a surgical Lindemann mill. Moreover, in this study, an experienced surgeon applied lower interaction forces compared with untrained volunteers. The measured values further indicate that both the intraoperative handling of the bone-attached drill guide as well as the tool removal after completing the hole can be expected to cause temporary load peaks which exceed the values acquired during the drilling procedure itself. CONCLUSIONS: The results obtained using the proposed experimental setup serve as realistic design criteria with respect to the development of future drill guide prototypes. Furthermore, the given values can be used to parameterize simulations for profound stiffness analyses of existing mechanisms.

Tissue surface information for intraoperative incision planning and focus adjustment in laser surgery.

PURPOSE: Introducing computational methods to laser surgery are an emerging field. Focusing on endoscopic laser interventions, a novel approach is presented to enhance intraoperative incision planning and laser focusing by means of tissue surface information obtained by stereoscopic vision. METHODS: Tissue surface is estimated with stereo-based methods using nonparametric image transforms. Subsequently, laser-to-camera registration is obtained by ablating a pattern on tissue substitutes and performing a principle component analysis for precise laser axis estimation. Furthermore, a virtual laser view is computed utilizing trifocal transfer. Depth-based laser focus adaptation is integrated into a custom experimental laser setup in order to achieve optimal ablation morphology. Experimental validation is conducted on tissue substitutes and ex vivo animal tissue. RESULTS: Laser-to-camera registration gives an error between planning and ablation of less than 0.2 mm. As a result, the laser workspace can accurately be highlighted within the live views and incision planning can directly be performed. Experiments related to laser focus adaptation demonstrate that ablation geometry can be kept almost uniform within a depth range of 7.9 mm, whereas cutting quality significantly decreases when the laser is defocused. CONCLUSIONS: An automatic laser focus adjustment on tissue surfaces based on stereoscopic scene information is feasible and has the potential to become an effective methodology for optimal ablation. Laser-to-camera registration facilitates advanced surgical planning for prospective user interfaces and augmented reality extensions.

OpenIGTLink interface for state control and visualisation of a robot for image-guided therapy systems.

PURPOSE: The integration of a robot into an image-guided therapy system is still a time consuming process, due to the lack of a well-accepted standard for interdevice communication. The aim of this project is to simplify this procedure by developing an open interface based on three interface classes: state control, visualisation, and sensor. A state machine on the robot control is added to the concept because the robot has its own workflow during surgical procedures, which differs from the workflow of the surgeon. METHODS: A KUKA Light Weight Robot is integrated into the medical technology environment of the Institute of Mechatronic Systems as a proof of concept. Therefore, 3D Slicer was used as visualisation and state control software. For the network communication the OpenIGTLink protocol was implemented. In order to achieve high rate control of the robot the "KUKA Sunrise. Connectivity SmartServo" package was used. An exemplary state machine providing states typically used by image-guided therapy interventions, was implemented. Two interface classes, which allow for a direct use of OpenIGTLink for robot control on the one hand and visualisation on the other hand were developed. Additionally, a 3D Slicer module was written to operate the state control. RESULTS: Utilising the described software concept the state machine could be operated by the 3D Slicer module with 20 Hz cycle rate and no data loss was detected during a test phase of approximately 270s (13,640 packages). Furthermore, the current robot pose could be sent with more than 60 Hz. No influence on the performance of the state machine by the communication thread could be measured. CONCLUSION: Simplified integration was achieved by using only one programming context for the implementation of the state machine, the interfaces, and the robot control. Eventually, the exemplary state machine can be easily expanded by adding new states.