Evaluation of a calibration rig for stereo laparoscopes.

BACKGROUND: Accurate camera and hand-eye calibration are essential to ensure high-quality results in image-guided surgery applications. The process must also be able to be undertaken by a nonexpert user in a surgical setting. PURPOSE: This work seeks to identify a suitable method for tracked stereo laparoscope calibration within theater. METHODS: A custom calibration rig, to enable rapid calibration in a surgical setting, was designed. The rig was compared against freehand calibration. Stereo reprojection, stereo reconstruction, tracked stereo reprojection, and tracked stereo reconstruction error metrics were used to evaluate calibration quality. RESULTS: Use of the calibration rig reduced mean errors: reprojection (1.47 mm [SD 0.13] vs. 3.14 mm [SD 2.11], p-value 1e-8), reconstruction (1.37 px [SD 0.10] vs. 10.10 px [SD 4.54], p-value 6e-7), and tracked reconstruction (1.38 mm [SD 0.10] vs. 12.64 mm [SD 4.34], p-value 1e-6) compared with freehand calibration. The use of a ChArUco pattern yielded slightly lower reprojection errors, while a dot grid produced lower reconstruction errors and was more robust under strong global illumination. CONCLUSION: The use of the calibration rig results in a statistically significant decrease in calibration error metrics, versus freehand calibration, and represents the preferred approach for use in the operating theater.

A patient-specific multi-modality abdominal aortic aneurysm imaging phantom.

PURPOSE: Multimodality imaging of the vascular system is a rapidly growing area of innovation and research, which is increasing with awareness of the dangers of ionizing radiation. Phantom models that are applicable across multiple imaging modalities facilitate testing and comparisons in pre-clinical studies of new devices. Additionally, phantom models are of benefit to surgical trainees for gaining experience with new techniques. We propose a temperature-stable, high-fidelity method for creating complex abdominal aortic aneurysm phantoms that are compatible with both radiation-based, and ultrasound-based imaging modalities, using low cost materials. METHODS: Volumetric CT data of an abdominal aortic aneurysm were acquired. Regions of interest were segmented to form a model compatible with 3D printing. The novel phantom fabrication method comprised a hybrid approach of using 3D printing of water-soluble materials to create wall-less, patient-derived vascular structures embedded within tailored tissue-mimicking materials to create realistic surrounding tissues. A non-soluble 3-D printed spine was included to provide a radiological landmark. RESULTS: The phantom was found to provide realistic appearances with intravascular ultrasound, computed tomography and transcutaneous ultrasound. Furthermore, the utility of this phantom as a training model was demonstrated during a simulated endovascular aneurysm repair procedure with image fusion. CONCLUSION: With the hybrid fabrication method demonstrated here, complex multimodality imaging patient-derived vascular phantoms can be successfully fabricated. These have potential roles in the benchtop development of emerging imaging technologies, refinement of novel minimally invasive surgical techniques and as clinical training tools.

Multispectral tissue mapping: developing a concept for the optical evaluation of liver disease.

Purpose: Alterations in the optical absorption behavior of liver tissue secondary to pathological processes can be evaluated by multispectral analysis, which is increasingly being explored as an imaging adjunct for use in liver surgery. Current methods are either invasive or have a limited wavelength spectrum, which restricts utility. This proof of concept study describes the development of a multispectral imaging (MSI) method called multispectral tissue mapping (MTM) that addresses these issues. Approach: The imaging system consists of a tunable excitation light source and a near-infrared camera. Following the development stage, proof of concept experiments are carried out where absorption spectra from colorectal cancer liver metastasis (CRLM), hepatocellular carcinoma (HCC), and liver steatosis specimen are acquired and compared to controls. Absorption spectra are compared to histopathology examination as the current gold standard for tissue assessment. Generalized linear mixed modeling is employed to compare absorption characteristics of individual pixels and to select wavelengths for false color image processing with the aim of visually enhancing cancer tissue. Results: Analysis of individual pixels revealed distinct absorption spectra therefore suggesting that MTM is possible. A prominent absorption peak at 1210 nm was found in lipid-rich animal tissues and steatotic liver specimen. Liver cancer tissue had a heterogeneous appearance on MSI. Subsequent statistical analysis suggests that measuring changes in absorption behavior may be a feasible method to estimate the pixel-based probability of cancer being present. In CRLM, this was observed throughout 1100 to 1700 nm, whereas in HCC it was concentrated around 1140 and 1430 nm. False color image processing visibly enhances contrast between cancer and normal liver tissues. Conclusions: The system's ability to enable no-touch MSI at 1100 to 1700 nm was demonstrated. Preliminary data suggest that MTM warrants further exploration as a potential imaging tool for the detection of liver cancer during surgery.

Electromagnetic tracking in image-guided laparoscopic surgery: Comparison with optical tracking and feasibility study of a combined laparoscope and laparoscopic ultrasound system.

PURPOSE: In image-guided laparoscopy, optical tracking is commonly employed, but electromagnetic (EM) systems have been proposed in the literature. In this paper, we provide a thorough comparison of EM and optical tracking systems for use in image-guided laparoscopic surgery and a feasibility study of a combined, EM-tracked laparoscope and laparoscopic ultrasound (LUS) image guidance system. METHODS: We first assess the tracking accuracy of a laparoscope with two optical trackers tracking retroreflective markers mounted on the shaft and an EM tracker with the sensor embedded at the proximal end, using a standard evaluation plate. We then use a stylus to test the precision of position measurement and accuracy of distance measurement of the trackers. Finally, we assess the accuracy of an image guidance system comprised of an EM-tracked laparoscope and an EM-tracked LUS probe. RESULTS: In the experiment using a standard evaluation plate, the two optical trackers show less jitter in position and orientation measurement than the EM tracker. Also, the optical trackers demonstrate better consistency of orientation measurement within the test volume. However, their accuracy of measuring relative positions decreases significantly with longer distances whereas the EM tracker's performance is stable; at 50 mm distance, the RMS errors for the two optical trackers are 0.210 and 0.233 mm, respectively, and it is 0.214 mm for the EM tracker; at 250 mm distance, the RMS errors for the two optical trackers become 1.031 and 1.178 mm, respectively, while it is 0.367 mm for the EM tracker. In the experiment using the stylus, the two optical trackers have RMS errors of 1.278 and 1.555 mm in localizing the stylus tip, and it is 1.117 mm for the EM tracker. Our prototype of a combined, EM-tracked laparoscope and LUS system using representative calibration methods showed a RMS point localization error of 3.0 mm for the laparoscope and 1.3 mm for the LUS probe, the lager error of the former being predominantly due to the triangulation error when using a narrow-baseline stereo laparoscope. CONCLUSIONS: The errors incurred by optical trackers, due to the lever-arm effect and variation in tracking accuracy in the depth direction, would make EM-tracked solutions preferable if the EM sensor is placed at the proximal end of the laparoscope.

3D printing from microfocus computed tomography (micro-CT) in human specimens: education and future implications.

Microfocus CT (micro-CT) is an imaging method that provides three-dimensional digital data sets with comparable resolution to light microscopy. Although it has traditionally been used for non-destructive testing in engineering, aerospace industries and in preclinical animal studies, new applications are rapidly becoming available in the clinical setting including post-mortem fetal imaging and pathological specimen analysis. Printing three-dimensional models from imaging data sets for educational purposes is well established in the medical literature, but typically using low resolution (0.7 mm voxel size) data acquired from CT or MR examinations. With higher resolution imaging (voxel sizes below 1 micron, <0.001 mm) at micro-CT, smaller structures can be better characterised, and data sets post-processed to create accurate anatomical models for review and handling. In this review, we provide examples of how three-dimensional printing of micro-CT imaged specimens can provide insight into craniofacial surgical applications, developmental cardiac anatomy, placental imaging, archaeological remains and high-resolution bone imaging. We conclude with other potential future usages of this emerging technique.

Gel wax-based tissue-mimicking phantoms for multispectral photoacoustic imaging.

Tissue-mimicking phantoms are widely used for the calibration, evaluation and standardisation of medical imaging systems, and for clinical training. For photoacoustic imaging, tissue-mimicking materials (TMMs) that have tuneable optical and acoustic properties, high stability, and mechanical robustness are highly desired. In this study, gel wax is introduced as a TMM that satisfies these criteria for developing photoacoustic imaging phantoms. The reduced scattering and optical absorption coefficients were independently tuned with the addition of TiO2 and oil-based inks. The frequency-dependent acoustic attenuation obeyed a power law; for native gel wax, it varied from 0.71 dB/cm at 3 MHz to 9.93 dB/cm at 12 MHz. The chosen oil-based inks, which have different optical absorption spectra in the range of 400 to 900 nm, were found to have good photostability under pulsed illumination with photoacoustic excitation light. Optically heterogeneous phantoms that comprised of inclusions with different concentrations of carbon black and coloured inks were fabricated, and multispectral photoacoustic imaging was performed with an optical parametric oscillator and a planar Fabry-Pérot sensor. We conclude that gel wax is well suited as a TMM for multispectral photoacoustic imaging.

Anatomically realistic ultrasound phantoms using gel wax with 3D printed moulds.

Here we describe methods for creating tissue-mimicking ultrasound phantoms based on patient anatomy using a soft material called gel wax. To recreate acoustically realistic tissue properties, two additives to gel wax were considered: paraffin wax to increase acoustic attenuation, and solid glass spheres to increase backscattering. The frequency dependence of ultrasound attenuation was well described with a power law over the measured range of 3-10 MHz. With the addition of paraffin wax in concentrations of 0 to 8 w/w%, attenuation varied from 0.72 to 2.91 dB cm-1 at 3 MHz and from 6.84 to 26.63 dB cm-1 at 10 MHz. With solid glass sphere concentrations in the range of 0.025-0.9 w/w%, acoustic backscattering consistent with a wide range of ultrasonic appearances was achieved. Native gel wax maintained its integrity during compressive deformations up to 60%; its Young's modulus was 17.4 ± 1.4 kPa. The gel wax with additives was shaped by melting and pouring it into 3D printed moulds. Three different phantoms were constructed: a nerve and vessel phantom for peripheral nerve blocks, a heart atrium phantom, and a placental phantom for minimally-invasive fetal interventions. In the first, nerves and vessels were represented as hyperechoic and hypoechoic tubular structures, respectively, in a homogeneous background. The second phantom comprised atria derived from an MRI scan of a patient with an intervening septum and adjoining vena cavae. The third comprised the chorionic surface of a placenta with superficial fetal vessels derived from an image of a post-partum human placenta. Gel wax is a material with widely tuneable ultrasound properties and mechanical characteristics that are well suited for creating patient-specific ultrasound phantoms in several clinical disciplines.

The Bionic Clicker Mark I & II.

In this manuscript, we present two 'Bionic Clicker' systems, the first designed to demonstrate electromyography (EMG) based control systems for educational purposes and the second for research purposes. EMG based control systems pick up electrical signals generated by muscle activation and use these as inputs for controllers. EMG controllers are widely used in prosthetics to control limbs. The Mark I (MK I) clicker allows the wearer to change the slide of a presentation by raising their index finger. It is built around a microcontroller and a bio-signals shield. It generated a lot of interest from both the public and research community. The Mark II (MK II) device presented here was designed to be a cheaper, sleeker, and more customizable system that can be easily modified and directly transmit EMG data. It is built using a wireless capable microcontroller and a muscle sensor.

From medical imaging data to 3D printed anatomical models.

Anatomical models are important training and teaching tools in the clinical environment and are routinely used in medical imaging research. Advances in segmentation algorithms and increased availability of three-dimensional (3D) printers have made it possible to create cost-efficient patient-specific models without expert knowledge. We introduce a general workflow that can be used to convert volumetric medical imaging data (as generated by Computer Tomography (CT)) to 3D printed physical models. This process is broken up into three steps: image segmentation, mesh refinement and 3D printing. To lower the barrier to entry and provide the best options when aiming to 3D print an anatomical model from medical images, we provide an overview of relevant free and open-source image segmentation tools as well as 3D printing technologies. We demonstrate the utility of this streamlined workflow by creating models of ribs, liver, and lung using a Fused Deposition Modelling 3D printer.

Medical-grade Sterilizable Target for Fluid-immersed Fetoscope Optical Distortion Calibration.

We have developed a calibration target for use with fluid-immersed endoscopes within the context of the GIFT-Surg (Guided Instrumentation for Fetal Therapy and Surgery) project. One of the aims of this project is to engineer novel, real-time image processing methods for intra-operative use in the treatment of congenital birth defects, such as spina bifida and the twin-to-twin transfusion syndrome. The developed target allows for the sterility-preserving optical distortion calibration of endoscopes within a few minutes. Good optical distortion calibration and compensation are important for mitigating undesirable effects like radial distortions, which not only hamper accurate imaging using existing endoscopic technology during fetal surgery, but also make acquired images less suitable for potentially very useful image computing applications, like real-time mosaicing. In this paper proposes a novel fabrication method to create an affordable, sterilizable calibration target suitable for use in a clinical setup. This method involves etching a calibration pattern by laser cutting a sandblasted stainless steel sheet. This target was validated using the camera calibration module provided by OpenCV, a state-of-the-art software library popular in the computer vision community.

Coded excitation ultrasonic needle tracking: An in vivo study.

PURPOSE: Accurate and efficient guidance of medical devices to procedural targets lies at the heart of interventional procedures. Ultrasound imaging is commonly used for device guidance, but determining the location of the device tip can be challenging. Various methods have been proposed to track medical devices during ultrasound-guided procedures, but widespread clinical adoption has remained elusive. With ultrasonic tracking, the location of a medical device is determined by ultrasonic communication between the ultrasound imaging probe and a transducer integrated into the medical device. The signal-to-noise ratio (SNR) of the transducer data is an important determinant of the depth in tissue at which tracking can be performed. In this paper, the authors present a new generation of ultrasonic tracking in which coded excitation is used to improve the SNR without spatial averaging. METHODS: A fiber optic hydrophone was integrated into the cannula of a 20 gauge insertion needle. This transducer received transmissions from the ultrasound imaging probe, and the data were processed to obtain a tracking image of the needle tip. Excitation using Barker or Golay codes was performed to improve the SNR, and conventional bipolar excitation was performed for comparison. The performance of the coded excitation ultrasonic tracking system was evaluated in an in vivo ovine model with insertions to the brachial plexus and the uterine cavity. RESULTS: Coded excitation significantly increased the SNRs of the tracking images, as compared with bipolar excitation. During an insertion to the brachial plexus, the SNR was increased by factors of 3.5 for Barker coding and 7.1 for Golay coding. During insertions into the uterine cavity, these factors ranged from 2.9 to 4.2 for Barker coding and 5.4 to 8.5 for Golay coding. The maximum SNR was 670, which was obtained with Golay coding during needle withdrawal from the brachial plexus. Range sidelobe artifacts were observed in tracking images obtained with Barker coded excitation, and they were visually absent with Golay coded excitation. The spatial tracking accuracy was unaffected by coded excitation. CONCLUSIONS: Coded excitation is a viable method for improving the SNR in ultrasonic tracking without compromising spatial accuracy. This method provided SNR increases that are consistent with theoretical expectations, even in the presence of physiological motion. With the ultrasonic tracking system in this study, the SNR increases will have direct clinical implications in a broad range of interventional procedures by improving visibility of medical devices at large depths.

Construction of 3-Dimensional Printed Ultrasound Phantoms With Wall-less Vessels.

Ultrasound phantoms are invaluable as training tools for vascular access procedures. We developed ultrasound phantoms with wall-less vessels using 3-dimensional printed chambers. Agar was used as a soft tissue-mimicking material, and the wall-less vessels were created with rods that were retracted after the agar was set. The chambers had integrated luer connectors to allow for fluid injections with clinical syringes. Several variations on this design are presented, which include branched and stenotic vessels. The results show that 3-dimensional printing can be well suited to the construction of wall-less ultrasound phantoms, with designs that can be readily customized and shared electronically.

Quantification of light attenuation in optically cleared mouse brains.

Optical clearing, in combination with recently developed optical imaging techniques, enables visualization and acquisition of high-resolution, three-dimensional images of biological structures deep within the tissue. Many different approaches can be used to reduce light absorption and scattering within the tissue, but there is a paucity of research on the quantification of clearing efficacy. With the use of a custom-made spectroscopy system, we developed a way to quantify the quality of clearing in biological tissue and applied it to the mouse brain. Three clearing techniques were compared: BABB (1:2 mixture of benzyl alcohol and benzyl benzoate, also known as Murray's clear), pBABB (peroxide BABB, a modification of BABB which includes the use of hydrogen peroxide), and passive CLARITY. We found that BABB and pBABB produced the highest degree of optical clearing. Furthermore, the approach allows regional measurement of light attenuation to be performed, and our results show that light is most attenuated in regions with high lipid content. We provide a way to choose between the multiple clearing protocols available, and it could prove useful for evaluating images that are acquired with cleared tissues.

Performance characteristics of an interventional multispectral photoacoustic imaging system for guiding minimally invasive procedures.

Precise device guidance is important for interventional procedures in many different clinical fields including fetal medicine, regional anesthesia, interventional pain management, and interventional oncology. While ultrasound is widely used in clinical practice for real-time guidance, the image contrast that it provides can be insufficient for visualizing tissue structures such as blood vessels, nerves, and tumors. This study was centered on the development of a photoacoustic imaging system for interventional procedures that delivered excitation light in the ranges of 750 to 900 nm and 1150 to 1300 nm, with an optical fiber positioned in a needle cannula. Coregistered B-mode ultrasound images were obtained. The system, which was based on a commercial ultrasound imaging scanner, has an axial resolution in the vicinity of 100 µm and a submillimeter, depth-dependent lateral resolution. Using a tissue phantom and 800 nm excitation light, a simulated blood vessel could be visualized at a maximum distance of 15 mm from the needle tip. Spectroscopic contrast for hemoglobin and lipids was observed with ex vivo tissue samples, with photoacoustic signal maxima consistent with the respective optical absorption spectra. The potential for further optimization of the system is discussed.

Interventional Photoacoustic Imaging of the Human Placenta with Ultrasonic Tracking for Minimally Invasive Fetal Surgeries.

Image guidance plays a central role in minimally invasive fetal surgery such as photocoagulation of inter-twin placental anastomosing vessels to treat twin-to-twin transfusion syndrome (TTTS). Fetoscopic guidance provides insufficient sensitivity for imaging the vasculature that lies beneath the fetal placental surface due to strong light scattering in biological tissues. Incomplete photocoagulation of anastamoses is associated with postoperative complications and higher perinatal mortality. In this study, we investigated the use of multi-spectral photoacoustic (PA) imaging for better visualization of the placental vasculature. Excitation light was delivered with an optical fiber with dimensions that are compatible with the working channel of a fetoscope. Imaging was performed on an ex vivo normal term human placenta collected at Caesarean section birth. The photoacoustically-generated ultrasound signals were received by an external clinical linear array ultrasound imaging probe. A vein under illumination on the fetal placenta surface was visualized with PA imaging, and good correspondence was obtained between the measured PA spectrum and the optical absorption spectrum of deoxygenated blood. The delivery fiber had an attached fiber optic ultrasound sensor positioned directly adjacent to it, so that its spatial position could be tracked by receiving transmissions from the ultrasound imaging probe. This study provides strong indications that PA imaging in combination with ultrasonic tracking could be useful for detecting the human placental vasculature during minimally invasive fetal surgery.

Dual-wavelength mode-locked quantum-dot laser, via ground and excited state transitions: experimental and theoretical investigation.

We report a dual-wavelength passive mode locking regime where picosecond pulses are generated from both ground (lambda = 1263 nm) and excited state transitions (lambda = 1180 nm), in a GaAs-based monolithic two-section quantum-dot laser. Moreover, these results are reproduced by numerical simulations which provide a better insight on the dual-wavelength mode-locked operation.