Patient-specific needle guidance templates drilled intraprocedurally for image guided intervention: feasibility study in swine.

PURPOSE: Thermal ablation of large tumors may benefit from simultaneous placement of multiple needles, but accurate placement becomes challenging as the number of needles increases. The aim of this work was to evaluate use of personalized needle guidance grid templates based on intraprocedural CT and fabricated at the point of care to implement ablation treatment plans with multiple needles in vivo. METHODS: A plastic frame was designed to hold two parallel plastic guide plates in a rigid relationship, fixed over the abdomen by a mounting arm. Steel ball targets (1.5 mm) were implanted under ultrasound in the livers of two domestic swine under general anesthesia. Following breath-hold CT of the subject and frame, the targets and frame were identified using customized 3D Slicer-based planning software. Multiple needle trajectories targeting the balls were planned, including complex off-plane trajectories. A machining program for drilling the hole pattern corresponding to the planned needle trajectories was generated. The pattern was drilled in the two plates with a numerical-controlled milling machine in the suite. The plates were attached to the frame and needles passed through the paired holes to the calculated depth. Placement accuracy was defined as needle tip-to-target distance on post-placement CT. RESULTS: The planning process and manufacturing required approximately 6 and 15 min, respectively. Needles were rapidly inserted (n = 11) to the target points without complications or traversing nontarget anatomy. The mean needle tip-to-target distance error was 3.4 ± 2.2, range 0-7 mm. CONCLUSION: Rapid and accurate needle placement was feasible using a subject-specific, custom-drilled, needle guidance grid template fabricated intraprocedurally. Targeting accuracy and performance were similar to more complex and expensive tracking systems which may enable accurate intraprocedural implementation of treatment plans in the liver or other organs. This may be of value in complex ablation cases or in areas where more advanced guidance systems are not available.

Tracked Foley catheter for motion compensation during fusion image-guided prostate procedures: a phantom study.

BACKGROUND: Uncorrected patient or prostate motion may impair targeting prostate areas during fusion image-guided procedures. We evaluated if a prototype "tracked Foley catheter" (TFC) could maintain fusion image alignment after simulated organ motion. METHODS: A pelvic phantom model underwent magnetic resonance imaging (MRI), and the prostate was segmented. The TFC was placed in the phantom. MRI/ultrasound (US) fusion was performed. Four trials were performed varying motion and TFC presence/absence: (1) TFC/no-motion, (2) TFC/motion, (3) no-TFC/no-motion, and (4) no-TFC/motion. To quantify image alignment, screen captures generated Dice similarity coefficient (DSC) and offset distances (ODs) (maximal US-to-MRI distance between edges on fusion images). Three anatomical targets were identified for placement of a needle under fusion guidance. A computed tomography scan was used to measure system error (SE), i.e., the distance from needle tip to intended target. RESULTS: The TFC presence improved MRI/US alignment by DSC 0.88, 0.88, 0.74, and 0.61 in trials 1, 2, 3, and 4, respectively. Both OD (trial 2 versus trial 4, 4.85 ± 1.60 versus 25.29 ± 6.50 mm, p < 0.001) and SE (trial 2 versus trial 4, 6.35 ± 1.31 versus 32.16 ± 6.50 mm, p < 0.005) were significantly lower when the TFC was present after artificial motion, and significantly smaller OD when static (trial 1 versus trial 3, 4.29 ± 1.24 versus 6.42 ± 2.29 mm, p < 0.001). CONCLUSION: TFC provided better image alignment with or without simulated motion. This may overcome system limitations, allowing for more accurate fusion image alignment during fusion-guided biopsy, ablation, or robotic prostatectomy.

Patient-specific templates for image-guided intervention - a phantom study.

Purpose: To evaluate the in vitro accuracy of a new device and method for simultaneous stereotactic CT-guided punctures.Material and methods: 240 needle paths were planned in 1 mm, 1.5 mm and 3 mm slice thickness with a custom-designed software. The data were transferred to a three-axis tabletop CNC machine that then drilled the hole pattern for the needles into square plastic plates. Kirschner wires were slid through the holes of the two parallel fixed plates to aim at the chosen targets inside the phantom. The accuracy was calculated by taking control CTs and measuring the Euclidean distance and the normal distance between the wire and the entry and target point.Results: The mean Euclidean distance of the wire tip to the target for the 1 mm, 1.5mm and 3 mm slice thickness were 2.5 mm (SD ± 0.64), 2.71mm (SD ± 0.78) and 2.8 mm (SD ± 1.0). The mean normal distance was 1.42 mm (SD ± 0.65), 1.43mm (SD ± 0.75) and 1.9 mm (SD ± 1.1), respectively.Conclusion: The system yields satisfactory accuracy comparable to other image-guided intervention systems. Involuntary movements of the patient need to be taken into account in a clinical setting.

Magnetic resonance imaging/ultrasound fusion guided prostate biopsy improves cancer detection following transrectal ultrasound biopsy and correlates with multiparametric magnetic resonance imaging.

PURPOSE: A novel platform was developed that fuses pre-biopsy magnetic resonance imaging with real-time transrectal ultrasound imaging to identify and biopsy lesions suspicious for prostate cancer. The cancer detection rates for the first 101 patients are reported. MATERIALS AND METHODS: This prospective, single institution study was approved by the institutional review board. Patients underwent 3.0 T multiparametric magnetic resonance imaging with endorectal coil, which included T2-weighted, spectroscopic, dynamic contrast enhanced and diffusion weighted magnetic resonance imaging sequences. Lesions suspicious for cancer were graded according to the number of sequences suspicious for cancer as low (2 or less), moderate (3) and high (4) suspicion. Patients underwent standard 12-core transrectal ultrasound biopsy and magnetic resonance imaging/ultrasound fusion guided biopsy with electromagnetic tracking of magnetic resonance imaging lesions. Chi-square and within cluster resampling analyses were used to correlate suspicion on magnetic resonance imaging and the incidence of cancer detected on biopsy. RESULTS: Mean patient age was 63 years old. Median prostate specific antigen at biopsy was 5.8 ng/ml and 90.1% of patients had a negative digital rectal examination. Of patients with low, moderate and high suspicion on magnetic resonance imaging 27.9%, 66.7% and 89.5% were diagnosed with cancer, respectively (p <0.0001). Magnetic resonance imaging/ultrasound fusion guided biopsy detected more cancer per core than standard 12-core transrectal ultrasound biopsy for all levels of suspicion on magnetic resonance imaging. CONCLUSIONS: Prostate cancer localized on magnetic resonance imaging may be targeted using this novel magnetic resonance imaging/ultrasound fusion guided biopsy platform. Further research is needed to determine the role of this platform in cancer detection, active surveillance and focal therapy, and to determine which patients may benefit.

Real-time FDG PET guidance during biopsies and radiofrequency ablation using multimodality fusion with electromagnetic navigation.

PURPOSE: To assess the feasibility of combined electromagnetic device tracking and computed tomography (CT)/ultrasonography (US)/fluorine 18 fluorodeoxyglucose (FDG) positron emission tomography (PET) fusion for real-time feedback during percutaneous and intraoperative biopsies and hepatic radiofrequency (RF) ablation. MATERIALS AND METHODS: In this HIPAA-compliant, institutional review board-approved prospective study with written informed consent, 25 patients (17 men, eight women) underwent 33 percutaneous and three intraoperative biopsies of 36 FDG-avid targets between November 2007 and August 2010. One patient underwent biopsy and RF ablation of an FDG-avid hepatic focus. Targets demonstrated heterogeneous FDG uptake or were not well seen or were totally inapparent at conventional imaging. Preprocedural FDG PET scans were rigidly registered through a semiautomatic method to intraprocedural CT scans. Coaxial biopsy needle introducer tips and RF ablation electrode guider needle tips containing electromagnetic sensor coils were spatially tracked through an electromagnetic field generator. Real-time US scans were registered through a fiducial-based method, allowing US scans to be fused with intraprocedural CT and preacquired FDG PET scans. A visual display of US/CT image fusion with overlaid coregistered FDG PET targets was used for guidance; navigation software enabled real-time biopsy needle and needle electrode navigation and feedback. RESULTS: Successful fusion of real-time US to coregistered CT and FDG PET scans was achieved in all patients. Thirty-one of 36 biopsies were diagnostic (malignancy in 18 cases, benign processes in 13 cases). RF ablation resulted in resolution of targeted FDG avidity, with no local treatment failure during short follow-up (56 days). CONCLUSION: Combined electromagnetic device tracking and image fusion with real-time feedback may facilitate biopsies and ablations of focal FDG PET abnormalities that would be challenging with conventional image guidance.

Clinical utility of real-time fusion guidance for biopsy and ablation.

PURPOSE: To show utility, accuracy, and clinical outcomes of electromagnetic tracking and multimodality image fusion for guidance of biopsy and radiofrequency (RF) ablation procedures. MATERIALS AND METHODS: A combination of conventional image guidance (ultrasound[US]/computed tomography [CT]) and a research navigation system was used in 40 patients undergoing biopsy or RF ablation to assist in target localization and needle and electrode placement. The navigation system displays electromagnetically tracked needles and US images relative to a preprocedural CT scan. Additional images (prior positron emission tomography [PET] or magnetic resonance [MR] imaging) can be fused with CT as needed. Needle aiming with and without tracking were compared, the utility of navigation for each procedure was assessed, the system's off-target tracking error for two different registration methods was evaluated, and setup time was recorded. RESULTS: The tracking error could be evaluated in 35 of 40 patients. A basic tracking error of 3.8 mm ± 2.3 was shown using skin fiducial markers for registration. The error improved to 2.7 mm ± 1.6 when using prior internal needle positions as additional fiducial markers. Real-time fusion of US with CT and registration with prior PET and MR imaging were successful and provided clinically relevant guidance information, enabling 19 of the 40 procedures. CONCLUSIONS: The spatial accuracy of the navigation system is sufficient to display clinically relevant image guidance information during biopsy and RF ablation. Breath holding and respiratory gating are effective in minimizing the error associated with tissue motion. In 48% of cases, the navigation system provided information crucial for successful execution of the procedure. Fusion of real-time US with CT or prior diagnostic images may enable procedures that are not feasible with standard, single-modality image guidance.

D'Amico risk stratification correlates with degree of suspicion of prostate cancer on multiparametric magnetic resonance imaging.

PURPOSE: We determined whether there is a correlation between D'Amico risk stratification and the degree of suspicion of prostate cancer on multiparametric magnetic resonance imaging based on targeted biopsies done with our electromagnetically tracked magnetic resonance imaging/ultrasound fusion platform. MATERIALS AND METHODS: A total of 101 patients underwent 3 Tesla multiparametric magnetic resonance imaging of the prostate, consisting of T2, dynamic contrast enhanced, diffusion weighted and spectroscopy images in cases suspicious for or with a diagnosis of prostate cancer. All prostate magnetic resonance imaging lesions were then identified and graded by the number of positive modalities, including low-2 or fewer, moderate-3 and high-4 showing suspicion on multiparametric magnetic resonance imaging. The biopsy protocol included standard 12-core biopsy, followed by real-time magnetic resonance imaging/ultrasound fusion targeted biopsies of the suspicious magnetic resonance lesions. Cases and lesions were stratified by the D'Amico risk stratification. RESULTS: In this screening population 90.1% of men had a negative digital rectal examination. Mean±SD age was 62.7±8.3 years and median prostate specific antigen was 5.8 ng/ml. Of the cases 54.5% were positive for cancer on protocol biopsy. Chi-square analysis revealed a statistically significant correlation between magnetic resonance suspicion and D'Amico risk stratification (p<0.0001). Within cluster resampling demonstrated a statistically significant correlation between magnetic resonance suspicion and D'Amico risk stratification for magnetic resonance targeted core biopsies and magnetic resonance lesions (p<0.01) CONCLUSIONS: Our data support the notion that using multiparametric magnetic resonance prostate imaging one may assess the degree of risk associated with magnetic resonance visible lesions in the prostate.

Electromagnetic navigation for thoracic aortic stent-graft deployment: a pilot study in swine.

PURPOSE: To determine the feasibility of electromagnetic tracking as a method to augment conventional imaging guidance for the safe delivery, precise positioning, and accurate deployment of thoracic aortic endografts. MATERIALS AND METHODS: Custom guide wires were fabricated, and the delivery catheters for thoracic aortic endoprostheses were retrofitted with integrated electromagnetic coil sensors to enable real-time endovascular tracking. Preprocedure thoracic computed tomographic (CT) angiograms were obtained after the placement of fiducial skin patches on the chest wall of three anesthetized swine, enabling automatic registration. The stent-graft deployment location target near the subclavian artery was selected on the preprocedure CT angiogram. Two steps were analyzed: advancing a tracked glidewire to the aortic arch and positioning the tracked stent-graft assembly by using electromagnetic guidance alone. Multiple CT scans were obtained to evaluate the accuracy of the electromagnetic tracking system by measuring the target registration error, which compared the actual position of the tracked devices to the displayed "virtual" electromagnetic-tracked position. Postdeployment CT angiography and necropsy helped confirm stent-graft position and subclavian artery patency. RESULTS: A stent-graft was successfully delivered and deployed in each of the three animals by using real-time electromagnetic tracking alone. The mean fiducial registration error with autoregistration was 1.5 mm. Sixteen comparative scans were obtained to determine the target registration error, which was 4.3 mm +/- 0.97 (range, 3.0-6.0 mm) for the glidewire sensor coil. The mean target registration error for the stent-graft delivery catheter sensor coil was 2.6 mm +/- 0.7 (range, 1.9-3.8 mm). The mean deployment error for the stent-graft, defined as deployment deviation from the target, was 2.6 mm +/- 3.0. CONCLUSIONS: Delivery and deployment of customized thoracic stent-grafts with use of electromagnetic tracking alone is feasible and accurate in swine. Combining endovascular electromagnetic tracking with conventional fluoroscopy may further improve accuracy and be a more realistic multimodality approach.

Advantages of optical compared with electromagnetic tracking.

Tracking systems are critical to all types of computer-assisted image-guided intervention. Many technologies exist; however, only optical and electromagnetic systems are widely used commercially. In orthopaedic applications, optical systems dominate because of the large working volume and accuracy, but these systems suffer from deficiencies due to line of sight. Electromagnetic trackers can be made much smaller but are less accurate and are affected by metal, although current-generation systems are less affected by metal artifacts than were the earlier ones, which were more widely reported in the literature.

Real-time MRI-TRUS fusion for guidance of targeted prostate biopsies.

Targeted prostate biopsy is challenging because no currently established imaging modality is both accurate for prostate cancer diagnosis and cost-effective for real-time procedure guidance. A system that fuses real-time transrectal ultrasound images with previously acquired endorectal coil MRI images for prostate biopsy guidance is presented here. The system uses electromagnetic tracking and intraoperative image registration to superimpose the MRI data on the ultrasound image. Prostate motion is tracked and compensated for without the need for fiducial markers. The accuracy of the system in phantom studies was shown to be 2.4 +/- 1.2 mm. The fusion system has been used in more than 20 patients to guide biopsies with almost no modification of the conventional protocol. Retrospective clinical evaluation suggests that clinically acceptable spatial accuracy can be achieved.

Initial clinical experience with real-time transrectal ultrasonography-magnetic resonance imaging fusion-guided prostate biopsy.

OBJECTIVE: To evaluate the feasibility and utility of registration and fusion of real-time transrectal ultrasonography (TRUS) and previously acquired magnetic resonance imaging (MRI) to guide prostate biopsies. PATIENTS AND METHODS: Two National Cancer Institute trials allowed MRI-guided (with or with no US fusion) prostate biopsies during placement of fiducial markers. Fiducial markers were used to guide patient set-up for daily external beam radiation therapy. The eligible patients had biopsy-confirmed prostate cancer that was visible on MRI. A high-field (3T) MRI was performed with an endorectal coil in place. After moving to an US suite, the patient then underwent TRUS to visualize the prostate. The US transducer was equipped with a commercial needle guide and custom modified with two embedded miniature orthogonal five-degrees of freedom sensors to enable spatial tracking and registration with MR images in six degrees of freedom. The MRI sequence of choice was registered manually to the US using custom software for real-time navigation and feedback. The interface displayed the actual and projected needle pathways superimposed upon the real-time US blended with the prior MR images, with position data updating in real time at 10 frames per second. The registered MRI information blended to the real-time US was available to the physician who performed targeted biopsies of highly suspicious areas. RESULTS: Five patients underwent limited focal biopsy and fiducial marker placement with real-time TRUS-MRI fusion. The Gleason scores at the time of enrollment on study were 8, 7, 9, 9, and 6. Of the 11 targeted biopsies, eight showed prostate cancer. Positive biopsies were found in all patients. The entire TRUS procedure, with fusion, took approximately 10 min. CONCLUSION: The fusion of real-time TRUS and prior MR images of the prostate is feasible and enables MRI-guided interventions (like prostate biopsy) outside of the MRI suite. The technique allows for navigation within dynamic contrast-enhanced maps, or T2-weighted or MR spectroscopy images. This technique is a rapid way to facilitate MRI-guided prostate therapies such as external beam radiation therapy, brachytherapy, cryoablation, high-intensity focused ultrasound ablation, or direct injection of agents, without the cost, throughput, or equipment compatibility issues that might arise with MRI-guided interventions inside the MRI suite.

Closed-loop control in fused MR-TRUS image-guided prostate biopsy.

Multi-modality fusion imaging for targeted prostate biopsy is difficult because of prostate motion during the biopsy procedure. A closed-loop control mechanism is proposed to improve the efficacy and safety of the biopsy procedure, which uses real-time ultrasound and spatial tracking as feedback to adjust the registration between a preoperative 3D image (e.g. MRI) and real-time ultrasound images. The spatial tracking data is used to initialize the image-based registration between intraoperative ultrasound images and a preoperative ultrasound volume. The preoperative ultrasound volume is obtained using a 2D sweep and manually registered to the MRI dataset before the biopsy procedure. The accuracy of the system is 2.3 +/- 0.9 mm in phantom studies. The results of twelve patient studies show that prostate motion can be effectively compensated using closed-loop control.

Electromagnetic tracking for thermal ablation and biopsy guidance: clinical evaluation of spatial accuracy.

PURPOSE: To evaluate the spatial accuracy of electromagnetic needle tracking and demonstrate the feasibility of ultrasonography (US)-computed tomography (CT) fusion during CT- and US-guided biopsy and radiofrequency ablation procedures. MATERIALS AND METHODS: The authors performed a 20-patient clinical trial to investigate electromagnetic needle tracking during interventional procedures. The study was approved by the institutional investigational review board, and written informed consent was obtained from all patients. Needles were positioned by using CT and US guidance. A commercial electromagnetic tracking device was used in combination with prototype internally tracked needles and custom software to record needle positions relative to previously obtained CT scans. Position tracking data were acquired to evaluate the tracking error, defined as the difference between tracked needle position and reference standard needle position on verification CT scans. Registration between tracking space and image space was obtained by using reference markers attached to the skin ("fiducials"), and different registration methods were compared. The US transducer was tracked to demonstrate the potential use of real-time US-CT fusion for imaging guidance. RESULTS: One patient was excluded from analysis because he was unable to follow breathing instructions during the acquisition of CT scans. Nineteen of the 20 patients were evaluable, demonstrating a basic tracking error of 5.8 mm +/- 2.6, which improved to 3.5 mm +/- 1.9 with use of nonrigid registrations that used previous internal needle positions as additional fiducials. Fusion of tracked US with CT was successful. Patient motion and distortion of the tracking system by the CT table and gantry were identified as sources of error. CONCLUSIONS: The demonstrated spatial tracking accuracy is sufficient to display clinically relevant preprocedural imaging information during needle-based procedures. Virtual needles displayed within preprocedural images may be helpful for clandestine targets such as arterial phase enhancing liver lesions or during thermal ablations when obscuring gas is released. Electromagnetic tracking may help improve imaging guidance for interventional procedures and warrants further investigation, especially for procedures in which the outcomes are dependent on accuracy.

Implementation of an electromagnetic tracking system for accurate intrahepatic puncture needle guidance: accuracy results in an in vitro model.

RATIONALE AND OBJECTIVES: Electromagnetic tracking potentially may be used to guide percutaneous needle-based interventional procedures. The accuracy of electromagnetic guided-needle puncture procedures has not been specifically characterized. This article reports the functional accuracy of a needle guidance system featuring real-time tracking of respiratory-related target motion. MATERIALS AND METHODS: A needle puncture algorithm based on a "free-hand" needle puncture technique for percutaneous intrahepatic portocaval systemic shunt was employed. Preoperatively obtained computed tomographic images were displayed on a graphical user interface and registered with the electromagnetically tracked needle position. The system and procedure was tested on an abdominal torso phantom containing a liver model mounted on a motor-driven platform to simulate respiratory excursion. The liver model featured two hollow tubes to simulate intrahepatic vessels. Registration and respiratory motion tracking was performed using four skin fiducials and a needle fiducial within the liver. Success rates for 15 attempts at simultaneous puncture of the two "vessels" of different luminal diameters guided by the electromagnetic tracking system were recorded. RESULTS: Successful "vessel" puncture occurred in 0%, 33%, and 53% of attempts for 3-, 5-, and 7-mm diameter "vessels," respectively. Using a two-dimensional accuracy prediction analysis, predicted accuracy exceeded actual puncture accuracy by 25%-35% for all vessel diameters. Accuracy outcome improved when depth-only errors were omitted from the analysis. CONCLUSIONS: Actual puncture success rate approximates predicted rates for target vessels 5 mm in diameter or greater when depth errors are excluded. Greater accuracy for smaller diameter vessels would be desirable for implementation in a broader range of clinical applications.

Technologies for guidance of radiofrequency ablation in the multimodality interventional suite of the future.

Several new image-guidance tools and devices are being prototyped, investigated, and compared. These tools are introduced and include prototype software for image registration and fusion, thermal modeling, electromagnetic tracking, semiautomated robotic needle guidance, and multimodality imaging. The integration of treatment planning with computed tomography robot systems or electromagnetic needle-tip tracking allows for seamless, iterative, "see-and-treat," patient-specific tumor ablation. Such automation, navigation, and visualization tools could eventually optimize radiofrequency ablation and other needle-based ablation procedures and decrease variability among operators, thus facilitating the translation of novel image-guided therapies. Much of this new technology is in use or will be available to the interventional radiologist in the near future, and this brief introduction will hopefully encourage research in this emerging area.

Electromagnetic tracking for abdominal interventions in computer aided surgery.

Electromagnetic tracking has great potential for assisting physicians in precision placement of instruments during minimally invasive interventions in the abdomen, since electromagnetic tracking is not limited by the line-of-sight restrictions of optical tracking. A new generation of electromagnetic tracking has recently become available, with sensors small enough to be included in the tips of instruments. To fully exploit the potential of this technology, our research group has been developing a computer aided, image-guided system that uses electromagnetic tracking for visualization of the internal anatomy during abdominal interventions. As registration is a critical component in developing an accurate image-guided system, we present three registration techniques: 1) enhanced paired-point registration (time-stamp match registration and dynamic registration); 2) orientation-based registration; and 3) needle shape-based registration. Respiration compensation is another important issue, particularly in the abdomen, where respiratory motion can make precise targeting difficult. To address this problem, we propose reference tracking and affine transformation methods. Finally, we present our prototype navigation system, which integrates the registration, segmentation, path-planning and navigation functions to provide real-time image guidance in the clinical environment. The methods presented here have been tested with a respiratory phantom specially designed by our group and in swine animal studies under approved protocols. Based on these tests, we conclude that our system can provide quick and accurate localization of tracked instruments in abdominal interventions, and that it offers a user-friendly display for the physician.

Navigation with electromagnetic tracking for interventional radiology procedures: a feasibility study.

PURPOSE: To assess the feasibility of the use of preprocedural imaging for guide wire, catheter, and needle navigation with electromagnetic tracking in phantom and animal models. MATERIALS AND METHODS: An image-guided intervention software system was developed based on open-source software components. Catheters, needles, and guide wires were constructed with small position and orientation sensors in the tips. A tetrahedral-shaped weak electromagnetic field generator was placed in proximity to an abdominal vascular phantom or three pigs on the angiography table. Preprocedural computed tomographic (CT) images of the phantom or pig were loaded into custom-developed tracking, registration, navigation, and rendering software. Devices were manipulated within the phantom or pig with guidance from the previously acquired CT scan and simultaneous real-time angiography. Navigation within positron emission tomography (PET) and magnetic resonance (MR) volumetric datasets was also performed. External and endovascular fiducials were used for registration in the phantom, and registration error and tracking error were estimated. RESULTS: The CT scan position of the devices within phantoms and pigs was accurately determined during angiography and biopsy procedures, with manageable error for some applications. Preprocedural CT depicted the anatomy in the region of the devices with real-time position updating and minimal registration error and tracking error (<5 mm). PET can also be used with this system to guide percutaneous biopsies to the most metabolically active region of a tumor. CONCLUSIONS: Previously acquired CT, MR, or PET data can be accurately codisplayed during procedures with reconstructed imaging based on the position and orientation of catheters, guide wires, or needles. Multimodality interventions are feasible by allowing the real-time updated display of previously acquired functional or morphologic imaging during angiography, biopsy, and ablation.

Electromagnetic tracking for image-guided abdominal procedures: overall system and technical issues.

This paper summarizes our work over the past several years in developing an image-guided system based on electromagnetic tracking for abdominal interventions. The paper begins with a review of computer-aided surgery and electromagnetic tracking. We next describe our image-guided system along with phantom and animal studies. We then present some technical issues in improving accuracy including pivot calibration, dynamic referencing, and registration using two 5 degree-of- freedom sensors. Electromagnetic tracking has great potential for assisting physicians in precision placement of instruments during minimally invasive interventions. However, the accuracy of these systems needs to be validated in the clinical environment and issues such as respiratory motion and organ deformation need to be addressed.

Two-stage registration for real-time deformable compensation using an electromagnetic tracking device.

Electromagnetic tracking systems have the potential to track instruments inside the body because they are not limited by the line of sight constraints that characterize optical tracking systems. To integrate an electromagnetic tracking device into a surgical navigation system, accurate registration is required. We present a two-stage registration mechanism designed to be more accurate than the widely used global fiducial-based registration method. The first stage uses a hybrid Iterative Closest Point (ICP) registration method and the Simulated Annealing (SA) optimization algorithm, to increase the initial registration accuracy. The second stage exploits multiple implanted tracking needles that are used to calculate the affine transform based on the initial transform information, and thereby to compensate for the deformation in real time. Phantom and swine studies have demonstrated the utility of this technique.

Augmented reality laser projection device for surgery.

We have developed an augmented reality system capable of projecting preoperative plans directly onto a patient using rapidly scanned laser beams. Projected contours can typically represent cut paths, tumors or delineate boundaries of interest. The system can be used as part of, or a replacement for, conventional robotic Telesurgery systems. Because the graphics are projected, there is no degradation in surgeon's view due to optical components interposed between the surgeon's eye and the patient. This system has been designed to work with a common infrared 3D camera system used in image-guided surgery, and projects both visible and infrared beams. The IR beam enables surface digitization functions to be carried out using the camera. The clinical accuracy is in the range required by CAS procedures, around 1-2mm. The device will be particularly useful for executing precise preoperative plans and for teleconsultation applications, where planned or live consultations can be efficiently communicated to a less skilled local caregiver.