Automatic lesion detection for narrow-band imaging bronchoscopy.

Purpose: Early detection of cancer is crucial for lung cancer patients, as it determines disease prognosis. Lung cancer typically starts as bronchial lesions along the airway walls. Recent research has indicated that narrow-band imaging (NBI) bronchoscopy enables more effective bronchial lesion detection than other bronchoscopic modalities. Unfortunately, NBI video can be hard to interpret because physicians currently are forced to perform a time-consuming subjective visual search to detect bronchial lesions in a long airway-exam video. As a result, NBI bronchoscopy is not regularly used in practice. To alleviate this problem, we propose an automatic two-stage real-time method for bronchial lesion detection in NBI video and perform a first-of-its-kind pilot study of the method using NBI airway exam video collected at our institution. Approach: Given a patient's NBI video, the first method stage entails a deep-learning-based object detection network coupled with a multiframe abnormality measure to locate candidate lesions on each video frame. The second method stage then draws upon a Siamese network and a Kalman filter to track candidate lesions over multiple frames to arrive at final lesion decisions. Results: Tests drawing on 23 patient NBI airway exam videos indicate that the method can process an incoming video stream at a real-time frame rate, thereby making the method viable for real-time inspection during a live bronchoscopic airway exam. Furthermore, our studies showed a 93% sensitivity and 86% specificity for lesion detection; this compares favorably to a sensitivity and specificity of 80% and 84% achieved over a series of recent pooled clinical studies using the current time-consuming subjective clinical approach. Conclusion: The method shows potential for robust lesion detection in NBI video at a real-time frame rate. Therefore, it could help enable more common use of NBI bronchoscopy for bronchial lesion detection.

Endobronchial Ultrasound Image Simulation for Image-Guided Bronchoscopy.

BACKGROUND/OBJECTIVE: Accurate disease diagnosis and staging are essential for patients suspected of having lung cancer. The state-of-the-art minimally invasive tools used by physicians to perform these operations are bronchoscopy, for navigating the lung airways, and endobronchial ultrasound (EBUS), for localizing suspect extraluminal cancer lesions. While new image-guided systems enable accurate bronchoscope navigation close to a lesion, no means exists for guiding the final EBUS localization of an extraluminal lesion. We propose an EBUS simulation method to assist with EBUS localization. METHODS: The method draws on a patient's chest computed-tomography (CT) scan to model the ultrasound signal propagation through the tissue media. The method, which is suitable for simulating EBUS images for both radial-probe and convex-probe EBUS devices, entails three steps: 1) image preprocessing, which generates a 2D CT equivalent of the EBUS scan plane; 2) EBUS scan-line computation, which models ultrasound transmission to map the CT plane into a preliminary simulated EBUS image; and 3) image post-processing, which increases realism by introducing simulated EBUS imaging effects and artifacts. RESULTS: Results show that the method produces simulated EBUS images that strongly resemble images generated live by a real device and compares favorably to an existing ultrasound simulation method. It also produces images at a rate greater than real time (i.e., 53 frames/sec). We also demonstrate a successful integration of the method into an image-guided EBUS bronchoscopy system. CONCLUSION/SIGNIFICANCE: The method is effective and practical for procedure planning/preview and follow-on live guidance of EBUS bronchoscopy.

Efficient procedure planning for comprehensive lymph node staging bronchoscopy.

Purpose: For a patient at risk of having lung cancer, accurate disease staging is vital as it dictates disease prognosis and treatment. Accurate staging requires a comprehensive sampling of lymph nodes within the chest via bronchoscopy. Unfortunately, physicians are generally unable to plan and perform sufficiently comprehensive procedures to ensure accurate disease staging. We propose a method for planning comprehensive lymph node staging procedures. Approach: Drawing on a patient's chest CT scan, the method derives a multi-destination tour for efficient navigation to a set of lymph nodes. We formulate the planning task as a traveling salesman problem. To solve the problem, we apply the concept of ant colony optimization (ACO) to derive an efficient airway tour connecting the target nodes. The method has three main steps: (1) CT preprocessing, to define important chest anatomy; (2) graph and staging zone construction, to set up the necessary data structures and clinical constraints; and (3) tour computation, to derive the staging plan. The plan conforms to the world standard International Association for the Study of Lung Cancer (IASLC) lymph node map and recommended clinical staging guidelines. Results: Tests with a patient database indicate that the method derives optimal or near-optimal tours in under a few seconds, regardless of the number of target lymph nodes (mean tour length = 1.4% longer than the optimum). A brute force optimal search, on the other hand, generally cannot reach a solution in under 10 min. for patients exhibiting > 16 nodes, and other methods provide poor solutions. We also demonstrate the method's utility in an image-guided bronchoscopy system. Conclusions: The method provides an efficient computational approach for planning a comprehensive lymph node staging bronchoscopy. In addition, the method shows promise for driving an image-guided bronchoscopy system or robotics-assisted bronchoscopy system tailored to lymph node staging.

Image-guided EBUS bronchoscopy system for lung-cancer staging.

The staging of the central-chest lymph nodes is a major step in the management of lung-cancer patients. For this purpose, the physician uses a device that integrates videobronchoscopy and an endobronchial ultrasound (EBUS) probe. To biopsy a lymph node, the physician first uses videobronchoscopy to navigate through the airways and then invokes EBUS to localize and biopsy the node. Unfortunately, this process proves difficult for many physicians, with the choice of biopsy site found by trial and error. We present a complete image-guided EBUS bronchoscopy system tailored to lymph-node staging. The system accepts a patient's 3D chest CT scan, an optional PET scan, and the EBUS bronchoscope's video sources as inputs. System workflow follows two phases: (1) procedure planning and (2) image-guided EBUS bronchoscopy. Procedure planning derives airway guidance routes that facilitate optimal EBUS scanning and nodal biopsy. During the live procedure, the system's graphical display suggests a series of device maneuvers to perform and provides multimodal visual cues for locating suitable biopsy sites. To this end, the system exploits data fusion to drive a multimodal virtual bronchoscope and other visualization tools that lead the physician through the process of device navigation and localization. A retrospective lung-cancer patient study and follow-on prospective patient study, performed within the standard clinical workflow, demonstrate the system's feasibility and functionality. For the prospective study, 60/60 selected lymph nodes (100%) were correctly localized using the system, and 30/33 biopsied nodes (91%) gave adequate tissue samples. Also, the mean procedure time including all user interactions was 6 min 43 s All of these measures improve upon benchmarks reported for other state-of-the-art systems and current practice. Overall, the system enabled safe, efficient EBUS-based localization and biopsy of lymph nodes.

Autofluorescence Bronchoscopy Video Analysis for Lesion Frame Detection.

Because of the significance of bronchial lesions as indicators of early lung cancer and squamous cell carcinoma, a critical need exists for early detection of bronchial lesions. Autofluorescence bronchoscopy (AFB) is a primary modality used for bronchial lesion detection, as it shows high sensitivity to suspicious lesions. The physician, however, must interactively browse a long video stream to locate lesions, making the search exceedingly tedious and error prone. Unfortunately, limited research has explored the use of automated AFB video analysis for efficient lesion detection. We propose a robust automatic AFB analysis approach that distinguishes informative and uninformative AFB video frames in a video. In addition, for the informative frames, we determine the frames containing potential lesions and delineate candidate lesion regions. Our approach draws upon a combination of computer-based image analysis, machine learning, and deep learning. Thus, the analysis of an AFB video stream becomes more tractable. Using patient AFB video, 99.5%/90.2% of test frames were correctly labeled as informative/uninformative by our method versus 99.2%/47.6% by ResNet. In addition, ≥97% of lesion frames were correctly identified, with false positive and false negative rates ≤3%.Clinical relevance-The method makes AFB-based bronchial lesion analysis more efficient, thereby helping to advance the goal of better early lung cancer detection.

Optimal route planning for image-guided EBUS bronchoscopy.

The staging of the central-chest lymph nodes is a major lung-cancer management procedure. To perform a staging procedure, the physician first uses a patient's 3D X-ray computed-tomography (CT) chest scan to interactively plan airway routes leading to selected target lymph nodes. Next, using an integrated EBUS bronchoscope (EBUS = endobronchial ultrasound), the physician uses videobronchoscopy to navigate through the airways toward a target node's general vicinity and then invokes EBUS to localize the node for biopsy. Unfortunately, during the procedure, the physician has difficulty in translating the preplanned airway routes into safe, effective biopsy sites. We propose an automatic route-planning method for EBUS bronchoscopy that gives optimal localization of safe, effective nodal biopsy sites. To run the method, a 3D chest model is first computed from a patient's chest CT scan. Next, an optimization method derives feasible airway routes that enables maximal tissue sampling of target lymph nodes while safely avoiding major blood vessels. In a lung-cancer patient study entailing 31 nodes (long axis range: [9.0 mm, 44.5 mm]), 25/31 nodes yielded safe airway routes having an optimal tissue sample size = 8.4 mm (range: [1.0 mm, 18.6 mm]) and sample adequacy = 0.42 (range: [0.05, 0.93]). Quantitative results indicate that the method potentially enables successful biopsies in essentially 100% of selected lymph nodes versus the 70-94% success rate of other approaches. The method also potentially facilitates adequate tissue biopsies for nearly 100% of selected nodes, as opposed to the 55-77% tissue adequacy rates of standard methods. The remaining nodes did not yield a safe route within the preset safety-margin constraints, with 3 nodes never yielding a route even under the most lenient safety-margin conditions. Thus, the method not only helps determine effective airway routes and expected sample quality for nodal biopsy, but it also helps point out situations where biopsy may not be advisable. We also demonstrate the methodology in an image-guided EBUS bronchoscopy system, used successfully in live lung-cancer patient studies. During a live procedure, the method provides dynamic real-time sample size visualization in an enhanced virtual bronchoscopy viewer. In this way, the physician vividly sees the most promising biopsy sites along the airway walls as the bronchoscope moves through the airways.

Thoracic cavity definition for 3D PET/CT analysis and visualization.

X-ray computed tomography (CT) and positron emission tomography (PET) serve as the standard imaging modalities for lung-cancer management. CT gives anatomical details on diagnostic regions of interest (ROIs), while PET gives highly specific functional information. During the lung-cancer management process, a patient receives a co-registered whole-body PET/CT scan pair and a dedicated high-resolution chest CT scan. With these data, multimodal PET/CT ROI information can be gleaned to facilitate disease management. Effective image segmentation of the thoracic cavity, however, is needed to focus attention on the central chest. We present an automatic method for thoracic cavity segmentation from 3D CT scans. We then demonstrate how the method facilitates 3D ROI localization and visualization in patient multimodal imaging studies. Our segmentation method draws upon digital topological and morphological operations, active-contour analysis, and key organ landmarks. Using a large patient database, the method showed high agreement to ground-truth regions, with a mean coverage=99.2% and leakage=0.52%. Furthermore, it enabled extremely fast computation. For PET/CT lesion analysis, the segmentation method reduced ROI search space by 97.7% for a whole-body scan, or nearly 3 times greater than that achieved by a lung mask. Despite this reduction, we achieved 100% true-positive ROI detection, while also reducing the false-positive (FP) detection rate by >5 times over that achieved with a lung mask. Finally, the method greatly improved PET/CT visualization by eliminating false PET-avid obscurations arising from the heart, bones, and liver. In particular, PET MIP views and fused PET/CT renderings depicted unprecedented clarity of the lesions and neighboring anatomical structures truly relevant to lung-cancer assessment.

Hands-Free System for Bronchoscopy Planning and Guidance.

Bronchoscopy is a commonly used minimally invasive procedure for lung-cancer staging. In standard practice, however, physicians differ greatly in their levels of performance. To address this concern, image-guided intervention (IGI) systems have been devised to improve procedure success. Current IGI bronchoscopy systems based on virtual bronchoscopic navigation (VBN), however, require involvement from the attending technician. This lessens physician control and hinders the overall acceptance of such systems. We propose a hands-free VBN system for planning and guiding bronchoscopy. The system introduces two major contributions. First, it incorporates a new procedure-planning method that automatically computes airway navigation plans conforming to the physician's bronchoscopy training and manual dexterity. Second, it incorporates a guidance strategy for bronchoscope navigation that enables user-friendly system control via a foot switch, coupled with a novel position-verification mechanism. Phantom studies verified that the system enables smooth operation under physician control, while also enabling faster navigation than an existing technician-assisted VBN system. In a clinical human study, we noted a 97% bronchoscopy navigation success rate, in line with existing VBN systems, and a mean guidance time per diagnostic site = 52 s. This represents a guidance time often nearly 3 min faster per diagnostic site than guidance times reported for other technician-assisted VBN systems. Finally, an ergonomic study further asserts the system's acceptability to the physician and long-term potential.

Optimal procedure planning and guidance system for peripheral bronchoscopy.

With the development of multidetector computed-tomography (MDCT) scanners and ultrathin bronchoscopes, the use of bronchoscopy for diagnosing peripheral lung-cancer nodules is becoming a viable option. The work flow for assessing lung cancer consists of two phases: 1) 3-D MDCT analysis and 2) live bronchoscopy. Unfortunately, the yield rates for peripheral bronchoscopy have been reported to be as low as 14%, and bronchoscopy performance varies considerably between physicians. Recently, proposed image-guided systems have shown promise for assisting with peripheral bronchoscopy. Yet, MDCT-based route planning to target sites has relied on tedious error-prone techniques. In addition, route planning tends not to incorporate known anatomical, device, and procedural constraints that impact a feasible route. Finally, existing systems do not effectively integrate MDCT-derived route information into the live guidance process. We propose a system that incorporates an automatic optimal route-planning method, which integrates known route constraints. Furthermore, our system offers a natural translation of the MDCT-based route plan into the live guidance strategy via MDCT/video data fusion. An image-based study demonstrates the route-planning method's functionality. Next, we present a prospective lung-cancer patient study in which our system achieved a successful navigation rate of 91% to target sites. Furthermore, when compared to a competing commercial system, our system enabled bronchoscopy over two airways deeper into the airway-tree periphery with a sample time that was nearly 2 min shorter on average. Finally, our system's ability to almost perfectly predict the depth of a bronchoscope's navigable route in advance represents a substantial benefit of optimal route planning.

Interactive CT-video registration for the continuous guidance of bronchoscopy.

Bronchoscopy is a major step in lung cancer staging. To perform bronchoscopy, the physician uses a procedure plan, derived from a patient's 3D computed-tomography (CT) chest scan, to navigate the bronchoscope through the lung airways. Unfortunately, physicians vary greatly in their ability to perform bronchoscopy. As a result, image-guided bronchoscopy systems, drawing upon the concept of CT-based virtual bronchoscopy (VB), have been proposed. These systems attempt to register the bronchoscope's live position within the chest to a CT-based virtual chest space. Recent methods, which register the bronchoscopic video to CT-based endoluminal airway renderings, show promise but do not enable continuous real-time guidance. We present a CT-video registration method inspired by computer-vision innovations in the fields of image alignment and image-based rendering. In particular, motivated by the Lucas-Kanade algorithm, we propose an inverse-compositional framework built around a gradient-based optimization procedure. We next propose an implementation of the framework suitable for image-guided bronchoscopy. Laboratory tests, involving both single frames and continuous video sequences, demonstrate the robustness and accuracy of the method. Benchmark timing tests indicate that the method can run continuously at 300 frames/s, well beyond the real-time bronchoscopic video rate of 30 frames/s. This compares extremely favorably to the ≥ 1 s/frame speeds of other methods and indicates the method's potential for real-time continuous registration. A human phantom study confirms the method's efficacy for real-time guidance in a controlled setting, and, hence, points the way toward the first interactive CT-video registration approach for image-guided bronchoscopy. Along this line, we demonstrate the method's efficacy in a complete guidance system by presenting a clinical study involving lung cancer patients.

Computer-based route-definition system for peripheral bronchoscopy.

Multi-detector computed tomography (MDCT) scanners produce high-resolution images of the chest. Given a patient's MDCT scan, a physician can use an image-guided intervention system to first plan and later perform bronchoscopy to diagnostic sites situated deep in the lung periphery. An accurate definition of complete routes through the airway tree leading to the diagnostic sites, however, is vital for avoiding navigation errors during image-guided bronchoscopy. We present a system for the robust definition of complete airway routes suitable for image-guided bronchoscopy. The system incorporates both automatic and semiautomatic MDCT analysis methods for this purpose. Using an intuitive graphical user interface, the user invokes automatic analysis on a patient's MDCT scan to produce a series of preliminary routes. Next, the user visually inspects each route and quickly corrects the observed route defects using the built-in semiautomatic methods. Application of the system to a human study for the planning and guidance of peripheral bronchoscopy demonstrates the efficacy of the system.

Segmentation of the central-chest lymph nodes in 3D MDCT images.

Central-chest lymph nodes play a vital role in lung-cancer staging. The definition of lymph nodes from three-dimensional (3D) multidetector computed-tomography (MDCT) images, however, remains an open problem. We propose two methods for computer-based segmentation of the central-chest lymph nodes from a 3D MDCT scan: the single-section live wire and the single-click live wire. For the single-section live wire, the user first applies the standard live wire to a single two-dimensional (2D) section after which automated analysis completes the segmentation process. The single-click live wire is similar but is almost completely automatic. Ground-truth studies involving human 3D MDCT scans demonstrate the robustness, efficiency, and intra-observer and inter-observer reproducibility of the methods.

Automatic definition of the central-chest lymph-node stations.

PURPOSE: Lung cancer remains the leading cause of cancer death in the United States. Central to the lung-cancer diagnosis and staging process is the assessment of the central-chest lymph nodes. This assessment requires two steps: (1) examination of the lymph-node stations and identification of diagnostically important nodes in a three-dimensional (3D) multidetector computed tomography (MDCT) chest scan; (2) tissue sampling of the identified nodes. We describe a computer-based system for automatically defining the central-chest lymph-node stations in a 3D MDCT chest scan. METHODS: Automated methods first construct a 3D chest model, consisting of the airway tree, aorta, pulmonary artery, and other anatomical structures. Subsequent automated analysis then defines the 3D regional nodal stations, as specified by the internationally standardized TNM lung-cancer staging system. This analysis involves extracting over 140 pertinent anatomical landmarks from structures contained in the 3D chest model. Next, the physician uses data mining tools within the system to interactively select diagnostically important lymph nodes contained in the regional nodal stations. RESULTS: Results from a ground-truth database of unlabeled lymph nodes identified in 32 MDCT scans verify the system's performance. The system automatically defined 3D regional nodal stations that correctly labeled 96% of the database's lymph nodes, with 93% of the stations correctly labeling 100% of their constituent nodes. CONCLUSIONS: The system accurately defines the regional nodal stations in a given high-resolution 3D MDCT chest scan and eases a physician's burden for analyzing a given MDCT scan for lymph-node station assessment. It also shows potential as an aid for preplanning lung-cancer staging procedures.

Robust 3-D airway tree segmentation for image-guided peripheral bronchoscopy.

A vital task in the planning of peripheral bronchoscopy is the segmentation of the airway tree from a 3-D multidetector computed tomography chest scan. Unfortunately, existing methods typically do not sufficiently extract the necessary peripheral airways needed to plan a procedure. We present a robust method that draws upon both local and global information. The method begins with a conservative segmentation of the major airways. Follow-on stages then exhaustively search for additional candidate airway locations. Finally, a graph-based optimization method counterbalances both the benefit and cost of retaining candidate airway locations for the final segmentation. Results demonstrate that the proposed method typically extracts 2-3 more generations of airways than several other methods, and that the extracted airway trees enable image-guided bronchoscopy deeper into the human lung periphery than past studies.

Image-based reporting for bronchoscopy.

Bronchoscopy is often performed for staging lung cancer. The recent development of multidetector computed tomography (MDCT) scanners and ultrathin bronchoscopes now enable the bronchoscopic biopsy and treatment of peripheral diagnostic regions of interest (ROIs). Because these ROIs are often located several generations within the airway tree, careful planning and interpretation of the bronchoscopic route is required prior to a procedure. The current practice for planning bronchoscopic procedures, however, is difficult, error prone, and time consuming. To alleviate these issues, we propose a method for producing and previewing reports for bronchoscopic procedures using patient-specific MDCT chest scans. The reports provide quantitative data about the bronchoscopic routes and both static and dynamic previews of the proper airway route. The previews consist of virtual bronchoscopic endoluminal renderings along the route and three-dimensional cues for a final biopsy site. The reports require little storage space and computational resources, enabling physicians to view the reports on a portable tablet PC. To evaluate the efficacy of the reporting system, we have generated reports for 22 patients in a human lung cancer patient pilot study. For 17 of these patients, we used the reports in conjunction with live image-based bronchoscopic guidance to direct physicians to central chest and peripheral ROIs for subsequent diagnostic evaluation. Our experience shows that the tool enabled useful procedure preview and an effective means for planning strategy prior to a live bronchoscopy.

3D MDCT-based system for planning peripheral bronchoscopic procedures.

The diagnosis and staging of lung cancer often begins with the assessment of a suspect peripheral chest site. Such suspicious peripheral sites may be solitary pulmonary nodules or other abnormally appearing regions of interest (ROIs). The state-of-the-art process for assessing such peripheral ROIs involves off-line procedure planning using a three-dimensional (3D) multidetector computed tomography (MDCT) chest scan followed by bronchoscopy with an ultrathin bronchoscope. We present an integrated computer-based system for planning peripheral bronchoscopic procedures. The system takes a 3D MDCT chest image as input and performs nearly all operations automatically. The only interaction required by the physician is the selection of ROI locations. The system is computationally efficient and fits smoothly within the clinical work flow. Integrated into the system and described in detail in the paper is a new surface-definition method, which is vital for effective analysis and planning to peripheral sites. Results demonstrate the efficacy of the system and its usage for the live guidance of ultrathin bronchoscopy to the periphery.

Image-guided bronchoscopy for peripheral lung lesions: a phantom study.

BACKGROUND: Ultrathin bronchoscopy guided by virtual bronchoscopy (VB) techniques show promise for the diagnosis of peripheral lung lesions. In a phantom study, we evaluated a new real-time, VB-based, image-guided system for guiding the bronchoscopic biopsy of peripheral lung lesions and compared its performance to that of standard bronchoscopy practice. METHODS: Twelve bronchoscopists of varying experience levels participated in the study. The task was to use an ultrathin bronchoscope and a biopsy forceps to localize 10 synthetically created lesions situated at varying airway depths. For route planning and guidance, the bronchoscopists employed either standard bronchoscopy practice or the real-time image-guided system. Outcome measures were biopsy site position error, which was defined as the distance from the forceps contact point to the ground-truth lesion boundary, and localization success, which was defined as a site identification having a biopsy site position error of < or = 5 mm. RESULTS: Mean (+/- SD) localization success more than doubled from 43 +/- 16% using standard practice to 94 +/- 7.9% using image guidance (p < 10(-15) [McNemar paired test]). The mean biopsy site position error dropped from 9.7 +/- 9.1 mm for standard practice to 2.2 +/- 2.3 mm for image guidance. For standard practice, localization success decreased from 56% for generation 3 to 4 lesions to 31% for generation 6 to 8 lesions and also decreased from 51% for lesions on a carina vs 23% for lesions situated away from a carina. These factors were far less pronounced when using image guidance, as follows: success for generation 3 to 4 lesions, 97%; success for generation 6 to 8 lesions, 91%; success for lesions on a carina, 98%; success for lesions away from a carina, 86%. Bronchoscopist experience did not significantly affect performance using the image-guided system. CONCLUSIONS: Real-time, VB-based image guidance can potentially far exceed standard bronchoscopy practice for enabling the bronchoscopic biopsy of peripheral lung lesions.

Interbronchoscopist variability in endobronchial path selection: a simulation study.

BACKGROUND: Endobronchial path selection is important for the bronchoscopic diagnosis of focal lung lesions. Path selection typically involves mentally reconstructing a three-dimensional path by interpreting a stack of two-dimensional (2D) axial plane CT scan sections. The hypotheses of our study about path selection were as follows: (1) bronchoscopists are inaccurate and overly confident when making endobronchial path selections based on 2D CT scan analysis; and (2) path selection accuracy and confidence improve and become better aligned when bronchoscopists employ path-planning methods based on virtual bronchoscopy (VB). METHODS: Studies of endobronchial path selection comparing three path-planning methods (ie, the standard 2D CT scan analysis and two new VB-based techniques) were performed. The task was to navigate to discrete lesions located between the third-order and fifth-order bronchi of the right upper and middle lobes. Outcome measures were the cumulative accuracy of making four sequential path selection decisions and self-reported confidence (1, least confident; 5, most confident). Both experienced and inexperienced bronchoscopists participated in the studies. RESULTS: In the first study involving a static paper-based tool, the mean (+/- SD) cumulative accuracy was 14 +/- 3% using 2D CT scan analysis (confidence, 3.4 +/- 1.3) and 49 +/- 15% using a VB-based technique (confidence, 4.2 +/- 1.1; p = 0.0001 across all comparisons). For a second study using an interactive computer-based tool, the mean accuracy was 40 +/- 28% using 2D CT scan analysis (confidence, 3.0 +/- 0.3) and 96 +/- 3% using a dynamic VB-based technique (confidence, 4.6 +/- 0.2). Regardless of the experience level of the bronchoscopist, use of the standard 2D CT scan analysis resulted in poor path selection accuracy and misaligned confidence. Use of the VB-based techniques resulted in considerably higher accuracy and better aligned decision confidence. CONCLUSIONS: Endobronchial path selection is a source of error in the bronchoscopy workflow. The use of VB-based path-planning techniques significantly improves path selection accuracy over use of the standard 2D CT scan section analysis in this simulation format.

3D CT-video fusion for image-guided bronchoscopy.

Bronchoscopic biopsy of the central-chest lymph nodes is an important step for lung-cancer staging. Before bronchoscopy, the physician first visually assesses a patient's three-dimensional (3D) computed tomography (CT) chest scan to identify suspect lymph-node sites. Next, during bronchoscopy, the physician guides the bronchoscope to each desired lymph-node site. Unfortunately, the physician has no link between the 3D CT image data and the live video stream provided during bronchoscopy. Thus, the physician must essentially perform biopsy blindly, and the skill levels between different physicians differ greatly. We describe an approach that enables synergistic fusion between the 3D CT data and the bronchoscopic video. Both the integrated planning and guidance system and the internal CT-video registration and fusion methods are described. Phantom, animal, and human studies illustrate the efficacy of the methods.

System for the analysis and visualization of large 3D anatomical trees.

Modern micro-CT and multi-detector helical CT scanners can produce high-resolution 3D digital images of various anatomical trees. The large size and complexity of these trees make it essentially impossible to define them interactively. Automatic approaches have been proposed for a few specific problems, but none of these approaches guarantee extracting geometrically accurate multi-generational tree structures. This paper proposes an interactive system for defining and visualizing large anatomical trees and for subsequent quantitative data mining. The system consists of a large number of tools for automatic image analysis, semi-automatic and interactive tree editing, and an assortment of visualization tools. Results are presented for a variety of 3D high-resolution images.