Fluorescence excitation-scanning hyperspectral imaging with scalable 2D-3D deep learning framework for colorectal cancer detection.

Colorectal cancer is one of the top contributors to cancer-related deaths in the United States, with over 100,000 estimated cases in 2020 and over 50,000 deaths. The most common screening technique is minimally invasive colonoscopy using either reflected white light endoscopy or narrow-band imaging. However, current imaging modalities have only moderate sensitivity and specificity for lesion detection. We have developed a novel fluorescence excitation-scanning hyperspectral imaging (HSI) approach to sample image and spectroscopic data simultaneously on microscope and endoscope platforms for enhanced diagnostic potential. Unfortunately, fluorescence excitation-scanning HSI datasets pose major challenges for data processing, interpretability, and classification due to their high dimensionality. Here, we present an end-to-end scalable Artificial Intelligence (AI) framework built for classification of excitation-scanning HSI microscopy data that provides accurate image classification and interpretability of the AI decision-making process. The developed AI framework is able to perform real-time HSI classification with different speed/classification performance trade-offs by tailoring the dimensionality of the dataset, supporting different dimensions of deep learning models, and varying the architecture of deep learning models. We have also incorporated tools to visualize the exact location of the lesion detected by the AI decision-making process and to provide heatmap-based pixel-by-pixel interpretability. In addition, our deep learning framework provides wavelength-dependent impact as a heatmap, which allows visualization of the contributions of HSI wavelength bands during the AI decision-making process. This framework is well-suited for HSI microscope and endoscope platforms, where real-time analysis and visualization of classification results are required by clinicians.

Multifaceted mirror array illuminator for fluorescence excitation-scanning spectral imaging microscopy.

Significance: Hyperspectral imaging (HSI) technologies offer great potential in fluorescence microscopy for multiplexed imaging, autofluorescence removal, and analysis of autofluorescent molecules. However, there are also associated trade-offs when implementing HSI in fluorescence microscopy systems, such as decreased acquisition speed, resolution, or field-of-view due to the need to acquire spectral information in addition to spatial information. The vast majority of HSI fluorescence microscopy systems provide spectral discrimination by filtering or dispersing the fluorescence emission, which may result in loss of emitted fluorescence signal due to optical filters, dispersive optics, or supporting optics, such as slits and collimators. Technologies that scan the fluorescence excitation spectrum may offer an approach to mitigate some of these trade-offs by decreasing the complexity of the emission light path. Aim: We describe the development of an optical technique for hyperspectral imaging fluorescence excitation-scanning (HIFEX) on a microscope system. Approach: The approach is based on the design of an array of wavelength-dependent light emitting diodes (LEDs) and a unique beam combining system that uses a multifurcated mirror. The system was modeled and optimized using optical ray trace simulations, and a prototype was built and coupled to an inverted microscope platform. The prototype system was calibrated, and initial feasibility testing was performed by imaging multilabel slide preparations. Results: We present results from optical ray trace simulations, prototyping, calibration, and feasibility testing of the system. Results indicate that the system can discriminate between at least six fluorescent labels and autofluorescence and that the approach can provide decreased wavelength switching times, in comparison with mechanically tuned filters. Conclusions: We anticipate that LED-based HIFEX microscopy may provide improved performance for time-dependent and photosensitive assays.

Endoscopy Lifetime Systems Architecture: Scoping Out the Past to Diagnose the Future Technology.

Systems engineering captures the desires and needs of the customer to conceptualize a system from the overall goal down to the small details prior to any physical development. While many systems projects tend to be large and complicated (i.e., cloud-based infrastructure, long-term space travel shuttles, missile defense systems), systems engineering can also be applied to smaller, complex systems. Here, the system of interest is the endoscope, a standard biomedical screening device used in laparoscopic surgery, screening of upper and lower gastrointestinal tracts, and inspection of the upper airway. Often, endoscopic inspection is used to identify pre-cancerous and cancerous tissues, and hence, a requirement for endoscopic systems is the ability to provide images with high contrast between areas of normal tissue and neoplasia (early-stage abnormal tissue growth). For this manuscript, the endoscope was reviewed for all the technological advancements thus far to theorize what the next version of the system could be in order to provide improved detection capabilities. Endoscopic technology was decomposed into categories, using systems architecture and systems thinking, to visualize the improvements throughout the system's lifetime from the original to current state-of-the-art. Results from this review were used to identify trends in subsystems and components to estimate the theoretical performance maxima for different subsystems as well as areas for further development. The subsystem analysis indicated that future endoscope systems will focus on more complex imaging and higher computational requirements that will provide improved contrast in order to have higher accuracy in optical diagnoses of early, abnormal tissue growth.

Microscopy is better in color: development of a streamlined spectral light path for real-time multiplex fluorescence microscopy.

Spectroscopic image data has provided molecular discrimination for numerous fields including: remote sensing, food safety and biomedical imaging. Despite the various technologies for acquiring spectral data, there remains a trade-off when acquiring data. Typically, spectral imaging either requires long acquisition times to collect an image stack with high spectral specificity or acquisition times are shortened at the expense of fewer spectral bands or reduced spatial sampling. Hence, new spectral imaging microscope platforms are needed to help mitigate these limitations. Fluorescence excitation-scanning spectral imaging is one such new technology, which allows more of the emitted signal to be detected than comparable emission-scanning spectral imaging systems. Here, we have developed a new optical geometry that provides spectral illumination for use in excitation-scanning spectral imaging microscope systems. This was accomplished using a wavelength-specific LED array to acquire spectral image data. Feasibility of the LED-based spectral illuminator was evaluated through simulation and benchtop testing and assessment of imaging performance when integrated with a widefield fluorescence microscope. Ray tracing simulations (TracePro) were used to determine optimal optical component selection and geometry. Spectral imaging feasibility was evaluated using a series of 6-label fluorescent slides. The LED-based system response was compared to a previously tested thin-film tunable filter (TFTF)-based system. Spectral unmixing successfully discriminated all fluorescent components in spectral image data acquired from both the LED and TFTF systems. Therefore, the LED-based spectral illuminator provided spectral image data sets with comparable information content so as to allow identification of each fluorescent component. These results provide proof-of-principle demonstration of the ability to combine output from many discrete wavelength LED sources using a double-mirror (Cassegrain style) optical configuration that can be further modified to allow for high speed, video-rate spectral image acquisition. Real-time spectral fluorescence microscopy would allow monitoring of rapid cell signaling processes (i.e., Ca2+ and other second messenger signaling) and has potential to be translated to clinical imaging platforms.

Validation of Excitation-Scan Hyperspectral Multi-faceted Mirror Array Prototype System Advancements to Hyperspectral Imaging Applications.

Hyperspectral imaging technologies (HSI) have undergone rapid development since their beginning stages. While original applications were in remote sensing, other uses include agriculture, food safety and medicine. HSI has shown great utility in fluorescence microscopy for detecting signatures from many fluorescent molecules; however, acquisitions speeds have been slow due to light losses associated with spectral filtering. Therefore, we designed a novel light emitting diode (LED)-based rapid excitation scanning hyperspectral imaging platform allowing users to obtain simultaneous measurements of fluorescent labels without compromising acquisition speeds. Previously, we reported our results of the optical ray trace simulations and the geometrical capability of designing a multifaceted mirror imaging system as an initial approach to combine light at many wavelengths. The design utilized LEDs and a multifaceted mirror array to combine light sources into a liquid light guide. The computational model was constructed using Monte Carlo optical ray software (TracePro, Lambda Research Corp.). Recent prototype validation results show that when compared to a commercial emission scanning spectral confocal microscope (Zeiss-LSM-980), the novel LED-based excitation scanning HSI prototype successfully detected and separated six fluorescent labels from a custom 6-label African green monkey kidney epithelial cells. We report on the prototype's ability to overcome limitations of acquisition speeds, sensitivity, and specificity present in conventional systems. Future work will evaluate prototype's light losses to determine latent design modifications needed to demonstrate the system's feasibility as a promising solution for overcoming HSI acquisition speeds. This work was supported by NSF award MRI1725937.

Excitation-scanning hyperspectral video endoscopy: enhancing the light at the end of the tunnel.

Colorectal cancer is the 3rd leading cancer for incidence and mortality rates. Positive treatment outcomes have been associated with early detection; however, early stage lesions have limited contrast to surrounding mucosa. A potential technology to enhance early stagise detection is hyperspectral imaging (HSI). While HSI technologies have been previously utilized to detect colorectal cancer ex vivo or post-operation, they have been difficult to employ in real-time endoscopy scenarios. Here, we describe an LED-based multifurcated light guide and spectral light source that can provide illumination for spectral imaging at frame rates necessary for video-rate endoscopy. We also present an updated light source optical ray-tracing model that resulted in further optimization and provided a ∼10X light transmission increase compared to the initial prototype. Future work will iterate simulation and benchtop testing of the hyperspectral endoscopic system to achieve the goal of video-rate spectral endoscopy.

Optical simulations for determining efficacy of new light source designs for excitation-scanning high-speed hyperspectral imaging systems.

Positive outcomes for colorectal cancer treatment have been linked to early detection. The difficulty in detecting early lesions is the limited contrast with surrounding mucosa and minimal definitive markers to distinguish between hyperplastic and carcinoma lesions. Colorectal cancer is the 3rd leading cancer for incidence and mortality rates which is potentially linked to missed early lesions which allow for increased growth and metastatic potential. One potential technology for early-stage lesion detection is hyperspectral imaging. Traditionally, hyperspectral imaging uses reflectance spectroscopic data to provide a component analysis, per pixel, of an image in fields such as remote sensing, agriculture, food processing and archaeology. This work aims to acquire higher signal-to-noise fluorescence spectroscopic data, harnessing the autofluorescence of tissue, adding a hyperspectral contrast to colorectal cancer detection while maintaining spatial resolution at video-rate speeds. We have previously designed a multi-furcated LED-based spectral light source to prove this concept. Our results demonstrated that the technique is feasible, but the initial prototype has a high light transmission loss (~98%) minimizing spatial resolution and slowing video acquisition. Here, we present updated results in developing an optical ray-tracing model of light source geometries to maximize irradiance throughput for excitation-scanning hyperspectral imaging. Results show combining solid light guide branches have a compounding light loss effect, however, there is potential to minimize light loss through the use of optical claddings. This simulation data will provide the necessary metrics to verify and validate future physical optical components within the hyperspectral endoscopic system for detecting colorectal cancer.

Comparison of spectral FRET microscopy approaches for single-cell analysis.

Förster resonance energy transfer (FRET) is a valuable tool for measuring molecular distances and the effects of biological processes such as cyclic nucleotide messenger signaling and protein localization. Most FRET techniques require two fluorescent proteins with overlapping excitation/emission spectral pairing to maximize detection sensitivity and FRET efficiency. FRET microscopy often utilizes differing peak intensities of the selected fluorophores measured through different optical filter sets to estimate the FRET index or efficiency. Microscopy platforms used to make these measurements include wide-field, laser scanning confocal, and fluorescence lifetime imaging. Each platform has associated advantages and disadvantages, such as speed, sensitivity, specificity, out-of-focus fluorescence, and Z-resolution. In this study, we report comparisons among multiple microscopy and spectral filtering platforms such as standard 2-filter FRET, emission-scanning hyperspectral imaging, and excitation-scanning hyperspectral imaging. Samples of human embryonic kidney (HEK293) cells were grown on laminin-coated 28 mm round gridded glass coverslips (10816, Ibidi, Fitchburg, Wisconsin) and transfected with adenovirus encoding a cAMP-sensing FRET probe composed of a FRET donor (Turquoise) and acceptor (Venus). Additionally, 3 FRET "controls" with fixed linker lengths between Turquoise and Venus proteins were used for inter-platform validation. Grid locations were logged, recorded with light micrographs, and used to ensure that whole-cell FRET was compared on a cell-by-cell basis among the different microscopy platforms. FRET efficiencies were also calculated and compared for each method. Preliminary results indicate that hyperspectral methods increase the signal-to-noise ratio compared to a standard 2-filter approach.

Spectral Illumination System Utilizing Spherical Reflection Optics.

Fluorescence imaging microscopy has traditionally been used because of the high specificity that is achievable through fluorescence labeling techniques and optical filtering. When combined with spectral imaging technologies, fluorescence microscopy can allow for quantitative identification of multiple fluorescent labels. We are working to develop a new approach for spectral imaging that samples the fluorescence excitation spectrum and may provide increased signal strength. The enhanced signal strength may be used to provide increased spectral sensitivity and spectral, spatial, and temporal sampling capabilities. A proof of concept excitation scanning system has shown over 10-fold increase in signal to noise ratio compared to emission scanning hyperspectral imaging. Traditional hyperspectral imaging fluorescence microscopy methods often require minutes of acquisition time. We are developing a new configuration that utilizes solid state LEDs to combine multiple illumination wavelengths in a 2-mirror assembly to overcome the temporal limitations of traditional hyperspectral imaging. We have previously reported on the theoretical performance of some of the aspects of this system by using optical ray trace modeling. Here, we present results from prototyping and benchtop testing of the system, including assembly, optical characterization, and data collection. This work required the assembly and characterization of a novel excitation scanning hyperspectral microscopy system, containing 12 LEDs ranging from 365-425 nm, 12 lenses, a spherical mirror, and a flat mirror. This unique approach may reduce the long image acquisition times seen in traditional hyperspectral imaging while maintaining high specificity and sensitivity for multilabel identification and autofluorescence imaging in real time.

Excitation-scan Mirror Array System Advancements to Hyperspectral Imaging Applications.

Hyperspectral imaging (HSI) technology has been applied in a range of fields for target detection and mixture analysis. While its original applications were in remote sensing, modern uses include agriculture, historical document authentications and medicine. HSI has shown great utility in fluorescence microscopy; however, acquisition speeds have been slow due to light losses associated with spectral filtering. We are currently developing a rapid hyperspectral imaging platform for 5-dimensional imaging (RHIP-5D), a confocal imaging system that will allow users to obtain simultaneous measurements of many fluorescent labels. We have previously reported on optical modeling performance of the system. This previous model investigated geometrical capability of designing a multifaceted mirror imaging system as an initial approach to sample light at many wavelengths. The design utilized light-emitting diodes (LEDs) and a multifaceted mirror array to combine light sources into a liquid light guide (LLG). The computational model was constructed using Monte Carlo optical ray software (TracePro, Lambda Research Corp.). Recent results presented here show transmission has increased up to 9% through parametric optimization of each component. Future work will involve system validation using a prototype engineered based on our optimized model. System requirements will be evaluated to determine if potential design changes are needed to improve the system. We will report on spectral resolution to demonstrate feasibility of the RHIP-5D as a promising solution for overcoming current HSI acquisition speed and sensitivity limitations.

Hyperspectral imaging microscopy for measurement of localized second messenger signals in single cells.

Ca2+ and cAMP are ubiquitous second messengers known to differentially regulate a variety of cellular functions over a wide range of timescales. Studies from a variety of groups support the hypothesis that these signals can be localized to discrete locations within cells, and that this subcellular localization is a critical component of signaling specificity. However, to date, it has been difficult to track second messenger signals at multiple locations within a single cell. This difficulty is largely due to the inability to measure multiplexed florescence signals in real time. To overcome this limitation, we have utilized both emission scan- and excitation scan-based hyperspectral imaging approaches to track second messenger signals as well as labeled cellular structures and/or proteins in the same cell. We have previously reported that hyperspectral imaging techniques improve the signal-to-noise ratios of both fluorescence and FRET measurements, and are thus well suited for the measurement of localized second messenger signals. Using these approaches, we have measured near plasma membrane and near nuclear membrane cAMP signals, as well as distributed signals within the cytosol, in several cell types including airway smooth muscle, pulmonary endothelial, and HEK-293 cells. We have also measured cAMP and Ca2+ signals near autofluorescent structures that appear to be golgi. Our data demonstrate that hyperspectral imaging approaches provide unique insight into the spatial and kinetic distributions of cAMP and Ca2+ signals in single cells.

Optimization of Light Transmission through an Excitation-scan Hyperspectral Mirror Array System.

Hyperspectral imaging has numerous applications in a range of fields for target detection. While its original applications were in remote sensing, new uses include analyzing food quality, agriculture and medicine, Hyperspectral imaging has shown utility in fluorescence microscopy for detecting signatures from many fluorescent molecules, but acquisition speeds have been slow due to the need to acquire many spectral bands and the light losses associated with spectral filtering. Therefore, a novel confocal microscope, the 5-Dimensional Rapid Hyperspectral Imaging Platform (RHIP-5D) was designed and is undergoing testing to overcome acquisition speed and sensitivity limitations. The current design utilizes light-emitting diodes (LEDs) and a multifaceted mirror array to combine light sources into a liquid light guide. Initial tests demonstrated feasibility and we are now working on determining the ideal location of the liquid light guide, LEDs, lenses and mirror array to optimize optical transmission. A computational model was constructed using Monte Carlo optical ray tracing in TracePro software (Lambda Research Corp.). LED sources were simulated by importing irradiance properties from the manufacturers' specifications. Optical properties of lenses were modeled using lens files available from the manufacturer. Analysis of the model includes geometry and parametric optimization, assessing lens power, mirror angles and location of optical elements. Initial results show an increase of transmission is possible by up to 20%. Future work will involve evaluating the position of the liquid light guide as well as analyzing lens configurations to further increase optical transmission.

A Spherical Mirror-based Illumination System for Fluorescence Excitation-Scanning Hyperspectral Imaging.

Many hardware approaches have been developed for implementing hyperspectral imaging on fluorescence microscope systems; each with tradeoffs in spectral sensitivity and spectral, spatial, and temporal sampling. For example, tunable filter-based systems typically have limited wavelength switching speeds and sensitivities that preclude high-speed spectral imaging. Here, we present a novel approach combining multiple illumination wavelengths using solid state LEDs in a 2-mirror configuration similar to a Cassegrain reflector assembly. This approach provides spectral discrimination by scanning a range of fluorescence excitation wavelengths, which we have previously shown can improve spectral image acquisition time compared to traditional fluorescence emission-scanning hyperspectral imaging. In this work, the geometry of the LED and other optical components was optimized. A model of the spectral illuminator was designed using TracePro ray tracing software (Lambda Research Corp.) that included an emitter, lens, Spherical mirror, flat mirror, and liquid light guide input. A parametric sensitivity study was performed to optimize the optical throughput varying the LED viewing angle, properties of the Spherical reflectors, the lens configuration, focal length, and position. The following factors significantly affected the optical throughput: LED viewing angle, lens position, and lens focal length. Several types of configurations were evaluated, and an optimized lens and LED position were determined. Initial optimization results indicate that a 10% optical transmission can be achieved for either a 16 or 32 wavelength system. Future work will include continuing to optimize the ray trace model, prototyping, and experimental testing of the optimized configuration.

Hyperspectral imaging fluorescence excitation scanning (HIFEX) microscopy for live cell imaging.

In the past two decades, spectral imaging technologies have expanded the capacity of fluorescence microscopy for accurate detection of multiple labels, separation of labels from cellular and tissue autofluorescence, and analysis of autofluorescence signatures. These technologies have been implemented using a range of optical techniques, such as tunable filters, diffraction gratings, prisms, interferometry, and custom Bayer filters. Each of these techniques has associated strengths and weaknesses with regard to spectral resolution, spatial resolution, temporal resolution, and signal-to-noise characteristics. We have previously shown that spectral scanning of the fluorescence excitation spectrum can provide greatly increased signal strength compared to traditional emission-scanning approaches. Here, we present results from utilizing a Hyperspectral Imaging Fluorescence Excitation Scanning (HIFEX) microscope system for live cell imaging. Live cell signaling studies were performed using HEK 293 and rat pulmonary microvascular endothelial cells (PMVECs), transfected with either a cAMP FRET reporter or a Ca2+ reporter. Cells were further labeled to visualize subcellular structures (nuclei, membrane, mitochondria, etc.). Spectral images were acquired using a custom inverted microscope (TE2000, Nikon Instruments) equipped with a 300W Xe arc lamp and tunable excitation filter (VF-5, Sutter Instrument Co., equipped with VersaChrome filters, Semrock), and run through MicroManager. Timelapse spectral images were acquired from 350-550 nm, in 5 nm increments. Spectral image data were linearly unmixed using custom MATLAB scripts. Results indicate that the HIFEX microscope system can acquire live cell image data at acquisition speeds of 8 ms/wavelength band with minimal photobleaching, sufficient for studying moderate speed cAMP and Ca2+ events.

Sensitivity analysis of a multibranched light guide for real time hyperspectral imaging systems.

Hyperspectral imaging (HSI) is a spectroscopic technique which captures images at a high contrast over a wide range of wavelengths to show pixel specific composition. Traditional uses of HSI include: satellite imagery, food distribution quality control and digital archaeological reconstruction. Our lab has focused on developing applications of HSI fluorescence imaging systems to study molecule-specific detection for rapid cell signaling events or real-time endoscopic screening. Previously, we have developed a prototype spectral light source, using our modified imaging technique, excitation-scanning hyperspectral imaging (HIFEX), coupled to a commercial colonoscope for feasibility testing. The 16 wavelength LED array was combined, using a multi-branched solid light guide, to couple to the scope's optical input. The prototype acquired a spectral scan at near video-rate speeds (∼8 fps). The prototype could operate at very rapid wavelength switch speeds, limited to the on/off rates of the LEDs (∼10 µs), but imaging speed was limited due to optical transmission losses (∼98%) through the solid light guide. Here we present a continuation of our previous work in performing an in-depth analysis of the solid light guide to optimize the optical intensity throughput. The parameters evaluated include: LED intensity input, geometry (branch curvature and combination) and light propagation using outer claddings. Simulations were conducted using a Monte Carlo ray tracing software (TracePro). Results show that transmission within the branched light guide may be optimized through LED focusing lenses, bend radii and smooth tangential branch merges. Future work will test a new fabricated light guide from the optimized model framework.

Identifying molecular contributors to autofluorescence of neoplastic and normal colon sections using excitation-scanning hyperspectral imaging.

Autofluorescence, the endogenous fluorescence present in cells and tissues, has historically been considered a nuisance in biomedical imaging. Many endogenous fluorophores, specifically, collagen, elastin, nicotinamide adenine dinucleotide, and flavin adenine dinucleotide (FAD), are found throughout the human body. In fluorescence imaging scenarios, these signals can be prohibitive as they can outcompete signals introduced for diagnostic purposes. However, autofluorescence also contains information that has diagnostic value. Recent advances in hyperspectral imaging have allowed the acquisition of significantly more data in a shorter time period by scanning the excitation spectra of fluorophores. The reduced acquisition time and increased signal-to-noise ratio allow for separation of significantly more fluorophores than previously possible. We propose to utilize excitation-scanning hyperspectral imaging of autofluorescence to differentiate neoplastic lesions from surrounding non-neoplastic "normal" tissue. The spectra of isolated autofluorescent molecules are obtained using a custom inverted microscope (TE-2000, Nikon Instruments) with an Xe arc lamp and thin-film tunable filter array (VersaChrome, Semrock, Inc.). Scans utilize excitation wavelengths from 360 to 550 nm in 5-nm increments. The resultant molecule-specific spectra are used to analyze hyperspectral image stacks from normal and neoplastic colorectal tissues. Due to a limited number of samples, neoplastic tissues examined here are a pool of both colorectal adenocarcinoma and adenomatous polyps. The hyperspectral images are analyzed with ENVI software and custom MATLAB scripts, including linear spectral unmixing. Initial results indicate the ability to separate signals of endogenous fluorophores and measure the relative concentrations of fluorophores among healthy and diseased states, in this case, normal colon versus neoplastic colon. These results suggest pathology-specific changes to endogenous fluorophores can be detected using excitation-scanning hyperspectral imaging. Future work will focus on expanding the library of pure molecules, exploring histogram distance metrics as a means for identifying deviations in spectral signatures, and examining more defined disease states.

Endoscopic hyperspectral imaging: light guide optimization for spectral light source.

Hyperspectral imaging (HSI) is a technology used in remote sensing, food processing and documentation recovery. Recently, this approach has been applied in the medical field to spectrally interrogate regions of interest within respective substrates. In spectral imaging, a two (spatial) dimensional image is collected, at many different (spectral) wavelengths, to sample spectral signatures from different regions and/or components within a sample. Here, we report on the use of hyperspectral imaging for endoscopic applications. Colorectal cancer is the 3rd leading cancer for incidences and deaths in the US. One factor of severity is the miss rate of precancerous/flat lesions (~65% accuracy). Integrating HSI into colonoscopy procedures could minimize misdiagnosis and unnecessary resections. We have previously reported a working prototype light source with 16 high-powered light emitting diodes (LEDs) capable of high speed cycling and imaging. In recent testing, we have found our current prototype is limited by transmission loss (~99%) through the multi-furcated solid light guide (lightpipe) and the desired framerate (20-30 fps) could not be achieved. Here, we report on a series of experimental and modeling studies to better optimize the lightpipe and the spectral endoscopy system as a whole. The lightpipe was experimentally evaluated using an integrating sphere and spectrometer (Ocean Optics). Modeling the lightpipe was performed using Monte Carlo optical ray tracing in TracePro (Lambda Research Corp.). Results of these optimization studies will aid in manufacturing a revised prototype with the newly designed light guide and increased sensitivity. Once the desired optical output (5-10 mW) is achieved then the HIS endoscope system will be able to be implemented without adding onto the procedure time.

Applications and assessment of an excitation-scanning hyperspectral imaging system.

The majority of microscopic and endoscopic technologies utilize white light illumination. For a number of applications, hyper-spectral imaging can be shown to have significant improvements over standard white-light imaging techniques. This is true for both microscopy and in vivo imaging. However, hyperspectral imaging methods have suffered from slow application times. Often, minutes are required to gather a full imaging stack. Here we will describe and evaluate a novel excitation-scanning hyperspectral imaging system and discuss some applications. We have developed and are optimizing a novel approach called excitation-scanning hyperspectral imaging that provides an order of magnitude increased signal strength. This excitation scanning technique has enabled us to produce a microscopy system capable of high speed hyperspectral imaging with the potential for live video acquisition. The excitation-scanning hyperspectral imaging technology we developed may impact a range of applications. The current design uses digital strobing to illuminate at 16 wavelengths with millisecond image acquisition time. Analog intensity control enables a fully customizable excitation profile. A significant advantage of excitation-scanning hyperspectral imaging is can identify multiple targets simultaneously in real time. Finally, we are exploring utilizing this technology for a variety of applications ranging from measuring cAMP distribution in three dimensions within a cell to electrophysiology.

Design of a modified endoscope illuminator for spectral imaging of colorectal tissues.

The gold standard for locating colonic polyps is a white light endoscope in a colonoscopy, however, polyps smaller than 5 mm can be easily missed. Modified procedures such as narrow band imaging have shown only marginal increases in detection rates. Spectral imaging is a potential solution to improve the sensitivity and specificity of colonoscopies by providing the ability to distinguish molecular fluorescence differences in tissues. The goal of this work is to implement a spectral endoscopic light source to acquire spectral image data of colorectal tissues. A beta-version endoscope light source was developed, by retrofitting a white light endoscope light source (Olympus, CLK-4) with 16 narrow band LEDs. This redesigned, beta-prototype uses high-power LEDs with a minimum output of 500 mW to provide sufficient spectral output (0.5 mW) through the endoscope. A mounting apparatus was designed to provide sufficient heat dissipation. Here, we report recent results of our tests to characterize the intensity output through the light source and endoscope to determine the flat spectral output for imaging and intensity losses through the endoscope. We also report preliminary spectral imaging data from transverse pig colon that demonstrates the ability to result in working practical spectral data. Preliminary results of this revised prototype spectral endoscope system demonstrate that there is sufficient power to allow the imaging process to continue and potentially determine spectral differences in cancerous and normal tissue from imaging ex vivo pairs. Future work will focus on building a spectral library for the colorectal region and refining the user interface the system for in vivo use.

LED-based endoscopic light source for spectral imaging.

Colorectal cancer is the United States 3rd leading cancer in death rates.1 The current screening for colorectal cancer is an endoscopic procedure using white light endoscopy (WLE). There are multiple new methods testing to replace WLE, for example narrow band imaging and autofluorescence imaging.2 However, these methods do not meet the need for a higher specificity or sensitivity. The goal for this project is to modify the presently used endoscope light source to house 16 narrow wavelength LEDs for spectral imaging in real time while increasing sensitivity and specificity. The process to do such was to take an Olympus CLK-4 light source, replace the light and electronics with 16 LEDs and new circuitry. This allows control of the power and intensity of the LEDs. This required a larger enclosure to house a bracket system for the solid light guide (lightpipe), three new circuit boards, a power source and National Instruments hardware/software for computer control. The results were a successfully designed retrofit with all the new features. The LED testing resulted in the ability to control each wavelength's intensity. The measured intensity over the voltage range will provide the information needed to couple the camera for imaging. Overall the project was successful; the modifications to the light source added the controllable LEDs. This brings the research one step closer to the main goal of spectral imaging for early detection of colorectal cancer. Future goals will be to connect the camera and test the imaging process.