Software-Based Phase Control, Video-Rate Imaging, and Real-Time Mosaicing With a Lissajous-Scanned Confocal Microscope.

We present software-based methods for automatic phase control and for mosaicing high-speed, Lissajous-scanned images. To achieve imaging speeds fast enough for mosaicing, we first increase the image update rate tenfold from 3 to 30 Hz, then vertically interpolate each sparse image in real-time to eliminate fixed pattern noise. We validate our methods by imaging fluorescent beads and automatically maintaining phase control over the course of one hour. We then image fixed mouse brain tissues at varying update rates and compare the resulting mosaics. Using reconstructed image data as feedback for phase control eliminates the need for phase sensors and feedback controllers, enabling long-term imaging experiments without additional hardware. Mosaicing subsampled images results in video-rate imaging speeds, nearly fully recovered spatial resolution, and millimeter-scale fields of view.

Automated Cell Segmentation for Quantitative Phase Microscopy.

Automated cell segmentation and tracking is essential for dynamic studies of cellular morphology, movement, and interactions as well as other cellular behaviors. However, accurate, automated, and easy-to-use cell segmentation remains a challenge, especially in cases of high cell densities, where discrete boundaries are not easily discernable. Here, we present a fully automated segmentation algorithm that iteratively segments cells based on the observed distribution of optical cell volumes measured by quantitative phase microscopy. By fitting these distributions to known probability density functions, we are able to converge on volumetric thresholds that enable valid segmentation cuts. Since each threshold is determined from the observed data itself, virtually no input is needed from the user. We demonstrate the effectiveness of this approach over time using six cell types that display a range of morphologies, and evaluate these cultures over a range of confluencies. Facile dynamic measures of cell mobility and function revealed unique cellular behaviors that relate to tissue origins, state of differentiation, and real-time signaling. These will improve our understanding of multicellular communication and organization.

Dynamic and social behaviors of human pluripotent stem cells.

Human pluripotent stem cells (hPSCs) can self-renew or differentiate to diverse cell types, thus providing a platform for basic and clinical applications. However, pluripotent stem cell populations are heterogeneous and functional properties at the single cell level are poorly documented leading to inefficiencies in differentiation and concerns regarding reproducibility and safety. Here, we use non-invasive time-lapse imaging to continuously examine hPSC maintenance and differentiation and to predict cell viability and fate. We document dynamic behaviors and social interactions that prospectively distinguish hPSC survival, self-renewal, and differentiation. Results highlight the molecular role of E-cadherin not only for cell-cell contact but also for clonal propagation of hPSCs. Results indicate that use of continuous time-lapse imaging can distinguish cellular heterogeneity with respect to pluripotency as well as a subset of karyotypic abnormalities whose dynamic properties were monitored.

A real-time clinical endoscopic system for intraluminal, multiplexed imaging of surface-enhanced Raman scattering nanoparticles.

The detection of biomarker-targeting surface-enhanced Raman scattering (SERS) nanoparticles (NPs) in the human gastrointestinal tract has the potential to improve early cancer detection; however, a clinically relevant device with rapid Raman-imaging capability has not been described. Here we report the design and in vivo demonstration of a miniature, non-contact, opto-electro-mechanical Raman device as an accessory to clinical endoscopes that can provide multiplexed molecular data via a panel of SERS NPs. This device enables rapid circumferential scanning of topologically complex luminal surfaces of hollow organs (e.g., colon and esophagus) and produces quantitative images of the relative concentrations of SERS NPs that are present. Human and swine studies have demonstrated the speed and simplicity of this technique. This approach also offers unparalleled multiplexing capabilities by simultaneously detecting the unique spectral fingerprints of multiple SERS NPs. Therefore, this new screening strategy has the potential to improve diagnosis and to guide therapy by enabling sensitive quantitative molecular detection of small and otherwise hard-to-detect lesions in the context of white-light endoscopy.

High-sensitivity, real-time, ratiometric imaging of surface-enhanced Raman scattering nanoparticles with a clinically translatable Raman endoscope device.

Topical application and quantification of targeted, surface-enhanced Raman scattering (SERS) nanoparticles offer a new technique that has the potential for early detection of epithelial cancers of hollow organs. Although less toxic than intravenous delivery, the additional washing required to remove unbound nanoparticles cannot necessarily eliminate nonspecific pooling. Therefore, we developed a real-time, ratiometric imaging technique to determine the relative concentrations of at least two spectrally unique nanoparticle types, where one serves as a nontargeted control. This approach improves the specific detection of bound, targeted nanoparticles by adjusting for working distance and for any nonspecific accumulation following washing. We engineered hardware and software to acquire SERS signals and ratios in real time and display them via a graphical user interface. We report quantitative, ratiometric imaging with nanoparticles at pM and sub-pM concentrations and at varying working distances, up to 50 mm. Additionally, we discuss optimization of a Raman endoscope by evaluating the effects of lens material and fiber coating on background noise, and theoretically modeling and simulating collection efficiency at various working distances. This work will enable the development of a clinically translatable, noncontact Raman endoscope capable of rapidly scanning large, topographically complex tissue surfaces for small and otherwise hard to detect lesions.

Real-time pathology through in vivo microscopy.

Miniature microscopes are being developed to examine tissue in situ for early anatomic and molecular indicators of disease, in real time, and at cellular resolution. These new devices will lead to a shift from the current diagnostic paradigm of biopsy followed by histopathology and recommended therapy, to one of non-invasive point-of-care diagnosis with the possibility of treatment in the same session. This potential revolution in disease management may have a major impact on the training of future physicians to include the use and interpretation of real-time in vivo microscopic data, and will also affect the emerging fields of telepathology and telemedicine. Implementation of new technologies into clinical practice is a complex process that requires multidisciplinary communication and collaboration among clinicians, engineers and scientists. As such, our aim is to provide a forward-looking view of the critical issues facing the development of new technologies and directing clinical education. Here, we focus on the use of in vivo microscopy for detection of malignant and pre-malignant lesions as well as for guiding therapy. We will highlight some of the areas in which in vivo microscopy could address unmet clinical needs, and then review the technological challenges that are being addressed, or need to be addressed, for in vivo microscopy to become an effective clinical tool.

Point-of-care pathology with miniature microscopes.

Advances in optical designs are enabling the development of miniature microscopes that can examine tissue in situ for early anatomic and molecular indicators of disease, in real time, and at cellular resolution. These new devices will lead to major changes in how diseases are detected and managed, driving a shift from today's diagnostic paradigm of biopsy followed by histopathology and recommended therapy, to non-invasive point-of-care diagnosis with possible same-session definitive treatment. This shift may have major implications for the training requirements of future physicians to enable them to interpret real-time in vivo microscopic data, and will also shape the emerging fields of telepathology and telemedicine. Implementation of new technologies into clinical practice is a complex process that requires bridging gaps between clinicians, engineers and scientists. This article provides a forward-looking discussion of these issues, with a focus on malignant and pre-malignant lesions, by first highlighting some of the clinical areas where point-of-care in vivo microscopy could address unmet needs, and then by reviewing the technological challenges that are being addressed, or need to be addressed, for in vivo microscopy to become a standard clinical tool.

Micromirror-scanned dual-axis confocal microscope utilizing a gradient-index relay lens for image guidance during brain surgery.

A fluorescence confocal microscope incorporating a 1.8-mm-diam gradient-index relay lens is developed for in vivo histological guidance during resection of brain tumors. The microscope utilizes a dual-axis confocal architecture to efficiently reject out-of-focus light for high-contrast optical sectioning. A biaxial microelectromechanical system (MEMS) scanning mirror is actuated at resonance along each axis to achieve a large field of view with low-voltage waveforms. The unstable Lissajous scan, which results from actuating the orthogonal axes of the MEMS mirror at highly disparate resonance frequencies, is optimized to fully sample 500x500 pixels at two frames per second. Optically sectioned fluorescence images of brain tissues are obtained in living mice to demonstrate the utility of this microscope for image-guided resections.