Ultrasound-on-chip platform for medical imaging, analysis, and collective intelligence.

Over the past half-century, ultrasound imaging has become a key technology for assessing an ever-widening range of medical conditions at all stages of life. Despite ultrasound's proven value, expensive systems that require domain expertise in image acquisition and interpretation have limited its broad adoption. The proliferation of portable and low-cost ultrasound imaging can improve global health and also enable broad clinical and academic studies with great impact on the fields of medicine. Here, we describe the design of a complete ultrasound-on-chip, the first to be cleared by the Food and Drug Administration for 13 indications, comprising a two-dimensional array of silicon-based microelectromechanical systems (MEMS) ultrasonic sensors directly integrated into complementary metal-oxide-semiconductor-based control and processing electronics to enable an inexpensive whole-body imaging probe. The fabrication and design of the transducer array with on-chip analog and digital circuits, having an operating power consumption of 3 W or less, are described, in which approximately 9,000 seven-level feedback-based pulsers are individually addressable to each MEMS element and more than 11,000 amplifiers, more than 1,100 analog-to-digital converters, and more than 1 trillion operations per second are implemented. We quantify the measured performance and the ability to image areas of the body that traditionally takes three separate probes. Additionally, two applications of this platform are described-augmented reality assistance that guides the user in the acquisition of diagnostic-quality images of the heart and algorithms that automate the measurement of cardiac ejection fraction, an indicator of heart health.

Fast-start escape performance across temperature and salinity gradients in mummichog Fundulus heteroclitus.

Fast-start predator-escape performance of mummichogs Fundulus heteroclitus was tested across field-informed variation in temperature (24, 30 and 36°C) and salinity (2, 12 and 32 ppt). Performance was similar across temperatures and salinities when fish were allowed to acclimate to these conditions. However, when mummichogs experienced acute temperature changes, performance exhibited thermal dependence in two contrasting ways. Fast-start turning rates and linear speeds varied directly with the temperature at which the manoeuvre was executed, but these aspects of performance varied inversely with acclimation temperature, with cool-acclimated fish exhibiting faster starts across test temperatures. Temperature effects were consistent across salinities. These results suggest that while mummichogs increase performance with acute temperature increases, long-term rises in sea temperature may cause these fish to become more susceptible to predation during abrupt cooling events, such as when storm events flood shallow water estuaries with cool rainwater.

Cross-validation of interferometric synthetic aperture microscopy and optical coherence tomography.

Computationally reconstructed interferometric synthetic aperture microscopy is coregistered with optical coherence tomography (OCT) focal plane data to provide quantitative cross validation with OCT. This is accomplished through a qualitative comparison of images and a quantitative analysis of the width of the point-spread function in simulation and experiment. The width of the ISAM point-spread function is seen to be independent of depth, in contrast to OCT.

Detecting intrinsic scattering changes correlated to neuron action potentials using optical coherence imaging.

We demonstrate how optical coherence imaging techniques can detect intrinsic scattering changes that occur during action potentials in single neurons. Using optical coherence tomography (OCT), an increase in scattering intensity from neurons in the abdominal ganglion of Aplysia californica is observed following electrical stimulation of the connective nerve. In addition, optical coherence microscopy (OCM), with its superior transverse spatial resolution, is used to demonstrate a direct correlation between scattering intensity changes and membrane voltage in single cultured Aplysia bag cell neurons during evoked action potentials. While intrinsic scattering changes are small, OCT and OCM have potential use as tools in neuroscience research for non-invasive and non-contact measurement of neural activity without electrodes or fluorescent dyes. These techniques have many attractive features such as high sensitivity and deep imaging penetration depth, as well as high temporal and spatial resolution. This study demonstrates the first use of OCT and OCM to detect functionally-correlated optical scattering changes in single neurons.

Imaging gold nanorods in excised human breast carcinoma by spectroscopic optical coherence tomography.

Plasmon-resonant gold nanorods (GNRs) can serve as imaging agents for spectroscopic optical coherence tomography (SOCT). The aspect ratio of the GNRs are adjusted for maximum absorption in the far red to create a partial spectral overlap with the low-wavelength edge of the near-infrared SOCT imaging band. The spectroscopic absorption profile of the GNRs is incorporated into a depth-resolved algorithm for mapping the relative GNR density within OCT images. This technique enables us to image GNR distributions in excised human breast carcinomas, demonstrating their potential as OCT contrast agents in heteregeneous, highly scattering tissues.

Magnetomotive nanoparticle transducers for optical rheology of viscoelastic materials.

The availability of a real-time non-destructive modality to interrogate the mechanical properties of viscoelastic materials would facilitate many new investigations. We introduce a new optical method for measuring elastic properties of samples which employs magnetite nanoparticles as perturbative agents. Magnetic nanoparticles distributed in silicone-based samples are displaced upon probing with a small external magnetic field gradient and depth-resolved optical coherence phase shifts allow for the tracking of scatterers in the sample with nanometer-scale sensitivity. The scatterers undergo underdamped oscillations when the magnetic field is applied step-wise, allowing for the measurement of the natural frequencies of oscillation of the samples. Validation of the measurements is accomplished using a commercial indentation apparatus to determine the elastic moduli of the samples. This real-time non-destructive technique constitutes a novel way of probing the natural frequencies of viscoelastic materials in which magnetic nanoparticles can be introduced.

High-speed processing architecture for spectral-domain optical coherence microscopy.

Optical coherence microscopy (OCM) is an interferometric technique that combines principles of confocal microscopy and optical coherence tomography (OCT) to obtain high-resolution en face images. Axial and lateral resolutions of several microns can be achieved using OCM depending on the numerical aperture (NA) of the objective and sample properties. We address the computational complexity that is inherent in spectral-domain OCM systems that limits its real-time capability as a microscope. An architecture that will improve the efficiency of the computation involved is presented. Currently, spectral-domain OCM images are obtained by individually taking the Fourier transform of each axial scan in cross-sectional frames and computationally slicing them to generate en face images. The real-time architecture presented here relies on the fact that only one Fourier domain point of a given axial scan needs to be computed rather than computing all the Fourier domain points, which can frequently require a significant amount of time to compute. This new realization has been shown to reduce the processing time to obtain the en face OCM images by a factor of 30.

Real-time interferometric synthetic aperture microscopy.

An interferometric synthetic aperture microscopy (ISAM) system design with real-time 2D cross-sectional processing is described in detail. The system can acquire, process, and display the ISAM reconstructed images at frame rates of 2.25 frames per second for 512 X 1024 pixel images. This system provides quantitatively meaningful structural information from previously indistinguishable scattering intensities and provides proof of feasibility for future real-time ISAM systems.

Interferometric Synthetic Aperture Microscopy: Computed Imaging for Scanned Coherent Microscopy.

Three-dimensional image formation in microscopy is greatly enhanced by the use of computed imaging techniques. In particular, Interferometric Synthetic Aperture Microscopy (ISAM) allows the removal of out-of-focus blur in broadband, coherent microscopy. Earlier methods, such as optical coherence tomography (OCT), utilize interferometric ranging, but do not apply computed imaging methods and therefore must scan the focal depth to acquire extended volumetric images. ISAM removes the need to scan the focus by allowing volumetric image reconstruction from data collected at a single focal depth. ISAM signal processing techniques are similar to the Fourier migration methods of seismology and the Fourier reconstruction methods of Synthetic Aperture Radar (SAR). In this article ISAM is described and the close ties between ISAM and SAR are explored. ISAM and a simple strip-map SAR system are placed in a common mathematical framework and compared to OCT and radar respectively. This article is intended to serve as a review of ISAM, and will be especially useful to readers with a background in SAR.

Nonparaxial vector-field modeling of optical coherence tomography and interferometric synthetic aperture microscopy.

A large-aperture, electromagnetic model for coherent microscopy is presented and the inverse scattering problem is solved. Approximations to the model are developed for near-focus and far-from-focus operations. These approximations result in an image-reconstruction algorithm consistent with interferometric synthetic aperture microscopy (ISAM): this validates ISAM processing of optical-coherence-tomography and optical-coherence-microscopy data in a vectorial setting. Numerical simulations confirm that diffraction-limited resolution can be achieved outside the focal plane and that depth of focus is limited only by measurement noise and/or detector dynamic range. Furthermore, the model presented is suitable for the quantitative study of polarimetric coherent microscopy systems operating within the first Born approximation.

Autocorrelation artifacts in optical coherence tomography and interferometric synthetic aperture microscopy.

Interferometric synthetic aperture microscopy processing of optical coherence tomography data has been shown to allow computational focusing of en face planes that have traditionally been regarded as out of focus. It is shown that this focusing of the image also produces a defocusing effect in autocorrelation artifacts resulting from Fourier-domain data collection. This effect is verified experimentally and through simulation.

Inverse scattering for frequency-scanned full-field optical coherence tomography.

Full-field optical coherence tomography (OCT) is able to image an entire en face plane of scatterers simultaneously, but typically the focus is scanned through the volume to acquire three-dimensional structure. By solving the inverse scattering problem for full-field OCT, we show it is possible to computationally reconstruct a three-dimensional volume while the focus is fixed at one plane inside the sample. While a low-numerical-aperture (NA) OCT system can tolerate defocus because the depth of field is large, for high NA it is critical to correct for defocus. By deriving a solution to the inverse scattering problem for full-field OCT, we propose and simulate an algorithm that recovers object structure both inside and outside the depth of field, so that even for high NA the focus can be fixed at a particular plane within the sample without compromising resolution away from the focal plane.

Interferometric synthetic aperture microscopy.

State-of-the-art methods in high-resolution three-dimensional optical microscopy require that the focus be scanned through the entire region of interest. However, an analysis of the physics of the light-sample interaction reveals that the Fourier-space coverage is independent of depth. Here we show that, by solving the inverse scattering problem for interference microscopy, computed reconstruction yields volumes with a resolution in all planes that is equivalent to the resolution achieved only at the focal plane for conventional high-resolution microscopy. In short, the entire illuminated volume has spatially invariant resolution, thus eliminating the compromise between resolution and depth of field. We describe and demonstrate a novel computational image-formation technique called interferometric synthetic aperture microscopy (ISAM). ISAM has the potential to broadly impact real-time three-dimensional microscopy and analysis in the fields of cell and tumour biology, as well as in clinical diagnosis where in vivo imaging is preferable to biopsy.

Inverse scattering for high-resolution interferometric microscopy.

We extend the applicability of inverse scattering for optical coherence tomography (OCT) to the case of high numerical aperture focusing optics. We include the effects of tight focusing so that the approach is applicable to any interferometric microscopy method. The applicability to modalities, such as OCT and optical coherence microscopy, enables computed reconstruction of three-dimensional volumes from en face temporal ranging data. Simulations show that the computed structure outside of the focal plane exhibits spatially invariant resolution on par with the resolution achieved at the focal plane.

Inverse scattering for rotationally scanned optical coherence tomography.

Optical coherence tomography of luminal structures, such as for intravascular or gastrointestinal imaging, is performed by using a fiber-optic catheter as a beam-delivery probe. The interrogating beam is scanned angularly by rotating the fiber around a fixed central axis. Because the beam is focused only at a fixed distance from the center of the fiber, only scatterers near this distance are resolved. We present a solution of the inverse scattering problem that provides an estimate of the susceptibility of the sample for an angularly scanned Gaussian beam focused at a fixed distance from the origin. This solution provides quantitatively meaningful reconstructions while also extending the volume of the sample that is resolvable by the instrument.

Three-dimensional optical coherence tomography of the embryonic murine cardiovascular system.

Optical coherence tomography (OCT) is an emerging high-resolution real-time biomedical imaging technology that has potential as a novel investigational tool in developmental biology and functional genomics. In this study, murine embryos and embryonic hearts are visualized with an OCT system capable of 2-microm axial and 15-microm lateral resolution and with real-time acquisition rates. We present, to our knowledge, the first sets of high-resolution 2- and 3-D OCT images that reveal the internal structures of the mammalian (murine) embryo (E10.5) and embryonic (E14.5 and E17.5) cardiovascular system. Strong correlations are observed between OCT images and corresponding hematoxylin- and eosin-stained histological sections. Real-time in vivo embryonic (E10.5) heart activity is captured by spectral-domain optical coherence tomography, processed, and displayed at a continuous rate of five frames per second. With the ability to obtain not only high-resolution anatomical data but also functional information during cardiovascular development, the OCT technology has the potential to visualize and quantify changes in murine development and in congenital and induced heart disease, as well as enable a wide range of basic in vitro and in vivo research studies in functional genomics.

Spectroscopic spectral-domain optical coherence microscopy.

The spectroscopic content within optical coherence tomography (OCT) data can provide a wealth of information. Spectroscopic OCT methods are frequently limited by time-frequency trade-offs that limit high spectral and spatial resolution simultaneously. We present spectroscopic spectral-domain optical coherence microscopy performed with a multimodality microscope. Restricting the spatial extent of the signal by using high-numerical-aperture optics makes high-resolution spectroscopic information accessible, facilitated with spectral-domain detection. Simultaneous acquisition of multiphoton microscopy images is used to validate tissue structure and localization of nuclei within individual cells.

Inverse scattering for optical coherence tomography.

Inverse scattering theory for optical coherence tomography (OCT) is developed. The results are used to produce algorithms to resolve three-dimensional object structure, taking into account the finite beam width, diffraction, and defocusing effects. The resolution normally achieved only in the focal plane of the OCT system is shown to be available for all illuminated depths in the object without moving the focal plane. Spatially invariant resolution is verified with numerical simulations and indicates an improvement of the high-resolution cross-sectional imaging capabilities of OCT.

Speckle reduction by I-divergence regularization in optical coherence tomography.

For optical coherence tomography (OCT), ultrasound, synthetic-aperture radar, and other coherent ranging methods, speckle can cause spurious detail that detracts from the utility of the image. It is a problem inherent to imaging densely scattering objects with limited bandwidth. Using a method of regularization by minimizing Csiszar's I-divergence measure, we derive a method of speckle minimization that produces an image that both is consistent with the known data and extrapolates additional detail based on constraints on the magnitude of the image. This method is demonstrated on a test image and on an OCT image of a Xenopus laevis tadpole.

Deconvolution methods for mitigation of transverse blurring in optical coherence tomography.

Imaging resolution in optical coherence tomography (OCT) is a key determinant for acquiring clinically useful optical biopsies of tissues. In contrast to light or confocal microscopy, the axial and transverse resolutions in OCT are independent and each can be analyzed individually. A method for mitigating transverse blurring and the apparent loss of transverse resolution in OCT by means of Gaussian beam deconvolution is presented. Such a method provides better representation of a specimen by using known physical parameters of a lens. To implement this method, deconvolution algorithms based on a focal-dependent kernel are investigated. First, the direct inverse problem is investigated using two types of regularization, truncated singular value decomposition, and Tikhonov. Second, an iterative expectation maximization algorithm, the Richardson-Lucy algorithm, with a beam-width-dependent iteration scheme is developed. A dynamically iterative Richardson-Lucy algorithm can reduce transverse blurring by providing an improvement in the transverse point-spread-function for sparse scattering samples in regions up to two times larger than the confocal region of the lens. These deblurring improvements inside and outside of the confocal region, which are validated experimentally, are possible without introducing new optical imaging hardware or acquiring multiple images of the same specimen. Implementation of this method in sparse scattering specimens, such as engineered tissues, has the potential to improve cellular detection and categorization.