On the inverse problem in optical coherence tomography.

We examine the inverse problem of retrieving sample refractive index information in the context of optical coherence tomography. Using two separate approaches, we discuss the limitations of the inverse problem which lead to it being ill-posed, primarily as a consequence of the limited viewing angles available in the reflection geometry. This is first considered from the theoretical point of view of diffraction tomography under a weak scattering approximation. We then investigate the full non-linear inverse problem using a variational approach. This presents another illustration of the non-uniqueness of the solution, and shows that even the non-linear (strongly scattering) scenario suffers a similar fate as the linear problem, with the observable spatial Fourier components of the sample occupying a limited support. Through examples we demonstrate how the solutions to the inverse problem compare when using the variational and diffraction-tomography approaches.

A Model-Based Iterative Learning Approach for Diffuse Optical Tomography.

Diffuse optical tomography (DOT) utilises near-infrared light for imaging spatially distributed optical parameters, typically the absorption and scattering coefficients. The image reconstruction problem of DOT is an ill-posed inverse problem, due to the non-linear light propagation in tissues and limited boundary measurements. The ill-posedness means that the image reconstruction is sensitive to measurement and modelling errors. The Bayesian approach for the inverse problem of DOT offers the possibility of incorporating prior information about the unknowns, rendering the problem less ill-posed. It also allows marginalisation of modelling errors utilising the so-called Bayesian approximation error method. A more recent trend in image reconstruction techniques is the use of deep learning, which has shown promising results in various applications from image processing to tomographic reconstructions. In this work, we study the non-linear DOT inverse problem of estimating the (absolute) absorption and scattering coefficients utilising a 'model-based' learning approach, essentially intertwining learned components with the model equations of DOT. The proposed approach was validated with 2D simulations and 3D experimental data. We demonstrated improved absorption and scattering estimates for targets with a mix of smooth and sharp image features, implying that the proposed approach could learn image features that are difficult to model using standard Gaussian priors. Furthermore, it was shown that the approach can be utilised in compensating for modelling errors due to coarse discretisation enabling computationally efficient solutions. Overall, the approach provided improved computation times compared to a standard Gauss-Newton iteration.

Unsupervised knowledge-transfer for learned image reconstruction.

Deep learning-based image reconstruction approaches have demonstrated impressive empirical performance in many imaging modalities. These approaches usually require a large amount of high-quality paired training data, which is often not available in medical imaging. To circumvent this issue we develop a novel unsupervised knowledge-transfer paradigm for learned reconstruction within a Bayesian framework. The proposed approach learns a reconstruction network in two phases. The first phase trains a reconstruction network with a set of ordered pairs comprising of ground truth images of ellipses and the corresponding simulated measurement data. The second phase fine-tunes the pretrained network to more realistic measurement data without supervision. By construction, the framework is capable of delivering predictive uncertainty information over the reconstructed image. We present extensive experimental results on low-dose and sparse-view computed tomography showing that the approach is competitive with several state-of-the-art supervised and unsupervised reconstruction techniques. Moreover, for test data distributed differently from the training data, the proposed framework can significantly improve reconstruction quality not only visually, but also quantitatively in terms of PSNR and SSIM, when compared with learned methods trained on the synthetic dataset only.

(An overview of) Synergistic reconstruction for multimodality/multichannel imaging methods.

Imaging is omnipresent in modern society with imaging devices based on a zoo of physical principles, probing a specimen across different wavelengths, energies and time. Recent years have seen a change in the imaging landscape with more and more imaging devices combining that which previously was used separately. Motivated by these hardware developments, an ever increasing set of mathematical ideas is appearing regarding how data from different imaging modalities or channels can be synergistically combined in the image reconstruction process, exploiting structural and/or functional correlations between the multiple images. Here we review these developments, give pointers to important challenges and provide an outlook as to how the field may develop in the forthcoming years. This article is part of the theme issue 'Synergistic tomographic image reconstruction: part 1'.

Dual wavelength spread-spectrum time-resolved diffuse optical instrument for the measurement of human brain functional responses.

Near-infrared spectroscopy has proven to be a valuable method to monitor tissue oxygenation and haemodynamics non-invasively and in real-time. Quantification of such parameters requires measurements of the time-of-flight of light through tissue, typically achieved using picosecond pulsed lasers, with their associated cost, complexity, and size. In this work, we present an alternative approach that employs spread-spectrum excitation to enable the development of a small, low-cost, dual-wavelength system using vertical-cavity surface-emitting lasers. Since the optimal wavelengths and drive parameters for optical spectroscopy are not served by commercially available modules as used in our previous single-wavelength demonstration platform, we detail the design of a custom instrument and demonstrate its performance in resolving haemodynamic changes in human subjects during apnoea and cognitive task experiments.

Single-pixel camera photoacoustic tomography.

Since it was first demonstrated more than a decade ago, the single-pixel camera concept has been used in numerous applications in which it is necessary or advantageous to reduce the channel count, cost, or data volume. Here, three-dimensional (3-D), compressed-sensing photoacoustic tomography (PAT) is demonstrated experimentally using a single-pixel camera. A large area collimated laser beam is reflected from a planar Fabry­Pérot ultrasound sensor onto a digital micromirror device, which patterns the light using a scrambled Hadamard basis before it is collected into a single photodetector. In this way, inner products of the Hadamard patterns and the distribution of thickness changes of the FP sensor­induced by the photoacoustic waves­are recorded. The initial distribution of acoustic pressure giving rise to those photoacoustic waves is recovered directly from the measured signals using an accelerated proximal gradient-type algorithm to solve a model-based minimization with total variation regularization. Using this approach, it is shown that 3-D PAT of imaging phantoms can be obtained with compression rates as low as 10%. Compressed sensing approaches to photoacoustic imaging, such as this, have the potential to reduce the data acquisition time as well as the volume of data it is necessary to acquire, both of which are becoming increasingly important in the drive for faster imaging systems giving higher resolution images with larger fields of view.

Three dimensional photoacoustic tomography in Bayesian framework.

The image reconstruction problem (or inverse problem) in photoacoustic tomography is to resolve the initial pressure distribution from detected ultrasound waves generated within an object due to an illumination by a short light pulse. Recently, a Bayesian approach to photoacoustic image reconstruction with uncertainty quantification was proposed and studied with two dimensional numerical simulations. In this paper, the approach is extended to three spatial dimensions and, in addition to numerical simulations, experimental data are considered. The solution of the inverse problem is obtained by computing point estimates, i.e., maximum a posteriori estimate and posterior covariance. These are computed iteratively in a matrix-free form using a biconjugate gradient stabilized method utilizing the adjoint of the acoustic forward operator. The results show that the Bayesian approach can produce accurate estimates of the initial pressure distribution in realistic measurement geometries and that the reliability of these estimates can be assessed.

Slice-illuminated optical projection tomography.

To improve the imaging performance of optical projection tomography (OPT) in live samples, we have explored a parallelized implementation of semi-confocal line illumination and detection to discriminate against scattered photons. Slice-illuminated OPT (sl-OPT) improves reconstruction quality in scattering samples by reducing interpixel crosstalk at the cost of increased acquisition time. For in vivo imaging, this can be ameliorated through the use of compressed sensing on angularly undersampled OPT data sets. Here, we demonstrate sl-OPT applied to 3D imaging of bead phantoms and live adult zebrafish.

A spread spectrum approach to time-domain near-infrared diffuse optical imaging using inexpensive optical transceiver modules.

We introduce a compact time-domain system for near-infrared spectroscopy using a spread spectrum technique. The proof-of-concept single channel instrument utilises a low-cost commercially available optical transceiver module as a light source, controlled by a Kintex 7 field programmable gate array (FPGA). The FPGA modulates the optical transceiver with maximum-length sequences at line rates up to 10Gb/s, allowing us to achieve an instrument response function with full width at half maximum under 600ps. The instrument is characterised through a set of detailed phantom measurements as well as proof-of-concept in vivo measurements, demonstrating performance comparable with conventional pulsed time-domain near-infrared spectroscopy systems.

NiftyPET: a High-throughput Software Platform for High Quantitative Accuracy and Precision PET Imaging and Analysis.

We present a standalone, scalable and high-throughput software platform for PET image reconstruction and analysis. We focus on high fidelity modelling of the acquisition processes to provide high accuracy and precision quantitative imaging, especially for large axial field of view scanners. All the core routines are implemented using parallel computing available from within the Python package NiftyPET, enabling easy access, manipulation and visualisation of data at any processing stage. The pipeline of the platform starts from MR and raw PET input data and is divided into the following processing stages: (1) list-mode data processing; (2) accurate attenuation coefficient map generation; (3) detector normalisation; (4) exact forward and back projection between sinogram and image space; (5) estimation of reduced-variance random events; (6) high accuracy fully 3D estimation of scatter events; (7) voxel-based partial volume correction; (8) region- and voxel-level image analysis. We demonstrate the advantages of this platform using an amyloid brain scan where all the processing is executed from a single and uniform computational environment in Python. The high accuracy acquisition modelling is achieved through span-1 (no axial compression) ray tracing for true, random and scatter events. Furthermore, the platform offers uncertainty estimation of any image derived statistic to facilitate robust tracking of subtle physiological changes in longitudinal studies. The platform also supports the development of new reconstruction and analysis algorithms through restricting the axial field of view to any set of rings covering a region of interest and thus performing fully 3D reconstruction and corrections using real data significantly faster. All the software is available as open source with the accompanying wiki-page and test data.

Direct Parametric Reconstruction With Joint Motion Estimation/Correction for Dynamic Brain PET Data.

Direct reconstruction of parametric images from raw photon counts has been shown to improve the quantitative analysis of dynamic positron emission tomography (PET) data. However it suffers from subject motion which is inevitable during the typical acquisition time of 1-2 hours. In this work we propose a framework to jointly estimate subject head motion and reconstruct the motion-corrected parametric images directly from raw PET data, so that the effects of distorted tissue-to-voxel mapping due to subject motion can be reduced in reconstructing the parametric images with motion-compensated attenuation correction and spatially aligned temporal PET data. The proposed approach is formulated within the maximum likelihood framework, and efficient solutions are derived for estimating subject motion and kinetic parameters from raw PET photon count data. Results from evaluations on simulated [11C]raclopride data using the Zubal brain phantom and real clinical [18F]florbetapir data of a patient with Alzheimer's disease show that the proposed joint direct parametric reconstruction motion correction approach can improve the accuracy of quantifying dynamic PET data with large subject motion.

Direct Estimation of Optical Parameters From Photoacoustic Time Series in Quantitative Photoacoustic Tomography.

Estimation of optical absorption and scattering of a target is an inverse problem associated with quantitative photoacoustic tomography. Conventionally, the problem is expressed as two folded. First, images of initial pressure distribution created by absorption of a light pulse are formed based on acoustic boundary measurements. Then, the optical properties are determined based on these photoacoustic images. The optical stage of the inverse problem can thus suffer from, for example, artefacts caused by the acoustic stage. These could be caused by imperfections in the acoustic measurement setting, of which an example is a limited view acoustic measurement geometry. In this work, the forward model of quantitative photoacoustic tomography is treated as a coupled acoustic and optical model and the inverse problem is solved by using a Bayesian approach. Spatial distribution of the optical properties of the imaged target are estimated directly from the photoacoustic time series in varying acoustic detection and optical illumination configurations. It is numerically demonstrated, that estimation of optical properties of the imaged target is feasible in limited view acoustic detection setting.

PET Reconstruction With an Anatomical MRI Prior Using Parallel Level Sets.

The combination of positron emission tomography (PET) and magnetic resonance imaging (MRI) offers unique possibilities. In this paper we aim to exploit the high spatial resolution of MRI to enhance the reconstruction of simultaneously acquired PET data. We propose a new prior to incorporate structural side information into a maximum a posteriori reconstruction. The new prior combines the strengths of previously proposed priors for the same problem: it is very efficient in guiding the reconstruction at edges available from the side information and it reduces locally to edge-preserving total variation in the degenerate case when no structural information is available. In addition, this prior is segmentation-free, convex and no a priori assumptions are made on the correlation of edge directions of the PET and MRI images. We present results for a simulated brain phantom and for real data acquired by the Siemens Biograph mMR for a hardware phantom and a clinical scan. The results from simulations show that the new prior has a better trade-off between enhancing common anatomical boundaries and preserving unique features than several other priors. Moreover, it has a better mean absolute bias-to-mean standard deviation trade-off and yields reconstructions with superior relative l2-error and structural similarity index. These findings are underpinned by the real data results from a hardware phantom and a clinical patient confirming that the new prior is capable of promoting well-defined anatomical boundaries.

Gradient-Based Quantitative Image Reconstruction in Ultrasound-Modulated Optical Tomography: First Harmonic Measurement Type in a Linearised Diffusion Formulation.

Ultrasound-modulated optical tomography is an emerging biomedical imaging modality which uses the spatially localised acoustically-driven modulation of coherent light as a probe of the structure and optical properties of biological tissues. In this work we begin by providing an overview of forward modelling methods, before deriving a linearised diffusion-style model which calculates the first-harmonic modulated flux measured on the boundary of a given domain. We derive and examine the correlation measurement density functions of the model which describe the sensitivity of the modality to perturbations in the optical parameters of interest. Finally, we employ said functions in the development of an adjoint-assisted gradient based image reconstruction method, which ameliorates the computational burden and memory requirements of a traditional Newton-based optimisation approach. We validate our work by performing reconstructions of optical absorption and scattering in two- and three-dimensions using simulated measurements with 1% proportional Gaussian noise, and demonstrate the successful recovery of the parameters to within ±5% of their true values when the resolution of the ultrasound raster probing the domain is sufficient to delineate perturbing inclusions.

Nonlinear approach to difference imaging in diffuse optical tomography.

Difference imaging aims at recovery of the change in the optical properties of a body based on measurements before and after the change. Conventionally, the image reconstruction is based on using difference of the measurements and a linear approximation of the observation model. One of the main benefits of the linearized difference reconstruction is that the approach has a good tolerance to modeling errors, which cancel out partially in the subtraction of the measurements. However, a drawback of the approach is that the difference images are usually only qualitative in nature and their spatial resolution can be weak because they rely on the global linearization of the nonlinear observation model. To overcome the limitations of the linear approach, we investigate a nonlinear approach for difference imaging where the images of the optical parameters before and after the change are reconstructed simultaneously based on the two datasets. We tested the feasibility of the method with simulations and experimental data from a phantom and studied how the approach tolerates modeling errors like domain truncation, optode coupling errors, and domain shape errors.

Multi-contrast attenuation map synthesis for PET/MR scanners: assessment on FDG and Florbetapir PET tracers.

Positron Emission Tomography/Magnetic Resonance Imaging (PET/MR) scanners are expected to offer a new range of clinical applications. Attenuation correction is an essential requirement for quantification of PET data but MRI images do not directly provide a patient-specific attenuation map. Methods We further validate and extend a Computed Tomography (CT) and attenuation map (µ-map) synthesis method based on pre-acquired MRI-CT image pairs. The validation consists of comparing the CT images synthesised with the proposed method to the original CT images. PET images were acquired using two different tracers ((18)F-FDG and (18)F-florbetapir). They were then reconstructed and corrected for attenuation using the synthetic µ-maps and compared to the reference PET images corrected with the CT-based µ-maps. During the validation, we observed that the CT synthesis was inaccurate in areas such as the neck and the cerebellum, and propose a refinement to mitigate these problems, as well as an extension of the method to multi-contrast MRI data. Results With the improvements proposed, a significant enhancement in CT synthesis, which results in a reduced absolute error and a decrease in the bias when reconstructing PET images, was observed. For both tracers, on average, the absolute difference between the reference PET images and the PET images corrected with the proposed method was less than 2%, with a bias inferior to 1%. Conclusion With the proposed method, attenuation information can be accurately derived from MRI images by synthesising CT using routine anatomical sequences. MRI sequences, or combination of sequences, can be used to synthesise CT images, as long as they provide sufficient anatomical information.

Quantitative photoacoustic tomography using illuminations from a single direction.

Quantitative photoacoustic tomography is an emerging imaging technique aimed at estimating optical parameters inside tissues from photoacoustic images, which are formed by combining optical information and ultrasonic propagation. This optical parameter estimation problem is ill-posed and needs to be approached within the framework of inverse problems. It has been shown that, in general, estimating the spatial distribution of more than one optical parameter is a nonunique problem unless more than one illumination pattern is used. Generally, this is overcome by illuminating the target from various directions. However, in some cases, for example when thick samples are investigated, illuminating the target from different directions may not be possible. In this work, the use of spatially modulated illumination patterns at one side of the target is investigated with simulations. The results show that the spatially modulated illumination patterns from a single direction could be used to provide multiple illuminations for quantitative photoacoustic tomography. Furthermore, the results show that the approach can be used to distinguish absorption and scattering inclusions located near the surface of the target. However, when compared to a full multidirection illumination setup, the approach cannot be used to image as deep inside tissues.

Compensation of modeling errors due to unknown domain boundary in diffuse optical tomography.

Diffuse optical tomography is a highly unstable problem with respect to modeling and measurement errors. During clinical measurements, the body shape is not always known, and an approximate model domain has to be employed. The use of an incorrect model domain can, however, lead to significant artifacts in the reconstructed images. Recently, the Bayesian approximation error theory has been proposed to handle model-based errors. In this work, the feasibility of the Bayesian approximation error approach to compensate for modeling errors due to unknown body shape is investigated. The approach is tested with simulations. The results show that the Bayesian approximation error method can be used to reduce artifacts in reconstructed images due to unknown domain shape.

Attenuation correction synthesis for hybrid PET-MR scanners: application to brain studies.

Attenuation correction is an essential requirement for quantification of positron emission tomography (PET) data. In PET/CT acquisition systems, attenuation maps are derived from computed tomography (CT) images. However, in hybrid PET/MR scanners, magnetic resonance imaging (MRI) images do not directly provide a patient-specific attenuation map. The aim of the proposed work is to improve attenuation correction for PET/MR scanners by generating synthetic CTs and attenuation maps. The synthetic images are generated through a multi-atlas information propagation scheme, locally matching the MRI-derived patient's morphology to a database of MRI/CT pairs, using a local image similarity measure. Results show significant improvements in CT synthesis and PET reconstruction accuracy when compared to a segmentation method using an ultrashort-echo-time MRI sequence and to a simplified atlas-based method.