GANPOP: Generative Adversarial Network Prediction of Optical Properties From Single Snapshot Wide-Field Images.

We present a deep learning framework for wide-field, content-aware estimation of absorption and scattering coefficients of tissues, called Generative Adversarial Network Prediction of Optical Properties (GANPOP). Spatial frequency domain imaging is used to obtain ground-truth optical properties at 660 nm from in vivo human hands and feet, freshly resected human esophagectomy samples, and homogeneous tissue phantoms. Images of objects with either flat-field or structured illumination are paired with registered optical property maps and are used to train conditional generative adversarial networks that estimate optical properties from a single input image. We benchmark this approach by comparing GANPOP to a single-snapshot optical property (SSOP) technique, using a normalized mean absolute error (NMAE) metric. In human gastrointestinal specimens, GANPOP with a single structured-light input image estimates the reduced scattering and absorption coefficients with 60% higher accuracy than SSOP while GANPOP with a single flat-field illumination image achieves similar accuracy to SSOP. When applied to both in vivo and ex vivo swine tissues, a GANPOP model trained solely on structured-illumination images of human specimens and phantoms estimates optical properties with approximately 46% improvement over SSOP, indicating adaptability to new, unseen tissue types. Given a training set that appropriately spans the target domain, GANPOP has the potential to enable rapid and accurate wide-field measurements of optical properties.

Wide-field optical property mapping and structured light imaging of the esophagus with spatial frequency domain imaging.

As the incidence of esophageal adenocarcinoma continues to rise, there is a need for improved imaging technologies with contrast to abnormal esophageal tissues. To inform the design of optical technologies that meet this need, we characterize the spatial distribution of the scattering and absorption properties from 471 to 851 nm of eight resected human esophagi tissues using Spatial Frequency Domain Imaging. Histopathology was used to categorize tissue types, including normal, inflammation, fibrotic, ulceration, Barrett's Esophagus and squamous cell carcinoma. Average absorption and reduced scattering coefficients of normal tissues were 0.211 ± 0.051 and 1.20 ± 0.18 mm-1 , respectively at 471 nm, and both values decreased monotonically with increasing wavelength. Fibrotic tissue exhibited at least 68% larger scattering signal across all wavelengths, while squamous cell carcinoma exhibited a 36% decrease in scattering at 471 nm. We additionally image the esophagus with high spatial frequencies up to 0.5 mm-1 and show strong reflectance contrast to tissue treated with radiation. Lastly, we observe that esophageal absorption and scattering values change by an average of 9.4% and 2.7% respectively over a 30 minute duration post-resection. These results may guide system design for the diagnosis, prevention and monitoring of esophageal pathologies.