Leukocyte differentiation in bronchoalveolar lavage fluids using higher harmonic generation microscopy and deep learning.

BACKGROUND: In diseases such as interstitial lung diseases (ILDs), patient diagnosis relies on diagnostic analysis of bronchoalveolar lavage fluid (BALF) and biopsies. Immunological BALF analysis includes differentiation of leukocytes by standard cytological techniques that are labor-intensive and time-consuming. Studies have shown promising leukocyte identification performance on blood fractions, using third harmonic generation (THG) and multiphoton excited autofluorescence (MPEF) microscopy. OBJECTIVE: To extend leukocyte differentiation to BALF samples using THG/MPEF microscopy, and to show the potential of a trained deep learning algorithm for automated leukocyte identification and quantification. METHODS: Leukocytes from blood obtained from three healthy individuals and one asthma patient, and BALF samples from six ILD patients were isolated and imaged using label-free microscopy. The cytological characteristics of leukocytes, including neutrophils, eosinophils, lymphocytes, and macrophages, in terms of cellular and nuclear morphology, and THG and MPEF signal intensity, were determined. A deep learning model was trained on 2D images and used to estimate the leukocyte ratios at the image-level using the differential cell counts obtained using standard cytological techniques as reference. RESULTS: Different leukocyte populations were identified in BALF samples using label-free microscopy, showing distinctive cytological characteristics. Based on the THG/MPEF images, the deep learning network has learned to identify individual cells and was able to provide a reasonable estimate of the leukocyte percentage, reaching >90% accuracy on BALF samples in the hold-out testing set. CONCLUSIONS: Label-free THG/MPEF microscopy in combination with deep learning is a promising technique for instant differentiation and quantification of leukocytes. Immediate feedback on leukocyte ratios has potential to speed-up the diagnostic process and to reduce costs, workload and inter-observer variations.

Compact portable multiphoton microscopy reveals histopathological hallmarks of unprocessed lung tumor tissue in real time.

During lung cancer operations a rapid and reliable assessment of tumor tissue can reduce operation time and potentially improve patient outcomes. We show that third harmonic generation (THG), second harmonic generation (SHG) and two-photon excited autofluorescence (2PEF) microscopy reveals relevant, histopathological information within seconds in fresh unprocessed human lung samples. We used a compact, portable microscope and recorded images within 1 to 3 seconds using a power of 5 mW. The generated THG/SHG/2PEF images of tumorous and nontumorous tissues are compared with the corresponding standard histology images, to identify alveolar structures and histopathological hallmarks. Cellular structures (tumor cells, macrophages and lymphocytes) (THG), collagen (SHG) and elastin (2PEF) are differentiated and allowed for rapid identification of carcinoid with solid growth pattern, minimally enlarged monomorphic cell nuclei with salt-and-pepper chromatin pattern, and adenocarcinoma with lipidic and micropapillary growth patterns. THG/SHG/2PEF imaging is thus a promising tool for clinical intraoperative assessment of lung tumor tissue.

Quantitative Third Harmonic Generation Microscopy for Assessment of Glioma in Human Brain Tissue.

Distinguishing tumors from normal brain cells is important but challenging in glioma surgery due to the lack of clear interfaces between the two. The ability of label-free third harmonic generation (THG) microscopy in combination with automated image analysis to quantitatively detect glioma infiltration in fresh, unprocessed tissue in real time is assessed. The THG images reveal increased cellularity in grades II-IV glioma samples from 23 patients, as confirmed by subsequent hematoxylin and eosin histology. An automated image quantification workflow is presented for quantitative assessment of the imaged cellularity as a reflection of the degree of glioma invasion. The cellularity is validated in three ways: 1) Quantitative comparison of THG imaging with fluorescence microscopy of nucleus-stained samples demonstrates that THG reflects the true tissue cellularity. 2) Thresholding of THG cellularity differentiates normal brain from glioma infiltration, with 96.6% sensitivity and 95.5% specificity, in nearly perfect (93%) agreement with pathologists. 3) In one patient, a good correlation between THG cellularity and preoperative magnetic resonance and positron emission tomography imaging is demonstrated. In conclusion, quantitative real-time THG microscopy accurately assesses glioma infiltration in ex vivo human brain samples, and therefore holds strong potential for improving the accuracy of surgical resection.

Second and third harmonic generation microscopy visualizes key structural components in fresh unprocessed healthy human breast tissue.

Real-time assessment of excised tissue may help to improve surgical results in breast tumor surgeries. Here, as a step towards this purpose, the potential of second and third harmonic generation (SHG, THG) microscopy is explored. SHG and THG are nonlinear optical microscopic techniques that do not require labeling of tissue to generate 3D images with intrinsic depth-sectioning at sub-cellular resolution. Until now, this technique had been applied on fixated breast tissue or to visualize the stroma only, whereas most tumors start in the lobules and ducts. Here, SHG/THG images of freshly excised unprocessed healthy human tissue are shown to reveal key breast components-lobules, ducts, fat tissue, connective tissue and blood vessels, in good agreement with hematoxylin and eosin histology. DNA staining of fresh unprocessed mouse breast tissue was performed to aid in the identification of cell nuclei in label-free THG images. Furthermore, 2- and 3-photon excited auto-fluorescence images of mouse and human tissue are collected for comparison. The SHG/THG imaging modalities generate high quality images of freshly excised tissue in less than a minute with an information content comparable to that of the gold standard, histopathology. Therefore, SHG/THG microscopy is a promising tool for real-time assessment of excised tissue during surgery.