Leukocyte differentiation in bronchoalveolar lavage fluids using higher harmonic generation microscopy and deep learning.

BACKGROUND: In diseases such as interstitial lung diseases (ILDs), patient diagnosis relies on diagnostic analysis of bronchoalveolar lavage fluid (BALF) and biopsies. Immunological BALF analysis includes differentiation of leukocytes by standard cytological techniques that are labor-intensive and time-consuming. Studies have shown promising leukocyte identification performance on blood fractions, using third harmonic generation (THG) and multiphoton excited autofluorescence (MPEF) microscopy. OBJECTIVE: To extend leukocyte differentiation to BALF samples using THG/MPEF microscopy, and to show the potential of a trained deep learning algorithm for automated leukocyte identification and quantification. METHODS: Leukocytes from blood obtained from three healthy individuals and one asthma patient, and BALF samples from six ILD patients were isolated and imaged using label-free microscopy. The cytological characteristics of leukocytes, including neutrophils, eosinophils, lymphocytes, and macrophages, in terms of cellular and nuclear morphology, and THG and MPEF signal intensity, were determined. A deep learning model was trained on 2D images and used to estimate the leukocyte ratios at the image-level using the differential cell counts obtained using standard cytological techniques as reference. RESULTS: Different leukocyte populations were identified in BALF samples using label-free microscopy, showing distinctive cytological characteristics. Based on the THG/MPEF images, the deep learning network has learned to identify individual cells and was able to provide a reasonable estimate of the leukocyte percentage, reaching >90% accuracy on BALF samples in the hold-out testing set. CONCLUSIONS: Label-free THG/MPEF microscopy in combination with deep learning is a promising technique for instant differentiation and quantification of leukocytes. Immediate feedback on leukocyte ratios has potential to speed-up the diagnostic process and to reduce costs, workload and inter-observer variations.

Fast intraoperative histology-based diagnosis of gliomas with third harmonic generation microscopy and deep learning.

Management of gliomas requires an invasive treatment strategy, including extensive surgical resection. The objective of the neurosurgeon is to maximize tumor removal while preserving healthy brain tissue. However, the lack of a clear tumor boundary hampers the neurosurgeon's ability to accurately detect and resect infiltrating tumor tissue. Nonlinear multiphoton microscopy, in particular higher harmonic generation, enables label-free imaging of excised brain tissue, revealing histological hallmarks within seconds. Here, we demonstrate a real-time deep learning-based pipeline for automated glioma image analysis, matching video-rate image acquisition. We used a custom noise detection scheme, and a fully-convolutional classification network, to achieve on average 79% binary accuracy, 0.77 AUC and 0.83 mean average precision compared to the consensus of three pathologists, on a preliminary dataset. We conclude that the combination of real-time imaging and image analysis shows great potential for intraoperative assessment of brain tissue during tumor surgery.

Transendothelial migration induces differential migration dynamics of leukocytes in tissue matrix.

Leukocyte extravasation into inflamed tissue is a complex process that is difficult to capture as a whole in vitro. We employed a blood-vessel-on-a-chip model in which human endothelial cells were cultured in a tube-like lumen in a collagen-1 matrix. The vessels are leak tight, creating a barrier for molecules and leukocytes. Addition of inflammatory cytokine TNF-α (also known as TNF) caused vasoconstriction, actin remodelling and upregulation of ICAM-1. Introducing leukocytes into the vessels allowed real-time visualization of all different steps of the leukocyte transmigration cascade, including migration into the extracellular matrix. Individual cell tracking over time distinguished striking differences in migratory behaviour between T-cells and neutrophils. Neutrophils cross the endothelial layer more efficiently than T-cells, but, upon entering the matrix, neutrophils display high speed but low persistence, whereas T-cells migrate with low speed and rather linear migration. In conclusion, 3D imaging in real time of leukocyte extravasation in a vessel-on-a-chip enables detailed qualitative and quantitative analysis of different stages of the full leukocyte extravasation process in a single assay. This article has an associated First Person interview with the first authors of the paper.