White blood cell detection, classification and analysis using phase imaging with computational specificity (PICS).

Treatment of blood smears with Wright's stain is one of the most helpful tools in detecting white blood cell abnormalities. However, to diagnose leukocyte disorders, a clinical pathologist must perform a tedious, manual process of locating and identifying individual cells. Furthermore, the staining procedure requires considerable preparation time and clinical infrastructure, which is incompatible with point-of-care diagnosis. Thus, rapid and automated evaluations of unlabeled blood smears are highly desirable. In this study, we used color spatial light interference microcopy (cSLIM), a highly sensitive quantitative phase imaging (QPI) technique, coupled with deep learning tools, to localize, classify and segment white blood cells (WBCs) in blood smears. The concept of combining QPI label-free data with AI for the purpose of extracting cellular specificity has recently been introduced in the context of fluorescence imaging as phase imaging with computational specificity (PICS). We employed AI models to first translate SLIM images into brightfield micrographs, then ran parallel tasks of locating and labelling cells using EfficientNet, which is an object detection model. Next, WBC binary masks were created using U-net, a convolutional neural network that performs precise segmentation. After training on digitally stained brightfield images of blood smears with WBCs, we achieved a mean average precision of 75% for localizing and classifying neutrophils, eosinophils, lymphocytes, and monocytes, and an average pixel-wise majority-voting F1 score of 80% for determining the cell class from semantic segmentation maps. Therefore, PICS renders and analyzes synthetically stained blood smears rapidly, at a reduced cost of sample preparation, providing quantitative clinical information.

Quantitative Histopathology of Stained Tissues using Color Spatial Light Interference Microscopy (cSLIM).

Tissue biopsy evaluation in the clinic is in need of quantitative disease markers for diagnosis and, most importantly, prognosis. Among the new technologies, quantitative phase imaging (QPI) has demonstrated promise for histopathology because it reveals intrinsic tissue nanoarchitecture through the refractive index. However, a vast majority of past QPI investigations have relied on imaging unstained tissues, which disrupts the established specimen processing. Here we present color spatial light interference microscopy (cSLIM) as a new whole-slide imaging modality that performs interferometric imaging on stained tissue, with a color detector array. As a result, cSLIM yields in a single scan both the intrinsic tissue phase map and the standard color bright-field image, familiar to the pathologist. Our results on 196 breast cancer patients indicate that cSLIM can provide stain-independent prognostic information from the alignment of collagen fibers in the tumor microenvironment. The effects of staining on the tissue phase maps were corrected by a mathematical normalization. These characteristics are likely to reduce barriers to clinical translation for the new cSLIM technology.

Interpretation of Optical Coherence Tomography Images for Breast Tissue Assessment.

PURPOSE: Initial studies have shown that optical coherence tomography (OCT) is an effective margin-evaluation tool for breast-conserving surgery, but methods for the interpretation of breast OCT images have not been directly studied. In this work, breast pathologies were assessed with a handheld OCT probe. OCT images and corresponding histology were used to develop guidelines for the identification of breast tissue features in OCT images. METHODS: Mastectomy and breast-conserving surgery specimens from 26 women were imaged with a handheld OCT probe. During standard pathology specimen dissection, representative 1-cm × 1-cm tissue regions were grossly identified, assessed with OCT, inked for orientation and image-matching purposes, and processed. Histology slides corresponding to the OCT image region were digitally photographed. OCT and histology images from the same region were paired by selecting the best structural matches. RESULTS: In total, 2880 OCT images were acquired from 26 breast specimens (from 26 patients) and 48 matching OCT-histology image pairs were identified. These matched image pairs illustrate tissue types including adipose tissue, dense fibrosis, fibroadipose tissue, blood vessels, regular and hyperplastic ducts and lobules, cysts, cyst, fibroadenoma, invasive ductal carcinoma, invasive lobular carcinoma, ductal carcinoma in situ, calcifications, and biopsy cavities. Differentiation between pathologies was achieved by considering feature boundaries, interior appearance, posterior shadowing or enhancement, and overall morphologic patterns. CONCLUSIONS: This is the first work to systematically catalog the critical features of breast OCT images. The results indicate that OCT can be used to identify and distinguish between benign and malignant features in human breast tissue.

Label-free tissue scanner for colorectal cancer screening.

The current practice of surgical pathology relies on external contrast agents to reveal tissue architecture, which is then qualitatively examined by a trained pathologist. The diagnosis is based on the comparison with standardized empirical, qualitative assessments of limited objectivity. We propose an approach to pathology based on interferometric imaging of "unstained" biopsies, which provides unique capabilities for quantitative diagnosis and automation. We developed a label-free tissue scanner based on "quantitative phase imaging," which maps out optical path length at each point in the field of view and, thus, yields images that are sensitive to the "nanoscale" tissue architecture. Unlike analysis of stained tissue, which is qualitative in nature and affected by color balance, staining strength and imaging conditions, optical path length measurements are intrinsically quantitative, i.e., images can be compared across different instruments and clinical sites. These critical features allow us to automate the diagnosis process. We paired our interferometric optical system with highly parallelized, dedicated software algorithms for data acquisition, allowing us to image at a throughput comparable to that of commercial tissue scanners while maintaining the nanoscale sensitivity to morphology. Based on the measured phase information, we implemented software tools for autofocusing during imaging, as well as image archiving and data access. To illustrate the potential of our technology for large volume pathology screening, we established an "intrinsic marker" for colorectal disease that detects tissue with dysplasia or colorectal cancer and flags specific areas for further examination, potentially improving the efficiency of existing pathology workflows.

Prediction of prostate cancer recurrence using quantitative phase imaging: Validation on a general population.

Prediction of biochemical recurrence risk of prostate cancer following radical prostatectomy is critical for determining whether the patient would benefit from adjuvant treatments. Various nomograms exist today for identifying individuals at higher risk for recurrence; however, an optimistic under-estimation of recurrence risk is a common problem associated with these methods. We previously showed that anisotropy of light scattering measured using quantitative phase imaging, in the stromal layer adjacent to cancerous glands, is predictive of recurrence. That nested-case controlled study consisted of specimens specifically chosen such that the current prognostic methods fail. Here we report on validating the utility of optical anisotropy for prediction of prostate cancer recurrence in a general population of 192 patients, with 17% probability of recurrence. Our results show that our method can identify recurrent cases with 73% sensitivity and 72% specificity, which is comparable to that of CAPRA-S, a current state of the art method, in the same population. However, our results show that optical anisotropy outperforms CAPRA-S for patients with Gleason grades 7-10. In essence, we demonstrate that anisotropy is a better biomarker for identifying high-risk cases, while Gleason grade is better suited for selecting non-recurrence. Therefore, we propose that anisotropy and current techniques be used together to maximize prediction accuracy.

Trimodal Therapy: Combining Hyperthermia with Repurposed Bexarotene and Ultrasound for Treating Liver Cancer.

Repurposing of existing cancer drugs to overcome their physical limitations, such as insolubility, represents an attractive strategy to achieve enhanced therapeutic efficacy and broaden the range of clinical applications. Such an approach also promises to offer substantial cost savings in drug development efforts. Here we repurposed FDA-approved topical agent bexarotene (Targretin), currently in limited use for cutaneous manifestations of T-cell lymphomas, and re-engineer it for use in solid tumor applications by forming self-assembling nanobubbles. Physico-chemical characterization studies of the novel prodrug nanobubbles demonstrated their stability, enhanced target cell internalization capability, and highly controlled release profile in response to application of focused ultrasound energy. Using an in vitro model of hepatocellular carcinoma and an in vivo large animal model of liver ablation, we demonstrate the effectiveness of bexarotene prodrug nanobubbles when used in conjunction with catheter-based ultrasound, thereby highlighting the therapeutic promise of this trimodal approach.

Breast cancer diagnosis using spatial light interference microscopy.

The standard practice in histopathology of breast cancers is to examine a hematoxylin and eosin (H&E) stained tissue biopsy under a microscope to diagnose whether a lesion is benign or malignant. This determination is made based on a manual, qualitative inspection, making it subject to investigator bias and resulting in low throughput. Hence, a quantitative, label-free, and high-throughput diagnosis method is highly desirable. We present here preliminary results showing the potential of quantitative phase imaging for breast cancer screening and help with differential diagnosis. We generated phase maps of unstained breast tissue biopsies using spatial light interference microscopy (SLIM). As a first step toward quantitative diagnosis based on SLIM, we carried out a qualitative evaluation of our label-free images. These images were shown to two pathologists who classified each case as either benign or malignant. This diagnosis was then compared against the diagnosis of the two pathologists on corresponding H&E stained tissue images and the number of agreements were counted. The agreement between SLIM and H&E based diagnosis was 88% for the first pathologist and 87% for the second. Our results demonstrate the potential and promise of SLIM for quantitative, label-free, and high-throughput diagnosis.

Isolation of Primary Human Colon Tumor Cells from Surgical Tissues and Culturing Them Directly on Soft Elastic Substrates for Traction Cytometry.

Cancer cells respond to matrix mechanical stiffness in a complex manner using a coordinated, hierarchical mechano-chemical system composed of adhesion receptors and associated signal transduction membrane proteins, the cytoskeletal architecture, and molecular motors. Mechanosensitivity of different cancer cells in vitro are investigated primarily with immortalized cell lines or murine derived primary cells, not with primary human cancer cells. Hence, little is known about the mechanosensitivity of primary human colon cancer cells in vitro. Here, an optimized protocol is developed that describes the isolation of primary human colon cells from healthy and cancerous surgical human tissue samples. Isolated colon cells are then successfully cultured on soft (2 kPa stiffness) and stiff (10 kPa stiffness) polyacrylamide hydrogels and rigid polystyrene (~3.6 GPa stiffness) substrates functionalized by an extracellular matrix (fibronectin in this case). Fluorescent microbeads are embedded in soft gels near the cell culture surface, and traction assay is performed to assess cellular contractile stresses using free open access software. In addition, immunofluorescence microscopy on different stiffness substrates provides useful information about primary cell morphology, cytoskeleton organization and vinculin containing focal adhesions as a function of substrate rigidity.

Prediction of prostate cancer recurrence using quantitative phase imaging.

The risk of biochemical recurrence of prostate cancer among individuals who undergo radical prostatectomy for treatment is around 25%. Current clinical methods often fail at successfully predicting recurrence among patients at intermediate risk for recurrence. We used a label-free method, spatial light interference microscopy, to perform localized measurements of light scattering in prostatectomy tissue microarrays. We show, for the first time to our knowledge, that anisotropy of light scattering in the stroma immediately adjoining cancerous glands can be used to identify patients at higher risk for recurrence. The data show that lower value of anisotropy corresponds to a higher risk for recurrence, meaning that the stroma adjoining the glands of recurrent patients is more fractionated than in non-recurrent patients. Our method outperformed the widely accepted clinical tool CAPRA-S in the cases we interrogated irrespective of Gleason grade, prostate-specific antigen (PSA) levels and pathological tumor-node-metastasis (pTNM) stage. These results suggest that QPI shows promise in assisting pathologists to improve prediction of prostate cancer recurrence.

Spatiotemporal characterization of a fibrin clot using quantitative phase imaging.

Studying the dynamics of fibrin clot formation and its morphology is an important problem in biology and has significant impact for several scientific and clinical applications. We present a label-free technique based on quantitative phase imaging to address this problem. Using quantitative phase information, we characterized fibrin polymerization in real-time and present a mathematical model describing the transition from liquid to gel state. By exploiting the inherent optical sectioning capability of our instrument, we measured the three-dimensional structure of the fibrin clot. From this data, we evaluated the fractal nature of the fibrin network and extracted the fractal dimension. Our non-invasive and speckle-free approach analyzes the clotting process without the need for external contrast agents.

Mastocytosis as an unusual cause of hip fracture in an elderly woman.

Mastocytosis is a type of myeloproliferative neoplasm characterized by accumulation and proliferation of morphologically and immunophenotypically abnormal mast cells in 1 or more organ systems. Clinical manifestations vary depending upon the organ involved and chemical mediators released by mast cells along with constitutional symptoms and musculoskeletal complaints. We report a case of isolated bone marrow mastocytosis in an 87-year-old woman who presented with a fall resulting in proximal femur fracture. Bone marrow biopsy revealed mastocytosis, and no evidence of systemic involvement or peripheral mastocytosis was found. Physicians should be aware of this entity, especially in patients with osteoporosis.

Fourier phase microscopy with white light.

Laser-based Fourier phase microscopy (FPM) works on the principle of decomposition of an image field in two spatial components that can be controllably shifted in phase with respect to each other. However, due to the coherent illumination, the contrast in phase images is degraded by speckles. In this paper we present FPM with spatially coherent white light (wFPM), which offers high spatial phase sensitivity due to the low temporal coherence and high temporal phase stability due to common path geometry. Further, by using a fast spatial light modulator (SLM) and a fast scientific-grade complementary metal oxide semiconductor (sCMOS) camera, we report imaging at a maximum rate of 12.5 quantitative phase frames per second with 5.5 mega pixels image size. We illustrate the utility of wFPM as a contrast enhancement as well as dynamic phase measurement method by imaging section of benign colonic glands and red blood cell membrane fluctuation.

Real time blood testing using quantitative phase imaging.

We demonstrate a real-time blood testing system that can provide remote diagnosis with minimal human intervention in economically challenged areas. Our instrument combines novel advances in label-free optical imaging with parallel computing. Specifically, we use quantitative phase imaging for extracting red blood cell morphology with nanoscale sensitivity and NVIDIA's CUDA programming language to perform real time cellular-level analysis. While the blood smear is translated through focus, our system is able to segment and analyze all the cells in the one megapixel field of view, at a rate of 40 frames/s. The variety of diagnostic parameters measured from each cell (e.g., surface area, sphericity, and minimum cylindrical diameter) are currently not available with current state of the art clinical instruments. In addition, we show that our instrument correctly recovers the red blood cell volume distribution, as evidenced by the excellent agreement with the cell counter results obtained on normal patients and those with microcytic and macrocytic anemia. The final data outputted by our instrument represent arrays of numbers associated with these morphological parameters and not images. Thus, the memory necessary to store these data is of the order of kilobytes, which allows for their remote transmission via, for example, the cellular network. We envision that such a system will dramatically increase access for blood testing and furthermore, may pave the way to digital hematology.

Gradient field microscopy for label-free diagnosis of human biopsies [Invited].

We introduce a label-free method for detecting high-grade prostatic intraepithelial neoplasia (HGPIN) in unstained biopsies. We image this condition based on the identification of basal cells in biopsies that otherwise would resemble prostate cancer by unassisted histologic examination. Gradient field microscopy (GFM) is used as a label-free imaging method which increases the contrast of a transparent sample by taking the first-order phase derivative that is very sensitive to rapid refractive index changes. GFM is able to image the basal cell layers in HGPIN biopsies because of their rapid refractive index changes at the periphery of small glandular structures.

Three-dimensional optical coherence tomography for optical biopsy of lymph nodes and assessment of metastatic disease.

BACKGROUND: Numerous techniques have been developed for localizing lymph nodes before surgical resection and for their histological assessment. Nondestructive high-resolution transcapsule optical imaging of lymph nodes offers the potential for in situ assessment of metastatic involvement, potentially during surgical procedures. METHODS: Three-dimensional optical coherence tomography (3-D OCT) was used for imaging and assessing resected popliteal lymph nodes from a preclinical rat metastatic tumor model over a 9-day time-course study after tumor induction. The spectral-domain OCT system utilized a center wavelength of 800 nm, provided axial and transverse resolutions of 3 and 12 µm, respectively, and performed imaging at 10,000 axial scans per second. RESULTS: OCT is capable of providing high-resolution label-free images of intact lymph node microstructure based on intrinsic optical scattering properties with penetration depths of ~1-2 mm. The results demonstrate that OCT is capable of differentiating normal, reactive, and metastatic lymph nodes based on microstructural changes. The optical scattering and structural changes revealed by OCT from day 3 to day 9 after the injection of tumor cells into the lymphatic system correlate with inflammatory and immunological changes observed in the capsule, precortical regions, follicles, and germination centers found during histopathology. CONCLUSIONS: We report for the first time a longitudinal study of 3-D transcapsule OCT imaging of intact lymph nodes demonstrating microstructural changes during metastatic infiltration. These results demonstrate the potential of OCT as a technique for intraoperative, real-time in situ 3-D optical biopsy of lymph nodes for the intraoperative staging of cancer.

Blood testing at the single cell level using quantitative phase and amplitude microscopy.

It has recently been shown that quantitative phase imaging methods can provide clinically relevant parameters for red blood cell analysis with unprecedented detail and sensitivity. Since the quantitative phase information is dependent on both the thickness and refractive index, a major limitation to clinical translation has been a simple and practical approach to measure both simultaneously. Here we demonstrate both theoretically and experimentally that, by combining quantitative phase with a single absorption measurement, it is possible to measure both quantities at the single cell level. We validate this approach by comparing our results to those acquired using a clinical blood analyzer. This approach to decouple the thickness and refractive index for red blood cells may be used with any quantitative phase imaging method that can operate in tandem with bright field microscopy at the Soret-band wavelength.

Correlation-induced spectral changes in tissues.

We report experimental evidence of correlation-induced spectral changes in biological tissues. The overall spectral shift in our transmission measurements is to the red and the mean wavelength of the original spectrum is up 10% larger. These results indicate that the spectral changes due to elastic scattering are significant and likely to hinder all spectroscopic measurements based on the inelastic (i.e., emission and absorption) interaction between light and tissues. Thus, simultaneous morphology and spectral measurements are required for accurate measurements spectroscopic information.

Tissue refractive index as marker of disease.

The gold standard in histopathology relies on manual investigation of stained tissue biopsies. A sensitive and quantitative method for in situ tissue specimen inspection is highly desirable, as it would allow early disease diagnosis and automatic screening. Here we demonstrate that quantitative phase imaging of entire unstained biopsies has the potential to fulfill this requirement. Our data indicates that the refractive index distribution of histopathology slides, which contains information about the molecular scale organization of tissue, reveals prostate tumors and breast calcifications. These optical maps report on subtle, nanoscale morphological properties of tissues and cells that cannot be recovered by common stains, including hematoxylin and eosin. We found that cancer progression significantly alters the tissue organization, as exhibited by consistently higher refractive index variance in prostate tumors versus normal regions. Furthermore, using the quantitative phase information, we obtained the spatially resolved scattering mean free path and anisotropy factor g for entire biopsies and demonstrated their direct correlation with tumor presence. In essence, our results show that the tissue refractive index reports on the nanoscale tissue architecture and, in principle, can be used as an intrinsic marker for cancer diagnosis.

Born approximation model for light scattering by red blood cells.

The primary role of a red blood cell (RBC) is delivering oxygen throughout our body. Abnormalities of this basic function lead to anemia and are caused by numerous diseases such as malaria and sickle cell anemia. As prompt and inexpensive tests for blood screening are in demand, we have developed a faster and reliable way to measure morphological parameters associated with the structure of red blood cells and the size distribution of the cells in a whole blood smear. Modeling the RBC shape under Born approximation, we are able to determine parameters of clinical relevance, such as the diameter, thickness and dimple size. From a measured quantitative phase image of a blood smear, we can determine the average and standard deviation of the red blood cell volume simultaneously, i.e., without analyzing each cell individually. This approach may open the door for a new generation of label-free, high-throughput blood testing.