Intelligent sort-timing prediction for image-activated cell sorting.

Intelligent image-activated cell sorting (iIACS) has enabled high-throughput image-based sorting of single cells with artificial intelligence (AI) algorithms. This AI-on-a-chip technology combines fluorescence microscopy, AI-based image processing, sort-timing prediction, and cell sorting. Sort-timing prediction is particularly essential due to the latency on the order of milliseconds between image acquisition and sort actuation, during which image processing is performed. The long latency amplifies the effects of the fluctuations in the flow speed of cells, leading to fluctuation and uncertainty in the arrival time of cells at the sort point on the microfluidic chip. To compensate for this fluctuation, iIACS measures the flow speed of each cell upstream, predicts the arrival timing of the cell at the sort point, and activates the actuation of the cell sorter appropriately. Here, we propose and demonstrate a machine learning technique to increase the accuracy of the sort-timing prediction that would allow for the improvement of sort event rate, yield, and purity. Specifically, we trained an algorithm to predict the sort timing for morphologically heterogeneous budding yeast cells. The algorithm we developed used cell morphology, position, and flow speed as inputs for prediction and achieved 41.5% lower prediction error compared to the previously employed method based solely on flow speed. As a result, our technique would allow for an increase in the sort event rate of iIACS by a factor of ~2.

Long-term effects of Pfizer-BioNTech COVID-19 vaccinations on platelets.

There is a global concern about the safety of COVID-19 vaccines associated with platelet function. However, their long-term effects on overall platelet activity remain poorly understood. Here we address this problem by image-based single-cell profiling and temporal monitoring of circulating platelet aggregates in the blood of healthy human subjects, before and after they received multiple Pfizer-BioNTech (BNT162b2) vaccine doses over a time span of nearly 1 year. Results show no significant or persisting platelet aggregation trends following the vaccine doses, indicating that any effects of vaccinations on platelet turnover, platelet activation, platelet aggregation, and platelet-leukocyte interaction was insignificant.

Deep imaging flow cytometry.

Imaging flow cytometry (IFC) has become a powerful tool for diverse biomedical applications by virtue of its ability to image single cells in a high-throughput manner. However, there remains a challenge posed by the fundamental trade-off between throughput, sensitivity, and spatial resolution. Here we present deep-learning-enhanced imaging flow cytometry (dIFC) that circumvents this trade-off by implementing an image restoration algorithm on a virtual-freezing fluorescence imaging (VIFFI) flow cytometry platform, enabling higher throughput without sacrificing sensitivity and spatial resolution. A key component of dIFC is a high-resolution (HR) image generator that synthesizes "virtual" HR images from the corresponding low-resolution (LR) images acquired with a low-magnification lens (10×/0.4-NA). For IFC, a low-magnification lens is favorable because of reduced image blur of cells flowing at a higher speed, which allows higher throughput. We trained and developed the HR image generator with an architecture containing two generative adversarial networks (GANs). Furthermore, we developed dIFC as a method by combining the trained generator and IFC. We characterized dIFC using Chlamydomonas reinhardtii cell images, fluorescence in situ hybridization (FISH) images of Jurkat cells, and Saccharomyces cerevisiae (budding yeast) cell images, showing high similarities of dIFC images to images obtained with a high-magnification lens (40×/0.95-NA), at a high flow speed of 2 m s-1. We lastly employed dIFC to show enhancements in the accuracy of FISH-spot counting and neck-width measurement of budding yeast cells. These results pave the way for statistical analysis of cells with high-dimensional spatial information.

Massive image-based single-cell profiling reveals high levels of circulating platelet aggregates in patients with COVID-19.

A characteristic clinical feature of COVID-19 is the frequent incidence of microvascular thrombosis. In fact, COVID-19 autopsy reports have shown widespread thrombotic microangiopathy characterized by extensive diffuse microthrombi within peripheral capillaries and arterioles in lungs, hearts, and other organs, resulting in multiorgan failure. However, the underlying process of COVID-19-associated microvascular thrombosis remains elusive due to the lack of tools to statistically examine platelet aggregation (i.e., the initiation of microthrombus formation) in detail. Here we report the landscape of circulating platelet aggregates in COVID-19 obtained by massive single-cell image-based profiling and temporal monitoring of the blood of COVID-19 patients (n = 110). Surprisingly, our analysis of the big image data shows the anomalous presence of excessive platelet aggregates in nearly 90% of all COVID-19 patients. Furthermore, results indicate strong links between the concentration of platelet aggregates and the severity, mortality, respiratory condition, and vascular endothelial dysfunction level of COVID-19 patients.

Raman image-activated cell sorting.

The advent of image-activated cell sorting and imaging-based cell picking has advanced our knowledge and exploitation of biological systems in the last decade. Unfortunately, they generally rely on fluorescent labeling for cellular phenotyping, an indirect measure of the molecular landscape in the cell, which has critical limitations. Here we demonstrate Raman image-activated cell sorting by directly probing chemically specific intracellular molecular vibrations via ultrafast multicolor stimulated Raman scattering (SRS) microscopy for cellular phenotyping. Specifically, the technology enables real-time SRS-image-based sorting of single live cells with a throughput of up to ~100 events per second without the need for fluorescent labeling. To show the broad utility of the technology, we show its applicability to diverse cell types and sizes. The technology is highly versatile and holds promise for numerous applications that are previously difficult or undesirable with fluorescence-based technologies.

Intelligent image-activated cell sorting 2.0.

The advent of intelligent image-activated cell sorting (iIACS) has enabled high-throughput intelligent image-based sorting of single live cells from heterogeneous populations. iIACS is an on-chip microfluidic technology that builds on a seamless integration of a high-throughput fluorescence microscope, cell focuser, cell sorter, and deep neural network on a hybrid software-hardware data management architecture, thereby providing the combined merits of optical microscopy, fluorescence-activated cell sorting (FACS), and deep learning. Here we report an iIACS machine that far surpasses the state-of-the-art iIACS machine in system performance in order to expand the range of applications and discoveries enabled by the technology. Specifically, it provides a high throughput of ∼2000 events per second and a high sensitivity of ∼50 molecules of equivalent soluble fluorophores (MESFs), both of which are 20 times superior to those achieved in previous reports. This is made possible by employing (i) an image-sensor-based optomechanical flow imaging method known as virtual-freezing fluorescence imaging and (ii) a real-time intelligent image processor on an 8-PC server equipped with 8 multi-core CPUs and GPUs for intelligent decision-making, in order to significantly boost the imaging performance and computational power of the iIACS machine. We characterize the iIACS machine with fluorescent particles and various cell types and show that the performance of the iIACS machine is close to its achievable design specification. Equipped with the improved capabilities, this new generation of the iIACS technology holds promise for diverse applications in immunology, microbiology, stem cell biology, cancer biology, pathology, and synthetic biology.

Author Correction: A practical guide to intelligent image-activated cell sorting.

An amendment to this paper has been published and can be accessed via a link at the top of the paper.

Label-free chemical imaging flow cytometry by high-speed multicolor stimulated Raman scattering.

Combining the strength of flow cytometry with fluorescence imaging and digital image analysis, imaging flow cytometry is a powerful tool in diverse fields including cancer biology, immunology, drug discovery, microbiology, and metabolic engineering. It enables measurements and statistical analyses of chemical, structural, and morphological phenotypes of numerous living cells to provide systematic insights into biological processes. However, its utility is constrained by its requirement of fluorescent labeling for phenotyping. Here we present label-free chemical imaging flow cytometry to overcome the issue. It builds on a pulse pair-resolved wavelength-switchable Stokes laser for the fastest-to-date multicolor stimulated Raman scattering (SRS) microscopy of fast-flowing cells on a 3D acoustic focusing microfluidic chip, enabling an unprecedented throughput of up to ∼140 cells/s. To show its broad utility, we use the SRS imaging flow cytometry with the aid of deep learning to study the metabolic heterogeneity of microalgal cells and perform marker-free cancer detection in blood.

A practical guide to intelligent image-activated cell sorting.

Intelligent image-activated cell sorting (iIACS) is a machine-intelligence technology that performs real-time intelligent image-based sorting of single cells with high throughput. iIACS extends beyond the capabilities of fluorescence-activated cell sorting (FACS) from fluorescence intensity profiles of cells to multidimensional images, thereby enabling high-content sorting of cells or cell clusters with unique spatial chemical and morphological traits. Therefore, iIACS serves as an integral part of holistic single-cell analysis by enabling direct links between population-level analysis (flow cytometry), cell-level analysis (microscopy), and gene-level analysis (sequencing). Specifically, iIACS is based on a seamless integration of high-throughput cell microscopy (e.g., multicolor fluorescence imaging, bright-field imaging), cell focusing, cell sorting, and deep learning on a hybrid software-hardware data management infrastructure, enabling real-time automated operation for data acquisition, data processing, intelligent decision making, and actuation. Here, we provide a practical guide to iIACS that describes how to design, build, characterize, and use an iIACS machine. The guide includes the consideration of several important design parameters, such as throughput, sensitivity, dynamic range, image quality, sort purity, and sort yield; the development and integration of optical, microfluidic, electrical, computational, and mechanical components; and the characterization and practical usage of the integrated system. Assuming that all components are readily available, a team of several researchers experienced in optics, electronics, digital signal processing, microfluidics, mechatronics, and flow cytometry can complete this protocol in ~3 months.

Comment on "Ghost cytometry".

Ota et al (Reports, 15 June 2018, p. 1246) report using pseudo-random optical masks and a spatial-temporal transformation to perform blur-free, high-frame rate imaging of cells in flow with a high signal-to-noise ratio. They also claim sorting at rates of 3000 cells per second, based on imaging data. The experiments conducted and results reported in their study are insufficient to support these conclusions.

Intelligent Image-Activated Cell Sorting.

A fundamental challenge of biology is to understand the vast heterogeneity of cells, particularly how cellular composition, structure, and morphology are linked to cellular physiology. Unfortunately, conventional technologies are limited in uncovering these relations. We present a machine-intelligence technology based on a radically different architecture that realizes real-time image-based intelligent cell sorting at an unprecedented rate. This technology, which we refer to as intelligent image-activated cell sorting, integrates high-throughput cell microscopy, focusing, and sorting on a hybrid software-hardware data-management infrastructure, enabling real-time automated operation for data acquisition, data processing, decision-making, and actuation. We use it to demonstrate real-time sorting of microalgal and blood cells based on intracellular protein localization and cell-cell interaction from large heterogeneous populations for studying photosynthesis and atherothrombosis, respectively. The technology is highly versatile and expected to enable machine-based scientific discovery in biological, pharmaceutical, and medical sciences.

Single-Cell Analysis of Morphological and Metabolic Heterogeneity in Euglena gracilis by Fluorescence-Imaging Flow Cytometry.

Microalgal biofuels and biomass have ecofriendly advantages as feedstocks. Improved understanding and utilization of microalgae require large-scale analysis of the morphological and metabolic heterogeneity within populations. Here, with Euglena gracilis as a model microalgal species, we evaluate how fluorescence- and brightfield-derived-image-based descriptors vary during environmental stress at the single-cell level. This is achieved with a new multiparameter fluorescence-imaging cytometric technique that allows the assaying of thousands of cells per experiment. We track morphological changes, including the intensity and distribution of intracellular lipid droplets, and pigment autofluorescence. The combined fluorescence-morphological analysis identifies new metrics not accessible with traditional flow cytometry, including the lipid-to-cell-area ratio (LCAR), which shows promise as an indicator of oil productivity per biomass. Single-cell metrics of lipid productivity were highly correlated ( R2 > 0.90, p < 0.005) with bulk oil extraction. Such chemomorphological atlases of algal species can help optimize growth conditions and selection approaches for large-scale biomass production.

High-throughput imaging flow cytometry by optofluidic time-stretch microscopy.

The ability to rapidly assay morphological and intracellular molecular variations within large heterogeneous populations of cells is essential for understanding and exploiting cellular heterogeneity. Optofluidic time-stretch microscopy is a powerful method for meeting this goal, as it enables high-throughput imaging flow cytometry for large-scale single-cell analysis of various cell types ranging from human blood to algae, enabling a unique class of biological, medical, pharmaceutical, and green energy applications. Here, we describe how to perform high-throughput imaging flow cytometry by optofluidic time-stretch microscopy. Specifically, this protocol provides step-by-step instructions on how to build an optical time-stretch microscope and a cell-focusing microfluidic device for optofluidic time-stretch microscopy, use it for high-throughput single-cell image acquisition with sub-micrometer resolution at >10,000 cells per s, conduct image construction and enhancement, perform image analysis for large-scale single-cell analysis, and use computational tools such as compressive sensing and machine learning for handling the cellular 'big data'. Assuming all components are readily available, a research team of three to four members with an intermediate level of experience with optics, electronics, microfluidics, digital signal processing, and sample preparation can complete this protocol in a time frame of 1 month.

Label-free detection of aggregated platelets in blood by machine-learning-aided optofluidic time-stretch microscopy.

According to WHO, about 10 million new cases of thrombotic disorders are diagnosed worldwide every year. Thrombotic disorders, including atherothrombosis (the leading cause of death in the US and Europe), are induced by occlusion of blood vessels, due to the formation of blood clots in which aggregated platelets play an important role. The presence of aggregated platelets in blood may be related to atherothrombosis (especially acute myocardial infarction) and is, hence, useful as a potential biomarker for the disease. However, conventional high-throughput blood analysers fail to accurately identify aggregated platelets in blood. Here we present an in vitro on-chip assay for label-free, single-cell image-based detection of aggregated platelets in human blood. This assay builds on a combination of optofluidic time-stretch microscopy on a microfluidic chip operating at a high throughput of 10 000 blood cells per second with machine learning, enabling morphology-based identification and enumeration of aggregated platelets in a short period of time. By performing cell classification with machine learning, we differentiate aggregated platelets from single platelets and white blood cells with a high specificity and sensitivity of 96.6% for both. Our results indicate that the assay is potentially promising as predictive diagnosis and therapeutic monitoring of thrombotic disorders in clinical settings.

Image analysis of mast cell degranulation in a concentration gradient of stimuli formed in the channel between a glass plate and a silicon substrate.

Measurement of released granule components, popularly used to quantify mast cell exocytosis, does not deliver real-time information about degranulation at the single-cell level nor the ratio of responding/non-responding cells. Rather it provides, only end-point, bulk-population data. Here we studied degranulation of rat peritoneal mast cells dispersed in a narrow horizontal channel between a silicon substrate and a glass plate. Upon exposure to a concentration gradient of a soluble stimulus, degranulation started from those cells facing towards the highest concentration of stimulus. We captured images of exocytosing cells without the need for phase-contrast or differential interference-contrast microscopy. This was achieved using the reflection caused by the silicon substrate. The time-lapse images of cells in the channel were segmented into multiple concentration belts to identify the proportion of degranulated cells in each belt region. Maximum ratios of degranulated cells in the belt regions determined by time-course curve fitting calculations were then plotted against the distance from the stimulus injection site, resulting in a sigmoidal response curve. This method provides a powerful means for real-time analysis of concentration- and stimulus-dependent degranulation of mast cells and allows comparison of cell responses under different conditions. To show its effectiveness, we evaluated the effect of a protein kinase C (PKC) inhibitor, Gö6976, on degranulation induced by various stimuli. In contrast to stimulation with concanavalin A+lysophosphatidylserine (lysoPS) or nerve growth factor+lysoPS (completely inhibited by Gö6976 over the whole range of stimulus concentrations used) or compound 48/80 and mastoparan (no inhibition by Gö6976), stimulation with ionomycin, a known Ca(2+) ionophore, showed a concentration-dependent inhibition by Gö6976, with a major inhibition at low stimulus concentrations and a diminished one at higher ionomycin concentrations. The results indicate that ionomycin-induced degranulation is mainly induced via a PKC-independent signal cascade at high stimulus concentrations, whereas below a certain concentration, degranulation is completely dependent on PKC.

Differential regulatory function of resting and preactivated allergen-specific CD4+ CD25+ regulatory T cells in Th2-type airway inflammation.

Although CD4(+)CD25(+) regulatory T (Treg) cells are known to suppress Th1 cell-mediated immune responses, their effect on Th2-type immune responses remains unclear. In this study we examined the role of Treg cells in Th2-type airway inflammation in mice. Depletion and reconstitution experiments demonstrated that the Treg cells of naive mice effectively suppressed the initiation and development of Th2-driven airway inflammation. Despite effective suppression of Th2-type airway inflammation in naive mice, adoptively transferred, allergen-specific Treg cells were unable to suppress airway inflammation in allergen-presensitized mice. Preactivated allergen-specific Treg cells, however, could suppress airway inflammation even in allergen-presensitized mice by accumulating in the lung, where they reduced the accumulation and proliferation of Th2 cells. Upon activation, allergen-specific Treg cells up-regulated CCR4, exhibited enhanced chemotactic responses to CCR4 ligands, and suppressed the proliferation of and cytokine production by polarized Th2 cells. Collectively, these results demonstrated that Treg cells are capable of suppressing Th2-driven airway inflammation even in allergen-presensitized mice in a manner dependent on their efficient migration into the inflammatory site and their regulation of Th2 cell activation and proliferation.

Role of CC chemokine receptor 2 in bone marrow cells in the recruitment of macrophages into obese adipose tissue.

The MCP-1 (monocyte chemoattractant protein-1)/CCR2 (CC motif chemokine receptor-2) pathway may play a role in macrophage infiltration into obese adipose tissue. Here we investigated the role of CCR2 in the recruitment of bone marrow-derived macrophages into obese adipose tissue in vitro and in vivo. Using the TAXIScan device, which can measure quantitatively the directionality and velocity of cell migration at time lapse intervals in vitro, we demonstrated that bone marrow cells (BMCs) from wild type mice migrate directly toward MCP-1 or culture medium conditioned by adipose tissue explants of genetically obese ob/ob mice, which are efficiently suppressed by pharmacological blockade of CCR2 signaling. The number of F4/80-positive macrophages was reduced in the adipose tissue from high fat diet-fed obese KKAy or ob/ob mice treated with a CCR2 antagonist propagermanium relative to vehicle-treated groups. We also found that the number of macrophages is reduced in the adipose tissue from ob/ob mice reconstituted with CCR2(-/-) BMCs (ob/ob + CCR2(-/-) BMCs) relative to those with CCR2+/+ BMCs (ob/ob + CCR2+/+ BMCs). Expression of mRNAs for CD11c and TLR4 (Toll-like receptor 4) markers of proinflammatory M1 macrophages was also decreased in the adipose tissue from ob/ob + CCR2(-/-) BMCs relative to ob/ob + CCR2+/+ BMCs, whereas mannose receptor and CD163, markers of anti-inflammatory M2 macrophages, were unchanged. This study provides in vivo and in vitro evidence that CCR2 in bone marrow cells plays an important role in the recruitment of macrophages into obese adipose tissue.