ABSTRACT
Background: Variant Call Format (VCF) is the standard file format for interchanging genetic variation data and associated quality control metrics. The usual row-wise encoding of the VCF data model (either as text or packed binary) emphasises efficient retrieval of all data for a given variant, but accessing data on a field or sample basis is inefficient. Biobank scale datasets currently available consist of hundreds of thousands of whole genomes and hundreds of terabytes of compressed VCF. Row-wise data storage is fundamentally unsuitable and a more scalable approach is needed. Results: We present the VCF Zarr specification, an encoding of the VCF data model using Zarr which makes retrieving subsets of the data much more efficient. Zarr is a cloud-native format for storing multi-dimensional data, widely used in scientific computing. We show how this format is far more efficient than standard VCF based approaches, and competitive with specialised methods for storing genotype data in terms of compression ratios and calculation performance. We demonstrate the VCF Zarr format (and the vcf2zarr conversion utility) on a subset of the Genomics England aggV2 dataset comprising 78,195 samples and 59,880,903 variants, with a 5X reduction in storage and greater than 300X reduction in CPU usage in some representative benchmarks. Conclusions: Large row-encoded VCF files are a major bottleneck for current research, and storing and processing these files incurs a substantial cost. The VCF Zarr specification, building on widely-used, open-source technologies has the potential to greatly reduce these costs, and may enable a diverse ecosystem of next-generation tools for analysing genetic variation data directly from cloud-based object stores.
ABSTRACT
Allergic rhinitis is a common ailment in primary and acute care settings. Diagnosis is clinical, by means of history and physical examination. Referral to an allergist is considered when symptoms are difficult to manage and/or confirmation by means of further testing is desired. Management of allergic rhinitis should not be considered trivial, as multiple secondary effects can present as the course progresses. Several treatment modalities exist but should begin with glucocorticoid nasal sprays and systemic second- or third-generation antihistamines.
Subject(s)
Rhinitis, Allergic , Humans , Glucocorticoids/therapeutic use , Glucocorticoids/administration & dosage , Histamine Antagonists/therapeutic use , Rhinitis, Allergic/diagnosis , Rhinitis, Allergic/therapy , Rhinitis, Allergic/drug therapyABSTRACT
Allergic rhinitis is a common ailment in primary and acute care settings. Diagnosis is clinical, by means of history and physical examination. Referral to an allergist is considered when symptoms are difficult to manage and/or confirmation by means of further testing is desired. Management of allergic rhinitis should not be considered trivial, as multiple secondary effects can present as the course progresses. Several treatment modalities exist but should begin with glucocorticoid nasal sprays and systemic second- or third-generation antihistamines.
Subject(s)
Adrenal Cortex Hormones , Rhinitis, Allergic , Humans , Adrenal Cortex Hormones/therapeutic use , Administration, Intranasal , Rhinitis, Allergic/diagnosis , Rhinitis, Allergic/drug therapy , Histamine Antagonists/therapeutic use , Glucocorticoids/therapeutic useABSTRACT
Single-cell analysis tools have made substantial advances in characterizing genomic heterogeneity; however, tools for measuring phenotypic heterogeneity have lagged due to the increased difficulty of handling live biology. Here, we report a single-cell phenotyping tool capable of measuring image-based clonal properties at scales approaching 100,000 clones per experiment. These advances are achieved by exploiting a previously unidentified flow regime in ladder microfluidic networks that, under appropriate conditions, yield a mathematically perfect cell trap. Machine learning and computer vision tools are used to control the imaging hardware and analyze the cellular phenotypic parameters within these images. Using this platform, we quantified the responses of tens of thousands of single cellderived acute myeloid leukemia (AML) clones to targeted therapy, identifying rare resistance and morphological phenotypes at frequencies down to 0.05%. This approach can be extended to higher-level cellular architectures such as cell pairs and organoids and on-chip live-cell fluorescence assays.
Subject(s)
Leukemia, Myeloid, Acute , Clone Cells , Humans , Leukemia, Myeloid, Acute/drug therapy , Leukemia, Myeloid, Acute/genetics , Microfluidics , Phenotype , Single-Cell Analysis/methodsABSTRACT
BACKGROUND: Multiplexed in-situ fluorescent imaging offers several advantages over single-cell assays that do not preserve the spatial characteristics of biological samples. This spatial information, in addition to morphological properties and extensive intracellular or surface marker profiling, comprise promising avenues for rapid advancements in the understanding of disease progression and diagnosis. As protocols for conducting such imaging experiments continue to improve, it is the intent of this study to provide and validate software for processing the large quantity of associated data in kind. RESULTS: Cytokit offers (i) an end-to-end, GPU-accelerated image processing pipeline; (ii) efficient input/output (I/O) strategies for operations specific to high dimensional microscopy; and (iii) an interactive user interface for cross filtering of spatial, graphical, expression, and morphological cell properties within the 100+ GB image datasets common to multiplexed immunofluorescence. Image processing operations supported in Cytokit are generally sourced from existing deep learning models or are at least in part adapted from open source packages to run in a single or multi-GPU environment. The efficacy of these operations is demonstrated through several imaging experiments that pair Cytokit results with those from an independent but comparable assay. A further validation also demonstrates that previously published results can be reproduced from a publicly available multiplexed image dataset. CONCLUSION: Cytokit is a collection of open source tools for quantifying and analyzing properties of individual cells in large fluorescent microscopy datasets that are often, but not necessarily, generated from multiplexed antibody labeling protocols over many fields of view or time periods. This project is best suited to bioinformaticians or other technical users that wish to analyze such data in a batch-oriented, high-throughput setting. All source code, documentation, and data generated for this article are available under the Apache License 2.0 at https://github.com/hammerlab/cytokit .