Variability and bias in microbiome metagenomic sequencing: an interlaboratory study comparing experimental protocols.

Several studies have documented the significant impact of methodological choices in microbiome analyses. The myriad of methodological options available complicate the replication of results and generally limit the comparability of findings between independent studies that use differing techniques and measurement pipelines. Here we describe the Mosaic Standards Challenge (MSC), an international interlaboratory study designed to assess the impact of methodological variables on the results. The MSC did not prescribe methods but rather asked participating labs to analyze 7 shared reference samples (5 × human stool samples and 2 × mock communities) using their standard laboratory methods. To capture the array of methodological variables, each participating lab completed a metadata reporting sheet that included 100 different questions regarding the details of their protocol. The goal of this study was to survey the methodological landscape for microbiome metagenomic sequencing (MGS) analyses and the impact of methodological decisions on metagenomic sequencing results. A total of 44 labs participated in the MSC by submitting results (16S or WGS) along with accompanying metadata; thirty 16S rRNA gene amplicon datasets and 14 WGS datasets were collected. The inclusion of two types of reference materials (human stool and mock communities) enabled analysis of both MGS measurement variability between different protocols using the biologically-relevant stool samples, and MGS bias with respect to ground truth values using the DNA mixtures. Owing to the compositional nature of MGS measurements, analyses were conducted on the ratio of Firmicutes: Bacteroidetes allowing us to directly apply common statistical methods. The resulting analysis demonstrated that protocol choices have significant effects, including both bias of the MGS measurement associated with a particular methodological choices, as well as effects on measurement robustness as observed through the spread of results between labs making similar methodological choices. In the analysis of the DNA mock communities, MGS measurement bias was observed even when there was general consensus among the participating laboratories. This study was the result of a collaborative effort that included academic, commercial, and government labs. In addition to highlighting the impact of different methodological decisions on MGS result comparability, this work also provides insights for consideration in future microbiome measurement study design.

Standards for fecal microbiota transplant: Tools and therapeutic advances.

Fecal microbiota transplantation (FMT) has been demonstrated to be efficacious in preventing recurrent Clostridioides difficile (C. difficile) infections, and is being investigated for treatment of several other diseases including inflammatory bowel disease, cancer, obesity, liver disease, and diabetes. To speed up the translation of FMT into clinical practice as a safe and standardized therapeutic intervention, additional evidence-based technical and regulatory guidance is needed. To this end in May of 2022, the International Alliance for Biological Standardization (IABS) and the BIOASTER Microbiology Technology Institute hosted a second webinar to discuss key issues still impeding the advancement and standardization of FMT. The goal of this two-day webinar was to provide a forum for scientific experts to share and discuss data and key challenges with one another. Discussion included a focus on the evaluation of safety, efficacy, clinical trial design, reproducibility and accuracy in obtained microbiome measurements and data reporting, and the potential for standardization across these areas. It also focused on increasing the application potential and visibility of FMT beyond treating C. difficile infections.

Rapid production and free distribution of a synthetic RNA material to support SARS-CoV-2 molecular diagnostic testing.

In response to the COVID-19 pandemic, the National Institute of Standards and Technology released a synthetic RNA material for SARS-CoV-2 in June 2020. The goal was to rapidly produce a material to support molecular diagnostic testing applications. This material, referred to as Research Grade Test Material 10169, was shipped free of charge to laboratories across the globe to provide a non-hazardous material for assay development and assay calibration. The material consisted of two unique regions of the SARS-CoV-2 genome approximately 4 kb nucleotides in length. The concentration of each synthetic fragment was measured using RT-dPCR methods and confirmed to be compatible with RT-qPCR methods. In this report, the preparation, stability, and limitations of this material are described.

Amplicon Sequencing Minimal Information (ASqMI): Quality and Reporting Guidelines for Actionable Calls in Biodefense Applications.

BACKGROUND: Accurate, high-confidence data is critical for assessing potential biothreat incidents. In a biothreat event, false-negative and -positive results have serious consequences. Worst case scenarios can result in unnecessary shutdowns or fatalities at an exorbitant monetary and psychological cost, respectively. Quantitative PCR assays for agents of interest have been successfully used for routine biosurveillance. Recently, there has been increased impetus for adoption of amplicon sequencing (AS) for biosurveillance because it enables discrimination of true positives from near-neighbor false positives, as well as broad, simultaneous detection of many targets in many pathogens in a high-throughput scheme. However, the high sensitivity of AS can lead to false positives. Appropriate controls and workflow reporting can help address these challenges. OBJECTIVES: Data reporting standards are critical to data trustworthiness. The standards presented herein aim to provide a framework for method quality assessment in biodetection. METHODS: We present a set of standards, Amplicon Sequencing Minimal Information (ASqMI), developed under the auspices of the AOAC INTERNATIONAL Stakeholder Program on Agent Detection Assays for making actionable calls in biosurveillance applications. In addition to the first minimum information guidelines for AS, we provide a controls checklist and scoring scheme to assure AS run quality and assess potential sample contamination. RESULTS: Adoption of the ASqMI guidelines will improve data quality, help track workflow performance, and ultimately provide decision makers confidence to trust the results of this new and powerful technology. CONCLUSION: AS workflows can provide robust, confident calls for biodetection; however, due diligence in reporting and controls are needed. The ASqMI guideline is the first AS minimum reporting guidance document that also provides the means for end users to evaluate their workflows to improve confidence. HIGHLIGHTS: Standardized reporting guidance for actionable calls is critical to ensuring trustworthy data.

Interlaboratory performance and quantitative PCR data acceptance metrics for NIST SRM® 2917.

Surface water quality quantitative polymerase chain reaction (qPCR) technologies are expanding from a subject of research to routine environmental and public health laboratory testing. Readily available, reliable reference material is needed to interpret qPCR measurements, particularly across laboratories. Standard Reference Material® 2917 (NIST SRM® 2917) is a DNA plasmid construct that functions with multiple water quality qPCR assays allowing for estimation of total fecal pollution and identification of key fecal sources. This study investigates SRM 2917 interlaboratory performance based on repeated measures of 12 qPCR assays by 14 laboratories (n = 1008 instrument runs). Using a Bayesian approach, single-instrument run data are combined to generate assay-specific global calibration models allowing for characterization of within- and between-lab variability. Comparable data sets generated by two additional laboratories are used to assess new SRM 2917 data acceptance metrics. SRM 2917 allows for reproducible single-instrument run calibration models across laboratories, regardless of qPCR assay. In addition, global models offer multiple data acceptance metric options that future users can employ to minimize variability, improve comparability of data across laboratories, and increase confidence in qPCR measurements.

Enhancing untargeted metabolomics using metadata-based source annotation.

Human untargeted metabolomics studies annotate only ~10% of molecular features. We introduce reference-data-driven analysis to match metabolomics tandem mass spectrometry (MS/MS) data against metadata-annotated source data as a pseudo-MS/MS reference library. Applying this approach to food source data, we show that it increases MS/MS spectral usage 5.1-fold over conventional structural MS/MS library matches and allows empirical assessment of dietary patterns from untargeted data.

Phenotype-Based Threat Assessment.

Bacterial pathogen identification, which is critical for human health, has historically relied on culturing organisms from clinical specimens. More recently, the application of machine learning (ML) to whole-genome sequences (WGSs) has facilitated pathogen identification. However, relying solely on genetic information to identify emerging or new pathogens is fundamentally constrained, especially if novel virulence factors exist. In addition, even WGSs with ML pipelines are unable to discern phenotypes associated with cryptic genetic loci linked to virulence. Here, we set out to determine if ML using phenotypic hallmarks of pathogenesis could assess potential pathogenic threat without using any sequence-based analysis. This approach successfully classified potential pathogenetic threat associated with previously machine-observed and unobserved bacteria with 99% and 85% accuracy, respectively. This work establishes a phenotype-based pipeline for potential pathogenic threat assessment, which we term PathEngine, and offers strategies for the identification of bacterial pathogens.

Evolution of FMT - From early clinical to standardized treatments.

Faecal microbiota transplantation (FMT) is widely reported to be an effective treatment against recurrent Clostridioides difficile infections. Recent clinical studies support the therapeutic use of FMT for several other pathologies including inflammatory bowel disease, several types of cancer, and other functional or metabolic disorders. Initial guidelines are now available to overcome some of the technical and logistical issues for establishing a non-standardized treatment into clinical practice with proper safety and governance. To aid the improvement of guidance and standardization requirements for FMT, the International Alliance for Biological Standardization (IABS) and the BIOASTER Microbiology Technology Institute hosted a joint online workshop in May of 2021. The goal of the webinar was to provide a multi-disciplinary perspective of the ongoing efforts to develop FMT guidelines including technical, regulatory, and standardization requirements. Recognized experts gave insights into state-of-the art approaches and standards developed by international organizations and institutions.

Performance of NIST SRM® 2917 with 13 recreational water quality monitoring qPCR assays.

Fecal pollution remains a significant challenge for recreational water quality management worldwide. In response, there is a growing interest in the use of real-time quantitative PCR (qPCR) methods to achieve same-day notification of recreational water quality and associated public health risk as well as to characterize fecal pollution sources for targeted mitigation. However, successful widespread implementation of these technologies requires the development of and access to a high-quality standard control material. Here, we report a single laboratory qPCR performance assessment of the National Institute of Standards and Technology Standard Reference Material 2917 (NIST SRM® 2917), a linearized plasmid DNA construct that functions with 13 recreational water quality qPCR assays. Performance experiments indicate the generation of standard curves with amplification efficiencies ranging from 0.95 ± 0.006 to 0.99 ± 0.008 and coefficient of determination values (R2) ≥ 0.980. Regardless of qPCR assay, variability in repeated measurements at each dilution level were very low (quantification threshold standard deviations ≤ 0.657) and exhibited a heteroscedastic trend characteristic of qPCR standard curves. The influence of a yeast carrier tRNA added to the standard control material buffer was also investigated. Findings demonstrated that NIST SRM® 2917 functions with all qPCR methods and suggests that the future use of this control material by scientists and water quality managers should help reduce variability in concentration estimates and make results more consistent between laboratories.

Standards to support an enduring capability in wastewater surveillance for public health: Where are we?

The COVID-19 pandemic highlighted a wide range of public health system challenges for infectious disease surveillance. The discovery that the SARS-CoV-2 virus was shed in feces and can be characterized using PCR-based testing of sewage samples offers new possibilities and challenges for wastewater surveillance (WWS). However, WWS standardization of practices is needed to provide actionable data for a public health response. A workshop was convened consisting of academic, federal government, and industry stakeholders. The objective was to review WWS sampling protocols, testing methods, analyses, and data interpretation approaches for WWS employed nationally and identify opportunities for standardizing practices, including the development of documentary standards or reference materials in the case of SARS-CoV-2 surveillance. Other WWS potential future threats to public health were also discussed. Several aspects of WWS were considered and each offers the opportunity for standards development. These areas included sampling strategies, analytical methods, and data reporting practices. Each of these areas converged on a common theme, the challenge of results comparability across facilities and jurisdictions. For sampling, the consensus solution was the development of documentary standards to guide appropriate sampling practices. In contrast, the predominant opportunity for analytical methods was reference material development, such as PCR-based standards and surrogate recovery controls. For data reporting practices, the need for establishing the minimal required metadata, a metadata vocabulary, and standardizing data units of measure including measurement threshold definitions was discussed. Beyond SARS-CoV-2 testing, there was general agreement that the WWS platform will continue to be a valuable tool for a wide range of public health threats and that future cross-sector engagements are needed to guide an enduring WWS capability.

Generation of Isogenic Mutant Strains of Helicobacter pylori.

One important tool in the study of gene function is the construction of mutant strains. Specifically, the construction of isogenic mutant strains imparts researchers with the ability to compare a wild-type strain to a strain that is genetically identical with the exception of the gene of interest. For a bacterial species such as Helicobacter pylori , which is notorious for the genetic heterogeneity seen across isolates, comparisons between isogenic and parental strains control for the genetic variation seen between distinct isolates. This chapter details the construction of a clean gene deletion in which the entire coding region is replaced with a selectable marker. The approach detailed herein allows for the thorough investigation of gene function in the absence of confounding genetic variability.

ArsRS-Dependent Regulation of homB Contributes to Helicobacter pylori Biofilm Formation.

One elusive area in the Helicobacter pylori field is an understanding of why some infections result in gastric cancer, yet others persist asymptomatically for the life-span of the individual. Even before the genomic era, the high level of intraspecies diversity of H. pylori was well recognized and became an intriguing area of investigation with respect to disease progression. Of interest in this regard is the unique repertoire of over 60 outer membrane proteins (OMPs), several of which have been associated with disease outcome. Of these OMPs, the association between HomB and disease outcome varies based on the population being studied. While the molecular roles for some of the disease-associated OMPs have been evaluated, little is known about the role that HomB plays in the H. pylori lifecycle. Thus, herein we investigated homB expression, regulation, and contribution to biofilm formation. We found that in H. pylori strain G27, homB was expressed at a relatively low level until stationary phase. Furthermore, homB expression was suppressed at low pH in an ArsRS-dependent manner; mutation of arsRS resulted in increased homB transcript at all tested time-points. ArsRS regulation of homB appeared to be direct as purified ArsR was able to specifically bind to the homB promoter. This regulation, combined with our previous finding that ArsRS mutations lead to enhanced biofilm formation, led us to test the hypothesis that homB contributes to biofilm formation by H. pylori. Indeed, subsequent biofilm analysis using a crystal-violet quantification assay and scanning electron microscopy (SEM) revealed that loss of homB from hyper-biofilm forming strains resulted in reversion to a biofilm phenotype that mimicked wild-type. Furthermore, expression of homB in trans from a promoter that negated ArsRS regulation led to enhanced biofilm formation even in strains in which the chromosomal copy of homB had been deleted. Thus, homB is necessary for hyper-biofilm formation of ArsRS mutant strains and aberrant regulation of this gene is sufficient to induce a hyper-biofilm phenotype. In summary, these data suggest that the ArsRS-dependent regulation of OMPs such as HomB may be one mechanism by which ArsRS dictates biofilm development in a pH responsive manner.

Helicobacter pylori Biofilm Formation Is Differentially Affected by Common Culture Conditions, and Proteins Play a Central Role in the Biofilm Matrix.

The concept of Helicobacter pylori biofilm formation is relatively new. To help provide a foundation for future biofilm studies, we characterized the biofilm formation ability of a common H. pylori lab strain, G27. The goal of this study was to evaluate biofilm formation by G27 in response to common culture conditions and to explore the biofilm matrix. Our results indicate that while various types of growth media did not dramatically affect biofilm formation, surface selection had a significant effect on the final biofilm mass. Furthermore, enzymatic assays and confocal microscopy revealed that proteins appear to be the primary structural component of the H. pylori extracellular matrix; extracellular DNA (eDNA) and polysaccharides were also present but appear to play a secondary role. Finally, we found that two well-characterized antibiofilm cationic peptides differentially affected early and late-stage biofilms. Together these results provide interesting avenues for future investigations that will seek to understand H. pylori biofilm formation.IMPORTANCE The study of H. pylori biofilm formation is still in its infancy. As such, there is great variability in how biofilm assays are performed across labs. While several groups have begun to investigate factors that influence H. pylori biofilm formation, it is not yet understood how H. pylori biofilm formation may vary based on commonly used conditions. These inconsistencies lead to difficulties in interpretation and comparison between studies. Here, we set out to characterize biofilm formation by a commonly available lab strain, G27. Our findings provide novel insight into optimal biofilm conditions, the biofilm matrix, and possible mechanisms to block or disrupt biofilm formation.

Helicobacter pylori Biofilm Formation and Its Potential Role in Pathogenesis.

Despite decades of effort, Helicobacter pylori infections remain difficult to treat. Over half of the world's population is infected by H. pylori, which is a major cause of duodenal and gastric ulcers as well as gastric cancer. During chronic infection, H. pylori localizes within the gastric mucosal layer, including deep within invaginations called glands; thanks to its impressive ability to survive despite the harsh acidic environment, it can persist for the host's lifetime. This ability to survive and persist in the stomach is associated with urease production, chemotactic motility, and the ability to adapt to the fluctuating environment. Additionally, biofilm formation has recently been suggested to play a role in colonization. Biofilms are surface-associated communities of bacteria that are embedded in a hydrated matrix of extracellular polymeric substances. Biofilms pose a substantial health risk and are key contributors to many chronic and recurrent infections. This link between biofilm-associated bacteria and chronic infections likely results from an increased tolerance to conventional antibiotic treatments as well as immune system action. The role of this biofilm mode in antimicrobial treatment failure and H. pylori survival has yet to be determined. Furthermore, relatively little is known about the H. pylori biofilm structure or the genes associated with this mode of growth. In this review, therefore, we aim to highlight recent findings concerning H. pylori biofilms and the molecular mechanism of their formation. Additionally, we discuss the potential roles of biofilms in the failure of antibiotic treatment and in infection recurrence.

Certhrax Is an Antivirulence Factor for the Anthrax-Like Organism Bacillus cereus Strain G9241.

Bacillus cereus G9241 caused a life-threatening anthrax-like lung infection in a previously healthy human. This strain harbors two large virulence plasmids, pBCXO1 and pBC210, that are absent from typical B. cereus isolates. The pBCXO1 plasmid is nearly identical to pXO1 from Bacillus anthracis and carries genes (pagA1, lef, and cya) for anthrax toxin components (protective antigen [called PA1 in G9241], lethal factor [LF], and edema factor [EF], respectively). The plasmid also has an intact hyaluronic acid capsule locus. The pBC210 plasmid has a tetrasaccharide capsule locus, a gene for a PA1 homolog called PA2 (pagA2), and a gene (cer) for Certhrax, an ADP-ribosyltransferase toxin that inactivates vinculin. LF, EF, and Certhrax require PA for entry into cells. In this study, we asked what role PA1, PA2, LF, and Certhrax play in the pathogenicity of G9241. To answer this, we generated isogenic deletion mutations in the targeted toxin gene components and then assessed the strains for virulence in highly G9241-susceptible (A/J) and moderately G9241-sensitive (C57BL/6) mice. We found that full virulence of G9241 required PA1 and LF, while PA2 contributed minimally to pathogenesis of G9241 but could not functionally replace PA1 as a toxin-binding subunit in vivo Surprisingly, we discovered that Certhrax attenuated the virulence of G9241; i.e., a Δcer Δlef mutant strain was more virulent than a Δlef mutant strain following subcutaneous inoculation of A/J mice. Moreover, the enzymatic activity of Certhrax contributed to this phenotype. We concluded that Certhrax acts as an antivirulence factor in the anthrax-like organism B. cereus G9241.

Comparative analysis of the Hom family of outer membrane proteins in isolates from two geographically distinct regions: The United States and South Korea.

BACKGROUND: Helicobacter pylori encodes numerous outer membrane proteins (OMPs), but only a few have been characterized in depth. Deletion, duplication, and allelic variation of many of the H. pylori OMPs have been reported, which suggests that these proteins may play key roles in host adaptation. Herein, we characterize the variation observed within the Hom family of OMPs in H. pylori obtained from two geographically distinct populations. MATERIALS AND METHODS: PCR genotyping of the hom genes was carried out using clinical isolates from South Korea and the United States. A combination of statistical, phylogenetic, and protein modeling analyses was conducted to further characterize the hom variants. RESULTS: Variations in the closely related hom genes, homA and homB, occur in regions that are predicted to encode environmentally exposed loops. A similar phenomenon is true for homCS as compared to homCL . Conversely, little variation was observed in homD. Certain variants of the Hom family of proteins were more prominent in isolates from the Korean population as compared to isolates from the United States. CONCLUSION: En masse, our data show that the homA, homB, and homC profiles vary based upon the geographic origin of the strain; however, the fourth member of the hom family, homD, is more highly conserved. Additionally, protein topology modeling showed that many of the less well-conserved regions between homA and homB and between homCS and homCL corresponded to predicted environmentally exposed loops, suggesting that the divergence of the Hom family may be due to host adaptation/pressure.

Structure-function analyses of metal-binding sites of HypA reveal residues important for hydrogenase maturation in Helicobacter pylori.

The nickel-containing enzymes of Helicobacter pylori, urease and hydrogenase, are essential for efficient colonization in the human stomach. The insertion of nickel into urease and hydrogenase is mediated by the accessory protein HypA. HypA contains an N-terminal nickel-binding site and a dynamic structural zinc-binding site. The coordination of nickel and zinc within HypA is known to be critical for urease maturation and activity. Herein, we test the hydrogenase activity of a panel of H. pylori mutant strains containing point mutations within the nickel- and zinc-binding sites. We found that the residues that are important for hydrogenase activity are those that were similarly vital for urease activity. Thus, the zinc and metal coordination sites of HypA play similar roles in urease and hydrogenase maturation. In other pathogenic bacteria, deletion of hydrogenase leads to a loss in acid resistance. Thus, the acid resistance of two strains of H. pylori containing a hydrogenase deletion was also tested. These mutant strains demonstrated wild-type levels of acid resistance, suggesting that in H. pylori, hydrogenase does not play a role in acid resistance.

Correction: Helicobacter pylori bab Paralog Distribution and Association with cagA, vacA, and homA/B Genotypes in American and South Korean Clinical Isolates.

[This corrects the article DOI: 10.1371/journal.pone.0137078.].