Curated Data In - Trustworthy In Silico Models Out: The Impact of Data Quality on the Reliability of Artificial Intelligence Models as Alternatives to Animal Testing.

New Approach Methodologies (NAMs) that employ artificial intelligence (AI) for predicting adverse effects of chemicals have generated optimistic expectations as alternatives to animal testing. However, the major underappreciated challenge in developing robust and predictive AI models is the impact of the quality of the input data on the model accuracy. Indeed, poor data reproducibility and quality have been frequently cited as factors contributing to the crisis in biomedical research, as well as similar shortcomings in the fields of toxicology and chemistry. In this article, we review the most recent efforts to improve confidence in the robustness of toxicological data and investigate the impact that data curation has on the confidence in model predictions. We also present two case studies demonstrating the effect of data curation on the performance of AI models for predicting skin sensitisation and skin irritation. We show that, whereas models generated with uncurated data had a 7-24% higher correct classification rate (CCR), the perceived performance was, in fact, inflated owing to the high number of duplicates in the training set. We assert that data curation is a critical step in building computational models, to help ensure that reliable predictions of chemical toxicity are achieved through use of the models.

Early-life mitochondrial DNA damage results in lifelong deficits in energy production mediated by redox signaling in Caenorhabditis elegans.

The consequences of damage to the mitochondrial genome (mtDNA) are poorly understood, although mtDNA is more susceptible to damage resulting from some genotoxicants than nuclear DNA (nucDNA), and many environmental toxicants target the mitochondria. Reports from the toxicological literature suggest that exposure to early-life mitochondrial damage could lead to deleterious consequences later in life (the "Developmental Origins of Health and Disease" paradigm), but reports from other fields often report beneficial ("mitohormetic") responses to such damage. Here, we tested the effects of low (causing no change in lifespan) levels of ultraviolet C (UVC)-induced, irreparable mtDNA damage during early development in Caenorhabditis elegans. This exposure led to life-long reductions in mtDNA copy number and steady-state ATP levels, accompanied by increased oxygen consumption and altered metabolite profiles, suggesting inefficient mitochondrial function. Exposed nematodes were also developmentally delayed, reached smaller adult size, and were rendered more susceptible to subsequent exposure to chemical mitotoxicants. Metabolomic and genetic analysis of key signaling and metabolic pathways supported redox and mitochondrial stress-response signaling during early development as a mechanism for establishing these persistent alterations. Our results highlight the importance of early-life exposures to environmental pollutants, especially in the context of exposure to chemicals that target mitochondria.

Analysis of variability in the rabbit skin irritation assay.

The in vivo rabbit test is the benchmark against which new approach methodologies for skin irritation are usually compared. No alternative method offers a complete replacement of animal use for this endpoint for all regulatory applications. Variability in the animal reference data may be a limiting factor in identifying a replacement. We established a curated data set of 2624 test records, representing 990 substances, each tested at least twice, to characterize the reproducibility of the in vivo assay. Methodological deviations from guidelines were noted, and multiple data sets with differing tolerances for deviations were created. Conditional probabilities were used to evaluate the reproducibility of the in vivo method in identification of U.S. Environmental Protection Agency or Globally Harmonized System hazard categories. Chemicals classified as moderate irritants at least once were classified as mild or non-irritants at least 40% of the time when tested repeatedly. Variability was greatest between mild and moderate irritants, which both had less than a 50% likelihood of being replicated. Increased reproducibility was observed when a binary categorization between corrosives/moderate irritants and mild/non-irritants was used. This analysis indicates that variability present in the rabbit skin irritation test should be considered when evaluating nonanimal alternative methods as potential replacements.

In Silico Approaches In Carcinogenicity Hazard Assessment: Current Status and Future Needs.

Historically, identifying carcinogens has relied primarily on tumor studies in rodents, which require enormous resources in both money and time. In silico models have been developed for predicting rodent carcinogens but have not yet found general regulatory acceptance, in part due to the lack of a generally accepted protocol for performing such an assessment as well as limitations in predictive performance and scope. There remains a need for additional, improved in silico carcinogenicity models, especially ones that are more human-relevant, for use in research and regulatory decision-making. As part of an international effort to develop in silico toxicological protocols, a consortium of toxicologists, computational scientists, and regulatory scientists across several industries and governmental agencies evaluated the extent to which in silico models exist for each of the recently defined 10 key characteristics (KCs) of carcinogens. This position paper summarizes the current status of in silico tools for the assessment of each KC and identifies the data gaps that need to be addressed before a comprehensive in silico carcinogenicity protocol can be developed for regulatory use.

Mining a human transcriptome database for chemical modulators of NRF2.

Nuclear factor erythroid-2 related factor 2 (NRF2) encoded by the NFE2L2 gene is a transcription factor critical for protecting cells from chemically-induced oxidative stress. We developed computational procedures to identify chemical modulators of NRF2 in a large database of human microarray data. A gene expression biomarker was built from statistically-filtered gene lists derived from microarray experiments in primary human hepatocytes and cancer cell lines exposed to NRF2-activating chemicals (oltipraz, sulforaphane, CDDO-Im) or in which the NRF2 suppressor Keap1 was knocked down by siRNA. Directionally consistent biomarker genes were further filtered for those dependent on NRF2 using a microarray dataset from cells after NFE2L2 siRNA knockdown. The resulting 143-gene biomarker was evaluated as a predictive tool using the correlation-based Running Fisher algorithm. Using 59 gene expression comparisons from chemically-treated cells with known NRF2 activating potential, the biomarker gave a balanced accuracy of 93%. The biomarker was comprised of many well-known NRF2 target genes (AKR1B10, AKR1C1, NQO1, TXNRD1, SRXN1, GCLC, GCLM), 69% of which were found to be bound directly by NRF2 using ChIP-Seq. NRF2 activity was assessed across ~9840 microarray comparisons from ~1460 studies examining the effects of ~2260 chemicals in human cell lines. A total of 260 and 43 chemicals were found to activate or suppress NRF2, respectively, most of which have not been previously reported to modulate NRF2 activity. Using a NRF2-responsive reporter gene in HepG2 cells, we confirmed the activity of a set of chemicals predicted using the biomarker. The biomarker will be useful for future gene expression screening studies of environmentally-relevant chemicals.

Chemical Activation of the Constitutive Androstane Receptor Leads to Activation of Oxidant-Induced Nrf2.

Exposure to environmentally relevant chemicals that activate the xenobiotic receptors aryl hydrocarbon receptor (AhR), constitutive androstane receptor (CAR), and peroxisome proliferator-activated receptor alpha (PPARα) in rodent test systems often leads to increases in oxidative stress (OS) that contributes to liver cancer induction. We hypothesized that activation of the oxidant-induced transcription factor Nrf2 could be used as a surrogate endpoint for increases in OS. We examined the relationships between activation of xenobiotic receptors and Nrf2 using previously characterized gene expression biomarkers that accurately predict modulation. Using a correlation approach (Running Fisher Test), the biomarkers were compared with microarray profiles in a mouse liver gene expression compendium. Out of the 163 chemicals examined, 47% from 53 studies activated Nrf2. We found consistent coupling between CAR and Nrf2 activation. Out of the 41 chemicals from 32 studies that activated CAR, 90% also activated Nrf2. CAR was activated earlier and at lower doses than Nrf2, indicating CAR activation preceded Nrf2 activation. Nrf2 activation by 2 CAR activators was abolished in CAR-null mice. We hypothesized that Nrf2 is activated by reactive oxygen species from the increased activity of enzymes encoded by Cyp2b family members. However, Nrf2 was similarly activated in the livers of both TCPOBOP-treated wild-type and Cyp2b9/10/13-null mice. This study provides evidence that Nrf2 activation (1) often occurs after exposure to xenobiotic chemicals, (2) is tightly linked to activation of CAR, and (3) does not require induction of 3 Cyp2b genes secondary to CAR activation.

Identification of Androgen Receptor Modulators in a Prostate Cancer Cell Line Microarray Compendium.

High-throughput transcriptomic (HTTr) technologies are increasingly being used to screen environmental chemicals in vitro to identify molecular targets and provide mechanistic context for regulatory testing. Here, we describe the development and validation of a novel gene expression biomarker to identify androgen receptor (AR)-modulating chemicals using a pattern matching method. Androgen receptor biomarker genes were identified by their consistent expression after exposure to 4 AR agonists and 4 AR antagonists and included only those genes that were regulated by AR. The 51 gene biomarker was evaluated as a predictive tool using the fold-change, rank-based Running Fisher algorithm. Using 158 comparisons from cells treated with 95 chemicals, the biomarker gave balanced accuracies for prediction of AR activation or AR suppression of 97% or 98%, respectively. The biomarker correctly classified 16 out of the 17 AR reference antagonists including those that are "weak" and "very weak". Predictions based on microarray profiles from AR-positive LAPC-4 cells treated with 28 chemicals in antagonist mode were compared with those from an AR pathway model which used 11 in vitro HT assays. The balanced accuracy for suppression was 93%. Using our approach, we identified conditions in which AR was modulated in a large collection of microarray profiles from prostate cancer cell lines including (1) constitutively active mutants or knockdown of AR, (2) decreases in availability of androgens by castration or removal from media, and (3) exposure to chemical modulators that work through indirect mechanisms including suppression of AR expression. These results demonstrate that the AR gene expression biomarker could be a useful tool in HTTr to identify AR modulators.

Newly Revised Quantitative PCR-Based Assay for Mitochondrial and Nuclear DNA Damage.

Given the crucial role of DNA damage in human health and disease, it is important to be able to accurately measure both mitochondrial and nuclear DNA damage. This article describes a method based on a long-amplicon quantitative PCR-based assay that does not require a separate mitochondrial isolation step, which can often be labor-intensive and generate artifacts. The detailed basic protocol presented here is newly revised, with particular attention to application in Homo sapiens, Rattus norvegicus, and Caenorhabditis elegans resulting from changes in availability of PCR reagents. Optimized extraction support protocols are also described for high-quality DNA from multiple rat tissues for which these procedures had not previously been described. © 2018 by John Wiley & Sons, Inc.

From the Cover: Genomic Effects of Androstenedione and Sex-Specific Liver Cancer Susceptibility in Mice.

Current strategies for predicting carcinogenic mode of action for nongenotoxic chemicals are based on identification of early key events in toxicity pathways. The goal of this study was to evaluate short-term key event indicators resulting from exposure to androstenedione (A4), an androgen receptor agonist and known liver carcinogen in mice. Liver cancer is more prevalent in men compared with women, but androgen-related pathways underlying this sex difference have not been clearly identified. Short-term hepatic effects of A4 were compared with reference agonists of the estrogen receptor (ethinyl estradiol, EE) and glucocorticoid receptor (prednisone, PRED). Male B6C3F1 mice were exposed for 7 or 28 days to A4, EE, or PRED. EE increased and PRED suppressed hepatocyte proliferation, while A4 had no detectable effects. In a microarray analysis, EE and PRED altered >3000 and >670 genes, respectively, in a dose-dependent manner, whereas A4 did not significantly alter any genes. Gene expression was subsequently examined in archival liver samples from male and female B6C3F1 mice exposed to A4 for 90 days. A4 altered more genes in females than males and did not alter expression of genes linked to activation of the mitogenic xenobiotic receptors AhR, CAR, and PPARα in either sex. A gene expression biomarker was used to show that in female mice, the high dose of A4 activated the growth hormone-regulated transcription factor STAT5b, which controls sexually dimorphic gene expression in the liver. These findings suggest that A4 induces subtle age-related effects on STAT5b signaling that may contribute to the higher risk of liver cancer in males compared with females.

Compensatory changes in CYP expression in three different toxicology mouse models: CAR-null, Cyp3a-null, and Cyp2b9/10/13-null mice.

Targeted mutant models are common in mechanistic toxicology experiments investigating the absorption, metabolism, distribution, or elimination (ADME) of chemicals from individuals. Key models include those for xenosensing transcription factors and cytochrome P450s (CYP). Here we investigated changes in transcript levels, protein expression, and steroid hydroxylation of several xenobiotic detoxifying CYPs in constitutive androstane receptor (CAR)-null and two CYP-null mouse models that have subfamily members regulated by CAR; the Cyp3a-null and a newly described Cyp2b9/10/13-null mouse model. Compensatory changes in CYP expression that occur in these models may also occur in polymorphic humans, or may complicate interpretation of ADME studies performed using these models. The loss of CAR causes significant changes in several CYPs probably due to loss of CAR-mediated constitutive regulation of these CYPs. Expression and activity changes include significant repression of Cyp2a and Cyp2b members with corresponding drops in 6α- and 16ß-testosterone hydroxylase activity. Further, the ratio of 6α-/15α-hydroxylase activity, a biomarker of sexual dimorphism in the liver, indicates masculinization of female CAR-null mice, suggesting a role for CAR in the regulation of sexually dimorphic liver CYP profiles. The loss of Cyp3a causes fewer changes than CAR. Nevertheless, there are compensatory changes including gender-specific increases in Cyp2a and Cyp2b. Cyp2a and Cyp2b were down-regulated in CAR-null mice, suggesting activation of CAR and potentially PXR following loss of the Cyp3a members. However, the loss of Cyp2b causes few changes in hepatic CYP transcript levels and almost no significant compensatory changes in protein expression or activity with the possible exception of 6α-hydroxylase activity. This lack of a compensatory response in the Cyp2b9/10/13-null mice is probably due to low CYP2B hepatic expression, especially in male mice. Overall, compensatory and regulatory CYP changes followed the order CAR-null > Cyp3a-null > Cyp2b-null mice.

Correction: Mitochondrial Morphology and Fundamental Parameters of the Mitochondrial Respiratory Chain Are Altered in Caenorhabditis elegans Strains Deficient in Mitochondrial Dynamics and Homeostasis Processes.

[This corrects the article DOI: 10.1371/journal.pone.0130940.].

PCR-Based Analysis of Mitochondrial DNA Copy Number, Mitochondrial DNA Damage, and Nuclear DNA Damage.

Because of the role that DNA damage and depletion play in human disease, it is important to develop and improve tools to assess these endpoints. This unit describes PCR-based methods to measure nuclear and mitochondrial DNA damage and copy number. Long amplicon quantitative polymerase chain reaction (LA-QPCR) is used to detect DNA damage by measuring the number of polymerase-inhibiting lesions present based on the amount of PCR amplification; real-time PCR (RT-PCR) is used to calculate genome content. In this unit, we provide step-by-step instructions to perform these assays in Homo sapiens, Mus musculus, Rattus norvegicus, Caenorhabditis elegans, Drosophila melanogaster, Danio rerio, Oryzias latipes, Fundulus grandis, and Fundulus heteroclitus, and discuss the advantages and disadvantages of these assays.

Seahorse Xfe 24 Extracellular Flux Analyzer-Based Analysis of Cellular Respiration in Caenorhabditis elegans.

Mitochondria are critical for their role in ATP production as well as multiple nonenergetic functions, and mitochondrial dysfunction is causal in myriad human diseases. Less well appreciated is the fact that mitochondria integrate environmental and intercellular as well as intracellular signals to modulate function. Because mitochondria function in an organismal milieu, there is need for assays capable of rapidly assessing mitochondrial health in vivo. Here, using the Seahorse XF(e) 24 Extracellular Flux Analyzer and the pharmacological inhibitors dicyclohexylcarbodiimide (DCCD, ATP synthase inhibitor), carbonyl cyanide-p-trifluoromethoxyphenylhydrazone (FCCP, mitochondrial uncoupler), and sodium azide (cytochrome c oxidase inhibitor), we describe how to obtain in vivo measurements of the fundamental parameters [basal oxygen consumption rate (OCR), ATP-linked respiration, maximal OCR, spare respiratory capacity, and proton leak] of the mitochondrial respiratory chain in the model organism Caenorhabditis elegans.

Mitochondrial Morphology and Fundamental Parameters of the Mitochondrial Respiratory Chain Are Altered in Caenorhabditis elegans Strains Deficient in Mitochondrial Dynamics and Homeostasis Processes.

Mitochondrial dysfunction has been linked to myriad human diseases and toxicant exposures, highlighting the need for assays capable of rapidly assessing mitochondrial health in vivo. Here, using the Seahorse XFe24 Analyzer and the pharmacological inhibitors dicyclohexylcarbodiimide and oligomycin (ATP-synthase inhibitors), carbonyl cyanide 4-(trifluoromethoxy) phenylhydrazone (mitochondrial uncoupler) and sodium azide (cytochrome c oxidase inhibitor), we measured the fundamental parameters of mitochondrial respiratory chain function: basal oxygen consumption, ATP-linked respiration, maximal respiratory capacity, spare respiratory capacity and proton leak in the model organism Caenhorhabditis elegans. Since mutations in mitochondrial homeostasis genes cause mitochondrial dysfunction and have been linked to human disease, we measured mitochondrial respiratory function in mitochondrial fission (drp-1)-, fusion (fzo-1)-, mitophagy (pdr-1, pink-1)-, and electron transport chain complex III (isp-1)-deficient C. elegans. All showed altered function, but the nature of the alterations varied between the tested strains. We report increased basal oxygen consumption in drp-1; reduced maximal respiration in drp-1, fzo-1, and isp-1; reduced spare respiratory capacity in drp-1 and fzo-1; reduced proton leak in fzo-1 and isp-1; and increased proton leak in pink-1 nematodes. As mitochondrial morphology can play a role in mitochondrial energetics, we also quantified the mitochondrial aspect ratio for each mutant strain using a novel method, and for the first time report increased aspect ratios in pdr-1- and pink-1-deficient nematodes.

PCR based determination of mitochondrial DNA copy number in multiple species.

Mitochondrial DNA (mtDNA) copy number is a critical component of overall mitochondrial health. In this chapter, we describe methods for isolation of both mtDNA and nuclear DNA (nucDNA) and measurement of their respective copy numbers using quantitative PCR. Methods differ depending on the species and cell type of the starting material and availability of specific PCR reagents.

Cellular toxicity associated with exposure to perfluorinated carboxylates (PFCAs) and their metabolic precursors.

The biotransformation of fluorotelomer based compounds yields saturated and unsaturated fluorotelomer aldehydes (FTALs and FTUALs, respectively) and carboxylic acids (FTCAs and FTUCAs, respectively) as intermediate metabolites that subsequently transform to perfluorinated carboxylic acids (PFCAs). Previous studies have demonstrated that the FTCAs and FTUCAs are 1 to 5 orders of magnitude more toxic than PFCAs after exposure to aquatic organisms. Additionally, FTUALs have demonstrated reactivity with proteins, which may be associated with toxicity through the inhibition of protein function. The purpose of this study was to carry out a comprehensive assessment of the relative toxicity between PFCAs and their intermediate precursor metabolites: the FTALs, FTUALs, FTCAs, and FTUCAs. Analytes were separately incubated with human liver epithelial (THLE-2) cells to assess how varying the functional group and the fluorinated chain length affects cell viability. For each analyte, dose-response EC50 values were calculated. The EC50 values for FTUCAs and FTCAs were similar, with values ranging from 22 ± 9 and 24 ± 9 µM for the 10:2 congeners to 1004 ± 20 and 1004 ± 24 µM for the 4:2 congeners, respectively. The EC50 values for the PFCAs ranged from 65 ± 41 (PFDA) to 1361 ± 146 (PFBA) µM. The range of toxicity between PFCAs and their acid precursors were similar. However, the comparative toxicity between the 6:2 and 8:2 congeners and their corresponding PFCA had toxicity thresholds that varied depending on the functional headgroup, where FTUALs ≥ FTALs > FTUCAs ≥ FTCAs > PFCAs. For all PFCAs and acid precursors, toxicity depended on the length of the fluorinated chain, where the longer chain lengths yielded greater bioaccumulation and enhanced toxicity, results which agreed with those previously reported. By contrast, FTALs and FTUALs were the most toxic of all the analytes examined, where toxicity was enhanced at shorter chain lengths, with EC50 values of 7 ± 1 µM (6:2 FTUAL) and 8.6 ± 0.8 µM (6:2 FTAL). DNA adducts were not detectable for the aldehyde precursors, using a quantitative long-range PCR method. Our data provide the first evidence that aldehyde intermediates have demonstrated toxicity in cellular systems that is more significant than PFCAs and their corresponding acid intermediates.

Effects of mutations in mitochondrial dynamics-related genes on the mitochondrial response to ultraviolet C radiation in developing Caenorhabditis elegans.

We recently found that genes involved in mitochondrial dynamics and autophagy are required for removal of UVC-induced mitochondrial DNA damage. However, drp-1 and pink-1, unlike the autophagy and fusion genes tested, were not necessary for larval development after exposure. We hypothesized that increased fusion resulting from mutations in these genes facilitated recovery of mitochondrial function. In this work, we investigated this hypothesis by studying the effects of fis-1, fis-2, drp-1 and pink-1 mutations on mitochondrial responses to UVC exposure including ATP levels, mitochondrial DNA copy number, larval development and mitochondrial morphology. Our results suggest that mutations that promote highly networked mitochondria have the capacity to lessen the effects of mitochondrial genotoxicants on the function of this organelle.

Mitochondria as a target of environmental toxicants.

Enormous strides have recently been made in our understanding of the biology and pathobiology of mitochondria. Many diseases have been identified as caused by mitochondrial dysfunction, and many pharmaceuticals have been identified as previously unrecognized mitochondrial toxicants. A much smaller but growing literature indicates that mitochondria are also targeted by environmental pollutants. We briefly review the importance of mitochondrial function and maintenance for health based on the genetics of mitochondrial diseases and the toxicities resulting from pharmaceutical exposure. We then discuss how the principles of mitochondrial vulnerability illustrated by those fields might apply to environmental contaminants, with particular attention to factors that may modulate vulnerability including genetic differences, epigenetic interactions, tissue characteristics, and developmental stage. Finally, we review the literature related to environmental mitochondrial toxicants, with a particular focus on those toxicants that target mitochondrial DNA. We conclude that the fields of environmental toxicology and environmental health should focus more strongly on mitochondria.

Effects of early life exposure to ultraviolet C radiation on mitochondrial DNA content, transcription, ATP production, and oxygen consumption in developing Caenorhabditis elegans.

BACKGROUND: Mitochondrial DNA (mtDNA) is present in multiple copies per cell and undergoes dramatic amplification during development. The impacts of mtDNA damage incurred early in development are not well understood, especially in the case of types of mtDNA damage that are irreparable, such as ultraviolet C radiation (UVC)-induced photodimers. METHODS: We exposed first larval stage nematodes to UVC using a protocol that results in accumulated mtDNA damage but permits nuclear DNA (nDNA) repair. We then measured the transcriptional response, as well as oxygen consumption, ATP levels, and mtDNA copy number through adulthood. RESULTS: Although the mtDNA damage persisted to the fourth larval stage, we observed only a relatively minor ~40% decrease in mtDNA copy number. Transcriptomic analysis suggested an inhibition of aerobic metabolism and developmental processes; mRNA levels for mtDNA-encoded genes were reduced ~50% at 3 hours post-treatment, but recovered and, in some cases, were upregulated at 24 and 48 hours post-exposure. The mtDNA polymerase γ was also induced ~8-fold at 48 hours post-exposure. Moreover, ATP levels and oxygen consumption were reduced in response to UVC exposure, with marked reductions of ~50% at the later larval stages. CONCLUSIONS: These results support the hypothesis that early life exposure to mitochondrial genotoxicants could result in mitochondrial dysfunction at later stages of life, thereby highlighting the potential health hazards of time-delayed effects of these genotoxicants in the environment.

Increased tRNA modification and gene-specific codon usage regulate cell cycle progression during the DNA damage response.

S-phase and DNA damage promote increased ribonucleotide reductase (RNR) activity. Translation of RNR1 has been linked to the wobble uridine modifying enzyme tRNA methyltransferase 9 (Trm9). We predicted that changes in tRNA modification would translationally regulate RNR1 after DNA damage to promote cell cycle progression. In support, we demonstrate that the Trm9-dependent tRNA modification 5-methoxycarbonylmethyluridine (mcm(5)U) is increased in hydroxyurea (HU)-induced S-phase cells, relative to G(1) and G(2), and that mcm(5)U is one of 16 tRNA modifications whose levels oscillate during the cell cycle. Codon-reporter data matches the mcm(5)U increase to Trm9 and the efficient translation of AGA codons and RNR1. Further, we show that in trm9Δ cells reduced Rnr1 protein levels cause delayed transition into S-phase after damage. Codon re-engineering of RNR1 increased the number of trm9Δ cells that have transitioned into S-phase 1 h after DNA damage and that have increased Rnr1 protein levels, similar to that of wild-type cells expressing native RNR1. Our data supports a model in which codon usage and tRNA modification are regulatory components of the DNA damage response, with both playing vital roles in cell cycle progression.