ABSTRACT
BACKGROUND: Results from recent clinical studies suggest potential efficacy of immune training (IT)-based approaches for protection against severe lower respiratory tract infections in infants, but underlying mechanisms are unclear. OBJECTIVE: We used systems-level analyses to elucidate IT mechanisms in infants in a clinical trial setting. METHODS: Pre- and posttreatment peripheral blood mononuclear cells from a placebo-controlled trial in which winter treatment with the IT agent OM85 reduced infant respiratory infection frequency and/or duration were stimulated for 24 hours with the virus/bacteria mimics polyinosinic:polycytidylic acid/lipopolysaccharide. Transcriptomic profiling via RNA sequencing, pathway and upstream regulator analyses, and systems-level gene coexpression network analyses were used sequentially to elucidate and compare responses in treatment and placebo groups. RESULTS: In contrast to subtle changes in antivirus-associated polyinosinic:polycytidylic acid response profiles, the bacterial lipopolysaccharide-triggered gene coexpression network responses exhibited OM85 treatment-associated upregulation of IFN signaling. This was accompanied by network rewiring resulting in increased coordination of TLR4 expression with IFN pathway-associated genes (especially master regulator IRF7); segregation of TNF and IFN-γ (which potentially synergize to exaggerate inflammatory sequelae) into separate expression modules; and reduced size/complexity of the main proinflammatory network module (containing, eg, IL-1,IL-6, and CCL3). Finally, we observed a reduced capacity for lipopolysaccharide-induced inflammatory cytokine (eg, IL-6 and TNF) production in the OM85 group. CONCLUSION: These changes are consistent with treatment-induced enhancement of bacterial pathogen detection/clearance capabilities concomitant with enhanced capacity to regulate ensuing inflammatory response intensity and duration. We posit that IT agents exemplified by OM85 potentially protect against severe lower respiratory tract infections in infants principally by effects on innate immune responses targeting the bacterial components of the mixed respiratory viral/bacterial infections that are characteristic of this age group.
Subject(s)
Respiratory Tract Infections , Viruses , Humans , Infant , Interleukin-6/metabolism , Leukocytes, Mononuclear , Lipopolysaccharides , Poly I-CABSTRACT
An amendment to this paper has been published and can be accessed via a link at the top of the paper.
Subject(s)
Asthma , Respiratory Tract Infections , Fever , Humans , Infant , Interferons , TranscriptomeABSTRACT
Respiratory disease is a major cause of morbidity and mortality in patients with ataxia-telangiectasia (A-T) who are prone to recurrent sinopulmonary infections, bronchiectasis, pulmonary fibrosis, and pulmonary failure. Upper airway infections are common in patients and S. pneumoniae is associated with these infections. We demonstrate here that the upper airway microbiome in patients with A-T is different from that to healthy controls, with S. pneumoniae detected largely in patients only. Patient-specific airway epithelial cells and differentiated air-liquid interface cultures derived from these were hypersensitive to infection which was at least in part due to oxidative damage since it was partially reversed by catalase. We also observed increased levels of the pro-inflammatory cytokines IL-8 and TNF-α (inflammasome-independent) and a decreased level of the inflammasome-dependent cytokine IL-ß in patient cells. Further investigation revealed that the ASC-Caspase 1 signalling pathway was defective in A-T airway epithelial cells. These data suggest that the heightened susceptibility of these cells to S. pneumoniae infection is due to both increased oxidative damage and a defect in inflammasome activation, and has implications for lung disease in these patients.
Subject(s)
Ataxia Telangiectasia/pathology , Epithelial Cells/pathology , Immunity, Innate , Lung/pathology , Oxidative Stress , Pneumococcal Infections/immunology , Pneumococcal Infections/pathology , Streptococcus pneumoniae/physiology , Adolescent , Ataxia Telangiectasia Mutated Proteins/metabolism , Case-Control Studies , Cell Differentiation , Cells, Cultured , Child , Child, Preschool , Epithelial Cells/immunology , Epithelial Cells/microbiology , Female , Humans , Inflammasomes/metabolism , Inflammation/pathology , Lung/microbiology , Male , Nose/pathologyABSTRACT
Rationale: A subset of infants are hypersusceptible to severe/acute viral bronchiolitis (AVB), for reasons incompletely understood. Objectives: To characterize the cellular/molecular mechanisms underlying infant AVB in circulating cells/local airway tissues. Methods: Peripheral blood mononuclear cells and nasal scrapings were obtained from infants (<18 mo) and children (≥18 mo to 5 yr) during AVB and after convalescence. Immune response patterns were profiled by multiplex analysis of plasma cytokines, flow cytometry, and transcriptomics (RNA-Seq). Molecular profiling of group-level data used a combination of upstream regulator and coexpression network analysis, followed by individual subject-level data analysis using personalized N-of-1-pathways methodology. Measurements and Main Results: Group-level analyses demonstrated that infant peripheral blood mononuclear cell responses were dominated by monocyte-associated hyperupregulated type 1 IFN signaling/proinflammatory pathways (drivers: TNF [tumor necrosis factor], IL-6, TREM1 [triggering receptor expressed on myeloid cells 1], and IL-1B), versus a combination of inflammation (PTGER2 [prostaglandin E receptor 2] and IL-6) plus growth/repair/remodeling pathways (ERBB2 [erbb-b2 receptor tyrosine kinase 2], TGFB1 [transforming growth factor-ß1], AREG [amphiregulin], and HGF [hepatocyte growth factor]) coupled with T-helper cell type 2 and natural killer cell signaling in children. Age-related differences were not attributable to differential steroid usage or variations in underlying viral pathogens. Nasal mucosal responses were comparable qualitatively in infants/children, dominated by IFN types 1-3, but the magnitude of upregulation was higher in infants (range, 6- to 48-fold) than children (5- to 17-fold). N-of-1-pathways analysis confirmed differential upregulation of innate immunity in infants and natural killer cell networks in children, and additionally demonstrated covert AVB response subphenotypes that were independent of chronologic age. Conclusions: Dysregulated expression of IFN-dependent pathways after respiratory viral infections is a defining immunophenotypic feature of AVB-susceptible infants and a subset of children. Susceptible subjects seem to represent a discrete subgroup who cluster based on (slow) kinetics of postnatal maturation of innate immune competence.
Subject(s)
Bronchiolitis, Viral/genetics , Bronchiolitis, Viral/immunology , Immunity, Innate , Leukocytes, Mononuclear/immunology , Nasal Mucosa/immunology , Phenotype , Transcriptome , Child, Preschool , Female , Humans , Infant , Infant, Newborn , Male , Sequence Analysis, RNAABSTRACT
BACKGROUND AND OBJECTIVE: Respiratory syncytial virus (RSV) is the most significant cause of acute respiratory infection (ARI) in early life. RSV and other respiratory viruses are known to stimulate substantial outgrowth of potentially pathogenic bacteria in the upper airways of young children. However, the clinical significance of interactions between viruses and bacteria is currently unclear. The present study aimed to clarify the effect of viral and bacterial co-detections on disease severity during paediatric ARI. METHODS: Nasopharyngeal aspirates from children under 2 years of age presenting with ARI to the emergency department were screened by quantitative PCR for 17 respiratory viruses and the bacterial pathogens Streptococcus pneumoniae, Haemophilus influenzae and Moraxella catarrhalis. Associations between pathogen detection and clinical measures of disease severity were investigated. RESULTS: RSV was the most common virus detected, present in 29 of 58 samples from children with ARI (50%). Detection of S. pneumoniae was significantly more frequent during RSV infections compared to other respiratory viruses (adjusted effect size: 1.8, P: 0.03), and co-detection of both pathogens was associated with higher clinical disease severity scores (adjusted effect size: 1.2, P: 0.03). CONCLUSION: Co-detection of RSV and S. pneumoniae in the nasopharynx was associated with more severe ARI, suggesting that S. pneumoniae colonization plays a pathogenic role in young children.
Subject(s)
Coinfection/diagnosis , Coinfection/microbiology , Nasopharynx/microbiology , Respiratory Syncytial Virus Infections/microbiology , Respiratory Tract Infections/microbiology , Streptococcus pneumoniae/isolation & purification , Female , Haemophilus influenzae/isolation & purification , Humans , Infant , Infant, Newborn , Male , Moraxella catarrhalis/isolation & purification , Respiratory Syncytial Viruses/isolation & purificationABSTRACT
Myelodysplastic syndromes and chronic myelomonocytic leukemia are blood disorders characterized by ineffective hematopoiesis and progressive marrow failure that can transform into acute leukemia. The DNA methyltransferase inhibitor 5-azacytidine (AZA) is the most effective pharmacological option, but only â¼50% of patients respond. A response only manifests after many months of treatment and is transient. The reasons underlying AZA resistance are unknown, and few alternatives exist for non-responders. Here, we show that AZA responders have more hematopoietic progenitor cells (HPCs) in the cell cycle. Non-responder HPC quiescence is mediated by integrin α5 (ITGA5) signaling and their hematopoietic potential improved by combining AZA with an ITGA5 inhibitor. AZA response is associated with the induction of an inflammatory response in HPCs in vivo. By molecular bar coding and tracking individual clones, we found that, although AZA alters the sub-clonal contribution to different lineages, founder clones are not eliminated and continue to drive hematopoiesis even in complete responders.
Subject(s)
Azacitidine/administration & dosage , Drug Resistance , Genomics , Myelodysplastic Syndromes , Aged , Aged, 80 and over , Drug Resistance/drug effects , Drug Resistance/genetics , Female , Humans , Integrin alpha Chains/genetics , Integrin alpha Chains/metabolism , Middle Aged , Myelodysplastic Syndromes/drug therapy , Myelodysplastic Syndromes/genetics , Myelodysplastic Syndromes/metabolismABSTRACT
Asthmatics are highly susceptible to respiratory viral infections, possibly due to impaired innate immunity. However, the exact mechanisms of susceptibility are likely to differ amongst viruses. Therefore, we infected primary nasal epithelial cells (NECs) from adults with mild-to-moderate asthma, with respiratory syncytial virus (RSV) or human metapneumovirus (hMPV) in vitro and investigated the antiviral response. NECs from these asthmatics supported elevated hMPV but not RSV infection, compared to non-asthmatic controls. This correlated with reduced apoptosis and reduced activation of caspase-9 and caspase-3/7 in response to hMPV, but not RSV. The expression of heat shock protein 70 (HSP70), a known inhibitor of caspase activation and subsequent apoptosis, was amplified in response to hMPV infection. Chemical inhibition of HSP70 function restored caspase activation and reduced hMPV infection in NECs from asthmatic subjects. There was no impairment in the production of IFN by NECs from asthmatics in response to either hMPV or RSV, demonstrating that increased infection of asthmatic airway cells by hMPV is IFN-independent. This study demonstrates, for the first time, a mechanism for elevated hMPV infection in airway epithelial cells from adult asthmatics and identifies HSP70 as a potential target for antiviral and asthma therapies.
Subject(s)
Asthma/immunology , HSP70 Heat-Shock Proteins/metabolism , Metapneumovirus/immunology , Nasal Mucosa/physiology , Paramyxoviridae Infections/immunology , Adult , Apoptosis , Asthma/complications , Caspase 3/metabolism , Caspase 9/metabolism , Cells, Cultured , Female , HSP70 Heat-Shock Proteins/antagonists & inhibitors , Humans , Interferons/metabolism , Male , Middle Aged , Molecular Targeted Therapy , Nasal Mucosa/virology , Paramyxoviridae Infections/complications , Purine Nucleosides/pharmacology , Respiratory Syncytial Virus Infections/complications , Respiratory Syncytial Virus Infections/immunology , Respiratory Syncytial Viruses/immunology , Young AdultABSTRACT
Longitudinal studies are often used to investigate age-related developmental change. Whereas a single cohort design takes a group of individuals at the same initial age and follows them over time, an accelerated longitudinal design takes multiple single cohorts, each one starting at a different age. The main advantage of an accelerated longitudinal design is its ability to span the age range of interest in a shorter period of time than would be possible with a single cohort longitudinal design. This paper considers design issues for accelerated longitudinal studies. A linear mixed effect model is considered to describe the responses over age with random effects for intercept and slope parameters. Random and fixed cohort effects are used to cope with the potential bias accelerated longitudinal designs have due to multiple cohorts. The impact of other factors such as costs and the impact of dropouts on the power of testing or the precision of estimating parameters are examined. As duration-related costs increase relative to recruitment costs the best designs shift towards shorter duration and eventually cross-sectional design being best. For designs with the same duration but differing interval between measurements, we found there was a cutoff point for measurement costs relative to recruitment costs relating to frequency of measurements. Under our model of 30% dropout there was a maximum power loss of 7%.
Subject(s)
Linear Models , Longitudinal Studies , Research Design , Age Factors , Bias , Cigarette Smoking/adverse effects , Cigarette Smoking/epidemiology , Cross-Sectional Studies/economics , Female , Humans , Male , Patient Dropouts , Patient Selection , Respiratory Tract Diseases/etiology , Respiratory Tract Diseases/mortality , Time Factors , United Kingdom/epidemiologyABSTRACT
BACKGROUND: Recent studies have reported that asthma prevalence increases on migration to Australia. We hypothesised that changes in dietary intake contribute to this phenomenon. The aim of this study was to assess dietary intake in relation to migration status, length of stay in Australia and the association with self-reported wheeze. METHODS: Students (n = 144) in a multicultural high school in Western Sydney completed the asthma symptoms ISAAC video questionnaire (AVQ3.0), spirometry and allergy skin prick tests. A dietitian administered a'Food Frequency' and 'Food Habits' questionnaire and a dietary history interview. RESULTS: Students who spoke a language other than English, consumed a traditional or mixed dietary pattern, with lower consumption of saturated fat, compared to students who spoke English only. Saturated fat intake increased and fibre intake decreased with length of time in Australia. Intake of foods high in saturated or trans fatty acids were positively associated with length of stay in Australia. No associations between nutrient intake or whole food intake and self-reported wheeze were observed. CONCLUSION: As time progressed, dietary intake of immigrant children changed. While this was not associated with the development of wheeze in the students in this cohort, these changes are likely to have negative health consequences.
Subject(s)
Asthma/epidemiology , Diet , Feeding Behavior , Transients and Migrants , Adolescent , Australia/epidemiology , Child , Cross-Sectional Studies , Diet/adverse effects , Dietary Fats/adverse effects , Dietary Fiber , Female , Humans , Male , Prevalence , Respiratory Sounds/etiology , Retrospective Studies , Risk Factors , Time FactorsABSTRACT
BACKGROUND: Several infections trigger postinfective fatigue syndromes, which share key illness characteristics with each other and with chronic fatigue syndrome (CFS). Previous cross-sectional case-control studies of CFS have suggested that unique gene expression signatures are evident in peripheral blood samples. METHODS: Peripheral blood transcriptomes in samples collected longitudinally, in 18 subjects with a fatigue syndrome lasting ≥ 6 months after acute infection due to Epstein-Barr virus, Ross River virus, or Coxiella burnetii (Q fever), and 18 matched control subjects who had recovered promptly, were studied by microarray (n = 127) and confirmatory quantitative polymerase chain reaction (PCR). Gene expression patterns associated with CFS were sought by univariate statistics and regression modeling. RESULTS: There were 23 genes with modest differential expression (0.6-2.3-fold change) in within-subject comparisons of early, symptomatic time points with late, recovered time points. There were modest differences found in 63 genes, either in cross-sectional comparison of cases and controls at 6 months after infection onset or in the regression model. There were 223 genes significantly correlated with individual symptom domains. Quantitative PCR confirmed 33 (73%) of 45 genes-none were consistent across cohorts. CONCLUSIONS: Although the illness characteristics of patients with postinfective fatigue syndromes have more similarities than differences, no reliable peripheral blood gene expression correlate is evident.
Subject(s)
Alphavirus Infections/complications , Epstein-Barr Virus Infections/complications , Fatigue Syndrome, Chronic/genetics , Gene Expression , Q Fever/complications , Ross River virus , Adolescent , Adult , Aged , Case-Control Studies , Fatigue Syndrome, Chronic/virology , Female , Gene Expression Profiling , Humans , Longitudinal Studies , Male , Middle Aged , Oligonucleotide Array Sequence Analysis , Polymerase Chain Reaction , Young AdultABSTRACT
STUDY OBJECTIVES: Disturbances of the internal biological clock manifest as fatigue, poor concentration, and sleep disturbances-symptoms reminiscent of chronic fatigue syndrome (CFS) and suggestive of a role for circadian rhythm disturbance in CFS. We examined circadian patterns of activity, sleep, and cortisol secretion in patients with CFS. DESIGN: Case-control study, 5-day behavioral observation. SETTING: Natural setting/home environment PARTICIPANTS: 15 patients with CFS and 15 healthy subjects of similar age, sex, body mass index (BMI), and activity levels. INTERVENTIONS: N/A. MEASUREMENTS: Self-report questionnaires were used to obtain medical history and demographic information and to assess health behaviors, somatic and psychological symptoms, and sleep quality. An actiwatch accelerometer recorded activity and sleep patterns over 5 days with concurrent activity and symptom logs. Diurnal salivary cortisol secretion was measured. Additionally, overnight heart rate monitoring and pain sensitivity assessment was undertaken. RESULTS: Ratings of symptoms, disability, sleep disturbance, and pain sensitivity were greater in patients with CFS. No between-group differences were found in the pattern or amount of sleep, activity, or cortisol secretion. Afternoon activity levels significantly increased evening fatigue in patients but not control subjects. Low nocturnal heart rate variability was identified as a biological correlate of unrefreshing sleep. CONCLUSIONS: We found no evidence of circadian rhythm disturbance in CFS. However, the role of autonomic activity in the experience of unrefreshing sleep warrants further assessment. The activity symptom-relationship modelled here is of clinical significance in the approach to activity and symptom management in the treatment of CFS.
Subject(s)
Circadian Rhythm/physiology , Fatigue Syndrome, Chronic/physiopathology , Actigraphy , Adult , Case-Control Studies , Female , Heart Rate/physiology , Humans , Hydrocortisone/analysis , Male , Pain/physiopathology , Pain Measurement , Regression Analysis , Saliva/chemistry , Sleep/physiology , Sleep Initiation and Maintenance Disorders/physiopathology , Surveys and QuestionnairesABSTRACT
Model selection procedures for simultaneous analysis of all single-nucleotide polymorphisms in genome-wide association studies are most suitable for making full use of the data for a complex disease study. In this paper we consider a penalized regression using the LASSO procedure and show that post-processing of the penalized-regression results with subsequent stepwise selection may lead to improved identification of causal single-nucleotide polymorphisms.
ABSTRACT
Statistical analysis is critical in the interpretation of experimental data across the life sciences, including neuroscience. The nature of the data collected has a critical role in determining the best statistical approach to take. One particularly prevalent type of data is referred to as "clustered data." Clustered data are characterized as data that can be classified into a number of distinct groups or "clusters" within a particular study. Clustered data arise most commonly in neuroscience when data are compiled across multiple experiments, for example in electrophysiological or optical recordings taken from synaptic terminals, with each experiment providing a distinct cluster of data. However, there are many other types of experimental design that can yield clustered data. Here, we provide a statistical model for intracluster correlation and systematically investigate a range of methods for analyzing clustered data. Our analysis reveals that it is critical to take data clustering into account and suggests appropriate statistical approaches that can be used to account for data clustering.
Subject(s)
Cluster Analysis , Data Collection/methods , Models, Statistical , SoftwareABSTRACT
Although drugs used to treat several neurological diseases are presumed to target synapses that secrete dopamine (DA), relatively little is known about synaptic vesicle (SV) release mechanisms at single DA synapses. We found that the relative probability of release (Pr) varied between individual DA synapses. Furthermore, DA terminals generally exhibited lower Pr than glutamatergic hippocampal (Hpc) terminals, suggesting that DA release is less reliable than the release of glutamate. Our mathematical model of fluorescence loss shows that Pr is regulated by two independent and heterogeneous elements. First, the size of the recycling SV pool regulates Pr. Second, Pr is also independently regulated by additional factors, which are reflected in the time constant of FM 1-43 destaining, tau. We found that the observed difference in Pr between Hpc and DA neurons results because the recycling SV pool is smaller in DA neurons than in Hpc neurons. However, tau does not vary between these two neuron populations. We also identified a population of functional nonsynaptic boutons in DA axons, which are not associated with a postsynaptic element and which are not functionally different from boutons that formed conventional synapses. Our work provides a new approach to the study of SV exocytosis in DA neurons and shows that synaptic terminals of DA neurons are functionally heterogeneous and differ from excitatory terminals in terms of Pr.
Subject(s)
Dopamine/metabolism , Dopamine/physiology , Animals , Animals, Newborn , Cells, Cultured , Female , Fluorescence , Mice , Models, Neurological , Synaptic Vesicles/metabolism , Synaptic Vesicles/physiologyABSTRACT
It has long been proposed that excitotoxicity contributes to nerve cell death in neurodegenerative diseases. Activin A, a member of the transforming growth factor-beta superfamily, is expressed by neurons following excitotoxicity. We show for the first time that this activin A expression is essential for neurogenesis to proceed following neurodegeneration. We found that intraventricular infusion of activin A increased the number of newborn neurons in the dentate gyrus, CA3, and CA1 layers of the normal adult hippocampus and also, following lipopolysaccharide administration, had a potent inhibitory effect on gliosis in vivo and on microglial proliferation in vivo and in vitro. Consistent with the role of activin A in regulating central nervous system inflammation and neurogenesis, intraventricular infusion of follistatin, an activin A antagonist, profoundly impaired neurogenesis and increased the number of microglia and reactive astrocytes following onset of kainic acid-induced neurodegeneration. These results show that inhibiting endogenous activin A is permissive for a potent underlying inflammatory response to neurodegeneration. We demonstrate that the anti-inflammatory actions of activin A account for its neurogenic effects following neurodegeneration because co-administration of nonsteroidal anti-inflammatory drugs reversed follistatin's inhibitory effects on neurogenesis in vivo. Our work indicates that activin A, perhaps working in conjunction with other transforming growth factor-beta superfamily molecules, is essential for neurogenesis in the adult central nervous system following excitotoxic neurodegeneration and suggests that neurons can regulate regeneration by suppressing the inflammatory response, a finding with implications for understanding and treating acute and chronic neurodegenerative diseases.
Subject(s)
Activins/metabolism , Hippocampus/drug effects , Nerve Degeneration/drug therapy , Neurogenesis/physiology , Activins/pharmacology , Animals , Anti-Inflammatory Agents/pharmacology , Anti-Inflammatory Agents, Non-Steroidal/pharmacology , Astrocytes/drug effects , Astrocytes/metabolism , Excitatory Amino Acid Agonists/toxicity , Fluorescent Antibody Technique , Gliosis/chemically induced , Gliosis/drug therapy , Gliosis/metabolism , Hippocampus/injuries , Hippocampus/pathology , Inflammation/drug therapy , Inflammation/metabolism , Kainic Acid/toxicity , Lipopolysaccharides/toxicity , Male , Mice , Mice, Inbred C57BL , Microglia/drug effects , Microglia/metabolism , Nerve Degeneration/chemically induced , Nerve Degeneration/metabolism , Neurogenesis/drug effectsABSTRACT
BACKGROUND: Infectious mononucleosis (IM) commonly triggers a protracted postinfective fatigue syndrome (PIFS) of unknown pathogenesis. METHODS: Seven subjects with PIFS with 6 or more months of disabling symptoms and 8 matched control subjects who had recovered promptly from documented IM were studied. The expression of 30,000 genes was examined in the peripheral blood by microarray analysis in 65 longitudinally collected samples. Gene expression patterns associated with PIFS were sought by correlation with symptom factor scores. RESULTS: Differential expression of 733 genes was identified when samples collected early during the illness and at the late (recovered) time point were compared. Of these genes, 234 were found to be significantly correlated with the reported severity of the fatigue symptom factor, and 180 were found to be correlated with the musculoskeletal pain symptom factor. Validation by analysis of the longitudinal expression pattern revealed 35 genes for which changes in expression were consistent with the illness course. These genes included several that are involved in signal transduction pathways, metal ion binding, and ion channel activity. CONCLUSIONS: Gene expression correlates of the cardinal symptoms of PIFS after IM have been identified. Further studies of these gene products may help to elucidate the pathogenesis of PIFS.
Subject(s)
Fatigue Syndrome, Chronic/genetics , Gene Expression Profiling , Gene Expression Regulation , Infectious Mononucleosis/complications , Adolescent , Adult , Case-Control Studies , Fatigue Syndrome, Chronic/blood , Fatigue Syndrome, Chronic/pathology , Fatigue Syndrome, Chronic/physiopathology , Female , Humans , Longitudinal Studies , Male , Middle Aged , Oligonucleotide Array Sequence Analysis , PainABSTRACT
OBJECTIVE: There are clear advantages to using biomarkers and surrogate endpoints, but concerns about clinical and statistical validity and systematic methods to evaluate these aspects hinder their efficient application. Our objective was to review the literature on biomarkers and surrogates to develop a hierarchical schema that systematically evaluates and ranks the surrogacy status of biomarkers and surrogates; and to obtain feedback from stakeholders. METHODS: After a systematic search of Medline and Embase on biomarkers, surrogate (outcomes, endpoints, markers, indicators), intermediate endpoints, and leading indicators, a quantitative surrogate validation schema was developed and subsequently evaluated at a stakeholder workshop. RESULTS: The search identified several classification schema and definitions. Components of these were incorporated into a new quantitative surrogate validation level of evidence schema that evaluates biomarkers along 4 domains: Target, Study Design, Statistical Strength, and Penalties. Scores derived from 3 domains the Target that the marker is being substituted for, the Design of the (best) evidence, and the Statistical strength are additive. Penalties are then applied if there is serious counterevidence. A total score (0 to 15) determines the level of evidence, with Level 1 the strongest and Level 5 the weakest. It was proposed that the term "surrogate" be restricted to markers attaining Levels 1 or 2 only. Most stakeholders agreed that this operationalization of the National Institutes of Health definitions of biomarker, surrogate endpoint, and clinical endpoint was useful. CONCLUSION: Further development and application of this schema provides incentives and guidance for effective biomarker and surrogate endpoint research, and more efficient drug discovery, development, and approval.
Subject(s)
Biomarkers , Outcome Assessment, Health Care , Rheumatic Diseases/therapy , Evidence-Based Medicine , Humans , National Institutes of Health (U.S.) , Predictive Value of Tests , Reproducibility of Results , Terminology as Topic , United StatesABSTRACT
OBJECTIVE: A schema was recently proposed for assessing the levels of evidence for surrogate validity that included 4 domains: Target, Study Design, Statistical Strength, and Penalties. This report examines one component of the schema. It surveys the literature on methods of statistical validation of surrogate markers and compares these methods head-to-head using simulated datasets. METHODS: Simulated datasets (continuous, multivariate normal) were generated to capture 3 possible relationships of surrogate (S) and true (T) outcome (none, weakly positive, strongly positive) each applied to 4 treatment effects (effect on both surrogate and true outcome, effect on neither, effect on surrogate only, and effect on true outcome only). These datasets were analyzed using single and multitrial statistical approaches, and the results were provided to participants for discussion. RESULTS: The multitrial surrogate threshold effect seemed to capture best the requirement that surrogate validation is demonstrated by a treatment-associated change in the surrogate predicting a treatment-associated change in the outcome. CONCLUSION: There was general agreement that neither a single trial nor any of the single trial statistical methods was adequate to establish surrogate validity. These exercises also showed that summary statistics developed specifically to establish surrogate validity, such as the proportion of the effect explained, were problematic. A sizable statistical research agenda remains, which includes investigating the additional advantage obtained with modeling subject-level data compared to modeling with only trial-level data; and developing and testing multitrial statistical approaches robust to settings with only a few trials.