Joint Models for Estimating Determinants of Cognitive Decline in the Presence of Survival Bias.

BACKGROUND: Identifying determinants of cognitive decline is crucial for developing strategies to prevent Alzheimer's disease and related dementias. However, determinants of cognitive decline remain elusive, with inconsistent results across studies. One reason could be differential survival. Cognitive decline and many exposures of interest are associated with mortality making survival a collider. Not accounting for informative attrition can result in survival bias. Generalized estimating equations (GEE) and linear mixed-effects model (LME) are commonly used to estimate effects of exposures on cognitive decline, but both assume mortality is not informative. Joint models combine LME with Cox proportional hazards models to simultaneously estimate cognitive decline and the hazard of mortality. METHODS: Using simulations, we compared estimates of the effect of a binary exposure on rate of cognitive decline from GEE, weighted GEE using inverse-probability-of-attrition weights, and LME to joint models under several causal structures of survival bias. RESULTS: We found that joint models with correctly specified relationship between survival and cognition performed best, producing unbiased estimates and appropriate coverage. Even those with misspecified relationship between survival and cognition showed advantage under causal structures consistent with survival bias. We also compared these models in estimating the effect of education on cognitive decline after dementia diagnosis using Framingham Heart Study data. Estimates of the effect of education on cognitive decline from joint models were slightly attenuated with similar precision compared with LME. CONCLUSIONS: In our study, joint models were more robust than LME, GEE, and weighted GEE models when evaluating determinants of cognitive decline.

Proof of Concept Example for Use of Simulation to Allow Data Pooling Despite Privacy Restrictions.

BACKGROUND: Integrating results from multiple samples is often desirable, but privacy restrictions may preclude full data pooling, and most datasets do not include fully harmonized variable sets. We propose a simulation-based method leveraging partial information across datasets to guide creation of synthetic data based on explicit assumptions about the underlying causal structure that permits pooled analyses that adjust for all desired confounders in the context of privacy restrictions. METHODS: This proof-of-concept project uses data from the Health and Retirement Study (HRS) and Atherosclerosis Risk in Communities (ARIC) study. We specified an estimand of interest and a directed acyclic graph (DAG) summarizing the presumed causal structure for the effect of glycated hemoglobin (HbA1c) on cognitive change. We derived publicly reportable statistics to describe the joint distribution of each variable in our DAG. These summary estimates were used as data-generating rules to create synthetic datasets. After pooling, we imputed missing covariates in the synthetic datasets and used the synthetic data to estimate the pooled effect of HbA1c on cognitive change, adjusting for all desired covariates. RESULTS: Distributions of covariates and model coefficients and associated standard errors for our model estimating the effect of HbA1c on cognitive change were similar across cohort-specific original and preimputation synthetic data. The estimate from the pooled synthetic incorporates control for confounders measured in either original dataset. DISCUSSION: Our approach has advantages over meta-analysis or individual-level pooling/data harmonization when privacy concerns preclude data sharing and key confounders are not uniformly measured across datasets.

Extension of Mendelian Randomization to Identify Earliest Manifestations of Alzheimer Disease: Association of Genetic Risk Score for Alzheimer Disease With Lower Body Mass Index by Age 50 Years.

Weight loss or lower body mass index (BMI) could be an early symptom of Alzheimer disease (AD), but when this begins to emerge is difficult to estimate with traditional observational data. In an extension of Mendelian randomization, we leveraged variation in genetic risk for late-onset AD risk to estimate the causal effect of AD on BMI and the earliest ages at which AD-related weight loss (or lower BMI as a proxy) occurs. We studied UK Biobank participants enrolled in 2006-2010, who were without dementia, aged 39-73, with European genetic ancestry. BMI was calculated with measured height/weight (weight (kg)/height (m)2). An AD genetic risk score (AD-GRS) was calculated based on 23 genetic variants. Using linear regressions, we tested the association of AD-GRS with BMI, stratified by decade, and calculated the age of divergence in BMI trends between low and high AD-GRS. AD-GRS was not associated with BMI in 39- to 49-year-olds (ß = 0.00, 95% confidence interval (CI): -0.03, 0.03). AD-GRS was associated with lower BMI in 50- to 59-year-olds (ß = -0.03, 95% CI: -0.06, -0.01) and 60- to 73-year-olds (ß = -0.09, 95% CI:-0.12, -0.07). Model-based BMI age curves for high versus low AD-GRS began to diverge after age 47 years. Sensitivity analyses found no evidence for pleiotropy or survival bias. Longitudinal replication is needed; however, our findings suggest that AD genes might begin to reduce BMI decades prior to dementia diagnosis.

Effect of reductions in amyloid levels on cognitive change in randomized trials: instrumental variable meta-analysis.

OBJECTIVE: To evaluate trials of drugs that target amyloid to determine whether reductions in amyloid levels are likely to improve cognition. DESIGN: Instrumental variable meta-analysis. SETTING: 14 randomized controlled trials of drugs for the prevention or treatment of Alzheimer's disease that targeted an amyloid mechanism, identified from ClinicalTrials.gov. POPULATION: Adults enrolled in randomized controlled trials of amyloid targeting drugs. Inclusion criteria for trials vary, but typically include adults aged 50 years or older with a diagnosis of mild cognitive impairment or Alzheimer's disease, and amyloid positivity at baseline. MAIN OUTCOME MEASURES: Analyses included trials for which information could be obtained on both change in brain amyloid levels measured with amyloid positron emission tomography and change in at least one cognitive test score reported for each randomization arm. RESULTS: Pooled results from the 14 randomized controlled trials were more precise than estimates from any single trial. The pooled estimate for the effect of reducing amyloid levels by 0.1 standardized uptake value ratio units was an improvement in the mini-mental state examination score of 0.03 (95% confidence interval -0.06 to 0.1) points. This study provides a web application that allows for the re-estimation of the results when new data become available and illustrates the magnitude of the new evidence that would be necessary to achieve a pooled estimate supporting the benefit of reducing amyloid levels. CONCLUSIONS: Pooled evidence from available trials reporting both reduction in amyloid levels and change in cognition suggests that amyloid reduction strategies do not substantially improve cognition.

Association of genetic risk for Alzheimer disease and hearing impairment.

OBJECTIVE: To test the hypothesis that incipient Alzheimer disease (AD) may adversely affect hearing and that hearing loss may adversely affect cognition, we evaluated whether genetic variants that increase AD risk also increase problem hearing and genetic variants that increase hearing impairment risk do not influence cognition. METHODS: UK Biobank participants without dementia ≥56 years of age with Caucasian genetic ancestry completed a Digit Triplets Test of speech-in-noise hearing (n = 80,074), self-reported problem hearing and hearing with background noise (n = 244,915), and completed brief cognitive assessments. A genetic risk score for AD (AD-GRS) was calculated as a weighted sum of 23 previously identified AD-related polymorphisms. A genetic risk score for hearing (hearing-GRS) was calculated using 3 previously identified polymorphisms related to hearing impairment. Using age-, sex-, and genetic ancestry-adjusted logistic and linear regression models, we evaluated whether the AD-GRS predicted poor hearing and whether the hearing-GRS predicted worse cognition. RESULTS: Poor speech-in-noise hearing (>-5.5-dB speech reception threshold; prevalence 14%) was associated with lower cognitive scores (ß = -1.28; 95% confidence interval [CI] -1.54 to -1.03). Higher AD-GRS was significantly associated with poor speech-in-noise hearing (odds ratio [OR] 1.06; 95% CI 1.01-1.11) and self-reported problems hearing with background noise (OR 1.03; 95% CI 1.00-1.05). Hearing-GRS was not significantly associated with cognitive scores (ß = -0.05; 95% CI -0.17 to 0.07). CONCLUSIONS: Genetic risk for AD also influences speech-in-noise hearing. We failed to find evidence that genetic risk for hearing impairment affects cognition. AD disease processes or a that shared etiology may cause speech-in-noise difficulty before dementia onset.

Differential Item Functioning of the Everyday Cognition (ECog) Scales in Relation to Racial/Ethnic Groups.

OBJECTIVE: The Everyday Cognition (ECog) scales measure cognitively based across domains of everyday abilities that are affected early in the course of neurodegenerative disorders such as Alzheimer's disease. However, the degree to which the ECog may be differentially influenced by ethnic/racial background is unknown. This study evaluates measurement invariance of the ECog across non-Hispanic White (NHW), Black, and Hispanic individuals. METHODS: Participants included 1177 NHW, 243 Black, and 216 Hispanic older adults from the UC Davis Alzheimer's Disease Center Cohort who had an ECog. Differential item functioning (DIF) for each ECog domain was evaluated separately for Black and Hispanic participants compared to NHW participants. An iterative multiple group confirmatory factor analysis approach for ordinal scores was used to identify items whose measurement properties differed across groups and to adjust scores for DIF. Adjusted scores were then evaluated to test whether they were more strongly associated with cognitive function (concurrent and longitudinal change in cognition) and brain volumes (measured by brain imaging). RESULTS: Varying levels, patterns, and impacts of DIF were found across domains and groups. However, the impact of DIF was relatively small, and DIF effects on scores generally were less than one-half standard error of measurement. There were no meaningful differences in associations with cognition and brain injury between DIF adjusted and unadjusted scores. CONCLUSIONS: Varying patterns of DIF were observed across the Black and Hispanic participants across select ECog domains. Overall, DIF effects were relatively small and did not change the relationship between the ECog and other indicators of disease.

Cognitive function and neuropathological outcomes: a forward-looking approach.

OBJECTIVE: To evaluate the risk of Alzheimer's disease-related neuropathology burden at autopsy given older adults' current cognitive state. METHOD: Participants included 1,303 individuals who enrolled in the Religious Orders Study (ROS) and 1,789 who enrolled in the Rush Memory and Aging Project (MAP). Cognitive status was evaluated via standardized assessments of global cognition and episodic memory. At the time of analyses, about 50% of participants were deceased with the remaining numbers right censored. Using multi-state Cox proportional hazard models, we compared the cognitive status of all subjects alive at a given age and estimated future risk of dying with different AD-related neuropathologies. Endpoints considered were Braak Stages (0-2, 3-4, 5-6), CERAD (0, 1, 2, 3), and TDP-43 (0, 1, 2, 3) level. RESULTS: For all three pathological groupings (Braak, CERAD, TDP-43), we found that a cognitive test score one standard deviation below average put individuals at up to three times the risk for being diagnosed with late stage AD at autopsy according to pathological designations. The effect remained significant after adjusting for sex, APOE-e4 status, smoking status, education level, and vascular health scores. CONCLUSION: Applying multi-state modeling techniques, we were able to identify those at risk of exhibiting specific levels of neuropathology based on current cognitive test performance. This approach presents new and approachable possibilities in clinical settings for diagnosis and treatment development programs.

Reserve and Alzheimer's disease genetic risk: Effects on hospitalization and mortality.

INTRODUCTION: Cognitive reserve predicts delayed diagnosis of Alzheimer's disease (AD) and faster postdiagnosis decline. The net impact of cognitive reserve, combining both prediagnosis and postdiagnosis risk, on adverse AD-related outcomes is unknown. We adopted a novel approach, using AD genetic risk scores (AD-GRS), to evaluate this. METHODS: Using 242,959 UK Biobank participants age 56+ years, we evaluated whether cognitive reserve (operationalized as education) modified associations between AD-GRS and mortality or hospitalization (total count, fall-related, and urinary tract infection-related). RESULTS: AD-GRS predicted mortality and hospitalization outcomes. Education did not modify AD-GRS effects on mortality, but had a nonsignificantly (interaction P = .10) worse effect on hospitalizations due to urinary tract infection or falls among low education (OR = 1.07 [95% CI: 1.02, 1.12]) than high education (OR = 1.01 [0.95, 1.07]) individuals. DISCUSSION: Education did not convey differential survival advantages to individuals with higher genetic risk of AD, but may reduce hospitalization risk associated with AD genetic risk.

Rate of Memory Change Before and After Cancer Diagnosis.

Importance: Patients with a history of cancer, even nonfatal cancers, have lower subsequent Alzheimer disease incidence. An inverse biological link between carcinogenesis and neurodegeneration has been hypothesized, although survival and detection biases are possible explanations. Objective: To compare long-term memory trajectories before and after incident cancer with memory trajectories of similarly aged individuals not diagnosed with cancer. Design, Setting, and Participants: This population-based cohort study included 14 583 US adults born before 1949 with no cancer history from the Health and Retirement Study. Biennial assessments were performed for up to 16 years from 1998 to 2014. Data analysis was performed from January 8 to October 5, 2018. Exposures: Self-reported physician diagnosis of any cancer (excluding nonmelanoma skin cancer) during follow-up. Main Outcomes and Measures: A composite memory score standardized to a mean (SD) of 0 (1) at baseline was based on immediate and delayed word-list recall and proxy assessments. The rate of memory change among people diagnosed with cancer during follow-up before and after diagnosis was compared with rate of memory change in individuals who remained cancer free during follow-up using linear mixed-effect models with random intercepts and slopes. Results: A total of 14 583 participants were included in the sample (mean [SD] age, 66.4 [10.4] years; 8453 [58.0%] female). The mean (SD) follow-up was 11.5 (5.1) years; 2250 had a cancer diagnosis during follow-up, and 12 333 had no cancer diagnosis during follow-up. The rate of memory decline in the decade before a cancer diagnosis was 10.5% (95% CI, 6.2%-14.9%), which was slower than memory decline in similarly aged cancer-free individuals. For individuals diagnosed at 75 years of age, mean memory function immediately before diagnosis was 0.096 SD units (95% CI, 0.060-0.133 SD units) higher compared with that among similarly aged cancer-free individuals. A new cancer diagnosis was associated with a short-term decline in memory of -0.058 (95% CI, -0.084 to -0.032) SD units compared with memory before diagnosis. After diagnosis, the rate of memory decline was 3.9% (95% CI, 0.9%-6.9%) slower in individuals with cancer than in those without a cancer diagnosis. Conclusions and Relevance: In this study, older individuals who developed cancer had better memory and slower memory decline than did similarly aged individuals who remained cancer free. These findings support the possibility of a common pathologic process working in opposite directions in cancer and Alzheimer disease.

Neuropsychological Test Performance and MRI Markers of Dementia Risk: Reducing Education Bias.

BACKGROUND: To use neuropsychological assessments for studying the underlying disease processes contributing to dementia, it is crucial that they correspond to magnetic resonance imaging (MRI)-based measures of dementia, regardless of educational level. METHODS: French 3-City Dijon MRI study cohort members (n=1782) with assessments of white matter lesion volume (WMLV), hippocampal volume (HCV), and cerebrospinal fluid volume (CSFV), and 6 waves of neuropsychological assessments over 11 years, including Mini-Mental State Examination (MMSE), plus 5 other tests combined using a Z-score or item-response theory (IRT-cognition) comprised the study cohort. We evaluated, testing interactions, whether education modified associations of MRI markers with intercept or rate of change of MMSE, Z-score composite, or IRT-cognition. RESULTS: In linear models, education modified the associations of WMLV and CSFV with MMSE and CSFV and Z-score composite. In mixed models, education modified the associations of WMLV and CSFV with level of MMSE and the association of HCV with slope of MMSE. Education also modified the association with CSFV and slope of Z-score composite decline. There was no evidence that education modified associations between MRI measures and level or slope of IRT-cognition. CONCLUSIONS: Longitudinal analysis of correctly scaled neuropsychological assessments may provide unbiased proxies for MRI-based measures of dementia risk.

Neuropathological Diagnoses of Demented Hispanic, Black, and Non-Hispanic White Decedents Seen at an Alzheimer's Disease Center.

Our nation is becoming increasingly diverse; however, few autopsy studies examine multiple ethnoracial groups, especially Hispanics. We examined differences in neuropathological diagnoses of 423 deceased participants with dementia from three ethnoracial groups (35 Black, 28 Hispanic, and 360 non-Hispanic White) evaluated at the University of California Davis Alzheimer's Disease Center. We used novel applications of bootstrap resampling and logistic regression standardization to project neuropathological diagnostic rates for non-Hispanic Whites to minority sample characteristics to improve inference of findings. Alzheimer's disease (AD) without significant cerebrovascular disease (CVD) or other dementia-related pathologies (AD (non-mixed)) was present in 15 Black (43%), 4 Hispanic (14%), and 156 (43%) non-Hispanic Whites. CVD sufficient to contribute to dementia was confirmed in 14 Black (40%), 15 Hispanic (54%), and 101 (28%) non-Hispanic White decedents. The observed CVD prevalence of 40% in Blacks exceeded the predicted 29% [95% CI: 22%-36%]. Despite being outside the 95% confidence interval, the difference between observed and predicted was not statistically significant after bootstrap testing. Conversely, for Hispanics, the observed proportion at 54% exceeded significantly the predicted prevalence of 24% from non-Hispanic Whites [95% CI: 16%-34%], avg. p = 0.008). An identical analysis using AD (non-mixed) as the outcome predicted AD (non-mixed) in Blacks averaging 41% [95% CI: 34%-48%], nearly equal to observed prevalence. For Hispanics, however, the observed proportion at 14%, was well below predictions (mean = 42%, 95% CI: 32%-53%], avg. p = 0.008). We conclude mixed diagnoses and CVD are more common in Hispanic and Black decedents than Non-Hispanic Whites with dementia in our cohort. The increased prevalence of vascular co-morbidity may be a potential opportunity to intervene more effectively in dementia treatment of those individuals.

"Liquid Biopsy" of White Matter Hyperintensity in Functionally Normal Elders.

Background and Objective: In the aging brain, increased blood-brain barrier (BBB) leakage and white matter hyperintensity (WMH) on MRI are frequently presumed secondary to cerebral small vessel disease (cSVD) or endotheliopathy. We investigate this association in vivo by quantifying protein cargo from endothelial-derived exosomes (EDE), and comparing levels between two groups of functionally normal elders with and without WMH. In addition, we study associations of EDE proteins with upstream and downstream factors, such as inflammation and neurodegenerative changes, respectively. Methods: Twenty six neurologically normal older adults completed general health questionnaires, neuropsychological and physical examinations, and brain MRI. WMH was visually graded with modified Fazekas score of 2 or greater used to classify 11 subjects as cases, and 15 without WMH as controls. Plasma total exosomes were precipitated and EDEs enriched by sequential immuno-precipitations. In addition, we quantified three inflammatory cytokines from plasma and imaging variables on MRI. Group means were compared, the discriminant functions of biomarkers calculated, and the association of EDE biomarkers with plasma inflammatory markers, cognition, and imaging outcomes assessed via regression modeling. Results: Plasma levels of EDE cargo proteins GLUT1, LAT1, P-GP, and NOSTRIN were significantly higher in subjects with WMH in comparison to those without. In contrast, EDE levels of the marker with low expression in brain (VCAM1) were equal between groups. The effect sizes for each of the brain-expressed cargo proteins (GLUT1, LAT1, and P-GP) were such that age-adjusted logistic regressions revealed areas under the curve (AUC) with range of 0.82-0.89, differentiating subjects with WMH from those without. VCAM1 poorly discriminated between groups (AUC:0.55). Higher levels of all brain-expressed EDE proteins were also associated with lower cognitive function, unrelated to burden of WMH. Levels of LAT1 and P-GP were significantly inversely associated with global gray matter volumes, and EDE GLUT1, LAT-1, and P-GP concentrations were significantly associated with systemic IL-6 levels. Conclusion: In a case control study of clinically normal adults with and without WMH, concentrations of EDE proteins were significantly higher in subjects with WMH in comparison to controls. This work is a first step toward in vivo dissection of molecular changes in endothelia of functionally normal subjects with radiographic evidence of age-associated white matter disease.

Staging of amyloid ß, t-tau, regional atrophy rates, and cognitive change in a nondemented cohort: Results of serial mediation analyses.

INTRODUCTION: Current models posit a sequence of amyloid ß (Aß), tau, atrophy, and cognitive change leading to Alzheimer's disease, but ambiguities remain. We examined these sequences via serial mediations. METHODS: We studied normal controls, early mild cognitive impairment, and late mild cognitive impairment individuals from the Alzheimer's Disease Neuroimaging Initiative 2 database for the mediation of baseline cerebrospinal fluid Aß effects on 2-year cognitive change via regional longitudinal atrophy rate (AR) alone or AR and tau. RESULTS: In normal controls, Aß correlated directly with regional ARs and memory loss, with no mediations. In early mild cognitive impairment, tau and lateral temporal ARs serially mediated the influence of Aß on memory while Aß affected memory via hippocampal AR. Late mild cognitive impairment consistently showed serial mediations of tau followed by atrophy. However, Aß effects on memory also continued to be specifically mediated by medial temporal ARs without intermediate tau. DISCUSSION: Biomarker sequences vary by region and disease state, suggesting the need to refine current cascade models.

Does selective survival before study enrolment attenuate estimated effects of education on rate of cognitive decline in older adults? A simulation approach for quantifying survival bias in life course epidemiology.

Background: The relationship between education and late-life cognitive decline is controversial. Selective survival between early life, when education is typically completed, and late life, when cognitive ageing studies take place, could attenuate effect estimates. Methods: We quantified potential survival bias (collider-stratification bias) in estimation of the effect of education on late-life cognitive decline by simulating hypothetical cohorts of 20-year-olds and applying cumulative mortality from US life tables. For each of four causal scenarios (2000 replications each), we compared the estimated versus causal effect of education on cognitive decline over 9 years, starting at age 60, 75 or 90 in random samples of n = 2000 people who survived to each age. Results: Effects of education on cognitive decline were underestimated when both education and U, another determinant of cognitive decline, influenced mortality (collider-stratification bias). The magnitude of bias was sensitive to the magnitude of the effect of U on cognitive decline and whether there was a multiplicative interaction between education and U on mortality. For example, when there was a multiplicative interaction between education and U on mortality, 95% confidence interval coverage of the causal effect ranged from 83.4% to 50.4% at age 60 and 25.8% to 0.2% at age 90. Conclusions: Selective survival could lead to underestimation of effects of education on late-life cognitive decline. Our simulations map survival bias to testable assumptions about underlying causal structures.

The Communication Gap Between the Medical System and Community Resources for Dementia-Related Behavioral Symptom Management: Family Caregiver Perspectives.

OBJECTIVE: To examine family caregiver perspectives on cooperative communication surrounding pharmacologic and nonpharmacologic resources for the treatment of dementia-related behavioral symptoms. METHODS: Personal narrative interviews were conducted by the primary investigator with 13 family caregivers from October 2014 to April 2015. The recorded interviews were then transcribed and coded. Models detailing the caregivers' resource utilization in regard to behavioral symptom management were produced for each participant and then summarized on the basis of recurring themes. RESULTS: There is a significant gap in the coordination and communication between physician services and caregiver community resources to aid in the behavioral management of family members with dementia. Physicians tend to rely on pharmacologic management independent of community resources and did not seem to be integrated or involved with recommendations from community resources. CONCLUSIONS: Better integration of caregiver resources is necessary to help caregivers in the management of dementia-related behavioral symptoms.

Antipsychotic Use in a Diverse Population With Dementia: A Retrospective Review of the National Alzheimer's Coordinating Center Database.

A cross-sectional analysis examined medication records in the National Alzheimer's Coordinating Center Database for community-dwelling patients with dementia who visited an Alzheimer's Disease Center between 2008 and 2014. Hispanic participants had a 1.62-fold greater use of antipsychotic medications, which was largely accounted for by a higher prevalence of neuropsychiatric symptoms and more severe dementia compared with non-Hispanic whites. These results are consistent with reports of later transition to nursing home care among Hispanic participants. Further studies are needed to clarify ethnic differences in how families and physicians address dementia progression and neuropsychiatric symptoms in community-dwelling patients with dementia.

OrbId: Origin-based identification of microRNA targets.

MicroRNAs coordinate networks of mRNAs, but predicting specific sites of interactions is complicated by the very few bases of complementarity needed for regulation. Although efforts to characterize the specific requirements for microRNA (miR) regulation have made some advances, no general model of target recognition has been widely accepted. In this work, we describe an entirely novel approach to miR target identification. The genomic events responsible for the creation of individual miR loci have now been described with many miRs now known to have been initially formed from transposable element (TE) sequences. In light of this, we propose that limiting miR target searches to transcripts containing a miR's progenitor TE can facilitate accurate target identification. In this report we outline the methodology behind OrbId (Origin-based identification of microRNA targets). In stark contrast to the principal miR target algorithms (which rely heavily on target site conservation across species and are therefore most effective at predicting targets for older miRs), we find OrbId is particularly efficacious at predicting the mRNA targets of miRs formed more recently in evolutionary time. After defining the TE origins of > 200 human miRs, OrbId successfully generated likely target sets for 191 predominately primate-specific human miR loci. While only a handful of the loci examined were well enough conserved to have been previously evaluated by existing algorithms, we find ~80% of the targets for the oldest miR (miR-28) in our analysis contained within the principal Diana and TargetScan prediction sets. More importantly, four of the 15 OrbId miR-28 putative targets have been previously verified experimentally. In light of OrbId proving best-suited for predicting targets for more recently formed miRs, we suggest OrbId makes a logical complement to existing, conservation based, miR target algorithms.