Sensitivity to the Instrumental Value of Choice Increases Across Development.

Across development, people tend to demonstrate a preference for contexts in which they have the opportunity to make choices. However, it is not clear how children, adolescents, and adults learn to calibrate this preference based on the costs and benefits of agentic choice. Here, in both a primary, in-person, reinforcement-learning experiment (N = 92; age range = 10-25 years) and a preregistered online replication study (N = 150; age range = 8-25 years), we found that participants overvalued agentic choice but also calibrated their agency decisions to the reward structure of the environment, increasingly selecting agentic choice when choice had greater instrumental value. Regression analyses and computational modeling of participant choices revealed that participants' bias toward agentic choice-reflecting its intrinsic value-remained consistent across age, whereas sensitivity to the instrumental value of agentic choice increased from childhood to early adulthood.

Novelty and uncertainty differentially drive exploration across development.

Across the lifespan, individuals frequently choose between exploiting known rewarding options or exploring unknown alternatives. A large body of work has suggested that children may explore more than adults. However, because novelty and reward uncertainty are often correlated, it is unclear how they differentially influence decision-making across development. Here, children, adolescents, and adults (ages 8-27 years, N = 122) completed an adapted version of a recently developed value-guided decision-making task that decouples novelty and uncertainty. In line with prior studies, we found that exploration decreased with increasing age. Critically, participants of all ages demonstrated a similar bias to select choice options with greater novelty, whereas aversion to reward uncertainty increased into adulthood. Computational modeling of participant choices revealed that whereas adolescents and adults demonstrated attenuated uncertainty aversion for more novel choice options, children's choices were not influenced by reward uncertainty.

Flexibility in valenced reinforcement learning computations across development.

Optimal integration of positive and negative outcomes during learning varies depending on an environment's reward statistics. The present study investigated the extent to which children, adolescents, and adults (N = 142 8-25 year-olds, 55% female, 42% White, 31% Asian, 17% mixed race, and 8% Black; data collected in 2021) adapt their weighting of better-than-expected and worse-than-expected outcomes when learning from reinforcement. Participants made choices across two contexts: one in which weighting positive outcomes more heavily than negative outcomes led to better performance, and one in which the reverse was true. Reinforcement learning modeling revealed that across age, participants shifted their valence biases in accordance with environmental structure. Exploratory analyses revealed strengthening of context-dependent flexibility with increasing age.

Developmental change in prefrontal cortex recruitment supports the emergence of value-guided memory.

Prioritizing memory for valuable information can promote adaptive behavior across the lifespan, but it is unclear how the neurocognitive mechanisms that enable the selective acquisition of useful knowledge develop. Here, using a novel task coupled with functional magnetic resonance imaging, we examined how children, adolescents, and adults (N = 90) learn from experience what information is likely to be rewarding, and modulate encoding and retrieval processes accordingly. We found that the ability to use learned value signals to selectively enhance memory for useful information strengthened throughout childhood and into adolescence. Encoding and retrieval of high- vs. low-value information was associated with increased activation in striatal and prefrontal regions implicated in value processing and cognitive control. Age-related increases in value-based lateral prefrontal cortex modulation mediated the relation between age and memory selectivity. Our findings demonstrate that developmental increases in the strategic engagement of the prefrontal cortex support the emergence of adaptive memory.

The rational use of causal inference to guide reinforcement learning strengthens with age.

Beliefs about the controllability of positive or negative events in the environment can shape learning throughout the lifespan. Previous research has shown that adults' learning is modulated by beliefs about the causal structure of the environment such that they update their value estimates to a lesser extent when the outcomes can be attributed to hidden causes. This study examined whether external causes similarly influenced outcome attributions and learning across development. Ninety participants, ages 7 to 25 years, completed a reinforcement learning task in which they chose between two options with fixed reward probabilities. Choices were made in three distinct environments in which different hidden agents occasionally intervened to generate positive, negative, or random outcomes. Participants' beliefs about hidden-agent intervention aligned with the true probabilities of the positive, negative, or random outcome manipulation in each of the three environments. Computational modeling of the learning data revealed that while the choices made by both adults (ages 18-25) and adolescents (ages 13-17) were best fit by Bayesian reinforcement learning models that incorporate beliefs about hidden-agent intervention, those of children (ages 7-12) were best fit by a one learning rate model that updates value estimates based on choice outcomes alone. Together, these results suggest that while children demonstrate explicit awareness of the causal structure of the task environment, they do not implicitly use beliefs about the causal structure of the environment to guide reinforcement learning in the same manner as adolescents and adults.

Causal Information-Seeking Strategies Change Across Childhood and Adolescence.

Intervening on causal systems can illuminate their underlying structures. Past work has shown that, relative to adults, young children often make intervention decisions that appear to confirm a single hypothesis rather than those that optimally discriminate alternative hypotheses. Here, we investigated how the ability to make informative causal interventions changes across development. Ninety participants between the ages of 7 and 25 completed 40 different puzzles in which they had to intervene on various causal systems to determine their underlying structures. Each puzzle comprised a three- or four-node computer chip with hidden wires. On each trial, participants viewed two possible arrangements of the chip's hidden wires and had to select a single node to activate. After observing the outcome of their intervention, participants selected a wire configuration and rated their confidence in their selection. We characterized participant choices with a Bayesian measurement model that indexed the extent to which participants selected nodes that would best disambiguate the two possible causal structures versus those that had high causal centrality in one of the two causal hypotheses but did not necessarily discriminate between them. Our model estimates revealed that the use of a discriminatory strategy increased through early adolescence. Further, developmental improvements in intervention strategy were related to changes in the ability to accurately judge the strength of evidence that interventions revealed, as indexed by participants' confidence in their selections. Our results suggest that improvements in causal information-seeking extend into adolescence and may be driven by metacognitive sensitivity to the efficacy of previous interventions in discriminating competing ideas.

Memory's reflection of learned information value increases across development.

Prioritizing memory for the information most likely to be useful in the future is critical to learning effectively in our complex world. Previous work has revealed that the ability to strategically encode high-value information may improve gradually over development, as the systems supporting cognitive control processes mature. However, studies of value-directed memory have relied on explicit cues that signal the importance of information, which are rarely present in real-world contexts. Here, we examined whether individuals across age groups could learn the relative frequency of items in their environment and prioritize memory for information associated with higher frequency items, which would ultimately enable them to earn more reward. We found that from childhood to early adulthood, individuals gained the ability to dynamically adjust memory based on the statistics of the environment (Experiment 1). In the absence of any relation between item frequency and the reward that could be earned for encoding related information, the increased exposure to higher frequency items did not facilitate associative memory (Experiment 2). Taken together, results from our two experiments suggest that the use of past experience to prioritize memory for high-value information strengthens with increasing age and is supported by the developing ability to derive explicit knowledge of the structure of the environment from experience. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Reinforcement learning across development: What insights can we draw from a decade of research?

The past decade has seen the emergence of the use of reinforcement learning models to study developmental change in value-based learning. It is unclear, however, whether these computational modeling studies, which have employed a wide variety of tasks and model variants, have reached convergent conclusions. In this review, we examine whether the tuning of model parameters that govern different aspects of learning and decision-making processes vary consistently as a function of age, and what neurocognitive developmental changes may account for differences in these parameter estimates across development. We explore whether patterns of developmental change in these estimates are better described by differences in the extent to which individuals adapt their learning processes to the statistics of different environments, or by more static learning biases that emerge across varied contexts. We focus specifically on learning rates and inverse temperature parameter estimates, and find evidence that from childhood to adulthood, individuals become better at optimally weighting recent outcomes during learning across diverse contexts and less exploratory in their value-based decision-making. We provide recommendations for how these two possibilities - and potential alternative accounts - can be tested more directly to build a cohesive body of research that yields greater insight into the development of core learning processes.

Differential Effects of Salient Visual Events on Memory-Guided Attention in Adults and Children.

Both salient visual events and scene-based memories can influence attention, but it is unclear how they interact in children and adults. In Experiment 1, children (N = 27; ages 7-12) were faster to discriminate targets when they appeared at the same versus different location as they had previously learned or as a salient visual event. In contrast, adults (N = 30; ages 18-31) responded faster only when cued by visual events. While Experiment 2 confirmed that adults (N = 27) can use memories to orient attention, Experiment 3 showed that, even in the absence of visual events, the effects of memories on attention were larger in children (N = 27) versus adults (N = 28). These findings suggest that memories may be a robust source of influence on children's attention.

When increasing distraction helps learning: Distractor number and content interact in their effects on memory.

Previous work has demonstrated that increasing the number of distractors in a search array can reduce interference from distractor content during target processing. However, it is unclear how this reduced interference influences learning of target information. Here, we investigated how varying the amount and content of distraction present in a learning environment affects visual search and subsequent memory for target items. In two experiments, we demonstrate that the number and content of competing distractors interact in their influence on target selection and memory. Specifically, while increasing the number of distractors present in a search array made target detection more effortful, it did not impair learning and memory for target content. Instead, when the distractors contained category information that conflicted with the target, increasing the number of distractors from one to three actually benefitted learning and memory. These data suggest that increasing numbers of distractors may reduce interference from conflicting conceptual information during encoding.

An Attentional Goldilocks Effect: An Optimal Amount of Social Interactivity Promotes Word Learning from Video.

Television can be a powerful education tool; however, content-makers must understand the factors that engage attention and promote learning from screen media. Prior research suggests that social engagement is critical for learning and that interactivity may enhance the educational quality of children's media. The present study examined the effects of increasing the social interactivity of television on children's visual attention and word learning. Three- to 5-year-old (MAge = 4;5 years, SD = 9 months) children completed a task in which they viewed videos of an actress teaching them the Swahili label for an on-screen image. Each child viewed these video clips in four conditions that parametrically manipulated social engagement and interactivity. We then tested whether each child had successfully learned the Swahili labels. Though 5-year-old children were able to learn words in all conditions, we found that there was an optimal level of social engagement that best supported learning for all participants, defined by engaging the child but not distracting from word labeling. Our eye-tracking data indicated that children in this condition spent more time looking at the target image and less time looking at the actress's face as compared to the most interactive condition. These findings suggest that social interactivity is critical to engaging attention and promoting learning from screen media up until a certain point, after which social stimuli may draw attention away from target images and impair children's word learning.

Selective attention neutralizes the adverse effects of low socioeconomic status on memory in 9-month-old infants.

Socioeconomic status (SES) has a documented impact on brain and cognitive development. We demonstrate that engaging spatial selective attention mechanisms may counteract this negative influence of impoverished environments on early learning. We previously used a spatial cueing task to compare target object encoding in the context of basic orienting ("facilitation") versus a spatial selective attention orienting mechanism that engages distractor suppression ("IOR"). This work showed that object encoding in the context of IOR boosted 9-month-old infants' recognition memory relative to facilitation (Markant and Amso, 2013). Here we asked whether this attention-memory link further interacted with SES in infancy. Results indicated that SES was related to memory but not attention orienting efficacy. However, the correlation between SES and memory performance was moderated by the attention mechanism engaged during encoding. SES predicted memory performance when objects were encoded with basic orienting processes, with infants from low-SES environments showing poorer memory than those from high-SES environments. However, SES did not predict memory performance among infants who engaged selective attention during encoding. Spatial selective attention engagement mitigated the effects of SES on memory and may offer an effective mechanism for promoting learning among infants at risk for poor cognitive outcomes related to SES.