Goal Shifts Structure Memories and Prioritize Event-defining Information in Memory.

Every day, we encounter far more information than we could possibly remember. Thus, our memory systems must organize and prioritize the details from an experience that can adaptively guide the storage and retrieval of specific episodic events. Prior work has shown that shifts in internal goal states can function as event boundaries, chunking experiences into distinct and memorable episodes. In addition, at short delays, memory for contextual information at boundaries has been shown to be enhanced compared with items within each event. However, it remains unclear if these memory enhancements are limited to features that signal a meaningful transition between events. To determine how changes in dynamic goal states influence the organization and content of long-term memory, we designed a 2-day experiment in which participants viewed a series of black-and-white objects surrounded by a color border on a two-by-two grid. The location of the object on the grid determined which of two tasks participants performed on a given trial. To examine if distinct types of goal shifts modulate the effects of event segmentation, we changed the border color, the task, or both after every four items in a sequence. We found that goal shifts influenced the temporal memory in a manner consistent with the formation of distinct events. However, for subjective memory representations in particular, these effects differed by the type of event boundary. Furthermore, to examine if goal shifts lead to the prioritization of goal-relevant features in longer lasting memories, we tested the source memory for each object's color and grid location both immediately and after a 24-hr delay. On the immediate test, boundaries enhanced the memory for all concurrent source features compared with nonboundary items, but only if those boundaries involved a goal shift. In contrast, after a delay, the source memory was selectively enhanced for the feature relevant to the goal shift. These findings suggest that goals can adaptively structure memories by prioritizing contextual features that define a unique episode in memory.

Temporal Interactions between Neural Proxies forMemory Recall, Negative Affect, and EmotionRegulation in Major Depression.

Dysfunction in emotion regulation (ER) and autobiographical memory are components of major depressive disorder (MDD). However, little is known about how they mechanistically interact with mood disturbances in real time. Using machine learning-based neural signatures, we can quantify negative affect (NA), ER, and memory continuously to evaluate how these processes dynamically interact in MDD. Unmedicated individuals with MDD (N=45) and healthy volunteers (HV; N=38) completed a negative autobiographical memory functional magnetic resonance imaging task wherein they recalled, distanced from (an ER strategy), and immersed into memories. We used a negative affect signature (PINES) and an emotion regulation signature (ERS) to quantify moment-to-moment NA and ER. We then examined whether memory engagement, indexed by hippocampal activity, predicted subsequent change in PINES and ERS over time. During memory recall and immersion, greater hippocampal activity predicted increased PINES across groups. During distancing, greater hippocampal activity in HVs predicted increased ERS but not PINES. In MDD, greater hippocampal activity predicted increased PINES but not ERS. Findings suggest abnormalities in the real-time relationship between memory, NA, and ER in MDD. During distancing, as predicted, HVs showed an attenuation of the linkage between memory engagement and NA, and they had subsequent increases in ER following memory reactivation. In contrast, MDD was characterized by continued linkage between memory engagement and NA, without subsequent increases in ER. Deficits in engagement of ER and ineffective modulation of NA following negative memory recall may contribute to the mood disturbances in MDD and are potential targets for clinical intervention.

The reach of reactivation: Effects of consciously triggered versus unconsciously triggered reactivation of associative memory.

Consolidating memories for long-term storage depends on reactivation. Reactivation occurs both consciously, during wakefulness, and unconsciously, during wakefulness and sleep. While considerable work has examined conscious awake and unconscious sleep reactivation, in this study, we directly compare the consequences of conscious and unconscious reactivation during wakefulness. Forty-one participants learned associations consisting of adjective-object-position triads. Objects were clustered into distinct semantic groups (e.g., fruits, vehicles) such that we could examine consequences of reactivation on semantically related memories. After an intensive learning protocol, we systematically reactivated some of the triads by presenting the adjective as a cue. Reactivation was done so that it was consciously experienced for some triads, and only unconsciously processed for others. Memory for spatial positions, the most distal part of the association, was affected by reactivation in a consciousness-dependent and memory-strength-dependent manner. Conscious reactivation resulted in weakening of semantically related memories that were strong initially, resonating with prior findings of retrieval-induced forgetting. Unconscious reactivation, on the other hand, selectively benefited weak reactivated memories, as previously shown for reactivation during sleep. Semantically linked memories were not impaired, but rather were integrated with the reactivated memory. These results taken together demonstrate that conscious and unconscious reactivation have qualitatively different consequences. Results support a consciousness-dependent inhibition account, whereby unconscious reactivation entails less inhibition than conscious reactivation, thus allowing more liberal spread of activation. Findings set the stage for additional exploration into the role of conscious experience in memory storage and structuring.

Memory functioning after hippocampal removal: Does side matter?

To address the memory functioning after medial temporal lobe (MTL) surgery for refractory epilepsy and relationships with the side of the hippocampal removal, 22 patients with pharmaco-resistant epilepsy who had undergone MTL resection (10 right/12 left) at the Salpêtrière Hospital were compared with 21 matched healthy controls. We designed a specific neuropsychological binding memory test that specifically addressed hippocampal cortex functioning, and left-right material-specific lateralization. Our results showed that both left and right mesial temporal lobe removal cause a severe memory impairment, for both verbal and visual material. The removal of left medial temporal lobe causes worse memory impairment than the right removal regardless of the stimuli type (verbal or visual) questioning the theory of the hippocampal material-specific lateralization. The present study provided new evidence for the role of both hippocampus and surrounding cortices in memory-binding whatever the material type and also suggested that a left MTL removal is more deleterious for both verbal and visual episodic memory in comparison with right MTL removal.

Event Integration and Temporal Differentiation: How Hierarchical Knowledge Emerges in Hippocampal Subfields through Learning.

Everyday life is composed of events organized by changes in contexts, with each event containing an unfolding sequence of occurrences. A major challenge facing our memory systems is how to integrate sequential occurrences within events while also maintaining their details and avoiding over-integration across different contexts. We asked if and how distinct hippocampal subfields come to hierarchically and, in parallel, represent both event context and subevent occurrences with learning. Female and male human participants viewed sequential events defined as sequences of objects superimposed on shared color frames while undergoing high-resolution fMRI. Importantly, these events were repeated to induce learning. Event segmentation, as indexed by increased reaction times at event boundaries, was observed in all repetitions. Temporal memory decisions were quicker for items from the same event compared to across different events, indicating that events shaped memory. With learning, hippocampal CA3 multivoxel activation patterns clustered to reflect the event context, with more clustering correlated with behavioral facilitation during event transitions. In contrast, in the dentate gyrus (DG), temporally proximal items that belonged to the same event became associated with more differentiated neural patterns. A computational model explained these results by dynamic inhibition in the DG. Additional similarity measures support the notion that CA3 clustered representations reflect shared voxel populations, while DG's distinct item representations reflect different voxel populations. These findings suggest an interplay between temporal differentiation in the DG and attractor dynamics in CA3. They advance our understanding of how knowledge is structured through integration and separation across time and context.

Time for Memories.

The ability to store information about the past to dynamically predict and prepare for the future is among the most fundamental tasks the brain performs. To date, the problems of understanding how the brain stores and organizes information about the past (memory) and how the brain represents and processes temporal information for adaptive behavior have generally been studied as distinct cognitive functions. This Symposium explores the inherent link between memory and temporal cognition, as well as the potential shared neural mechanisms between them. We suggest that working memory and implicit timing are interconnected and may share overlapping neural mechanisms. Additionally, we explore how temporal structure is encoded in associative and episodic memory and, conversely, the influences of episodic memory on subsequent temporal anticipation and the perception of time. We suggest that neural sequences provide a general computational motif that contributes to timing and working memory, as well as the spatiotemporal coding and recall of episodes.

Predictions transform memories: How expected versus unexpected events are integrated or separated in memory.

Our brains constantly generate predictions about the environment based on prior knowledge. Many of the events we experience are consistent with these predictions, while others might be inconsistent with prior knowledge and thus violate our predictions. To guide future behavior, the memory system must be able to strengthen, transform, or add to existing knowledge based on the accuracy of our predictions. We synthesize recent evidence suggesting that when an event is consistent with our predictions, it leads to neural integration between related memories, which is associated with enhanced associative memory, as well as memory biases. Prediction errors, in turn, can promote both neural integration and separation, and lead to multiple mnemonic outcomes. We review these findings and how they interact with factors such as memory reactivation, prediction error strength, and task goals, to offer insight into what determines memory for events that violate our predictions. In doing so, this review brings together recent neural and behavioral research to advance our understanding of how predictions shape memory, and why.

The reach of reactivation: Effects of consciously-triggered versus unconsciously-triggered reactivation of associative memory.

Newly formed memories are not passively stored for future retrieval; rather, they are reactivated offline and thereby strengthened and transformed. However, reactivation is not a uniform process: it occurs throughout different states of consciousness, including conscious rehearsal during wakefulness and unconscious processing during both wakefulness and sleep. In this study, we explore the consequences of reactivation during conscious and unconscious awake states. Forty-one participants learned associations consisting of adjective-object-position triads. Objects were clustered into distinct semantic groups (e.g., multiple fruits, vehicles, musical instruments) which allowed us to examine the consequences of reactivation on semantically-related memories. After an extensive learning phase, some triads were reactivated consciously, through cued retrieval, or unconsciously, through subliminal priming. In both conditions, the adjective was used as the cue. Reactivation impacted memory for the most distal association (i.e., the spatial position of associated objects) in a consciousness-dependent and memory-strength-dependent manner. First, conscious reactivation of a triad resulted in a weakening of other semantically related memories, but only those that were initially more accurate (i.e., memories with lower pre-reactivation spatial errors). This is similar to what has been previously demonstrated in studies employing retrieval-induced forgetting designs. Unconscious reactivation, on the other hand, benefited memory selectively for weak cued items. Semantically linked associations were not impaired, but rather integrated with the reactivated memory. Taken together, our results demonstrate that conscious and unconscious reactivation of memories during wakefulness have qualitatively different consequences on memory for distal associations. Effects are memory-strength-dependent, as has been shown for reactivation during sleep. Results support a consciousness-dependent inhibition account, according to which unconscious reactivation involves less inhibitory dynamics than conscious reactivation, thus allowing more liberal spread of activation. Our findings set the stage for additional exploration into the role of consciousness in memory structuring.

Cross-Modal Facilitation of Episodic Memory by Sequential Action Execution.

Throughout our lives, the actions we produce are often highly familiar and repetitive (e.g., commuting to work). However, layered upon these routine actions are novel, episodic experiences. Substantial research has shown that prior knowledge can facilitate learning of conceptually related new information. But despite the central role our behavior plays in real-world experience, it remains unclear how engagement in a familiar sequence of actions influences memory for unrelated, nonmotor information coincident with those actions. To investigate this, we had healthy young adults encode novel items while simultaneously following a sequence of actions (key presses) that was either predictable and well-learned or random. Across three experiments (N = 80 each), we found that temporal order memory, but not item memory, was significantly enhanced for novel items encoded while participants executed predictable compared with random action sequences. These results suggest that engaging in familiar behaviors during novel learning scaffolds within-event temporal memory, an essential feature of episodic experiences.

Neural temporal context reinstatement of event structure during memory recall.

The transformation of experiences into meaningful events and memories is intertwined with the notion of time. Temporal perception can influence, and be influenced by, segmenting continuous experience into meaningful events. Episodic memories formed from these events become associated with temporal information as well. However, it is less clear how temporal perception contributes to structuring events and organizing memory: whether it plays a more active or passive role, and whether this temporal information is encoded initially during perception or influenced by retrieval processes. To address these questions, we examined how event segmentation influences temporal representations during initial perception and memory retrieval, without testing temporal information explicitly. Using a neural measure of temporal context extracted from scalp electroencephalography in human participants (N = 170), we found reduced temporal context similarity between studied items separated by an event boundary when compared to items from the same event. Furthermore, while participants freely recalled list items, neural activity reflected reinstatement of temporal context representations from the study phase, including temporal disruption. A computational model of episodic memory, the context maintenance and retrieval (CMR) model, predicted these results, and made novel predictions regarding the influence of temporal disruption on recall order. These findings implicate the impact of event structure on memory organization via temporal representations, underscoring the role of temporal information in event segmentation and episodic memory. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Extra-hippocampal contributions to pattern separation.

Pattern separation, or the process by which highly similar stimuli or experiences in memory are represented by non-overlapping neural ensembles, has typically been ascribed to processes supported by the hippocampus. Converging evidence from a wide range of studies, however, suggests that pattern separation is a multistage process supported by a network of brain regions. Based on this evidence, considered together with related findings from the interference resolution literature, we propose the 'cortico-hippocampal pattern separation' (CHiPS) framework, which asserts that brain regions involved in cognitive control play a significant role in pattern separation. Particularly, these regions may contribute to pattern separation by (1) resolving interference in sensory regions that project to the hippocampus, thus regulating its cortical input, or (2) directly modulating hippocampal processes in accordance with task demands. Considering recent interest in how hippocampal operations are modulated by goal states likely represented and regulated by extra-hippocampal regions, we argue that pattern separation is similarly supported by neocortical-hippocampal interactions.

Identifying causal subsequent memory effects.

Over 40 y of accumulated research has detailed associations between neuroimaging signals measured during a memory encoding task and later memory performance, across a variety of brain regions, measurement tools, statistical approaches, and behavioral tasks. But the interpretation of these subsequent memory effects (SMEs) remains unclear: if the identified signals reflect cognitive and neural mechanisms of memory encoding, then the underlying neural activity must be causally related to future memory. However, almost all previous SME analyses do not control for potential confounders of this causal interpretation, such as serial position and item effects. We collect a large fMRI dataset and use an experimental design and analysis approach that allows us to statistically adjust for nearly all known exogenous confounding variables. We find that, using standard approaches without adjustment, we replicate several univariate and multivariate subsequent memory effects and are able to predict memory performance across people. However, we are unable to identify any signal that reliably predicts subsequent memory after adjusting for confounding variables, bringing into doubt the causal status of these effects. We apply the same approach to subjects' judgments of learning collected following an encoding period and show that these behavioral measures of mnemonic status do predict memory after adjustments, suggesting that it is possible to measure signals near the time of encoding that reflect causal mechanisms but that existing neuroimaging measures, at least in our data, may not have the precision and specificity to do so.

Acoustic features drive event segmentation in speech.

While our perceptual experience seems to unfold continuously over time, episodic memory preserves distinct events for storage and recollection. Previous work shows that stability in encoding context serves to temporally bind individual items into sequential composite events. This phenomenon has been almost exclusively studied using visual and spatial memory paradigms. Here we adapt these paradigms to test the role of speaker regularity for event segmentation of complex auditory information. The results of our auditory paradigm replicate the findings in other sensory modalities-finding greater within-event temporal memory for items within speaker-bound events and greater source memory for items at speaker or event transitions. The task we use significantly extends the ecological validity of past paradigms by allowing participants to encode the stimuli without any suggestions on the part of the experimenter. This unique property of our design reveals that, while memory performance is strongly dependent on self-reported mnemonic strategy, behavioral effects associated with event segmentation are robust to changes in mnemonic strategy. Finally, we consider the effect of serial position on segmentation effects during encoding and present a modeling approach to estimate the independent contribution of event segmentation. These findings provide several lines of evidence suggesting that contextual stability in perceptual features drives segmentation during word listening and supports a modality-independent role for mechanisms involved in event segmentation. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Mnemonic Content and Hippocampal Patterns Shape Judgments of Time.

Our experience of time can feel dilated or compressed, rather than reflecting true "clock time." Although many contextual factors influence the subjective perception of time, it is unclear how memory accessibility plays a role in constructing our experience of and memory for time. Here, we used a combination of behavioral and functional MRI measures in healthy young adults (N = 147) to ask the question of how memory is incorporated into temporal duration judgments. Behaviorally, we found that event boundaries, which have been shown to disrupt ongoing memory integration processes, result in the temporal compression of duration judgments. Additionally, using a multivoxel pattern similarity analysis of functional MRI data, we found that greater temporal pattern change in the left hippocampus within individual trials was associated with longer duration judgments. Together, these data suggest that mnemonic processes play a role in constructing representations of time.

Data-driven clustering of functional signals reveals gradients in processing both within the anterior hippocampus and across its long axis.

A particularly elusive puzzle concerning the hippocampus is how the structural differences along its long, anteroposterior axis might beget meaningful functional differences, particularly in terms of the granularity of information processing. One measure posits to quantify this granularity by calculating the average statistical independence of the BOLD signal across neighboring voxels, or inter-voxel similarity (IVS), and has shown the anterior hippocampus to process coarser-grained information than the posterior hippocampus. This measure, however, has yielded opposing results in studies of developmental and healthy aging samples, which also varied in fMRI acquisition parameters and hippocampal parcellation methods. In order to reconcile these findings, we measured IVS across two separate resting-state fMRI acquisitions and compared the results across many of the most widely used parcellation methods in a large young-adult sample of male and female humans (Acquisition 1, N = 233; Acquisition 2, N = 176). Finding conflicting results across acquisitions and parcellations, we reasoned that a data-driven approach to hippocampal parcellation is necessary. To this end, we implemented a group masked independent components analysis (mICA) to identify functional subunits of the hippocampus, most notably separating the anterior hippocampus into separate anterior-medial, anterior-lateral, and posteroanterior-lateral components. Measuring IVS across these components revealed a decrease in IVS along the medial-lateral axis of the anterior hippocampus but an increase from anterior to posterior. We conclude that inter-voxel similarity is deeply affected by parcellation, and that grounding one's parcellation in a functionally informed approach might allow for a more complex and reliable characterization of the hippocampus.SIGNIFICANCE STATEMENT:Processing information along hierarchical scales of granularity is critical for many of the feats of cognition considered most human. Recently, the changes in structure, cortical connectivity, and apparent functional properties across parcels of the hippocampal long axis have been hypothesized to underlie this hierarchical gradient in information processing. We show here, however, that the choice of parcellation method itself drastically affects one particular measure of granularity across the hippocampus, and that a functionally informed approach to parcellation reveals gradients both within the anterior hippocampus and in non-linear form across the long axis. These results point to the issue of parcellation as a critical one in the study of the hippocampus and reorient interpretation of existing results.

Reward Enhances Memory via Age-Varying Online and Offline Neural Mechanisms across Development.

Reward motivation enhances memory through interactions between mesolimbic, hippocampal, and cortical systems, both during and after encoding. Developmental changes in these distributed neural circuits may lead to age-related differences in reward-motivated memory and the underlying neural mechanisms. Converging evidence from cross-species studies suggests that subcortical dopamine signaling is increased during adolescence, which may lead to stronger memory representations of rewarding, relative to mundane, events and changes in the contributions of underlying subcortical and cortical brain mechanisms across age. Here, we used fMRI to examine how reward motivation influences the "online" encoding and "offline" postencoding brain mechanisms that support long-term associative memory from childhood to adulthood in human participants of both sexes. We found that reward motivation led to both age-invariant enhancements and nonlinear age-related differences in associative memory after 24 h. Furthermore, reward-related memory benefits were linked to age-varying neural mechanisms. During encoding, interactions between the prefrontal cortex (PFC) and ventral tegmental area (VTA) were associated with better high-reward memory to a greater degree with increasing age. Preencoding to postencoding changes in functional connectivity between the anterior hippocampus and VTA were also associated with better high-reward memory, but more so at younger ages. Our findings suggest that there may be developmental differences in the contributions of offline subcortical and online cortical brain mechanisms supporting reward-motivated memory.SIGNIFICANCE STATEMENT A substantial body of research has examined the neural mechanisms through which reward influences memory formation in adults. However, despite extensive evidence that both reward processing and associative memory undergo dynamic change across development, few studies have examined age-related changes in these processes. We found both age-invariant and nonlinear age-related differences in reward-motivated memory. Moreover, our findings point to developmental differences in the processes through which reward modulates the prioritization of information in long-term memory, with greater early reliance on offline subcortical consolidation mechanisms and increased contribution of systems-level online encoding circuitry with increasing age. These results highlight dynamic developmental changes in the cognitive and neural mechanisms through which motivationally salient information is prioritized in memory from childhood to adulthood.

Tag and capture: how salient experiences target and rescue nearby events in memory.

The long-term fate of a memory is not exclusively determined by the events occurring at the moment of encoding. Research at the cellular, circuit, and behavioral levels is beginning to reveal how neurochemical activations in the moments surrounding an event can retroactively and proactively rescue weak memory for seemingly mundane experiences. We review emerging evidence showing enhancement of weakly formed memories encoded minutes to hours before or after a related motivationally relevant experience. We discuss proposed neurobiological mechanisms for strengthening weak memories formed in temporal proximity to a strong event, and how this knowledge could be leveraged to improve memory for information that is prone to forgetting.

Neurophysiology of Remembering.

By linking the past with the future, our memories define our sense of identity. Because human memory engages the conscious realm, its examination has historically been approached from language and introspection and proceeded largely along separate parallel paths in humans and other animals. Here, we first highlight the achievements and limitations of this mind-based approach and make the case for a new brain-based understanding of declarative memory with a focus on hippocampal physiology. Next, we discuss the interleaved nature and common physiological mechanisms of navigation in real and mental spacetime. We suggest that a distinguishing feature of memory types is whether they subserve actions for single or multiple uses. Finally, in contrast to the persisting view of the mind as a highly plastic blank slate ready for the world to make its imprint, we hypothesize that neuronal networks are endowed with a reservoir of neural trajectories, and the challenge faced by the brain is how to select and match preexisting neuronal trajectories with events in the world.

Survival of the salient: Aversive learning rescues otherwise forgettable memories via neural reactivation and post-encoding hippocampal connectivity.

The effects of aversive events on memory are complex and go beyond the simple enhancement of threatening information. Negative experiences can also rescue related but otherwise forgettable details encoded close in time. Here, we used functional magnetic resonance imaging (fMRI) in healthy young adults to examine the brain mechanisms that support this retrograde memory effect. In a two-phase incidental encoding paradigm, participants viewed different pictures of tools and animals before and during Pavlovian fear conditioning. During Phase 1, these images were intermixed with neutral scenes, which provided a unique 'context tag' for this specific phase of encoding. A few minutes later, during Phase 2, new pictures from one category were paired with a mild shock (threat-conditioned stimulus; CS+), while pictures from the other category were not shocked. FMRI analyses revealed that, across-participants, individuals who showed aversive learning-related retroactive memory benefits for Phase 1 CS+ items were also more likely to exhibit three brain effects: first, greater spontaneous reinstatement of the Phase 1 context when participants viewed conceptually-related CS+ items in Phase 2; second, greater successful encoding-related VTA/SN and LC activation for Phase 2 CS+ items; and third, learning-dependent increases in post-encoding hippocampal functional coupling with CS+ category-selective cortex. These biases in hippocampal-cortical connectivity also mediated the relationship between VTA/SN aversive encoding effects and across-participant variability in the retroactive memory benefit. Collectively, our findings suggest that both online and offline brain mechanisms may enable threatening events to preserve memories that acquire new significance in the future.

Mnemonic prediction errors promote detailed memories.

When our experience violates our predictions, it is adaptive to update our knowledge to promote a more accurate representation of the world and facilitate future predictions. Theoretical models propose that these mnemonic prediction errors should be encoded into a distinct memory trace to prevent interference with previous, conflicting memories. We investigated this proposal by repeatedly exposing participants to pairs of sequentially presented objects (A → B), thus evoking expectations. Then, we violated participants' expectations by replacing the second object in the pairs with a novel object (A → C). The following item memory test required participants to discriminate between identical old items and similar lures, thus testing detailed and distinctive item memory representations. In two experiments, mnemonic prediction errors enhanced item memory: Participants correctly identified more old items as old when those items violated expectations during learning, compared with items that did not violate expectations. This memory enhancement for C items was only observed when participants later showed intact memory for the related A → B pairs, suggesting that strong predictions are required to facilitate memory for violations. Following up on this, a third experiment reduced prediction strength prior to violation and subsequently eliminated the memory advantage of violations. Interestingly, mnemonic prediction errors did not increase gist-based mistakes of identifying old items as similar lures or identifying similar lures as old. Enhanced item memory in the absence of gist-based mistakes suggests that violations enhanced memory for items' details, which could be mediated via distinct memory traces. Together, these results advance our knowledge of how mnemonic prediction errors promote memory formation.