Medial Temporal Lobe Damage Impairs Temporal Integration in Episodic Memory.

Although the role of the medial temporal lobe (MTL) and the hippocampus in episodic memory is well established, there is emerging evidence that these regions play a broader role in cognition, specifically in temporal processing. However, despite strong evidence that the hippocampus plays a critical role in sequential processing, the involvement of the MTL in timing per se is poorly understood. In the present study, we investigated whether patients with MTL damage exhibit differential performance on a temporal distance memory task. Critically, we manipulated context shifts, or boundaries, which have been shown to interfere with associative binding, leading to increases in subjective temporal distance. We predicted that patients with MTL damage would show impaired binding across boundaries and thus fail to show temporal expansion. Consistent with this hypothesis, unilateral patients failed to show a temporal expansion effect, and bilateral patients actually exhibited the reverse effect, suggesting a critical role for the MTL in binding temporal information across boundaries. Furthermore, patients were impaired overall on both the temporal distance memory task and recognition memory, but not on an independent, short-timescale temporal perception task. Interestingly, temporal distance performance could be independently predicted by performance on recognition memory and the short temporal perception task. Together, these data suggest that distinct mnemonic and temporal processes may influence long interval temporal memory and that damage to the MTL may impair the ability to integrate episodic and temporal information in memory.

Event representation at the scale of ordinary experience.

Weeks are divided into weekdays and weekends; years into semesters and seasons; lives into stages like childhood, adulthood, and adolescence. How does the structure of experience shape memory? Though much work has examined event representation in human cognition, little work has explored event representation at the scale of ordinary experience. Here, we use shared experiences - in the form of popular television shows - to explore how memories are shaped by event structure at a large scale. We find that memories for events in these shows exhibit several hallmarks of event cognition. Namely, we find that memories are organized with respect to their event structure (boundaries), and that beginnings and endings are better remembered at multiple levels of the event hierarchy simultaneously. These patterns seem to be partially, but not fully, explained by the perceived story-relevance of events. Lastly, using a longitudinal design, we also show how event representations evolve over periods of several months. These results offer an understanding of event cognition at the scale of ordinary human lives.

Acute Stress Effects on Statistical Learning and Episodic Memory.

Stress is widely considered to negatively impact hippocampal function, thus impairing episodic memory. However, the hippocampus is not merely the seat of episodic memory. Rather, it also (via distinct circuitry) supports statistical learning. On the basis of rodent work suggesting that stress may impair the hippocampal pathway involved in episodic memory while sparing or enhancing the pathway involved in statistical learning, we developed a behavioral experiment to investigate the effects of acute stress on both episodic memory and statistical learning in humans. Participants were randomly assigned to one of three conditions: stress (socially evaluated cold pressor) immediately before learning, stress ∼15 min before learning, or no stress. In the learning task, participants viewed a series of trial-unique scenes (allowing for episodic encoding of each image) in which certain scene categories reliably followed one another (allowing for statistical learning of associations between paired categories). Memory was assessed 24 hr later to isolate stress effects on encoding/learning rather than retrieval. We found modest support for our hypothesis that acute stress can amplify statistical learning: Only participants stressed ∼15 min in advance exhibited reliable evidence of learning across multiple measures. Furthermore, stress-induced cortisol levels predicted statistical learning retention 24 hr later. In contrast, episodic memory did not differ by stress condition, although we did find preliminary evidence that acute stress promoted memory for statistically predictable information and attenuated competition between statistical and episodic encoding. Together, these findings provide initial insights into how stress may differentially modulate learning processes within the hippocampus.

Multiple Memory Subsystems: Reconsidering Memory in the Mind and Brain.

The multiple-memory-systems framework-that distinct types of memory are supported by distinct brain systems-has guided learning and memory research for decades. However, recent work challenges the one-to-one mapping between brain structures and memory types central to this taxonomy, with key memory-related structures supporting multiple functions across substructures. Here we integrate cross-species findings in the hippocampus, striatum, and amygdala to propose an updated framework of multiple memory subsystems (MMSS). We provide evidence for two organizational principles of the MMSS theory: First, opposing memory representations are colocated in the same brain structures; second, parallel memory representations are supported by distinct structures. We discuss why this burgeoning framework has the potential to provide a useful revision of classic theories of long-term memory, what evidence is needed to further validate the framework, and how this novel perspective on memory organization may guide future research.

Statistical learning in epilepsy: Behavioral and anatomical mechanisms in the human brain.

OBJECTIVE: Statistical learning, the fundamental cognitive ability of humans to extract regularities across experiences over time, engages the medial temporal lobe (MTL) in the healthy brain. This leads to the hypothesis that statistical learning (SL) may be impaired in patients with epilepsy (PWE) involving the temporal lobe, and that this impairment could contribute to their varied memory deficits. In turn, studies done in collaboration with PWE, that evaluate the necessity of MTL circuitry through disease and causal perturbations, provide an opportunity to advance basic understanding of SL. METHODS: We implemented behavioral testing, volumetric analysis of the MTL substructures, and direct electrical brain stimulation to examine SL across a cohort of 61 PWE and 28 healthy controls. RESULTS: We found that behavioral performance in an SL task was negatively associated with seizure frequency irrespective of seizure origin. The volume of hippocampal subfields CA1 and CA2/3 correlated with SL performance, suggesting a more specific role of the hippocampus. Transient direct electrical stimulation of the hippocampus disrupted SL. Furthermore, the relationship between SL and seizure frequency was selective, as behavioral performance in an episodic memory task was not impacted by seizure frequency. SIGNIFICANCE: Overall, these results suggest that SL may be hippocampally dependent and that the SL task could serve as a clinically useful behavioral assay of seizure frequency that may complement existing approaches such as seizure diaries. Simple and short SL tasks may thus provide patient-centered endpoints for evaluating the efficacy of novel treatments in epilepsy.

Hippocampal Mechanisms Support Cortisol-Induced Memory Enhancements.

Stress can powerfully influence episodic memory, often enhancing memory encoding for emotionally salient information. These stress-induced memory enhancements stand at odds with demonstrations that stress and the stress-related hormone cortisol can negatively affect the hippocampus, a brain region important for episodic memory encoding. To resolve this apparent conflict and determine whether and how the hippocampus supports memory encoding under cortisol, we combined behavioral assays of associative memory, high-resolution fMRI, and pharmacological manipulation of cortisol in a within-participant, double-blinded procedure (in both sexes). Behaviorally, hydrocortisone promoted the encoding of subjectively arousing, positive associative memories. Neurally, hydrocortisone led to enhanced functional connectivity between hippocampal subregions, which predicted subsequent memory enhancements for emotional associations. Cortisol also modified the relationship between hippocampal representations and associative memory: whereas hippocampal signatures of distinctiveness predicted memory under placebo, relative integration predicted memory under cortisol. Together, these data provide novel evidence that the human hippocampus contains the necessary machinery to support emotional associative memory enhancements under cortisol.SIGNIFICANCE STATEMENT Our daily lives are filled with stressful events, which powerfully shape the way we form episodic memories. For example, stress and stress-related hormones can enhance our memory for emotional events. However, the mechanisms underlying these memory benefits are unclear. In the current study, we combined functional neuroimaging, behavioral tests of memory, and double-blind, placebo-controlled hydrocortisone administration to uncover the effects of the stress-related hormone cortisol on the function of the human hippocampus, a brain region important for episodic memory. We identified novel ways in which cortisol can enhance hippocampal function to promote emotional memories, highlighting the adaptive role of cortisol in shaping memory formation.

More than a moment: What does it mean to call something an 'event'?

Experiences are stored in the mind as discrete mental units, or 'events,' which influence-and are influenced by-attention, learning, and memory. In this way, the notion of an 'event' is foundational to cognitive science. However, despite tremendous progress in understanding the behavioral and neural signatures of events, there is no agreed-upon definition of an event. Here, we discuss different theoretical frameworks of event perception and memory, noting what they can and cannot account for in the literature. We then highlight key aspects of events that we believe should be accounted for in theories of event processing--in particular, we argue that the structure and substance of events should be better reflected in our theories and paradigms. Finally, we discuss empirical gaps in the event cognition literature and what the future of event cognition research may look like.

Intracranial Entrainment Reveals Statistical Learning across Levels of Abstraction.

We encounter the same people, places, and objects in predictable sequences and configurations. Humans efficiently learn these regularities via statistical learning. Importantly, statistical learning creates knowledge not only of specific regularities but also of regularities that apply more generally across related experiences (i.e., across members of a category). Prior evidence for different levels of learning comes from post-exposure behavioral tests, leaving open the question of whether more abstract regularities are detected online during initial exposure. We address this question by measuring neural entrainment in intracranial recordings. Neurosurgical patients viewed a stream of photographs with regularities at one of two levels: In the exemplar-level structured condition, the same photographs appeared repeatedly in pairs. In the category-level structured condition, the photographs were trial-unique but their categories were paired across repetitions. In a baseline random condition, the same photographs repeated but in a scrambled order. We measured entrainment at the frequency of individual photographs, which was expected in all conditions, but critically also at half that frequency-the rate at which to-be-learned pairs appeared in the two structured (but not random) conditions. Entrainment to both exemplar and category pairs emerged within minutes throughout visual cortex and in frontal and temporal regions. Many electrode contacts were sensitive to only one level of structure, but a significant number encoded both levels. These findings suggest that the brain spontaneously uncovers category-level regularities during statistical learning, providing insight into the brain's unsupervised mechanisms for building flexible and robust knowledge that generalizes across input variation and conceptual hierarchies.

Statistical learning in epilepsy: Behavioral, anatomical, and causal mechanisms in the human brain.

Statistical learning, the fundamental cognitive ability of humans to extract regularities across experiences over time, engages the medial temporal lobe in the healthy brain. This leads to the hypothesis that statistical learning may be impaired in epilepsy patients, and that this impairment could contribute to their varied memory deficits. In turn, epilepsy patients provide a platform to advance basic understanding of statistical learning by helping to evaluate the necessity of medial temporal lobe circuitry through disease and causal perturbations. We implemented behavioral testing, volumetric analysis of the medial temporal lobe substructures, and direct electrical brain stimulation to examine statistical learning across a cohort of 61 epilepsy patients and 28 healthy controls. Behavioral performance in a statistical learning task was negatively associated with seizure frequency, irrespective of where seizures originated in the brain. The volume of hippocampal subfields CA1 and CA2/3 correlated with statistical learning performance, suggesting a more specific role of the hippocampus. Indeed, transient direct electrical stimulation of the hippocampus disrupted statistical learning. Furthermore, the relationship between statistical learning and seizure frequency was selective: behavioral performance in an episodic memory task was impacted by structural lesions in the medial temporal lobe and by antiseizure medications, but not by seizure frequency. Overall, these results suggest that statistical learning may be hippocampally dependent and that this task could serve as a clinically useful behavioral assay of seizure frequency distinct from existing neuropsychological tests. Simple and short statistical learning tasks may thus provide patient-centered endpoints for evaluating the efficacy of novel treatments in epilepsy.

Hippocampal mechanisms support cortisol-induced memory enhancements.

Stress can powerfully influence episodic memory, often enhancing memory encoding for emotionally salient information. These stress-induced memory enhancements stand at odds with demonstrations that stress and the stress-related hormone cortisol can negatively affect the hippocampus, a brain region important for episodic memory encoding. To resolve this apparent conflict and determine whether and how the hippocampus supports memory encoding under cortisol, we combined behavioral assays of associative memory, high-resolution functional magnetic resonance imaging (fMRI), and pharmacological manipulation of cortisol in a within-participant, double-blinded procedure. Hydrocortisone led to enhanced functional connectivity between hippocampal subregions, which predicted subsequent memory enhancements for emotional information. Cortisol also modified the relationship between hippocampal representations and memory: whereas hippocampal signatures of distinctiveness predicted memory under placebo, relative integration predicted memory under cortisol. Together, these data provide novel evidence that the human hippocampus contains the necessary machinery to support emotional memory enhancements under stress.

Mnemonic Content and Hippocampal Patterns Shape Judgments of Time.

Our experience of time can feel dilated or compressed, rather than reflecting true "clock time." Although many contextual factors influence the subjective perception of time, it is unclear how memory accessibility plays a role in constructing our experience of and memory for time. Here, we used a combination of behavioral and functional MRI measures in healthy young adults (N = 147) to ask the question of how memory is incorporated into temporal duration judgments. Behaviorally, we found that event boundaries, which have been shown to disrupt ongoing memory integration processes, result in the temporal compression of duration judgments. Additionally, using a multivoxel pattern similarity analysis of functional MRI data, we found that greater temporal pattern change in the left hippocampus within individual trials was associated with longer duration judgments. Together, these data suggest that mnemonic processes play a role in constructing representations of time.

Temporal Dynamics of Competition between Statistical Learning and Episodic Memory in Intracranial Recordings of Human Visual Cortex.

The function of long-term memory is not just to reminisce about the past, but also to make predictions that help us behave appropriately and efficiently in the future. This predictive function of memory provides a new perspective on the classic question from memory research of why we remember some things but not others. If prediction is a key outcome of memory, then the extent to which an item generates a prediction signifies that this information already exists in memory and need not be encoded. We tested this principle using human intracranial EEG as a time-resolved method to quantify prediction in visual cortex during a statistical learning task and link the strength of these predictions to subsequent episodic memory behavior. Epilepsy patients of both sexes viewed rapid streams of scenes, some of which contained regularities that allowed the category of the next scene to be predicted. We verified that statistical learning occurred using neural frequency tagging and measured category prediction with multivariate pattern analysis. Although neural prediction was robust overall, this was driven entirely by predictive items that were subsequently forgotten. Such interference provides a mechanism by which prediction can regulate memory formation to prioritize encoding of information that could help learn new predictive relationships.SIGNIFICANCE STATEMENT When faced with a new experience, we are rarely at a loss for what to do. Rather, because many aspects of the world are stable over time, we rely on past experiences to generate expectations that guide behavior. Here we show that these expectations during a new experience come at the expense of memory for that experience. From intracranial recordings of visual cortex, we decoded what humans expected to see next in a series of photographs based on patterns of neural activity. Photographs that generated strong neural expectations were more likely to be forgotten in a later behavioral memory test. Prioritizing the storage of experiences that currently lead to weak expectations could help improve these expectations in future encounters.

Remembering the pattern: A longitudinal case study on statistical learning in spatial navigation and memory consolidation.

Distinct brain systems are thought to support statistical learning over different timescales. Regularities encountered during online perceptual experience can be acquired rapidly by the hippocampus. Further processing during offline consolidation can establish these regularities gradually in cortical regions, including the medial prefrontal cortex (mPFC). These mechanisms of statistical learning may be critical during spatial navigation, for which knowledge of the structure of an environment can facilitate future behavior. Rapid acquisition and prolonged retention of regularities have been investigated in isolation, but how they interact in the context of spatial navigation is unknown. We had the rare opportunity to study the brain systems underlying both rapid and gradual timescales of statistical learning using intracranial electroencephalography (iEEG) longitudinally in the same patient over a period of three weeks. As hypothesized, spatial patterns were represented in the hippocampus but not mPFC for up to one week after statistical learning and then represented in the mPFC but not hippocampus two and three weeks after statistical learning. Taken together, these findings suggest that the hippocampus may contribute to the initial extraction of regularities prior to cortical consolidation.

Statistical prediction of the future impairs episodic encoding of the present.

Memory is typically thought of as enabling reminiscence about past experiences. However, memory also informs and guides processing of future experiences. These two functions of memory are often at odds: Remembering specific experiences from the past requires storing idiosyncratic properties that define particular moments in space and time, but by definition such properties will not be shared with similar situations in the future and thus may not be applicable to future situations. We discovered that, when faced with this conflict, the brain prioritizes prediction over encoding. Behavioral tests of recognition and source recall showed that items allowing for prediction of what will appear next based on learned regularities were less likely to be encoded into memory. Brain imaging revealed that the hippocampus was responsible for this interference between statistical learning and episodic memory. The more that the hippocampus predicted the category of an upcoming item, the worse the current item was encoded. This competition may serve an adaptive purpose, focusing encoding on experiences for which we do not yet have a predictive model.

The prevalence and importance of statistical learning in human cognition and behavior.

Statistical learning, the ability to extract regularities from the environment over time, has become a topic of burgeoning interest. Its influence on behavior, spanning infancy to adulthood, has been demonstrated across a range of tasks, both those labeled as tests of statistical learning and those from other learning domains that predated statistical learning research or that are not typically considered in the context of that literature. Given this pervasive role in human cognition, statistical learning has the potential to reconcile seemingly distinct learning phenomena and may be an under-appreciated but important contributor to a wide range of human behaviors that are studied as unrelated processes, such as episodic memory and spatial navigation.