Neural correlates of retrieval success and precision: an fMRI study.

Prior studies examining the neural mechanisms underlying retrieval success and precision have yielded inconsistent results. Here, their neural correlates were examined using a memory task that assessed precision for spatial location. A sample of healthy young adults underwent fMRI scanning during a single study-test cycle. At study, participants viewed a series of object images, each placed at a randomly selected location on an imaginary circle. At test, studied images were intermixed with new images and presented to the participants. The requirement was to move a cursor to the location of the studied image, guessing if necessary. Participants then signaled whether the presented image as having been studied. Memory precision was quantified as the angle between the studied location and the location selected by the participant. A precision effect was evident in the left angular gyrus, where BOLD activity covaried across trials with location accuracy. Multi-voxel pattern analysis also revealed a significant item-level reinstatement effect for high-precision trials. There was no evidence of a retrieval success effect in the angular gyrus. BOLD activity in the hippocampus was insensitive to both success and precision. These findings are partially consistent with prior evidence that success and precision are dissociable features of memory retrieval.

The hippocampus supports precise memory for public events regardless of their remoteness.

The necessity of the human hippocampus and surrounding medial temporal lobe structures to semantic memory remains contentious. Impaired semantic memory following hippocampal lesions could arise either due to partially intertwined episodic memories and/or retrograde/anterograde effects. In this study, we tested amnesic individuals with lesions in hippocampus and surrounding medial temporal lobe (n = 7) and age-matched controls (n = 14) on their ability to precisely recall the dates of famous public events that occurred either before (i.e., pre-lifetime) or after participants' birth date (lifetime). We show that deficits in dating precision are greatest for recent lifetime events, consistent with the notion that recent event memory may be particularly intertwined with episodic memory. At the same time, individuals with medial temporal lobe lesions showed more subtle impairments in their ability to date pre-birth and remote lifetime events precisely. Together, these findings suggest that the hippocampus and surrounding medial temporal lobe structures are important for representational precision of semantic memories regardless of their remoteness.

Age differences in spatial memory are mitigated during naturalistic navigation.

Spatial navigation deficits are often observed among older adults on tasks that require navigating virtual reality (VR) environments on a computer screen. We investigated whether these age differences are attenuated when tested in more naturalistic and ambulatory virtual environments. In Experiment 1, young and older adults navigated a variant of the Morris Water Maze task in each of two VR conditions: a desktop VR condition which required using a mouse and keyboard to navigate, and an ambulatory VR condition which permitted unrestricted locomotion. In Experiment 2, we examined whether age- and VR-related differences in spatial performance were affected by the inclusion of additional spatial cues. In both experiments, older adults navigated to target locations less precisely than younger individuals in the desktop condition. Age differences were significantly attenuated, however, when tested in the ambulatory VR environment. These findings underscore the importance of developing naturalistic assessments of spatial memory and navigation.

CW_ICA: an efficient dimensionality determination method for independent component analysis.

Independent component analysis (ICA) is a widely used blind source separation method for signal pre-processing. The determination of the number of independent components (ICs) is crucial for achieving optimal performance, as an incorrect choice can result in either under-decomposition or over-decomposition. In this study, we propose a robust method to automatically determine the optimal number of ICs, named the column-wise independent component analysis (CW_ICA). CW_ICA divides the mixed signals into two blocks and applies ICA separately to each block. A quantitative measure, derived from the rank-based correlation matrix computed from the ICs of the two blocks, is utilized to determine the optimal number of ICs. The proposed method is validated and compared with the existing determination methods using simulation and scalp EEG data. The results demonstrate that CW_ICA is a reliable and robust approach for determining the optimal number of ICs. It offers computational efficiency and can be seamlessly integrated with different ICA methods.

Hippocampal contributions to novel spatial learning are both age-related and age-invariant.

Older adults show declines in spatial memory, although the extent of these alterations is not uniform across the healthy older population. Here, we investigate the stability of neural representations for the same and different spatial environments in a sample of younger and older adults using high-resolution functional MRI of the medial temporal lobes. Older adults showed, on average, lower neural pattern similarity for retrieving the same environment and more variable neural patterns compared to young adults. We also found a positive association between spatial distance discrimination and the distinctiveness of neural patterns between environments. Our analyses suggested that one source for this association was the extent of informational connectivity to CA1 from other subfields, which was dependent on age, while another source was the fidelity of signals within CA1 itself, which was independent of age. Together, our findings suggest both age-dependent and independent neural contributions to spatial memory performance.

Frontal-midline theta and posterior alpha oscillations index early processing of spatial representations during active navigation.

Previous research has demonstrated that humans combine multiple sources of spatial information such as self-motion and landmark cues while navigating through an environment. However, it is unclear whether this involves comparing multiple representations obtained from different sources during navigation (parallel hypothesis) or building a representation first based on self-motion cues and then combining with landmarks later (serial hypothesis). We tested these two hypotheses (parallel vs serial) in an active navigation task using wireless mobile scalp EEG recordings. Participants walked through an immersive virtual hallway with or without conflicts between self-motion and landmarks (i.e., intersections) and pointed toward the starting position of the hallway. We employed the oscillatory signals recorded during mobile wireless scalp EEG as a means of identifying when participant representations based on self-motion versus landmark cues might have first emerged. We found that path segments, including intersections present early during navigation, were more strongly associated with later pointing error, regardless of when they appeared during encoding. We also found that there was sufficient information contained within the frontal-midline theta and posterior alpha oscillatory signals in the earliest segments of navigation involving intersections to decode condition (i.e., conflicting vs not conflicting). Together, these findings suggest that intersections play a pivotal role in the early development of spatial representations, suggesting that memory representations for the geometry of walked paths likely develop early during navigation, in support of the parallel hypothesis.

Evidence of Impaired Remote Experience-near Semantic Memory in Medial Temporal Lobe Amnesia.

Neuropsychological research suggests that "experience-near" semantic memory, meaning knowledge attached to a spatiotemporal or event context, is commonly impaired in individuals who have medial temporal lobe amnesia. It is not known if this impairment extends to remotely acquired experience-near knowledge, which is a question relevant to understanding hippocampal/medial temporal lobe functioning. In the present study, we administered a novel semantic memory task designed to target knowledge associated with remote, "dormant" concepts, in addition to knowledge associated with active concepts, to four individuals with medial temporal lobe amnesia and eight matched controls. We found that the individuals with medial temporal lobe amnesia generated significantly fewer experience-near semantic memories for both remote concepts and active concepts. In comparison, the generation of abstract or "experience-far" knowledge was largely spared in the individuals with medial temporal lobe amnesia, regardless of whether the targets for retrieval were remote or active concepts. We interpret these findings as evidence that the medial temporal lobes may have a sustained role in the retrieval of semantic memories associated with spatiotemporal and event contexts, which are cognitive features often ascribed to episodic memory. These results align with recent theoretical models proposing that the hippocampus/medial temporal lobes support cognitive processes that are involved in, but not exclusive to, episodic memory.

Hippocampal contributions to novel spatial learning are both age-related and age-invariant.

Older adults show declines in spatial memory, although the extent of these alterations is not uniform across the healthy older population. Here, we investigate the stability of neural representations for the same and different spatial environments in a sample of younger and older adults using high-resolution functional magnetic resonance imaging (fMRI) of the medial temporal lobe. Older adults showed, on average, lower neural pattern similarity for retrieving the same environment and more variable neural patterns compared to young adults. We also found a positive association between spatial distance discrimination and the distinctiveness of neural patterns between environments. Our analyses suggested that one source for this association was the extent of informational connectivity to CA1 from other subfields, which was dependent on age, while another source was the fidelity of signals within CA1 itself, which was independent of age. Together, our findings suggest both age-dependent and independent neural contributions to spatial memory performance.

Memory-related processing is the primary driver of human hippocampal theta oscillations.

Decades of work in rodents suggest that movement is a powerful driver of hippocampal low-frequency "theta" oscillations. Puzzlingly, such movement-related theta increases in primates are less sustained and of lower frequency, leading to questions about their functional relevance. Verbal memory encoding and retrieval lead to robust increases in low-frequency oscillations in humans, and one possibility is that memory might be a stronger driver of hippocampal theta oscillations in humans than navigation. Here, neurosurgical patients navigated routes and then immediately mentally simulated the same routes while undergoing intracranial recordings. We found that mentally simulating the same route that was just navigated elicited oscillations that were of greater power, higher frequency, and longer duration than those involving navigation. Our findings suggest that memory is a more potent driver of human hippocampal theta oscillations than navigation, supporting models of internally generated theta oscillations in the human hippocampus.

Frontal-midline theta and posterior alpha oscillations index early processing of spatial representations during active navigation.

Previous research has demonstrated that humans combine multiple sources of spatial information such as self-motion and landmark cues, while navigating through an environment. However, it is unclear whether this involves comparing multiple representations obtained from different sources during navigation (parallel hypothesis) or building a representation first based on self-motion cues and then combining with landmarks later (serial hypothesis). We tested these two hypotheses (parallel vs. serial) in an active navigation task using wireless mobile scalp EEG recordings. Participants walked through an immersive virtual hallway with or without conflicts between self-motion and landmarks (i.e., intersections) and pointed toward the starting position of the hallway. We employed the oscillatory signals recorded during mobile wireless scalp EEG as means of identifying when participant representations based on self-motion vs. landmark cues might have first emerged. We found that path segments, including intersections present early during navigation, were more strongly associated with later pointing error, regardless of when they appeared during encoding. We also found that there was sufficient information contained within the frontal-midline theta and posterior alpha oscillatory signals in the earliest segments of navigation involving intersections to decode condition (i.e., conflicting vs. not conflicting). Together, these findings suggest that intersections play a pivotal role in the early development of spatial representations, suggesting that memory representations for the geometry of walked paths likely develop early during navigation, in support of the parallel hypothesis.

Understanding the encoding of object locations in small-scale spaces during free exploration using eye tracking.

Navigation is instrumental to daily life and is often used to encode and locate objects, such as keys in one's house. Yet, little is known about how navigation works in more ecologically valid situations such as finding objects within a room. Specifically, it is not clear how vision vs. body movements contribute differentially to spatial memory in such small-scale spaces. In the current study, participants encoded object locations by viewing them while standing (stationary condition) or by additionally being guided by the experimenter while blindfolded (walking condition) after viewing the objects. They then retrieved the objects from the same or different viewpoint, creating a 2 × 2 within subject design. We simultaneously recorded participant eye movements throughout the experiment using mobile eye tracking. The results showed no statistically significant differences among our four conditions (stationary, same viewpoint as encoding; stationary, different viewpoint; walking, same viewpoint; walking, different viewpoint), suggesting that in a small real-world space, vision may be sufficient to remember object locations. Eye tracking analyses revealed that object locations were better remembered next to landmarks and that participants encoded items on one wall together, suggesting the use of local wall coordinates rather than global room coordinates. A multivariate regression analysis revealed that the only significant predictor of object placement accuracy was average looking time. These results suggest that vision may be sufficient for encoding object locations in a small-scale environment and that such memories may be formed largely locally rather than globally.

Spatial navigation and memory: A review of the similarities and differences relevant to brain models and age.

Spatial navigation and memory are often seen as heavily intertwined at the cognitive and neural levels of analysis. We review models that hypothesize a central role for the medial temporal lobes, including the hippocampus, in both navigation and aspects of memory, particularly allocentric navigation and episodic memory. While these models have explanatory power in instances in which they overlap, they are limited in explaining functional and neuroanatomical differences. Focusing on human cognition, we explore the idea of navigation as a dynamically acquired skill and memory as an internally driven process, which may better account for the differences between the two. We also review network models of navigation and memory, which place a greater emphasis on connections rather than the functions of focal brain regions. These models, in turn, may have greater explanatory power for the differences between navigation and memory and the differing effects of brain lesions and age.

Machine learning classifiers for electrode selection in the design of closed-loop neuromodulation devices for episodic memory improvement.

Successful neuromodulation approaches to alter episodic memory require closed-loop stimulation predicated on the effective classification of brain states. The practical implementation of such strategies requires prior decisions regarding electrode implantation locations. Using a data-driven approach, we employ support vector machine (SVM) classifiers to identify high-yield brain targets on a large data set of 75 human intracranial electroencephalogram subjects performing the free recall (FR) task. Further, we address whether the conserved brain regions provide effective classification in an alternate (associative) memory paradigm along with FR, as well as testing unsupervised classification methods that may be a useful adjunct to clinical device implementation. Finally, we use random forest models to classify functional brain states, differentiating encoding versus retrieval versus non-memory behavior such as rest and mathematical processing. We then test how regions that exhibit good classification for the likelihood of recall success in the SVM models overlap with regions that differentiate functional brain states in the random forest models. Finally, we lay out how these data may be used in the design of neuromodulation devices.

Age differences in spatial memory are mitigated during naturalistic navigation.

Spatial navigation deficits in older adults are well documented. These findings are often based on experimental paradigms that require using a joystick or keyboard to navigate a virtual desktop environment. In the present study, we investigated whether age differences in spatial memory are attenuated when tested in a more naturalistic and ambulatory virtual environment. In Experiment 1, cognitively normal young and older adults navigated a virtual variant of the Morris Water Maze task in each of two virtual reality (VR) conditions: a desktop VR condition which required using a mouse and keyboard to navigate and an immersive and ambulatory VR condition which permitted unrestricted locomotion. In Experiment 2, we examined whether age- and VR-related differences in spatial performance were affected by the inclusion of additional spatial cues in an independent sample of young and older adults. In both experiments, older adults navigated to target locations less precisely than did younger individuals in the desktop condition, replicating numerous prior studies. These age differences were significantly attenuated, however, when tested in the fully immersive and ambulatory environment. These findings underscore the importance of developing naturalistic and ecologically valid measures of spatial memory and navigation, especially when performing cross-sectional studies of cognitive aging.

Spatial memory distortions for the shapes of walked paths occur in violation of physically experienced geometry.

An important question regards the nature of our spatial memories for the paths that we have walked and, in particular, whether such distortions might violate the topological properties of the shape of the paths (i.e., creating an intersection when two paths did not intersect or vice versa). To investigate whether and how this might occur, we tested humans in situations in which they walked simple paths and idiothetic and visual cues either matched or mismatched, with the mismatching cues creating the greatest potential for topological distortions. Participants walked four-segment paths with 90° turns in immersive virtual reality and pointed to their start location when they arrived at the end of the path. In paths with a crossing, when the intersection was not presented, participants pointed to a novel start location suggesting a topological distortion involving non-crossed paths. In paths without a crossing, when a false intersection was presented, participants pointed to a novel start location suggesting a topological distortion involving crossed paths. In paths without crossings and without false intersections, participants showed reduced pointing errors that typically did not involve topological distortions. Distortions more generally, as indicated by pointing errors to the start location, were significantly reduced for walked paths involving primarily idiothetic cues with limited visual cues; conversely, distortions were significantly increased when idiothetic cues were diminished and navigation relied primarily on visual cues. Our findings suggest that our spatial memories for walked paths sometimes involve topological distortions, particularly when resolving the competition between idiothetic and visual cues.

Combining egoformative and alloformative cues in a novel tabletop navigation task.

Previous work has shown how different interfaces (i.e., route navigation, maps, or a combination of the two) influence spatial knowledge and recollection. To test for the existence of intermediate representations along an egocentric-to-allocentric continuum, we developed a novel task, tabletop navigation, to provide a mixture of cues that inform the emergence of egocentric and allocentric representations or strategies. In this novel tabletop task, participants navigated a remote-controlled avatar through a tabletop scale model of the virtual city. Participants learned virtual cities from either navigating routes, studying maps, or our new tabletop navigation task. We interleaved these learning tasks with either an in situ pointing task (the scene- and orientation-dependent pointing [SOP] task) or imagined judgements of relative direction (JRD) pointing. In Experiment 1, performance on each memory task was similar across learning tasks and performance on the route and map learning tasks correlated with more precise spatial recall on both the JRD and SOP tasks. Tabletop learning performance correlated with SOP performance only, suggesting a reliance on egocentric strategies, although increased utilization of the affordances of the tabletop task were related to JRD performance. In Experiment 2, using a modified criterion map learning task, participants who learned using maps provided more precise responses on the JRD compared to route or tabletop learning. Together, these findings provide mixed evidence for both optimization and egocentric predominance after learning from the novel tabletop navigation task.

Classification of EEG signals: An interpretable approach using functional data analysis.

Electroencephalography (EEG) is a noninvasive method to record electrical activity of the brain. The EEG data is continuous flow of voltages, in this paper, we consider them as functional data, and propose a three-stage algorithm based on functional data analysis, with the advantage of interpretability. Specifically, the time and frequency information are extracted by wavelet transform in the first stage. Then, functional testing is utilized to select EEG channels and frequencies that show significant differences for different human behaviors. In the third stage, we propose to use penalized multiple functional logistic regression to interpretably classify human behaviors. With simulation and a scalp EEG data as validation set, we show that the proposed three-stage algorithm provides an interpretable classification of the scalp EEG signals.

Largely intact memory for spatial locations during navigation in an individual with dense amnesia.

Spatial navigation and event memory (termed episodic memory) are thought to be heavily intertwined, both in terms of their cognitive processes and underlying neural systems. Some theoretical models posit that both memory for places during navigation and episodic memory depend on highly overlapping brain systems. Here, we assessed this relationship by testing navigation in an individual with severe retrograde and anterograde amnesia; the amnesia stemmed from bilateral lesions in the medial temporal lobes from two separate strokes. The individual with amnesia and age-matched controls were tested on their memories for the locations of previously seen objects relative to distal mountain cues in an immersive virtual environment involving free ambulation. All participants were tested from both repeated and novel start locations and when a single distal mountain cue was unknowingly moved to determine if they relied on a single (beacon) cue to a greater extent than the collection of all distal cues. Compared to age-matched controls, the individual with amnesia showed no significant deficits in navigation from either the repeated or novel start points, although both the individual with amnesia and controls performed well above chance at placing objects near their correct locations. The individual with amnesia also relied on a combination of distal cues in a manner comparable to age-matched controls. Despite largely intact memory for locations using distal cues, the individual with amnesia walked longer paths, rotated more, and took longer to complete trials. Our findings suggest that memory for places during navigation and episodic memory may involve partially dissociable brain circuits and that other brain regions outside of the medial temporal lobe partially support some aspects of navigation. At the same time, the fact that the individual with amnesia walked more circuitous paths and had dense amnesia for autobiographic events supports the idea that the hippocampus may be important for binding information as part of a larger role in memory.

Combination and competition between path integration and landmark navigation in the estimation of heading direction.

Successful navigation requires the ability to compute one's location and heading from incoming multisensory information. Previous work has shown that this multisensory input comes in two forms: body-based idiothetic cues, from one's own rotations and translations, and visual allothetic cues, from the environment (usually visual landmarks). However, exactly how these two streams of information are integrated is unclear, with some models suggesting the body-based idiothetic and visual allothetic cues are combined, while others suggest they compete. In this paper we investigated the integration of body-based idiothetic and visual allothetic cues in the computation of heading using virtual reality. In our experiment, participants performed a series of body turns of up to 360 degrees in the dark with only a brief flash (300ms) of visual feedback en route. Because the environment was virtual, we had full control over the visual feedback and were able to vary the offset between this feedback and the true heading angle. By measuring the effect of the feedback offset on the angle participants turned, we were able to determine the extent to which they incorporated visual feedback as a function of the offset error. By further modeling this behavior we were able to quantify the computations people used. While there were considerable individual differences in performance on our task, with some participants mostly ignoring the visual feedback and others relying on it almost entirely, our modeling results suggest that almost all participants used the same strategy in which idiothetic and allothetic cues are combined when the mismatch between them is small, but compete when the mismatch is large. These findings suggest that participants update their estimate of heading using a hybrid strategy that mixes the combination and competition of cues.