Eye Movement Reinstatement and Neural Reactivation During Mental Imagery.

Half a century ago, Donald Hebb posited that mental imagery is a constructive process that emulates perception. Specifically, Hebb claimed that visual imagery results from the reactivation of neural activity associated with viewing images. He also argued that neural reactivation and imagery benefit from the re-enactment of eye movement patterns that first occurred at viewing (fixation reinstatement). To investigate these claims, we applied multivariate pattern analyses to functional MRI (fMRI) and eye tracking data collected while healthy human participants repeatedly viewed and visualized complex images. We observed that the specificity of neural reactivation correlated positively with vivid imagery and with memory for stimulus image details. Moreover, neural reactivation correlated positively with fixation reinstatement, meaning that image-specific eye movements accompanied image-specific patterns of brain activity during visualization. These findings support the conception of mental imagery as a simulation of perception, and provide evidence consistent with the supportive role of eye movement in neural reactivation.

Portable eyetracking-based assessment of memory decline.

INTRODUCTION: Preferential viewing of novel stimuli in the Visual Paired Comparison task has provided a useful marker of memory and medial temporal lobe function. We created a portable version of the VPC (P-VPC) and contrasted P-VPC metrics against the Montreal Cognitive Assessment (MoCA) in healthy adults, to assess the validity and reliability of the P-VPC as an indicator of memory function across age. A supplementary case series was conducted with individuals diagnosed with Alzheimer's disease (AD) and other dementias, to provide a preliminary illustration of the P-VPC's use as a measure in clinical populations. METHOD: Participants (n = 207) were tested using the P-VPC. Individuals were familiarized with a set of objects, which were each presented alongside a novel object in the test phase. Novelty viewing scores were compared to MoCA scores to index concurrent validity. Item analyses were conducted as a test of internal reliability of the P-VPC. A complementary clinical case series was conducted with AD (n = 4) and dementia (n = 5) participants, who were tested using the P-VPC and further compared to healthy age-matched participants. RESULTS: Preferential viewing decreased with age in healthy participants, and was positively correlated with MoCA scores. Compared to the MoCA, P-VPC scores did not differ based on education and/or whether English was spoken as the native language. Item analyses revealed acceptable internal consistency. P-VPC viewing percentiles of healthy participants were modeled as a function of age, and illustrated that individuals of the clinical case series diagnosed with AD scored in below-average percentiles, while those with dementia did not score below-average. CONCLUSION: Good concurrent validity and acceptable internal reliability were observed, and P-VPC scores were not confounded by education or language experience. Low performance was observed in individuals with clinically diagnosed AD, suggesting that the P-VPC may be a potential tool for screening memory decline.

Anterolateral Entorhinal Cortex Volume Predicted by Altered Intra-Item Configural Processing.

Recent functional imaging studies have proposed that the human entorhinal cortex (ERC) is subdivided into functionally distinct anterolateral (alERC) and posteromedial (pmERC) subregions. The alERC overlaps with regions that are affected earliest by Alzheimer's disease pathology, yet its cognitive function remains poorly understood. Previous human fMRI studies have focused on its role in object memory, but rodent studies on the putatively homologous lateral entorhinal cortex suggest that it also plays an important role in representing spatial properties of objects. To investigate the cognitive effects of human alERC volume differences, we developed an eye-tracking-based task to evaluate intra-item configural processing (i.e., processing the arrangement of an object's features) and used manual segmentation based on a recently developed protocol to delineate the alERC/pmERC and other medial temporal lobe (MTL) subregions. In a group of older adult men and women at varying stages of brain atrophy and cognitive decline, we found that intra-item configural processing, regardless of an object's novelty, was strongly predicted by alERC volume, but not by the volume of any other MTL subregion. These results provide the first evidence that the human alERC plays a role in supporting a distinct aspect of object processing, namely attending to the arrangement of an object's component features.SIGNIFICANCE STATEMENT Alzheimer's disease pathology appears earliest in brain regions that overlap with the anterolateral entorhinal cortex (alERC). However, the cognitive role of the alERC is poorly understood. Previous human studies treat the alERC as an extension of the neighboring perirhinal cortex, supporting object memory. Animal studies suggest that the alERC may support the spatial properties of objects. In a group of older adult humans at the earliest stages of cognitive decline, we show here that alERC volume selectively predicted configural processing (attention to the spatial arrangement of an object's parts). This is the first study to demonstrate a cognitive role related to alERC volume in humans. This task can be adapted to serve as an early detection method for Alzheimer's disease pathology.

Perceptual salience does not influence emotional arousal's impairing effects on top-down attention.

Emotional arousal impairs top-down attentional control while strengthening bottom-up attentional biases. In this study, we examined whether top-down impairments due to arousal can be modulated by increasing the perceptual salience of the target stimulus. To examine this question, we briefly displayed positive and negative arousing images prior to the encoding of 2 emotionally neutral items, 1 of which was to be remembered and 1 of which was perceptually salient (the to-be-remembered and the salient items were either the same item or different items). Eye tracking was used to measure attention biases during the encoding of the 2 competing neutral items, as well as to measure pupillary responses to the preceding modulator image. Viewing emotional images, regardless of valence, impaired top-down attention to animate stimulus targets (i.e., animals), regardless of perceptual salience. However, these effects on encoding had no influence on recognition memory. Taken together, these findings reveal that exposure to emotionally arousing images impairs top-down attention to animate stimuli, regardless of whether that stimulus is perceptually salient. (PsycINFO Database Record

Age-related changes to oscillatory dynamics in hippocampal and neocortical networks.

Recent models of hippocampal function have emphasized its role in relational binding - the ability to form lasting representations regarding the relations among distinct elements or items which can support memory performance, even over brief delays (e.g., several seconds). The present study examined the extent to which aging is associated with changes in the recruitment of oscillatory activity within hippocampal and neocortical regions to support relational binding performance on a short delay visuospatial memory task. Structural magnetic resonance imaging and MEG were used to characterize potential age-related changes in hippocampal volume, oscillatory activity, and subsequent memory performance, and the relationships among them. Participants were required to bind the relative visuospatial positions of objects that were presented singly across time. Subsequently, the objects were re-presented simultaneously, and participants were required to indicate whether the relative spatial positions among the objects had been maintained. Older and younger adults demonstrated similar task accuracy, and older adults had preserved hippocampal volumes relative to younger adults. Age-group differences were found in pre-stimulus theta (∼5Hz) and beta (∼20Hz) oscillations, and this pre-stimulus activity was related to hippocampal volumes in younger adults. Age-group differences were also found in the recruitment of oscillatory activity from the pre-stimulus period to the task. Only younger adults showed a task-related change in theta power that was predictive of memory performance. In contrast, older adults demonstrated task-related alpha (∼10Hz) oscillatory power changes that were not observed in younger adults. These findings provide novel evidence for the role of the hippocampus and functionally connected regions in relational binding that is disrupted in aging. The present findings are discussed in the context of current models regarding the cognitive neuroscience of aging.

Association with emotional information alters subsequent processing of neutral faces.

The processing of emotional as compared to neutral information is associated with different patterns in eye movement and neural activity. However, the 'emotionality' of a stimulus can be conveyed not only by its physical properties, but also by the information that is presented with it. There is very limited work examining the how emotional information may influence the immediate perceptual processing of otherwise neutral information. We examined how presenting an emotion label for a neutral face may influence subsequent processing by using eye movement monitoring (EMM) and magnetoencephalography (MEG) simultaneously. Participants viewed a series of faces with neutral expressions. Each face was followed by a unique negative or neutral sentence to describe that person, and then the same face was presented in isolation again. Viewing of faces paired with a negative sentence was associated with increased early viewing of the eye region and increased neural activity between 600 and 1200 ms in emotion processing regions such as the cingulate, medial prefrontal cortex, and amygdala, as well as posterior regions such as the precuneus and occipital cortex. Viewing of faces paired with a neutral sentence was associated with increased activity in the parahippocampal gyrus during the same time window. By monitoring behavior and neural activity within the same paradigm, these findings demonstrate that emotional information alters subsequent visual scanning and the neural systems that are presumably invoked to maintain a representation of the neutral information along with its emotional details.

The role of overt attention in emotion-modulated memory.

The presence of emotional stimuli results in a central/peripheral tradeoff effect in memory: memory for central details is enhanced at the cost of peripheral items. It has been assumed that emotion-modulated differences in memory are the result of differences in attention, but this has not been tested directly. The present experiment used eye movement monitoring as an index of overt attention allocation and mediation analysis to determine whether differences in attention were related to subsequent memory. Participants viewed negative and neutral scenes surrounded by three neutral objects and were then given a recognition memory test. The results revealed evidence in support of a central/peripheral tradeoff in both attention and memory. However, contrary with previous assumptions, whereas attention partially mediated emotion-enhanced memory for central pictures, it did not explain the entire relationship. Further, although centrally presented emotional stimuli led to decreased number of eye fixations toward the periphery, these differences in viewing did not contribute to emotion-impaired memory for specific details pertaining to the periphery. These findings suggest that the differential influence of negative emotion on central versus peripheral memory may result from other cognitive influences in addition to overt visual attention or on postencoding processes.

Eye movement monitoring of memory.

Explicit (often verbal) reports are typically used to investigate memory (e.g. "Tell me what you remember about the person you saw at the bank yesterday."), however such reports can often be unreliable or sensitive to response bias, and may be unobtainable in some participant populations. Furthermore, explicit reports only reveal when information has reached consciousness and cannot comment on when memories were accessed during processing, regardless of whether the information is subsequently accessed in a conscious manner. Eye movement monitoring (eye tracking) provides a tool by which memory can be probed without asking participants to comment on the contents of their memories, and access of such memories can be revealed on-line. Video-based eye trackers (either head-mounted or remote) use a system of cameras and infrared markers to examine the pupil and corneal reflection in each eye as the participant views a display monitor. For head-mounted eye trackers, infrared markers are also used to determine head position to allow for head movement and more precise localization of eye position. Here, we demonstrate the use of a head-mounted eye tracking system to investigate memory performance in neurologically-intact and neurologically-impaired adults. Eye movement monitoring procedures begin with the placement of the eye tracker on the participant, and setup of the head and eye cameras. Calibration and validation procedures are conducted to ensure accuracy of eye position recording. Real-time recordings of X,Y-coordinate positions on the display monitor are then converted and used to describe periods of time in which the eye is static (i.e. fixations) versus in motion (i.e., saccades). Fixations and saccades are time-locked with respect to the onset/offset of a visual display or another external event (e.g. button press). Experimental manipulations are constructed to examine how and when patterns of fixations and saccades are altered through different types of prior experience. The influence of memory is revealed in the extent to which scanning patterns to new images differ from scanning patterns to images that have been previously studied. Memory can also be interrogated for its specificity; for instance, eye movement patterns that differ between an identical and an altered version of a previously studied image reveal the storage of the altered detail in memory. These indices of memory can be compared across participant populations, thereby providing a powerful tool by which to examine the organization of memory in healthy individuals, and the specific changes that occur to memory with neurological insult or decline.

Eye movement monitoring reveals differential influences of emotion on memory.

Research shows that memory for emotional aspects of an event may be enhanced at the cost of impaired memory for surrounding peripheral details. However, this has only been assessed directly via verbal reports which reveal the outcome of a long stream of processing but cannot shed light on how/when emotion may affect the retrieval process. In the present experiment, eye movement monitoring (EMM) was used as an indirect measure of memory as it can reveal aspects of online memory processing. For example, do emotions modulate the nature of memory representations or the speed with which such memories can be accessed? Participants viewed central negative and neutral scenes surrounded by three neutral objects and after a brief delay, memory was assessed indirectly via EMM and then directly via verbal reports. Consistent with the previous literature, emotion enhanced central and impaired peripheral memory as indexed by eye movement scanning and verbal reports. This suggests that eye movement scanning may contribute and/or is related to conscious access of memory. However, the central/peripheral tradeoff effect was not observed in an early measure of eye movement behavior, i.e., participants were faster to orient to a critical region of change in the periphery irrespective of whether it was previously studied in a negative or neutral context. These findings demonstrate emotion's differential influences on different aspects of retrieval. In particular, emotion appears to affect the detail within, and/or the evaluation of, stored memory representations, but it may not affect the initial access to those representations.