Encoded and updated spatial working memories share a common representational format in alpha activity.

Working memory (WM) flexibly updates information to adapt to the dynamic environment. Here, we used alpha-band activity in the EEG to reconstruct the content of dynamic WM updates and compared this representational format to static WM content. An inverted encoding model using alpha activity precisely tracked both the initially encoded position and the updated position following an auditory cue signaling mental updating. The timing of the update, as tracked in the EEG, correlated with reaction times and saccade latency. Finally, cross-training analyses revealed a robust generalization of alpha-band reconstruction of WM contents before and after updating. These findings demonstrate that alpha activity tracks the dynamic updates to spatial WM and that the format of this activity is preserved across the encoded and updated representations. Thus, our results highlight a new approach for measuring updates to WM and show common representational formats during dynamic mental updating and static storage.

Shared Representational Formats for Information Maintained in Working Memory and Information Retrieved from Long-Term Memory.

Current theories propose that the short-term retention of information in working memory (WM) and the recall of information from long-term memory (LTM) are supported by overlapping neural mechanisms in occipital and parietal cortex. However, the extent of the shared representations between WM and LTM is unclear. We designed a spatial memory task that allowed us to directly compare the representations of remembered spatial information in WM and LTM with carefully matched behavioral response precision between tasks. Using multivariate pattern analyses on functional magnetic resonance imaging data, we show that visual memories were represented in a sensory-like code in both memory tasks across retinotopic regions in occipital and parietal cortex. Regions in lateral parietal cortex also encoded remembered locations in both tasks, but in a format that differed from sensory-evoked activity. These results suggest a striking correspondence in the format of representations maintained in WM and retrieved from LTM across occipital and parietal cortex. On the other hand, we also show that activity patterns in nearly all parietal regions, but not occipital regions, contained information that could discriminate between WM and LTM trials. Our data provide new evidence for theories of memory systems and the representation of mnemonic content.

Alpha suppression indexes a spotlight of visual-spatial attention that can shine on both perceptual and memory representations.

Although researchers have been recording the human electroencephalogram (EEG) for almost a century, we still do not completely understand what cognitive processes are measured by the activity of different frequency bands. The 8- to 12-Hz activity in the alpha band has long been a focus of this research, but our understanding of its links to cognitive mechanisms has been rapidly evolving recently. Here, we review and discuss the existing evidence for two competing perspectives about alpha activity. One view proposes that the suppression of alpha-band power following the onset of a stimulus array measures attentional selection. The competing view is that this same activity measures the buffering of the task-relevant representations in working memory. We conclude that alpha-band activity following the presentation of stimuli appears to be due to the operation of an attentional selection mechanism, with characteristics that mirror the classic views of attention as selecting both perceptual inputs and representations already stored in memory.

α-Band activity tracks a two-dimensional spotlight of attention during spatial working memory maintenance.

Covert spatial attention is thought to facilitate the maintenance of locations in working memory, and EEG α-band activity (8-12 Hz) is proposed to track the focus of covert attention. Recent work has shown that multivariate patterns of α-band activity track the polar angle of remembered locations relative to fixation. However, a defining feature of covert spatial attention is that it facilitates processing in a specific region of the visual field, and prior work has not determined whether patterns of α-band activity track the two-dimensional (2-D) coordinates of remembered stimuli within a visual hemifield or are instead maximally sensitive to the polar angle of remembered locations around fixation. Here, we used a lateralized spatial estimation task, in which observers remembered the location of one or two target dots presented to one side of fixation, to test this question. By applying a linear discriminant classifier to the topography of α-band activity, we found that we were able to decode the location of remembered stimuli. Critically, model comparison revealed that the pattern of classifier choices observed across remembered positions was best explained by a model assuming that α-band activity tracks the 2-D coordinates of remembered locations rather than a model assuming that α-band activity tracks the polar angle of remembered locations relative to fixation. These results support the hypothesis that this α-band activity is involved in the spotlight of attention, and arises from mid- to lower-level visual areas involved in maintaining spatial locations in working memory.NEW & NOTEWORTHY A substantial body of work has shown that patterns of EEG α-band activity track the angular coordinates of attended and remembered stimuli around fixation, but whether these patterns track the two-dimensional coordinates of stimuli presented within a visual hemifield remains an open question. Here, we demonstrate that α-band activity tracks the two-dimensional coordinates of remembered stimuli within a hemifield, showing that α-band activity reflects a spotlight of attention focused on locations maintained in working memory.

Decoding chromaticity and luminance from patterns of EEG activity.

A long-standing question in the field of vision research is whether scalp-recorded EEG activity contains sufficient information to identify stimulus chromaticity. Recent multivariate work suggests that it is possible to decode which chromaticity an observer is viewing from the multielectrode pattern of EEG activity. There is debate, however, about whether the claimed effects of stimulus chromaticity on visual evoked potentials (VEPs) are instead caused by unequal stimulus luminances, which are achromatic differences. Here, we tested whether stimulus chromaticity could be decoded when potential confounds with luminance were minimized by (1) equating chromatic stimuli in luminance using heterochromatic flicker photometry for each observer and (2) independently varying the chromaticity and luminance of target stimuli, enabling us to test whether the pattern for a given chromaticity generalized across wide variations in luminance. We also tested whether luminance variations can be decoded from the topography of voltage across the scalp. In Experiment 1, we presented two chromaticities (appearing red and green) at three luminance levels during separate trials. In Experiment 2, we presented four chromaticities (appearing red, orange, yellow, and green) at two luminance levels. Using a pattern classifier and the multielectrode pattern of EEG activity, we were able to accurately decode the chromaticity and luminance level of each stimulus. Furthermore, we were able to decode stimulus chromaticity when we trained the classifier on chromaticities presented at one luminance level and tested at a different luminance level. Thus, EEG topography contains robust information regarding stimulus chromaticity, despite large variations in stimulus luminance.

Alpha-band oscillations track the retrieval of precise spatial representations from long-term memory.

A hallmark of episodic memory is the phenomenon of mentally reexperiencing the details of past events, and a well-established concept is that the neuronal activity that mediates encoding is reinstated at retrieval. Evidence for reinstatement has come from multiple modalities, including functional magnetic resonance imaging and electroencephalography (EEG). These EEG studies have shed light on the time course of reinstatement but have been limited to distinguishing between a few categories. The goal of this work was to use recently developed experimental and technical approaches, namely continuous report tasks and inverted encoding models, to determine which frequencies of oscillatory brain activity support the retrieval of precise spatial memories. In experiment 1, we establish that an inverted encoding model applied to multivariate alpha topography tracks the retrieval of precise spatial memories. In experiment 2, we demonstrate that the frequencies and patterns of multivariate activity at study are similar to the frequencies and patterns observed during retrieval. These findings highlight the broad potential for using encoding models to characterize long-term memory retrieval.NEW & NOTEWORTHY Previous EEG work has shown that category-level information observed during encoding is recapitulated during memory retrieval, but studies with this time-resolved method have not demonstrated the reinstatement of feature-specific patterns of neural activity during retrieval. Here we show that EEG alpha-band activity tracks the retrieval of spatial representations from long-term memory. Moreover, we find considerable overlap between the frequencies and patterns of activity that track spatial memories during initial study and at retrieval.

Item-specific delay activity demonstrates concurrent storage of multiple active neural representations in working memory.

Persistent neural activity that encodes online mental representations plays a central role in working memory (WM). However, there has been debate regarding the number of items that can be concurrently represented in this active neural state, which is often called the "focus of attention." Some models propose a strict single-item limit, such that just 1 item can be neurally active at once while other items are relegated to an activity-silent state. Although past studies have decoded multiple items stored in WM, these studies cannot rule out a switching account in which only a single item is actively represented at a time. Here, we directly tested whether multiple representations can be held concurrently in an active state. We tracked spatial representations in WM using alpha-band (8-12 Hz) activity, which encodes spatial positions held in WM. Human observers remembered 1 or 2 positions over a short delay while we recorded electroencephalography (EEG) data. Using a spatial encoding model, we reconstructed active stimulus-specific representations (channel-tuning functions [CTFs]) from the scalp distribution of alpha-band power. Consistent with past work, we found that the selectivity of spatial CTFs was lower when 2 items were stored than when 1 item was stored. Critically, data-driven simulations revealed that the selectivity of spatial representations in the two-item condition could not be explained by models that propose that only a single item can exist in an active state at once. Thus, our findings demonstrate that multiple items can be concurrently represented in an active neural state.

Spatially Selective Alpha Oscillations Reveal Moment-by-Moment Trade-offs between Working Memory and Attention.

Current theories assume a functional role for covert attention in the maintenance of spatial information in working memory. Consistent with this view, both the locus of attention and positions stored in working memory can be decoded based on the topography of oscillatory alpha-band (8-12 Hz) activity on the scalp. Thus far, however, alpha modulation has been studied in isolation for covert attention and working memory tasks. Here, we applied an inverted spatial encoding model in combination with EEG to study the temporal dynamics of spatially specific alpha activity during a task that required observers to visually select a target location while maintaining another independently varying location in working memory. During the memory delay period, alpha-based spatial tuning functions shifted from the position stored in working memory to the covertly attended position and back again after the attention task was completed. The findings provide further evidence for a common oscillatory mechanism in both the selection and the maintenance of relevant spatial visual information and demonstrate the dynamic trade-off in prioritization between two spatial tasks.

Alpha-Band Oscillations Enable Spatially and Temporally Resolved Tracking of Covert Spatial Attention.

Covert spatial attention is essential for humans' ability to direct limited processing resources to the relevant aspects of visual scenes. A growing body of evidence suggests that rhythmic neural activity in the alpha frequency band (8-12 Hz) tracks the spatial locus of covert attention, which suggests that alpha activity is integral to spatial attention. However, extant work has not provided a compelling test of another key prediction: that alpha activity tracks the temporal dynamics of covert spatial orienting. In the current study, we examined the time course of spatially specific alpha activity after central cues and during visual search. Critically, the time course of this activity tracked trial-by-trial variations in orienting latency during visual search. These findings provide important new evidence for the link between rhythmic brain activity and covert spatial attention, and they highlight a powerful approach for tracking the spatial and temporal dynamics of this core cognitive process.

The role of long-term memory in a test of visual working memory: Proactive facilitation but no proactive interference.

We report 4 experiments examining whether associations in visual working memory are subject to proactive interference from long-term memory (LTM). Following a long-term learning phase in which participants learned the colors of 120 unique objects, a working memory (WM) test was administered in which participants recalled the precise colors of 3 concrete objects in an array. Each array in the WM test consisted of 1 old (previously learned) object with a new color (old-mismatch), 1 old object with its old color (old-match), and 1 new object. Experiments 1 to 3 showed that WM performance was better in the old-match condition than in the new condition, reflecting a beneficial contribution from LTM. In the old-mismatch condition, participants sometimes reported colors associated with the relevant shape in LTM, but the probability of successful recall was equivalent to that in the new condition. Thus, information from LTM only intruded in the absence of reportable information in WM. Experiment 4 tested for, and failed to find, proactive interference from the preceding trial in the WM test: Performance in the old-mismatch condition, presenting an object from the preceding trial with a new color, was equal to performance with new objects. Experiment 5 showed that long-term memory for object-color associations is subject to proactive interference. We conclude that the exchange of information between LTM and WM appears to be controlled by a gating mechanism that protects the contents of WM from proactive interference but admits LTM information when it is useful. (PsycINFO Database Record

Comparing the Effects of 10-Hz Repetitive TMS on Tasks of Visual STM and Attention.

Numerous studies have demonstrated that visual STM (VSTM) and attention are tightly linked processes that share a number of neuroanatomical substrates. Here, we used repetitive TMS (rTMS) along with simultaneous EEG to examine the causal relationship between intraparietal sulcus functioning and performance on tasks of attention and VSTM. Participants performed two tasks in which they were required to attend to or remember colored items over a brief interval, with 10-Hz rTMS applied on some of the trials. Although no overall behavioral changes were observed across either task, rTMS did affect individual performance on both the attention and VSTM tasks in a manner that was predicted by individual differences in baseline performance. Furthermore, rTMS also affected ongoing oscillations in the alpha and beta bands, and these changes were related to the observed change in behavioral performance. The results reveal a causal relationship between intraparietal sulcus activity and tasks measuring both visual attention and VSTM.

Feature-Selective Attentional Modulations in Human Frontoparietal Cortex.

UNLABELLED: Control over visual selection has long been framed in terms of a dichotomy between "source" and "site," where top-down feedback signals originating in frontoparietal cortical areas modulate or bias sensory processing in posterior visual areas. This distinction is motivated in part by observations that frontoparietal cortical areas encode task-level variables (e.g., what stimulus is currently relevant or what motor outputs are appropriate), while posterior sensory areas encode continuous or analog feature representations. Here, we present evidence that challenges this distinction. We used fMRI, a roving searchlight analysis, and an inverted encoding model to examine representations of an elementary feature property (orientation) across the entire human cortical sheet while participants attended either the orientation or luminance of a peripheral grating. Orientation-selective representations were present in a multitude of visual, parietal, and prefrontal cortical areas, including portions of the medial occipital cortex, the lateral parietal cortex, and the superior precentral sulcus (thought to contain the human homolog of the macaque frontal eye fields). Additionally, representations in many-but not all-of these regions were stronger when participants were instructed to attend orientation relative to luminance. Collectively, these findings challenge models that posit a strict segregation between sources and sites of attentional control on the basis of representational properties by demonstrating that simple feature values are encoded by cortical regions throughout the visual processing hierarchy, and that representations in many of these areas are modulated by attention. SIGNIFICANCE STATEMENT: Influential models of visual attention posit a distinction between top-down control and bottom-up sensory processing networks. These models are motivated in part by demonstrations showing that frontoparietal cortical areas associated with top-down control represent abstract or categorical stimulus information, while visual areas encode parametric feature information. Here, we show that multivariate activity in human visual, parietal, and frontal cortical areas encode representations of a simple feature property (orientation). Moreover, representations in several (though not all) of these areas were modulated by feature-based attention in a similar fashion. These results provide an important challenge to models that posit dissociable top-down control and sensory processing networks on the basis of representational properties.

Retrieval practice enhances the accessibility but not the quality of memory.

Numerous studies have demonstrated that retrieval from long-term memory (LTM) can enhance subsequent memory performance, a phenomenon labeled the retrieval practice effect. However, the almost exclusive reliance on categorical stimuli in this literature leaves open a basic question about the nature of this improvement in memory performance. It has not yet been determined whether retrieval practice improves the probability of successful memory retrieval or the quality of the retrieved representation. To answer this question, we conducted three experiments using a mixture modeling approach (Zhang & Luck, 2008) that provides a measure of both the probability of recall and the quality of the recalled memories. Subjects attempted to memorize the color of 400 unique shapes. After every 10 images were presented, subjects either recalled the last 10 colors (the retrieval practice condition) by clicking on a color wheel with each shape as a retrieval cue or they participated in a control condition that involved no further presentations (Experiment 1) or restudy of the 10 shape/color associations (Experiments 2 and 3). Performance in a subsequent delayed recall test revealed a robust retrieval practice effect. Subjects recalled a significantly higher proportion of items that they had previously retrieved relative to items that were untested or that they had restudied. Interestingly, retrieval practice did not elicit any improvement in the precision of the retrieved memories. The same empirical pattern also was observed following delays of greater than 24 hours. Thus, retrieval practice increases the probability of successful memory retrieval but does not improve memory quality.

The topography of alpha-band activity tracks the content of spatial working memory.

Working memory (WM) is a system for the online storage of information. An emerging view is that neuronal oscillations coordinate the cellular assemblies that code the content of WM. In line with this view, previous work has demonstrated that oscillatory activity in the alpha band (8-12 Hz) plays a role in WM maintenance, but the exact contributions of this activity have remained unclear. Here, we used an inverted spatial encoding model in combination with electroencephalography (EEG) to test whether the topographic distribution of alpha-band activity tracks spatial representations held in WM. Participants in three experiments performed spatial WM tasks that required them to remember the precise angular location of a sample stimulus for 1,000-1,750 ms. Across all three experiments, we found that the topographic distribution of alpha-band activity tracked the specific location that was held in WM. Evoked (i.e., activity phase-locked to stimulus onset) and total (i.e., activity regardless of phase) power across a range of low-frequency bands transiently tracked the location of the sample stimulus following stimulus onset. However, only total power in the alpha band tracked the content of spatial WM throughout the memory delay period, which enabled reconstruction of location-selective channel tuning functions (CTFs). These findings demonstrate that alpha-band activity is directly related to the coding of spatial representations held in WM and provide a promising method for tracking the content of this online memory system.

Strengthened effective connectivity underlies transfer of working memory training to tests of short-term memory and attention.

Although long considered a natively endowed and fixed trait, working memory (WM) ability has recently been shown to improve with intensive training. What remains controversial and poorly understood, however, are the neural bases of these training effects and the extent to which WM training gains transfer to other cognitive tasks. Here we present evidence from human electrophysiology (EEG) and simultaneous transcranial magnetic stimulation and EEG that the transfer of WM training to other cognitive tasks is supported by changes in task-related effective connectivity in frontoparietal and parieto-occipital networks that are engaged by both the trained and transfer tasks. One consequence of this effect is greater efficiency of stimulus processing, as evidenced by changes in EEG indices of individual differences in short-term memory capacity and in visual search performance. Transfer to search-related activity provides evidence that something more fundamental than task-specific strategy or stimulus-specific representations has been learned. Furthermore, these patterns of training and transfer highlight the role of common neural systems in determining individual differences in aspects of visuospatial cognition.

The positional-specificity effect reveals a passive-trace contribution to visual short-term memory.

The positional-specificity effect refers to enhanced performance in visual short-term memory (VSTM) when the recognition probe is presented at the same location as had been the sample, even though location is irrelevant to the match/nonmatch decision. We investigated the mechanisms underlying this effect with behavioral and fMRI studies of object change-detection performance. To test whether the positional-specificity effect is a direct consequence of active storage in VSTM, we varied memory load, reasoning that it should be observed for all objects presented in a sub-span array of items. The results, however, indicated that although robust with a memory load of 1, the positional-specificity effect was restricted to the second of two sequentially presented sample stimuli in a load-of-2 experiment. An additional behavioral experiment showed that this disruption wasn't due to the increased load per se, because actively processing a second object--in the absence of a storage requirement--also eliminated the effect. These behavioral findings suggest that, during tests of object memory, position-related information is not actively stored in VSTM, but may be retained in a passive tag that marks the most recent site of selection. The fMRI data were consistent with this interpretation, failing to find location-specific bias in sustained delay-period activity, but revealing an enhanced response to recognition probes that matched the location of that trial's sample stimulus.

Increased Alpha-Band Power during the Retention of Shapes and Shape-Location Associations in Visual Short-Term Memory.

Studies exploring the role of neural oscillations in cognition have revealed sustained increases in alpha-band (~8-14 Hz) power during the delay period of delayed-recognition short-term memory tasks. These increases have been proposed to reflect the inhibition, for example, of cortical areas representing task-irrelevant information, or of potentially interfering representations from previous trials. Another possibility, however, is that elevated delay-period alpha-band power (DPABP) reflects the selection and maintenance of information, rather than, or in addition to, the inhibition of task-irrelevant information. In the present study, we explored these possibilities using a delayed-recognition paradigm in which the presence and task relevance of shape information was systematically manipulated across trial blocks and electroencephalographic was used to measure alpha-band power. In the first trial block, participants remembered locations marked by identical black circles. The second block featured the same instructions, but locations were marked by unique shapes. The third block featured the same stimulus presentation as the second, but with pretrial instructions indicating, on a trial-by-trial basis, whether memory for shape or location was required, the other dimension being irrelevant. In the final block, participants remembered the unique pairing of shape and location for each stimulus. Results revealed minimal DPABP in each of the location-memory conditions, whether locations were marked with identical circles or with unique task-irrelevant shapes. In contrast, alpha-band power increases were observed in both the shape-memory condition, in which location was task irrelevant, and in the critical final condition, in which both shape and location were task relevant. These results provide support for the proposal that alpha-band oscillations reflect the retention of shape information and/or shape-location associations in short-term memory.