The aftermath of memory retrieval for recycling visual working memory representations.

We examined the aftermath of accessing and retrieving a subset of information stored in visual working memory (VWM)-namely, whether detection of a mismatch between memory and perception can impair the original memory of an item while triggering recognition-induced forgetting for the remaining, untested items. For this purpose, we devised a consecutive-change detection task wherein two successive testing probes were displayed after a single set of memory items. Across two experiments utilizing different memory-testing methods (whole vs. single probe), we observed a reliable pattern of poor performance in change detection for the second test when the first test had exhibited a color change. The impairment after a color change was evident even when the same memory item was repeatedly probed; this suggests that an attention-driven, salient visual change made it difficult to reinstate the previously remembered item. The second change detection, for memory items untested during the first change detection, was also found to be inaccurate, indicating that recognition-induced forgetting had occurred for the unprobed items in VWM. In a third experiment, we conducted a task that involved change detection plus continuous recall, wherein a memory recall task was presented after the change detection task. The analyses of the distributions of recall errors with a probabilistic mixture model revealed that the memory impairments from both visual changes and recognition-induced forgetting are explained better by the stochastic loss of memory items than by their degraded resolution. These results indicate that attention-driven visual change and recognition-induced forgetting jointly influence the "recycling" of VWM representations.

Dissociating models of visual working memory by reaction-time distribution analysis.

There have been heated debates on whether visual working memory (VWM) represents information in discrete-slots or a reservoir of flexible-resources. However, one key aspect of the models has gone unnoticed, the speed of processing when stored information in memory is assessed for accuracy. The present study evaluated contrasting predictions from the two models regarding the change detection decision times spent on the assessment of stored information by estimating the ex-Gaussian parameters from change detection RT distributions across different set sizes (2, 4, 6, or 8). The estimation showed that the Gaussian components µ and σ became larger as the set size increased from 2 to 4, but stayed constant as it reached 6 and 8, with an exponential component τ increasing at above-capacity set sizes. Moreover, we found that an individual's capacity limit correlates with the memory set size where the Gaussian µ reaches a plateau. These results indicate that the decision time for assessing in-memory items is constant regardless of memory set sizes whereas the time for the remaining not-in-memory items increases as the set size exceeds VWM storage capacity. The findings suggest that the discrete-slot model explains the observed RT distributions better than the flexible-resource model.

You may look unhappy unless you smile: the distinctiveness of a smiling face against faces without an explicit smile.

An expressionless face is often perceived as rude whereas a smiling face is considered as hospitable. Repetitive exposure to such perceptions may have developed stereotype of categorizing an expressionless face as expressing negative emotion. To test this idea, we displayed a search array where the target was an expressionless face and the distractors were either smiling or frowning faces. We manipulated set size. Search reaction times were delayed with frowning distractors. Delays became more evident as the set size increased. We also devised a short-term comparison task where participants compared two sequential sets of expressionless, smiling, and frowning faces. Detection of an expression change across the sets was highly inaccurate when the change was made between frowning and expressionless face. These results indicate that subjects were confused with expressed emotions on frowning and expressionless faces, suggesting that it is difficult to distinguish expressionless face from frowning faces.

The comparison of visual working memory representations with perceptual inputs.

The human visual system can notice differences between memories of previous visual inputs and perceptions of new visual inputs, but the comparison process that detects these differences has not been well characterized. In this study, the authors tested the hypothesis that differences between the memory of a stimulus array and the perception of a new array are detected in a manner that is analogous to the detection of simple features in visual search tasks. That is, just as the presence of a task-relevant feature in visual search can be detected in parallel, triggering a rapid shift of attention to the object containing the feature, the presence of a memory-percept difference along a task-relevant dimension can be detected in parallel, triggering a rapid shift of attention to the changed object. Supporting evidence was obtained in a series of experiments in which manual reaction times, saccadic reaction times, and event-related potential latencies were examined. However, these experiments also showed that a slow, limited-capacity process must occur before the observer can make a manual change detection response.

Early neural signatures of visual short-term memory.

Visual short-term memory (VSTM) relies on a distributed network including sensory-related, posterior regions of the brain and frontal areas associated with attention and cognitive control. To characterize the fine temporal details of processing within this network, we recorded event-related potentials (ERPs) while human subjects performed a recognition-memory task. The task's difficulty was graded by varying the perceptual similarity between the items held in memory and the probe used to access memory. The evaluation of VSTM's contents against a test stimulus produced clear similarity-dependent differences in ERPs as early as 156 ms after probe onset. Posterior recording sites were the first to reflect the difficulty of the analysis, preceding their frontal counterparts by about 50 ms. Our results suggest an initial feed-forward interaction underlying stimulus-memory comparisons, consistent with the idea that visual areas contribute to temporary storage of visual information for use in ongoing tasks. This study provides a first look into early neural activity underlying the processing of visual information in short-term memory.

The Role of Attention in the Binding of Surface Features to Locations.

Previous studies have proposed that attention is not necessary for detecting simple features but is necessary for binding them to spatial locations. The present study tested this hypothesis, using the N2pc component of the event-related potential waveform as a measure of the allocation of attention. A simple feature detection condition, in which observers reported whether a target color was present or not, was compared with feature-location binding conditions, in which observers reported the location of the target color. A larger N2pc component was observed in the binding conditions than in the detection condition, indicating that additional attentional resources are needed to bind a feature to a location than to detect the feature independently of its location. This finding supports theories of attention in which attention plays a special role in binding features.

Visual working memory as the substrate for mental rotation.

In mental rotation, a mental representation of an object must be rotated while the actual object remains visible. Where is this representation stored while it is being rotated? To answer this question, observers were asked to perform a mental rotation task during the delay interval of a visual working memory task. When the working memory task required the storage of object features, substantial bidirectional interference was observed between the memory and rotation tasks, and the interference increased with the degree of rotation. However, rotation-dependent interference was not observed when a spatial working memory task was used instead of an object working memory task. Thus, the object working memory subsystem--not the spatial working memory subsystem--provides the buffer in which object representations are stored while they undergo mental rotation. More broadly, the nature of the information being stored--not the nature of the operations performed on this information--may determine which subsystem stores the information.

The role of visual short-term memory in empty cell localization.

Three experiments examined the visual memory representation supporting performance at long interstimulus intervals (ISIs) in an empty cell localization task. Two arrays of dots within a 4 x 4 grid were displayed briefly in succession. One grid cell did not contain a dot in either array, and the task was to localize the empty cell. In Experiment 1, we replicated previous findings of recovery to high levels of performance at long ISIs. In Experiment 2, we tested whether figural grouping in visual short-term memory (VSTM) supports long-ISI performance by manipulating the complexity of the array pattern. Pattern complexity had no effect on empty cell localization at 0-msec ISI, suggesting dependence on high-capacity visible persistence, but there was a large simple pattern advantage at long ISIs, suggesting dependence on figural grouping in VSTM. Experiment 3 demonstrated that participants typically remember the empty cells of the first array, and not the dots, for comparison with Array 2.