Working memory flips the direction of serial bias through memory-based decision.

Reported perception of a new stimulus is either attracted toward or repelled away from task-irrelevant prior stimuli. While prevailing theories propose that the opposing serial biases may stem from distinct stages of information processing, the exact role of working memory (WM) in the serial bias remains unclear despite its consistent involvement in nearly all pertinent studies. Additionally, it is not well understood whether this bias is primarily driven by the biased representation itself or by the decision-making process for the new stimulus. In the present study, we used an orientation delayed estimation paradigm with an attention-demanding intervening task, designed to disrupt the maintenance of stimulus information to investigate the role of WM in serial bias. In the analysis, we scrutinized the trajectory of mouse reports and response time to investigate how the response unfolds over time. Our findings indicate that the serial bias went from repulsive to attractive when WM maintenance was interrupted by the intervening task, and that the associated response trajectories and response time exhibited patterns that cannot be explained by the biased representation alone. These results demonstrate that the task-irrelevant prior stimulus influences the decision for the new stimulus, with the direction of the bias being determined by attentional demand during WM maintenance, thereby placing significant constraints on existing theories on the serial bias effect.

EEG decoding reveals task-dependent recoding of sensory information in working memory.

Working memory (WM) supports future behavior by retaining perceptual information obtained in the recent past. The present study tested the hypothesis that WM recodes sensory information in a format that better supports behavioral goals. We recorded EEG while participants performed color delayed-estimation tasks where the colorwheel for the response was either randomly rotated or held fixed across trials. Accordingly, observers had to remember the exact colors in the Rotation condition, whereas they could prepare for a response based on the fixed mapping between the colors and their corresponding locations on the colorwheel in the No-Rotation condition. Results showed that the color reports were faster and more precise in the No-Rotation condition even when exactly the same set of colors were tested in both conditions. To investigate how the color information was maintained in the brain, we decoded the color using a multivariate EEG classification method. The decoding was limited to the stimulus encoding period in the Rotation condition, whereas it continued to be significant during the maintenance period in the No-Rotation condition, indicating that the color information was actively maintained in the condition. Follow-up analyses suggested that the prolonged decoding was not merely driven by the covert shift of attention but rather by the recoding of sensory information into an action-oriented response format. Together, these results provide converging evidence that WM flexibly recodes sensory information depending on the specific task context to optimize subsequent behavioral performance.

Cardinal bias interacts with the stimulus history bias in orientation working memory.

Reports in a visual working memory(WM) task exhibit biases related to the categorical structure of the stimulus space (e.g., cardinal bias) as well as biases related to previously seen stumuli (e.g., serial bias). While these biases are common and can occur simultaneously, the extent to which they interact in WM remains unknown. In the present study, I used orientation delayed estimation tasks known to produce both cardinal and serial biases and found that the serial bias systematically varied based on the relative positions of the cardinal axis and the preceding stimulus in orientation space. When they were positioned in a way that generated cardinal and serial biases in the same direction (i.e., on the same side of the target orientation), reports for the target orientation exhibited a regular repulsive serial bias. However, when their positions resulted in the biases in the opposite directions (i.e., on the opposite side of the target orientation), no serial bias occurred. This absence of serial bias was replicated in a follow-up experiment where the locations of the stimulus orientation and the response probe were completely randomized, suggesting that the interaction occurs independently from location-based response preparation processes. Together, these results demonstrate that the prior stimulus and the cardinal axis impose interactive impact on the processing of new stimulus, producing differential patterns of serial bias depending on the specific stimulus being processed. These findings place significant implications on computational models addressing the nature of the stimulus history effect and its underlying mechanisms.

Judgments during perceptual comparisons predict distinct forms of memory updating.

Comparing a visual memory with new visual stimuli can bias memory content, especially when the new stimuli are perceived as similar. Perceptual comparisons of this kind may play a mechanistic role in memory updating and can explain how memories can become erroneous in daily life. To test this possibility, we investigated whether comparisons can produce other types of memory distortion beyond memory bias that are commonly implicated in erroneous memories (e.g., memory misattribution). We hypothesized that the type of memory distortion induced during a comparison depends on the perceived overlap between the memory and incoming stimulus-when the input is perceived as similar, it biases memory content; when perceived as the same, it replaces memory content. Participants completed a delayed estimation task in which they compared their memories of color (Experiment 1) and shape stimuli (Experiment 2) to probe stimuli before reporting memory content. We found systematic errors in participants' memory reports following perceived similarity and sameness that were toward the probes and larger following perceived sameness. Simulations confirmed that these errors were not explained by noisy encoding processes that occurred before comparisons. Instead, computational modeling suggested that these errors were likely explained by the probabilistic replacement of the memory by the probe following perceived sameness and integration between the memory and the probe following perceived similarity. Together, these findings suggest that perceptual comparisons can prompt distinct forms of memory updating that have been described previously and may explain how memories become erroneous during their use in everyday behavior. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Image or Information? Examining the Nature and Impact of Visualization Perceptual Classification.

How do people internalize visualizations: as images or information? In this study, we investigate the nature of internalization for visualizations (i.e., how the mind encodes visualizations in memory) and how memory encoding affects its retrieval. This exploratory work examines the influence of various design elements on a user's perception of a chart. Specifically, which design elements lead to perceptions of visualization as an image (aims to provide visual references, evoke emotions, express creativity, and inspire philosophic thought) or as information (aims to present complex data, information, or ideas concisely and promote analytical thinking)? Understanding how design elements contribute to viewers perceiving a visualization more as an image or information will help designers decide which elements to include to achieve their communication goals. For this study, we annotated 500 visualizations and analyzed the responses of 250 online participants, who rated the visualizations on a bilinear scale as 'image' or 'information.' We then conducted an in-person study ( n = 101) using a free recall task to examine how the image/information ratings and design elements impacted memory. The results revealed several interesting findings: Image-rated visualizations were perceived as more aesthetically 'appealing,' 'enjoyable,' and 'pleasing.' Information-rated visualizations were perceived as less 'difficult to understand' and more aesthetically 'likable' and 'nice,' though participants expressed higher 'positive' sentiment when viewing image-rated visualizations and felt less 'guided to a conclusion.' The presence of axes and text annotations heavily influenced the likelihood of participants rating the visualization as 'information.' We also found different patterns among participants that were older. Importantly, we show that visualizations internalized as 'images' are less effective in conveying trends and messages, though they elicit a more positive emotional judgment, while 'informative' visualizations exhibit annotation focused recall and elicit a more positive design judgment. We discuss the implications of this dissociation between aesthetic pleasure and perceived ease of use in visualization design.

Qualitatively Different Delay-Dependent Working Memory Distortions in People With Schizophrenia and Healthy Control Participants.

BACKGROUND: Impairments in working memory (WM) have been well documented in people with schizophrenia (PSZ). However, these quantitative WM impairments can often be explained by nonspecific factors, such as impaired goal maintenance. Here, we used a spatial orientation delayed response task to explore a qualitative difference in WM dynamics between PSZ and healthy control participants (HCs). More specifically, we took advantage of the discovery that WM representations may drift either toward or away from previous trial targets (serial dependence). We tested the hypothesis that WM representations would drift toward the previous trial target in HCs but away from the previous trial target in PSZ. METHODS: We assessed serial dependence in PSZ (n = 31) and HCs (n = 25) using orientation as the to-be-remembered feature and memory delays lasting from 0 to 8 seconds. Participants were asked to remember the orientation of a teardrop-shaped object and reproduce the orientation after a delay period of varying length. RESULTS: Consistent with prior studies, we found that current trial memory representations were less precise in PSZ than in HCs. We also found that WM for the current trial orientation drifted toward the previous trial orientation in HCs (representational attraction) but drifted away from the previous trial orientation in PSZ (representational repulsion). CONCLUSIONS: These results demonstrate a qualitative difference in WM dynamics between PSZ and HCs that cannot be easily explained by nuisance factors such as reduced effort. Most computational neuroscience models also fail to explain these results because they maintain information solely by means of sustained neural firing, which does not extend across trials. The results suggest a fundamental difference between PSZ and HCs in longer-term memory mechanisms that persist across trials, such as short-term potentiation and neuronal adaptation.

Qualitatively different delay-dependent working memory distortions in people with schizophrenia and healthy control subjects.

Background: Impairments in working memory(WM) have been well-documented in people with schizophrenia(PSZ). However, these quantitative WM impairments can often be explained by nonspecific factors, such as impaired goal maintenance. Here, we used a spatial orientation delayed-response task to explore a qualitative difference in WM dynamics between PSZ and healthy control subjects(HCS). Specifically, we took advantage of the discovery that WM representations may drift either toward or away from previous-trial targets(serial dependence). We tested the hypothesis that WM representations drift toward the previous-trial target in HCS but away from the previous-trial target in PSZ. Methods: We assessed serial dependence in PSZ(N=31) and HCS(N=25), using orientation as the to-be-remembered feature and memory delays from 0 to 8s. Participants were asked to remember the orientation of a teardrop-shaped object and reproduce the orientation after a varying delay period. Results: Consistent with prior studies, we found that current-trial memory representations were less precise in PSZ than in HCS. We also found that WM for the current-trial orientation drifted toward the previous-trial orientation in HCS(representational attraction) but drifted away from the previous-trial orientation in PSZ(representational repulsion). Conclusions: These results demonstrate a qualitative difference in WM dynamics between PSZ and HCS that cannot easily be explained by nuisance factors such as reduced effort. Most computational neuroscience models also fail to explain these results, because they maintain information solely by means of sustained neural firing, which does not extend across trials. The results suggest a fundamental difference between PSZ and HCS in longer-term memory mechanisms that persist across trials, such as short-term potentiation and neuronal adaptation.

Perception of opposite-direction motion in random dot kinematograms.

Computational models of motion perception suggest that the perceived direction of weak motion signals may sometimes be directly opposite to the true stimulus motion direction. However, this possibility cannot be assessed by using standard 2AFC motion discrimination paradigms because two opposite directions of motion were used in most studies (e.g., leftward vs. rightward). We were able to obtain robust evidence of opposite-direction motion reports by using a random-dot-kinematogram (RDK) paradigm in which the motion direction varied over 360° and observers were asked to estimate the exact motion direction. These opposite-direction motion reports were replicable across multiple display types and feedback conditions, and observers had greater confidence in their opposite-direction responses than in true guess responses. When we fed RDKs into a computational model of motion processing, we found that the model estimated substantial motion activity in the direction opposite to the coherent stimulus direction, even though no such motion was objectively present in the stimuli, suggesting that the opposite-direction motion perception may be a consequence of the properties of motion-selective neurons in visual cortex. Together, these results demonstrate that the known properties of the visual system may lead to reports of motion that are directly opposite to the true direction.

Working Memory Content Is Distorted by Its Use in Perceptual Comparisons.

Visual information around us is rarely static. To perform a task in such a dynamic environment, we often have to compare current visual input with our working memory (WM) representation of the immediate past. However, little is known about what happens to a WM representation when it is compared with perceptual input. To test this, we asked young adults (N = 170 total in three experiments) to compare a new visual input with a WM representation prior to reporting the WM representation. We found that the perceptual comparison biased the WM report, especially when the input was subjectively similar to the WM representation. Furthermore, using computational modeling and individual-differences analyses, we found that this similarity-induced memory bias was driven by representational integration, rather than incidental confusion, between the WM representation and subjectively similar input. Together, our findings highlight a novel source of WM distortion and suggest a general mechanism that determines how WM interacts with new visual input.

Breaking the cardinal rule: The impact of interitem interaction and attentional priority on the cardinal biases in orientation working memory.

Although it is not typically assumed in influential models of visual working memory (WM), representations in WM are systematically biased by multiple factors. Orientation representations are biased away from the cardinal axis (i.e., cardinal bias) and they are biased away from or toward the other orientation simultaneously held in WM (i.e., interitem interaction). The present study investigated the extent to which these two bias mechanisms interact in WM. In Experiment 1, participants remembered two sequentially presented orientations and reproduced both orientations after a short delay. Cardinal biases were assessed separately for the trials where the two mechanisms produce biases in the same direction (i.e., congruent trials) and the trials where they produce biases in the opposite direction (i.e., incongruent trials). Whereas congruent trials exhibited a typical cardinal bias, incongruent trials exhibited no cardinal bias, demonstrating that the cardinal bias was canceled out by the interitem interaction. Follow-up experiments extended these results by manipulating attentional priority for the two orientations by means of precue (Experiment 2) and postcue (Experiment 3). In both experiments, attentionally prioritized items exhibited a typical cardinal bias irrespective of the congruency whereas attentionally unprioritized items exhibited a reversal of the cardinal bias in the incongruent trials, demonstrating that selective attention modulates the influence of the interitem interaction. Together, these results suggest that WM leverages information about specific stimuli and their relationship to support a given behavioral goal.