Activated long-term memory and visual working memory during hybrid visual search: Effects on target memory search and distractor memory.

In hybrid visual search, observers must maintain multiple target templates and subsequently search for any one of those targets. If the number of potential target templates exceeds visual working memory (VWM) capacity, then the target templates are assumed to be maintained in activated long-term memory (aLTM). Observers must search the array for potential targets (visual search), as well as search through memory (target memory search). Increasing the target memory set size reduces accuracy, increases search response times (RT), and increases dwell time on distractors. However, the extent of observers' memory for distractors during hybrid search is largely unknown. In the current study, the impact of hybrid search on target memory search (measured by dwell time on distractors, false alarms, and misses) and distractor memory (measured by distractor revisits and recognition memory of recently viewed distractors) was measured. Specifically, we aimed to better understand how changes in behavior during hybrid search impacts distractor memory. Increased target memory set size led to an increase in search RTs, distractor dwell times, false alarms, and target identification misses. Increasing target memory set size increased revisits to distractors, suggesting impaired distractor location memory, but had no effect on a two-alternative forced-choice (2AFC) distractor recognition memory test presented during the search trial. The results from the current study suggest a lack of interference between memory stores maintaining target template representations (aLTM) and distractor information (VWM). Loading aLTM with more target templates does not impact VWM for distracting information.

Differences in the duration of the attentional blink when viewing nature vs. urban scenes.

The current study examined how viewing nature vs. urban scenes impacts the duration of the attentional blink. Nature scenes produce a broader allocation of attention, allowing attention to spread and reduce the ability to disengage attention. Urban scenes produce a narrowed allocation of attention, allowing efficient encoding of relevant information, inhibition of irrelevant information and a speedier disengagement of attention. Participants viewed a rapid serial visual presentation (RSVP) of either nature or urban scenes. For both scene categories, an attentional blink was evident by reduced accuracy for reporting a second target that occurred two or three scenes after an accurately reported first target. However, the duration of the attentional blink was reduced for urban scenes compared with nature scenes. A peripheral target detection task confirmed a difference in the allocation of attention between scene categories. The peripheral targets were better detected for nature scenes, suggesting that participants have a broader spread of attention for nature scenes, even in an RSVP task. The shorter duration of the attentional blink for urban scenes was consistent across four experiments with small and large sets of urban and nature scenes. Therefore, urban scenes reliably reduce the attentional blink duration compared with nature scenes, and this could be attributed to a narrowed attention allocation that allows speedier disengagement of attention in an RSVP.

Loss aversion in the control of attention.

Loss aversion is a psychological bias where an increase in loss is perceived as being larger than an equivalent increase in gain. In the present study, two experiments were conducted to explore whether attentional control reflects loss aversion. Participants performed a visual search task. On each trial, a red target and a green target were presented simultaneously, and participants were free to search for either one. Participants always gained points when they searched for a gain color target (e.g., red). However, they gained or lost points when they searched for a gain-loss color target (e.g., green). In Experiment 1, the expected values of the gain color and the gain-loss color were equal. Therefore, for maximizing the reward, participants did not need to preferably search for a particular color. However, results showed that participants searched for the gain color target more than the gain-loss color target, suggesting stronger attentional control for the gain color than the gain-loss color. In Experiment 2, even though the expected value of the gain-loss color was greater than that of the gain color, attention was allocated to the gain color more than to the gain-loss color. The results imply that attentional control can operate in accordance with the loss aversion principle when the boundary conditions for loss aversion in a repeated binary decision-making task were met.

Behavioral and electrophysiological evidence for the flexible recruitment of feature- and object-based processing in visual working memory comparison.

Previous research is inconclusive on when visual working memory (VWM) can be object-based or feature-based. Prior event-related potential (ERP) studies using change detection tasks have found that amplitudes of the N200-an ERP index of VWM comparison- are sensitive to changes in both relevant and irrelevant features, suggesting a bias toward object-based processing. To test whether VWM comparison processing can operate in a feature-based manner, we aimed to create circumstances that would support feature-based processing by: 1) using a strong task-relevance manipulation, and 2) repeating features within a display. Participants completed two blocks of a change detection task for four-item displays in which they were told to respond to color changes (task relevant) but not shape changes (task irrelevant). The first block contained only task-relevant changes to create a strong task-relevance manipulation. In the second block, both relevant and irrelevant changes were present. In both blocks, half of the arrays contained within-display feature repetitions (e.g. two items of the same color or shape). We found that during the second block, N200 amplitudes were sensitive to task-relevant but not irrelevant features regardless of repetition status, consistent with feature-based processing. However, analyses of behavioral data and N200 latencies suggested that object-based processing was occurring at some stages of VWM processing on task-irrelevant feature change trials. In particular, task-irrelevant changes may be processed after no task-relevant feature change is revealed. Overall, the results from the current study suggest that the VWM processing is flexible and can be either object- or feature-based.

Diminishing sensitivity and absolute difference in value-driven attention.

Kim and Beck (2020b) demonstrated that value-driven attention is based on relative value rather than absolute value, suggesting that prospect theory is relevant to our understanding of value-driven attention. To further this understanding, the present study investigated the impacts of diminishing sensitivity on value-driven attention. According to diminishing sensitivity, changes in outcomes have greater impacts nearer the reference point of 0 than farther from the point. Thus, the difference between $1 and $100 looms larger than that between $901 and $1000, due to their different ratios (100/1 > 1000/901). However, according to the absolute difference hypothesis, the differences should have similar impacts due to the absolute differences being the same (100 - 1 = 1000 - 901). Experiment 1 investigated whether diminishing sensitivity operates in the modified value-driven attention paradigm while controlling the impact of absolute differences. In the training phase, 100-point and 1000-point color targets had references of 1-point and 901-point color targets, respectively. In the test phase, 100-point color distractors attracted attention more than 1000-point color distractors, supporting the diminishing sensitivity hypothesis. Experiment 2 examined the absolute difference hypothesis while controlling the impact of diminishing sensitivity. Contrary to the absolute difference hypothesis, the test phase showed that 1000-point color distractors (compared with 10-point colors for a 990 absolute difference in the training phase) failed to attract attention more than 100-point color distractors (compared with 1-point colors, for a 99 absolute difference). These results suggest that diminishing sensitivity rather than absolute difference influences value-driven attention, further supporting the relevance of prospect theory to value-driven attention.

Non-spatial context-driven search.

Contexts that predict characteristics of search targets can guide attention by triggering attentional control settings for the characteristics. However, this context-driven search has most commonly been found in the spatial dimension. The present study explored the context-driven search when shape contexts predict the color of targets: non-spatial context-driven search. It has been demonstrated that context-driven search requires cognitive resources, and evidence of non-spatial context-driven search is found when there is an increase in cognitive resources for the shape/color associations. Thus, the scarcity of evidence for non-spatial context-driven search is potentially because the context-driven search requires more cognitive resources for shape/color associations than for spatial/spatial associations. In the current study, we violated a previously 100% consistent shape/color association with two mismatch trials to encourage allocation of cognitive resources to the shape/color association. Three experiments showed that the shape-predicted color cues captured attention more than the non-predicted color cues, indicating that shape contexts triggered attentional control settings for a color predicted by the contexts. Furthermore, the shape contexts guided attention to the predicted color only after the two mismatch trials, suggesting that expression of the non-spatial context-driven search may require cognitive resources more than the spatial context-driven search.

Strengthening spatial reasoning: elucidating the attentional and neural mechanisms associated with mental rotation skill development.

Spatial reasoning is a critical skill in many everyday tasks and in science, technology, engineering, and mathematics disciplines. The current study examined how training on mental rotation (a spatial reasoning task) impacts the completeness of an encoded representation and the ability to rotate the representation. We used a multisession, multimethod design with an active control group to determine how mental rotation ability impacts performance for a trained stimulus category and an untrained stimulus category. Participants in the experimental group (n = 18) showed greater improvement than the active control group (n = 18) on the mental rotation tasks. The number of saccades between objects decreased and saccade amplitude increased after training, suggesting that participants in the experimental group encoded more of the object and possibly had more complete mental representations after training. Functional magnetic resonance imaging data revealed distinct neural activation associated with mental rotation, notably in the right motor cortex and right lateral occipital cortex. These brain areas are often associated with rotation and encoding complete representations, respectively. Furthermore, logistic regression revealed that activation in these brain regions during the post-training scan significantly predicted training group assignment. Overall, the current study suggests that effective mental rotation training protocols should aim to improve the encoding and manipulation of mental representations.

Impact of relative and absolute values on selective attention.

Valuable stimuli receive attentional priority. However, it is unknown whether the mechanism of the attentional priority is based on relative (e.g., higher) or absolute (e.g., 45 points) values. Therefore, we manipulated the relative and absolute values independently in a modified value-driven attentional capture paradigm. In the training phase, where associative learning occurs between color and reward value, two test target colors were each presented with another different target color (reference target colors) in separate context blocks. Therefore, each test target color had different reference points. In the test phase, the two test target colors were used as singleton distractor colors. In the training phase of Experiment 1, the absolute reward value of the test target colors was the same, but one had a higher value than its reference target color and the other had a lower value. In the test phase, the high relative value color distractor captured attention more, suggesting that the relative value of stimuli influenced selective attention. In Experiment 2 the relative value of the test target colors was the same, but the absolute value was higher for one. The high and low absolute value color distractors captured attention equally in the test phase, indicating little impact of the absolute value on selective attention. These findings suggest that the relative value, rather than absolute value, plays a critical role in the allocation of attention. Accordingly, the present study suggests that prospect theory (Kahneman & Tversky, Econometrica, 47 (2), 363-391, 1979) can be extended to earlier cognitive stages such as selective attention.

Not all information in visual working memory is forgotten equally.

To improve maintenance of task-relevant information in visual working memory (VWM), previously encoded, but no longer relevant, information can be suppressed or forgotten. However, it is unclear whether a cue directing attention to a subset of stimuli leads to complete forgetting for non-cued stimuli. The current study utilized a novel method of testing to-be forgotten information to determine if the effectiveness of forgetting differs depending on the type of encoded stimuli. Participants performed a directed forgetting change detection task, and importantly, the changed stimulus could be a novel stimulus or a to-be-forgotten stimulus. Stimulus type (colors, objects, or shapes) was manipulated across two experiments. Results suggest that a cue benefits memory for to-be-remembered information, but performance is not equivalent to never encoding to-be-forgotten information. Furthermore, the type of encoded information impacts the extent of forgetting.

Visual search with varying versus consistent attentional templates: Effects on target template establishment, comparison, and guidance.

Attentional templates can be represented in visual working memory (VWM) when the target varies from trial-to-trial and can be represented in long-term memory (LTM) when the target is consistent during trial runs. Given that attentional templates can be represented in either VWM or LTM, are there any differences in how these representations impact visual search when targets are consistent compared with varying? The current study tested the consistent template hypothesis, which predicts faster performance with a consistent target compared with a varying target. Experiment 1 examined whether consistent targets could lead to consistent templates that would improve template establishment, guidance, and/or comparison of the template to search items. Search response time was faster for consistent targets, and consistent targets produced faster comparison processes, but not more efficient guidance. Experiment 2 examined the consistent template restoration hypothesis, which predicts faster template establishment and comparison processes for a previously encountered consistent target. Experiment 2 replicated the consistent template hypothesis and supported the consistent template restoration hypothesis. These studies demonstrate that although attentional guidance is similar with varying and consistent attentional templates, consistent templates improve search performance by speeding template establishment and comparison processes. (PsycINFO Database Record

Attending globally or locally: Incidental learning of optimal visual attention allocation.

Attention allocation determines the information that is encoded into memory. Can participants learn to optimally allocate attention based on what types of information are most likely to change? The current study examined whether participants could incidentally learn that changes to either high spatial frequency (HSF) or low spatial frequency (LSF) Gabor patches were more probable and to use this incidentally learned probability information to bias attention during encoding. Participants detected changes in orientation in arrays of 6 Gabor patches: 3 HSF and 3 LSF. For half of the participants, an HSF patch changed orientation on 75% of the trials, and for the other half, an LSF patch changed orientation on 75% of the trials. Experiment 1 demonstrated a change probability effect and an attention allocation effect. Specifically, change detection performance was highest for the probable-change type, and participants learned to use a global spread of attention (fixating between Gabor patches) when LSF patches were most likely to change and to use a local allocation of attention (fixating directly on Gabor patches) when HSF patches were most likely to change. Experiments 2 and 3 replicated these effects and demonstrated that an internal monitoring system is sufficient for these effects. That is, the effects do not require explicit feedback or point rewards. This study demonstrates that incidental learning of probability information can affect the allocation of attention during encoding and can therefore affect what information is stored in visual working memory. (PsycINFO Database Record

Inattentional blindness: A combination of a relational set and a feature inhibition set?

Two experiments were conducted to directly test the feature set hypothesis and the relational set hypothesis in an inattentional blindness task. The feature set hypothesis predicts that unexpected objects that match the to-be-attended stimuli will be reported most. The relational set hypothesis predicts that unexpected objects that match the relationship between the to-be-attended and the to-be-ignored stimuli will be reported the most. Experiment 1 manipulated the luminance of the stimuli. Participants were instructed to monitor the gray letter shapes and to ignore either black or white letter shapes. The unexpected objects that exhibited the luminance relation of the to-be-attended to the to-be-ignored stimuli were reported by participants the most. Experiment 2 manipulated the color of the stimuli. Participants were instructed to monitor the yellower orange or the redder orange letter shapes and to ignore the redder orange or yellower letter shapes. The unexpected objects that exhibited the color relation of the to-be-attended to the to-be-ignored stimuli were reported the most. The results do not support the use of a feature set to accomplish the task and instead support the use of a relational set. In addition, the results point to the concurrent use of multiple attentional sets that are both excitatory and inhibitory.

Binding global and local object features in visual working memory.

When briefly presented with global and local visual information, individuals report global information more quickly and more accurately than local information, a phenomenon known as the global precedence effect (GPE; Navon, 1977). We investigated whether a bias toward global information persists in visual working memory (VWM) and whether the VWM representations for global and local features include information bound to their hierarchical levels and to each other. Navon figures, in which a larger (global) letter is composed of smaller (local) letters, were presented, and participants performed a change detection task that required participants to remember features only (either a global or local letter changed to a new identity); features bound to their hierarchical levels (the global and local letters within an object swapped levels); or features bound to each other within an object (2 letters from the same level swapped between objects). Performance suggested that there was a GPE in VWM (new global letters were more accurately detected than new local letters) and that although global and local features were not necessarily bound together in VWM, they were bound to their corresponding hierarchical levels. These results indicate that level binding in VWM occurs more readily than binding specific object features together. These findings further our understanding of how hierarchical objects are represented in VWM.

Visual working memory organization is subject to top-down control.

The limited capacity of visual working memory (VWM) can be maximized by combining multiple features into a single representation through grouping principles such as connection, proximity, and similarity. In this study, we sought to understand how VWM organizes information by investigating how connection and similarity cues are used either alone or in the presence of another grouping cue. Furthermore, we examined whether the use of one cue over another is within volitional control. Participants remembered displays of objects that contained no grouping cues, connection cues only, similarity cues only, or both connection and similarity cues. We found that it is possible to use either connection or similarity cues, although connection cues tend to dominate if the cues are in conflict with one another. However, it is possible to flexibly use either similarity or connection cues if both are present, depending on the task goals.

Incidental learning of probability information is differentially affected by the type of visual working memory representation.

In this study, we investigated whether the ability to learn probability information is affected by the type of representation held in visual working memory. Across 4 experiments, participants detected changes to displays of coloured shapes. While participants detected changes in 1 dimension (e.g., colour), a feature from a second, nonchanging dimension (e.g., shape) predicted which object was most likely to change. In Experiments 1 and 3, items could be grouped by similarity in the changing dimension across items (e.g., colours and shapes were repeated in the display), while in Experiments 2 and 4 items could not be grouped by similarity (all features were unique). Probability information from the predictive dimension was learned and used to increase performance, but only when all of the features within a display were unique (Experiments 2 and 4). When it was possible to group by feature similarity in the changing dimension (e.g., 2 blue objects appeared within an array), participants were unable to learn probability information and use it to improve performance (Experiments 1 and 3). The results suggest that probability information can be learned in a dimension that is not explicitly task-relevant, but only when the probability information is represented with the changing dimension in visual working memory.

Retrieval from long-term memory reduces working memory representations for visual features and their bindings.

The ability to remember feature bindings is an important measure of the ability to maintain objects in working memory (WM). In this study, we investigated whether both object- and feature-based representations are maintained in WM. Specifically, we tested the hypotheses that retaining a greater number of feature representations (i.e., both as individual features and bound representations) results in a more robust representation of individual features than of feature bindings, and that retrieving information from long-term memory (LTM) into WM would cause a greater disruption to feature bindings. In four experiments, we examined the effects of retrieving a word from LTM on shape and color-shape binding change detection performance. We found that binding changes were more difficult to detect than individual-feature changes overall, but that the cost of retrieving a word from LTM was the same for both individual-feature and binding changes.

The effects of incidentally learned temporal and spatial predictability on response times and visual fixations during target detection and discrimination.

Responses are quicker to predictable stimuli than if the time and place of appearance is uncertain. Studies that manipulate target predictability often involve overt cues to speed up response times. However, less is known about whether individuals will exhibit faster response times when target predictability is embedded within the inter-trial relationships. The current research examined the combined effects of spatial and temporal target predictability on reaction time (RT) and allocation of overt attention in a sustained attention task. Participants responded as quickly as possible to stimuli while their RT and eye movements were measured. Target temporal and spatial predictability were manipulated by altering the number of: 1) different time intervals between a response and the next target; and 2) possible spatial locations of the target. The effects of target predictability on target detection (Experiment 1) and target discrimination (Experiment 2) were tested. For both experiments, shorter RTs as target predictability increased across both space and time were found. In addition, the influences of spatial and temporal target predictability on RT and the overt allocation of attention were task dependent; suggesting that effective orienting of attention relies on both spatial and temporal predictability. These results indicate that stimulus predictability can be increased without overt cues and detected purely through inter-trial relationships over the course of repeated stimulus presentations.

Eyes-on training and radiological expertise: an examination of expertise development and its effects on visual working memory.

OBJECTIVE: Our aim was to examine the specificity of the effects of acquiring expertise on visual working memory (VWM) and the degree to which higher levels of experience within the domain of expertise are associated with more efficient use of VWM. BACKGROUND: Previous research is inconsistent on whether expertise effects are specific to the area of expertise or generalize to other tasks that also involve the same cognitive processes. It is also unclear whether more training and/or experience will lead to continued improvement on domain-relevant tasks or whether a plateau could be reached. METHOD: In Experiment I, veterinary medicine students completed a one-shot visual change detection task. In Experiment 2, veterinarians completed a flicker change detection task. Both experiments involved stimuli specific to the domain of radiology and general stimuli. RESULTS: In Experiment I, veterinary medicine students who had completed an "eyes-on" radiological training demonstrated a domain-specific effect in which performance was better on the domain-specific stimuli than on the domain-general stimuli. In Experiment 2, veterinarians again showed a domain-specific effect, but performance was unrelated to the amount of experience veterinarians had accumulated. CONCLUSION: The effect of experience is domain specific and occurs during the first few years of training, after which a plateau is reached. APPLICATION: VWM training in one domain may not lead to improved performance on other VWM tasks. In acquiring expertise, eyes-on training is important initially, but continued experience may not be associated with further improvements in the efficiency of VWM.

Changing target trajectories influences tracking performance.

People have the ability to attentively select and successfully track several moving objects, a process known as multiple-object tracking (MOT; Pylyshyn & Storm Spatial Vision 3: 179-197, 1988). Various factors have been known to influence MOT performance, such as speed, number of distractors, and proximity, while recent work has suggested that object trajectories may also be a factor (Fencsik, Kleiger, & Horowitz Perception and Psychophysics 69: 567-577, 2007). Meanwhile, unexpected changes in motion information have been demonstrated to be a critical facet for attracting attention Howard & Holcombe Attention, Perception & Psychophysics 72: 2087-2095, (2010). Therefore, we suggest that unexpected changes in target trajectories are an important factor in tracking performance. The research presented here controlled for spatial proximity while manipulating the number of instances in which an object changed trajectory. We found that spatial proximity had no effect on tracking performance but, rather, as the number of trajectory changes increased, tracking performance suffered. Results imply that the ability to track multiple moving objects is limited by unexpected changes in direction.

The change probability effect: incidental learning, adaptability, and shared visual working memory resources.

Statistical properties in the visual environment can be used to improve performance on visual working memory (VWM) tasks. The current study examined the ability to incidentally learn that a change is more likely to occur to a particular feature dimension (shape, color, or location) and use this information to improve change detection performance for that dimension (the change probability effect). Participants completed a change detection task in which one change type was more probable than others. Change probability effects were found for color and shape changes, but not location changes, and intentional strategies did not improve the effect. Furthermore, the change probability effect developed and adapted to new probability information quickly. Finally, in some conditions, an improvement in change detection performance for a probable change led to an impairment in change detection for improbable changes.