Comparing exponential race and signal detection models of encoding stimuli into visual short-term memory.

The exponential race model embodied in the theory of visual attention (TVA) and the power law generalization of the sample size model (SSPL) provide competing accounts of the mechanisms that determine how exposure duration, set size, and attention influence how many items enter visual short-term memory (VSTM). In the exponential race model, items compete for entry into VSTM in a processing race with exponentially distributed processing times. The most recent version of the sample size model assumes that target sensitivity measured by d' increases monotonically as a function of exposure duration and decreases as a power function of set size. Here we compare the two models in a new experiment with letters and Gabor patches and with data from five previously published experiments. This was done by applying TVA to the two-alternative forced-choice method (2AFC), which forms the basis of the experimental work on the sample size model. Both models fitted individual participants' proportions of correct trials quite well, and overall the fits by the two models were almost indistinguishable. This was confirmed by formal pairwise comparison of TVA and SSPL by the Akaike information criterion and the Bayesian information criterion measures. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

A Poisson random walk model of response times.

Based on the simple what first comes to mind rule, the theory of visual attention (TVA; Bundesen, 1990) provides a comprehensive account of visual attention that has been successful in explaining performance in visual categorization for a variety of attention tasks. If the stimuli to be categorized are mutually confusable, a response rule based on the amount of evidence collected over a longer time seems more appropriate. In this paper, we extend the idea of a simple race to continuous sampling of evidence in favor of a certain response category. The resulting Poisson random walk model is a TVA-based response time model in which categories are reported based on the amount of evidence obtained. We demonstrate that the model provides an excellent account for response time distributions obtained in speeded visual categorization tasks. The model is mathematically tractable, and its parameters are well founded and easily interpretable. We also provide an extension of the Poisson random walk to any number of response alternatives. We tested the model in experiments with speeded and nonspeeded binary responses and a speeded response task with multiple report categories. The Poisson random walk model agreed very well with the data. A thorough investigation of processing rates revealed that the perceptual categorizations described by the Poisson random walk were the same as those obtained from TVA. The Poisson random walk model could therefore provide a unifying account of attention and response times. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Distinguishing between parallel and serial processing in visual attention from neurobiological data.

Serial and parallel processing in visual search have been long debated in psychology, but the processing mechanism remains an open issue. Serial processing allows only one object at a time to be processed, whereas parallel processing assumes that various objects are processed simultaneously. Here, we present novel neural models for the two types of processing mechanisms based on analysis of simultaneously recorded spike trains using electrophysiological data from prefrontal cortex of rhesus monkeys while processing task-relevant visual displays. We combine mathematical models describing neuronal attention and point process models for spike trains. The same model can explain both serial and parallel processing by adopting different parameter regimes. We present statistical methods to distinguish between serial and parallel processing based on both maximum likelihood estimates and decoding the momentary focus of attention when two stimuli are presented simultaneously. Results show that both processing mechanisms are in play for the simultaneously recorded neurons, but neurons tend to follow parallel processing in the beginning after the onset of the stimulus pair, whereas they tend to serial processing later on.

Visual attention in adults with attention-deficit/hyperactivity disorder before and after stimulant treatment.

BACKGROUND: Attention-deficit/hyperactivity disorder (ADHD) is a neurodevelopmental disorder which frequently persists into adulthood. The primary goal of the current study was to (a) investigate attentional functions of stimulant medication-naïve adults with ADHD, and (b) investigate the effects of 6 weeks of methylphenidate treatment on these functions. METHODS: The study was a prospective, non-randomized, non-blinded, 6-week follow-up design with 42 stimulant medication-naïve adult patients with ADHD, and 42 age and parental education-matched healthy controls. Assessments included measures of visual attention, based on Bundesen's Theory of Visual Attention (TVA), which yields five precise measures of aspects of visual attention; general psychopathology; ADHD symptoms; dyslexia screening; and estimates of IQ. RESULTS: At baseline, significant differences were found between patients and controls on three attentional parameters: visual short-term memory capacity, threshold of conscious perception, and to a lesser extent visual processing speed. Secondary analyses revealed no significant correlations between TVA parameter estimates and severity of ADHD symptomatology. At follow-up, significant improvements were found specifically for visual processing speed; this improvement had a large effect size, and remained when controlling for re-test effects, IQ, and dyslexia screen performance. There were no significant correlations between changes in visual processing speed and changes in ADHD symptomatology. CONCLUSIONS: ADHD in adults may be associated with deficits in three distinct aspects of visual attention. Improvements after 6 weeks of medication are seen specifically in visual processing speed, which could represent an improvement in alertness. Clinical symptoms and visual attentional deficits may represent separate aspects of ADHD in adults.

In defense of limited-processing-capacity models for encoding into visual short-term memory: Comment on Sewell, Lilburn, and Smith (2014).

Despite claims to the contrary, experimental results by Sewell, Lilburn, and Smith (2014) appear to be consistent with limited-processing-capacity models for encoding into visual short-term memory. (PsycINFO Database Record

A physiologically based nonhomogeneous Poisson counter model of visual identification.

A physiologically based nonhomogeneous Poisson counter model of visual identification is presented. The model was developed in the framework of a Theory of Visual Attention (Bundesen, 1990; Kyllingsbæk, Markussen, & Bundesen, 2012) and meant for modeling visual identification of objects that are mutually confusable and hard to see. The model assumes that the visual system's initial sensory response consists in tentative visual categorizations, which are accumulated by leaky integration of both transient and sustained components comparable with those found in spike density patterns of early sensory neurons. The sensory response (tentative categorizations) feeds independent Poisson counters, each of which accumulates tentative object categorizations of a particular type to guide overt identification performance. We tested the model's ability to predict the effect of stimulus duration on observed distributions of responses in a nonspeeded (pure accuracy) identification task with eight response alternatives. The time courses of correct and erroneous categorizations were well accounted for when the event-rates of competing Poisson counters were allowed to vary independently over time in a way that mimicked the dynamics of receptive field selectivity as found in neurophysiological studies. Furthermore, the initial sensory response yielded theoretical hazard rate functions that closely resembled empirically estimated ones. Finally, supplied with a Naka-Rushton type contrast gain control, the model provided an explanation for Bloch's law. (PsycINFO Database Record

Attentional weights in vision as products of spatial and nonspatial components.

The relationship between visual attentional selection of items in particular spatial locations and selection by nonspatial criteria was investigated in a partial report experiment with report of letters (as many as possible) from brief postmasked exposures of circular arrays of letters and digits. The data were fitted by mathematical models based on Bundesen's (Psychological Review, 97, 523-547, 1990) theory of visual attention (TVA). Both attentional weights of targets (letters) and attentional weights of distractors (digits) showed strong variations across the eight possible target locations, but for each of the ten participants, the ratio of the weight of a distractor at a given location to the weight of a target at the same location was approximately constant. The results were accommodated by revising the weight equation of TVA such that the attentional weight of an object equals a product of a spatial weight component (weight due to being at a particular location) and a nonspatial weight component (weight due to having particular features other than locations), the two components scaling the effects of each other multiplicatively.

The effect of phasic auditory alerting on visual perception.

Phasic alertness refers to a short-lived change in the preparatory state of the cognitive system following an alerting signal. In the present study, we examined the effect of phasic auditory alerting on distinct perceptual processes, unconfounded by motor components. We combined an alerting/no-alerting design with a pure accuracy-based single-letter recognition task. Computational modeling based on Bundesen's Theory of Visual Attention was used to examine the effect of phasic alertness on visual processing speed and threshold of conscious perception. Results show that phasic auditory alertness affects visual perception by increasing the visual processing speed and lowering the threshold of conscious perception (Experiment 1). By manipulating the intensity of the alerting cue, we further observed a positive relationship between alerting intensity and processing speed, which was not seen for the threshold of conscious perception (Experiment 2). This was replicated in a third experiment, in which pupil size was measured as a physiological marker of alertness. Results revealed that the increase in processing speed was accompanied by an increase in pupil size, substantiating the link between alertness and processing speed (Experiment 3). The implications of these results are discussed in relation to a newly developed mathematical model of the relationship between levels of alertness and the speed with which humans process visual information.

Behavioral and Brain Measures of Phasic Alerting Effects on Visual Attention.

In the present study, we investigated effects of phasic alerting on visual attention in a partial report task, in which half of the displays were preceded by an auditory warning cue. Based on the computational Theory of Visual Attention (TVA), we estimated parameters of spatial and non-spatial aspects of visual attention and measured event-related lateralizations (ERLs) over visual processing areas. We found that the TVA parameter sensory effectiveness a, which is thought to reflect visual processing capacity, significantly increased with phasic alerting. By contrast, the distribution of visual processing resources according to task relevance and spatial position, as quantified in parameters top-down control α and spatial bias windex, was not modulated by phasic alerting. On the electrophysiological level, the latencies of ERLs in response to the task displays were reduced following the warning cue. These results suggest that phasic alerting facilitates visual processing in a general, unselective manner and that this effect originates in early stages of visual information processing.

Out with the old? The role of selective attention in retaining targets in partial report.

In the partial-report task, subjects are asked to report only a portion of the items presented. Selective attention chooses which objects to represent in short-term memory (STM) on the basis of their relevance. Because STM is limited in capacity, one must sometimes choose which objects are removed from memory in light of new relevant information. We tested the hypothesis that the choices among newly presented information and old information in STM involve the same process-that both are acts of selective attention. We tested this hypothesis using a two-display partial-report procedure. In this procedure, subjects had to select and retain relevant letters (targets) from two sequentially presented displays. If selection in perception and retention in STM are the same process, then irrelevant letters (distractors) in the second display, which demanded attention because of their similarity to the targets, should have decreased target report from the first display. This effect was not obtained in any of four experiments. Thus, choosing objects to keep in STM is not the same process as choosing new objects to bring into STM.

Responses of Leaky Integrate-and-Fire Neurons to a Plurality of Stimuli in Their Receptive Fields.

A fundamental question concerning the way the visual world is represented in our brain is how a cortical cell responds when its classical receptive field contains a plurality of stimuli. Two opposing models have been proposed. In the response-averaging model, the neuron responds with a weighted average of all individual stimuli. By contrast, in the probability-mixing model, the cell responds to a plurality of stimuli as if only one of the stimuli were present. Here we apply the probability-mixing and the response-averaging model to leaky integrate-and-fire neurons, to describe neuronal behavior based on observed spike trains. We first estimate the parameters of either model using numerical methods, and then test which model is most likely to have generated the observed data. Results show that the parameters can be successfully estimated and the two models are distinguishable using model selection.

Neurons in Primate Visual Cortex Alternate between Responses to Multiple Stimuli in Their Receptive Field.

A fundamental question concerning representation of the visual world in our brain is how a cortical cell responds when presented with more than a single stimulus. We find supportive evidence that most cells presented with a pair of stimuli respond predominantly to one stimulus at a time, rather than a weighted average response. Traditionally, the firing rate is assumed to be a weighted average of the firing rates to the individual stimuli (response-averaging model) (Bundesen et al., 2005). Here, we also evaluate a probability-mixing model (Bundesen et al., 2005), where neurons temporally multiplex the responses to the individual stimuli. This provides a mechanism by which the representational identity of multiple stimuli in complex visual scenes can be maintained despite the large receptive fields in higher extrastriate visual cortex in primates. We compare the two models through analysis of data from single cells in the middle temporal visual area (MT) of rhesus monkeys when presented with two separate stimuli inside their receptive field with attention directed to one of the two stimuli or outside the receptive field. The spike trains were modeled by stochastic point processes, including memory effects of past spikes and attentional effects, and statistical model selection between the two models was performed by information theoretic measures as well as the predictive accuracy of the models. As an auxiliary measure, we also tested for uni- or multimodality in interspike interval distributions, and performed a correlation analysis of simultaneously recorded pairs of neurons, to evaluate population behavior.

Confusing confusability: on the problems of using psychophysical measures of letter confusability in neuropsychological research.

The effect of letter confusability on reading has received increasing attention over the last decade. Confusability scores for individual letters, derived from older psychophysical studies, have been used to calculate summed confusability scores for whole words, and effects of this variable on normal and alexic reading have been reported. On this basis, letter confusability is now increasingly controlled for in stimulus selection. In this commentary, we try to clarify what letter confusability scores represent and discuss several problems with the way this variable has been treated in neuropsychological research. We conclude that it is premature to control for this variable when selecting stimuli in studies of reading and alexia. Although letter confusability may play a role in (impaired) reading, it remains to be determined how this measure should be calculated, and what effect it may have on word and letter identification.

Repetition priming in selective attention: A TVA analysis.

Current behavior is influenced by events in the recent past. In visual attention, this is expressed in many variations of priming effects. Here, we investigate color priming in a brief exposure digit-recognition task. Observers performed a masked odd-one-out singleton recognition task where the target-color either repeated or changed between subsequent trials. Performance was measured by recognition accuracy over exposure durations. The purpose of the study was to replicate earlier findings of perceptual priming in brief displays and to model those results based on a Theory of Visual Attention (TVA; Bundesen, 1990). We tested 4 different definitions of a generic TVA-model and assessed their explanatory power. Our hypothesis was that priming effects could be explained by selective mechanisms, and that target-color repetitions would only affect the selectivity parameter (α) of our models. Repeating target colors enhanced performance for all 12 observers. As predicted, this was only true under conditions that required selection of a target among distractors, but not when a target was presented alone. Model fits by TVA were obtained with a trial-by-trial maximum likelihood estimation procedure that estimated 4-15 free parameters, depending on the particular model. We draw two main conclusions. Color priming can be modeled simply as a change in selectivity between conditions of repetition or swap of target color. Depending on the desired resolution of analysis; priming can accurately be modeled by a simple four parameter model, where VSTM capacity and spatial biases of attention are ignored, or more fine-grained by a 10 parameter model that takes these aspects into account.

Components of visual bias: a multiplicative hypothesis.

Attentional selection can be viewed as having two aspects: selection with respect to particular objects and selection with respect to particular categories. Both aspects are mathematically modeled in the theory of visual attention (TVA). In this paper, we expand the rate equation of the TVA and propose that the visual bias toward seeing an object x as a member of category i is a product of three factors: the expectancy (prior probability) of being presented with members of category i, the subjective importance (utility) of seeing objects in category i as members of that category, and the general level of alertness. Together, the three factors also determine the level of arousal in the visual system. The hypothesized multiplicative interaction between the three components of visual bias seems consistent with the function of an ideal observer and also paves the way for a Bayesian interpretation of the TVA.

Dissociable spatial and non-spatial attentional deficits after circumscribed thalamic stroke.

Thalamic nuclei act as sensory, motor and cognitive relays between multiple subcortical areas and the cerebral cortex. They play a crucial role in cognitive functions such as executive functioning, memory and attention. In the acute period after thalamic stroke attentional deficits are common. The precise functional relevance of specific nuclei or vascular sub regions of the thalamus for attentional sub functions is still unclear. The theory of visual attention (TVA) allows the measurement of four independent attentional parameters (visual short term memory storage capacity (VSTM), visual perceptual processing speed, selective control and spatial weighting). We combined parameter-based assessment based on TVA with lesion symptom mapping in standard stereotactic space in sixteen patients (mean age 41.2 ± 11.0 SD, 6 females), with focal thalamic lesions in the medial (N = 9), lateral (N = 5), anterior (N = 1) or posterior (N = 1) vascular territories of the thalamus. Compared with an age-matched control group of 52 subjects (mean age 40.1 ± 6.4, 35 females), the patients with thalamic lesions were, on the group level, mildly impaired in visual processing speed and VSTM. Patients with lateral thalamic lesions showed a deficit in processing speed while all other TVA parameters were within the normal range. Medial thalamic lesions can be associated with a spatial bias and extinction of targets either in the ipsilesional or the contralesional field. A posterior case with a thalamic lesion of the pulvinar replicated a finding of Habekost and Rostrup (2006), demonstrating a spatial bias to the ipsilesional field, as suggested by the neural theory of visual attention (NTVA) (Bundesen, Habekost, & Kyllingsbæk, 2011). A case with an anterior-medial thalamic lesion showed reduced selective attentional control. We conclude that lesions in distinct vascular sub regions of the thalamus are associated with distinct attentional syndromes (medial = spatial bias, lateral = processing speed).

Recent developments in a computational theory of visual attention (TVA).

This article reviews the foundations of the theory of visual attention (TVA) and describes recent developments in the theory. TVA is based on the principle of biased competition: All possible visual categorizations ascribing features to objects compete (race) to become encoded into visual short-term memory before it is filled up. Each of the possible categorizations is supported by sensory evidence, but the competition is biased by multiplication with attentional weights (high weights on important objects) and perceptual biases (toward use of important categories). The way sensory evidence and attentional biases interact is specified in the rate and weight equations of TVA, so TVA represents a mathematical formalization of the biased competition principle. In addition to describing TVA as a psychological theory, we present the neural interpretation of TVA, NTVA.

TMS over the right precuneus reduces the bilateral field advantage in visual short term memory capacity.

BACKGROUND: Several studies have demonstrated a bilateral field advantage (BFA) in early visual attentional processing, that is, enhanced visual processing when stimuli are spread across both visual hemifields. The results are reminiscent of a hemispheric resource model of parallel visual attentional processing, suggesting more attentional resources on an early level of visual processing for bilateral displays [e.g. Sereno AB, Kosslyn SM. Discrimination within and between hemifields: a new constraint on theories of attention. Neuropsychologia 1991;29(7):659-75.]. Several studies have shown that the BFA extends beyond early stages of visual attentional processing, demonstrating that visual short term memory (VSTM) capacity is higher when stimuli are distributed bilaterally rather than unilaterally. OBJECTIVE/HYPOTHESIS: Here we examine whether hemisphere-specific resources are also evident on later stages of visual attentional processing. METHODS: Based on the Theory of Visual Attention (TVA) [Bundesen C. A theory of visual attention. Psychol Rev 1990;97(4):523-47.] we used a whole report paradigm that allows investigating visual attention capacity variability in unilateral and bilateral displays during navigated repetitive transcranial magnetic stimulation (rTMS) of the precuneus region. RESULTS: A robust BFA in VSTM storage capacity was apparent after rTMS over the left precuneus and in the control condition without rTMS. In contrast, the BFA diminished with rTMS over the right precuneus. CONCLUSION: This finding indicates that the right precuneus plays a causal role in VSTM capacity, particularly in bilateral visual displays.

A Componential Analysis of Visual Attention in Children With ADHD.

OBJECTIVE: Inattentive behaviour is a defining characteristic of ADHD. Researchers have wondered about the nature of the attentional deficit underlying these symptoms. The primary purpose of the current study was to examine this attentional deficit using a novel paradigm based upon the Theory of Visual Attention (TVA). METHOD: The TVA paradigm enabled a componential analysis of visual attention through the use of a mathematical model to estimate parameters relating to attentional selectivity and capacity. Children's ability to sustain attention was also assessed using the Sustained Attention to Response Task. The sample included a comparison between 25 children with ADHD and 25 control children aged 9-13. RESULTS: Children with ADHD had significantly impaired sustained attention and visual processing speed but intact attentional selectivity, perceptual threshold and visual short-term memory capacity. CONCLUSION: The results of this study lend support to the notion of differential impairment of attentional functions in children with ADHD.