Examining the role of action-driven attention in ensemble processing.

Ensemble processing allows the visual system to condense visual information into useful summary statistics (e.g., average size), thereby overcoming capacity limitations to visual working memory and attention. To examine the role of attention in ensemble processing, we conducted three experiments using a novel paradigm that merged the action effect (a manipulation of attention) and ensemble processing. Participants were instructed to make a simple action if the feature of a cue word corresponded to a subsequent shape. Immediately after, they were shown an ensemble display of eight ovals of varying sizes and were asked to report either the average size of all ovals or the size of a single oval from the set. In Experiments 1 and 2, participants were cued with a task-relevant feature, and in Experiment 3, participants were cued with a task-irrelevant feature. Overall, the task-relevant cues that elicited an action influenced reports of average size in the ensemble phase more than the cues that were passively viewed, whereas task-irrelevant cues did not bias the reports of average size. The results of this study suggest that attention influences ensemble processing only when it is directed toward a task-relevant feature.

Development of radial frequency pattern perception in macaque monkeys.

Infant primates see poorly, and most perceptual functions mature steadily beyond early infancy. Behavioral studies on human and macaque infants show that global form perception, as measured by the ability to integrate contour information into a coherent percept, improves dramatically throughout the first several years after birth. However, it is unknown when sensitivity to curvature and shape emerges in early life or how it develops. We studied the development of shape sensitivity in 18 macaques, aged 2 months to 10 years. Using radial frequency stimuli, circular targets whose radii are modulated sinusoidally, we tested monkeys' ability to radial frequency stimuli from circles as a function of the depth and frequency of sinusoidal modulation. We implemented a new four-choice oddity task and compared the resulting data with that from a traditional two-alternative forced choice task. We found that radial frequency pattern perception was measurable at the youngest age tested (2 months). Behavioral performance at all radial frequencies improved with age. Performance was better for higher radial frequencies, suggesting the developing visual system prioritizes processing of fine visual details that are ecologically relevant. By using two complementary methods, we were able to capture a comprehensive developmental trajectory for shape perception.

The large-scale organization of shape processing in the ventral and dorsal pathways is dissociable from attention.

The two visual pathways model posits that visual information is processed through two distinct cortical systems: The ventral pathway promotes visual recognition, while the dorsal pathway supports visuomotor control. Recent evidence suggests the dorsal pathway is also involved in shape processing and may contribute to object perception, but it remains unclear whether this sensitivity is independent of attentional mechanisms that were localized to overlapping cortical regions. To address this question, we conducted two fMRI experiments that utilized different parametric scrambling manipulations in which human participants viewed novel objects in different levels of scrambling and were instructed to attend to either the object or to another aspect of the image (e.g. color of the background). Univariate and multivariate analyses revealed that the large-scale organization of shape selectivity along the dorsal and ventral pathways was preserved regardless of the focus of attention. Attention did modulate shape sensitivity, but these effects were similar across the two pathways. These findings support the idea that shape processing is at least partially dissociable from attentional processes and relies on a distributed set of cortical regions across the visual pathways.

Attention deployment in natural scenes: Higher-order scene statistics rather than semantics modulate the N2pc component.

Which properties of a natural scene affect visual search? We consider the alternative hypotheses that low-level statistics, higher-level statistics, semantics, or layout affect search difficulty in natural scenes. Across three experiments (n = 20 each), we used four different backgrounds that preserve distinct scene properties: (a) natural scenes (all experiments); (b) 1/f noise (pink noise, which preserves only low-level statistics and was used in Experiments 1 and 2); (c) textures that preserve low-level and higher-level statistics but not semantics or layout (Experiments 2 and 3); and (d) inverted (upside-down) scenes that preserve statistics and semantics but not layout (Experiment 2). We included "split scenes" that contained different backgrounds left and right of the midline (Experiment 1, natural/noise; Experiment 3, natural/texture). Participants searched for a Gabor patch that occurred at one of six locations (all experiments). Reaction times were faster for targets on noise and slower on inverted images, compared to natural scenes and textures. The N2pc component of the event-related potential, a marker of attentional selection, had a shorter latency and a higher amplitude for targets in noise than for all other backgrounds. The background contralateral to the target had an effect similar to that on the target side: noise led to faster reactions and shorter N2pc latencies than natural scenes, although we observed no difference in N2pc amplitude. There were no interactions between the target side and the non-target side. Together, this shows that-at least when searching simple targets without own semantic content-natural scenes are more effective distractors than noise and that this results from higher-order statistics rather than from semantics or layout.

Default mode network shows distinct emotional and contextual responses yet common effects of retrieval demands across tasks.

The default mode network (DMN) lies towards the heteromodal end of the principal gradient of intrinsic connectivity, maximally separated from the sensory-motor cortex. It supports memory-based cognition, including the capacity to retrieve conceptual and evaluative information from sensory inputs, and to generate meaningful states internally; however, the functional organisation of DMN that can support these distinct modes of retrieval remains unclear. We used fMRI to examine whether activation within subsystems of DMN differed as a function of retrieval demands, or the type of association to be retrieved, or both. In a picture association task, participants retrieved semantic associations that were either contextual or emotional in nature. Participants were asked to avoid generating episodic associations. In the generate phase, these associations were retrieved from a novel picture, while in the switch phase, participants retrieved a new association for the same image. Semantic context and emotion trials were associated with dissociable DMN subnetworks, indicating that a key dimension of DMN organisation relates to the type of association being accessed. The frontotemporal and medial temporal DMN showed a preference for emotional and semantic contextual associations, respectively. Relative to the generate phase, the switch phase recruited clusters closer to the heteromodal apex of the principal gradient-a cortical hierarchy separating unimodal and heteromodal regions. There were no differences in this effect between association types. Instead, memory switching was associated with a distinct subnetwork associated with controlled internal cognition. These findings delineate distinct patterns of DMN recruitment for different kinds of associations yet common responses across tasks that reflect retrieval demands.

Role of the left posterior middle temporal gyrus in shape recognition and its reconstruction during drawing: A study combining transcranial magnetic stimulation and functional near infrared spectroscopy.

There are numerous reports of enhanced or emerged visual arts abilities in patients with semantic impairment. These reports led to the theory that a loss of function on the language side of the brain can result in changes of ability to draw and/or to paint. Further, the left posterior middle temporal gyrus (l-pMTG) has been revealed to contribute to the higher control semantic mechanisms with objects recognition and integration of visual information, within a widely distributed network of the left hemisphere. Nevertheless, the theory has not been fully studied in neural bases. The aim of this study is to examine role of the l-pMTG on shape recognition and its reconstruction within drawing behavior, by using a combining method of the repetitive transcranial magnetic stimulation (rTMS) and functional near-infrared spectroscopy (fNIRS). Eighteen healthy participants received a low frequency inhibitory rTMS to their l-pMTG during the drawing task of the Benton Visual Retention Test (BVRT). There was a significant decrease of the mean accuracy of reproductions in the Complex designs of the BVRT, compared to the Simple and Medium designs. The fNIRS data showed strong negative correlations with the results of the BVRT. Though our hypothesis had a contradiction that rTMS would have inhibited the brain activity in the stimulated site, the results suggest that shape recognition and its reconstruction such as the BVRT require neural activations of the l-TL as well as that of the l-pMTG.

A behavioral advantage for the face pareidolia illusion in peripheral vision.

Investigation of visual illusions helps us understand how we process visual information. For example, face pareidolia, the misperception of illusory faces in objects, could be used to understand how we process real faces. However, it remains unclear whether this illusion emerges from errors in face detection or from slower, cognitive processes. Here, our logic is straightforward; if examples of face pareidolia activate the mechanisms that rapidly detect faces in visual environments, then participants will look at objects more quickly when the objects also contain illusory faces. To test this hypothesis, we sampled continuous eye movements during a fast saccadic choice task-participants were required to select either faces or food items. During this task, pairs of stimuli were positioned close to the initial fixation point or further away, in the periphery. As expected, the participants were faster to look at face targets than food targets. Importantly, we also discovered an advantage for food items with illusory faces but, this advantage was limited to the peripheral condition. These findings are among the first to demonstrate that the face pareidolia illusion persists in the periphery and, thus, it is likely to be a consequence of erroneous face detection.

Have you been there before? Decoding recognition of spatial scenes from fMRI signals in precuneus.

One potential application of forensic "brain reading" is to test whether a suspect has previously experienced a crime scene. Here, we investigated whether it is possible to decode real life autobiographic exposure to spatial locations using fMRI. In the first session, participants visited four out of eight possible rooms on a university campus. During a subsequent scanning session, subjects passively viewed pictures and videos from these eight possible rooms (four old, four novel) without giving any responses. A multivariate searchlight analysis was employed that trained a classifier to distinguish between "seen" versus "unseen" stimuli from a subset of six rooms. We found that bilateral precuneus encoded information that can be used to distinguish between previously seen and unseen rooms and that also generalized to the two stimuli left out from training. We conclude that activity in bilateral precuneus is associated with the memory of previously visited rooms, irrespective of the identity of the room, thus supporting a parietal contribution to episodic memory for spatial locations. Importantly, we could decode whether a room was visited in real life without the need of explicit judgments about the rooms. This suggests that recognition is an automatic response that can be decoded from fMRI data, thus potentially supporting forensic applications of concealed information tests for crime scene recognition.

Investigating the neural effects of typicality and predictability for face and object stimuli.

The brain calibrates itself based on the past stimulus diet, which makes frequently observed stimuli appear as typical (as opposed to uncommon stimuli, which appear as distinctive). Based on predictive processing theory, the brain should be more "prepared" for typical exemplars, because these contain information that has been encountered frequently, allowing it to economically represent items of that category. Thus, one could ask whether predictability and typicality of visual stimuli interact, or rather act in an additive manner. We adapted the design by Egner and colleagues (2010), who used cues to induce expectations about stimulus category (face vs. chair) occurrence during an orthogonal inversion detection task. We measured BOLD responses with fMRI in 35 participants. First, distinctive stimuli always elicited stronger responses than typical ones in all ROIs, and our whole-brain directional contrasts for the effects of typicality and distinctiveness converge with previous findings. Second and importantly, we could not replicate the interaction between category and predictability reported by Egner et al. (2010), which casts doubt on whether cueing designs are ideal to elicit reliable predictability effects. Third, likely as a consequence of the lack of predictability effects, we found no interaction between predictability and typicality in any of the four tested regions (bilateral fusiform face areas, lateral occipital complexes) when considering both categories, nor in the whole brain. We discuss the issue of replicability in neuroscience and sketch an agenda for how future studies might address the same question.

Neural computations in prosopagnosia.

We report an investigation of the neural processes involved in the processing of faces and objects of brain-lesioned patient PS, a well-documented case of pure acquired prosopagnosia. We gathered a substantial dataset of high-density electrophysiological recordings from both PS and neurotypicals. Using representational similarity analysis, we produced time-resolved brain representations in a format that facilitates direct comparisons across time points, different individuals, and computational models. To understand how the lesions in PS's ventral stream affect the temporal evolution of her brain representations, we computed the temporal generalization of her brain representations. We uncovered that PS's early brain representations exhibit an unusual similarity to later representations, implying an excessive generalization of early visual patterns. To reveal the underlying computational deficits, we correlated PS' brain representations with those of deep neural networks (DNN). We found that the computations underlying PS' brain activity bore a closer resemblance to early layers of a visual DNN than those of controls. However, the brain representations in neurotypicals became more akin to those of the later layers of the model compared to PS. We confirmed PS's deficits in high-level brain representations by demonstrating that her brain representations exhibited less similarity with those of a DNN of semantics.

Investigation of preference for local and global processing of Capuchin-monkeys (Sapajus spp.) in shape discrimination of mosaic arrangements.

Classical experiments using hierarchical stimuli to investigate the ability of capuchin monkeys to integrate visual information based on global or local clues reported findings suggesting a behavioral preference for local information of the image. Many experiments using mosaics have been conducted with capuchin monkeys to identify some of their perceptual phenotypes. As the identification of an image in a mosaic demands the integration of elements that share some visual features, we evaluated the discrimination of shapes presented in solid and mosaic stimuli in capuchin monkeys. Shape discrimination performance was tested in 2 male adult capuchin monkeys in an experimental chamber with a touchscreen video monitor, in three experiments: (i) evaluation of global and local processing using hierarchical stimuli; (ii) evaluation of target detection using simple discrimination procedures; (iii) evaluation of shape discrimination using simple discrimination and delayed matching-to-sample procedures. We observed that both monkeys had preferences for local processing when tested by hierarchical stimuli. Additionally, detection performance for solid and mosaic targets was highly significant, but for shape discrimination tasks we found significant performance when using solid figures, non-significant performance when using circle and square shapes in mosaic stimuli, and significant performance when using Letter X and Number 8 shapes in mosaic stimuli. Our results are suggestive that the monkeys respond to local contrast and partly to global contrast in mosaic stimuli.

A spatial version of the Stroop task for examining proactive and reactive control independently from non-conflict processes.

Conflict-induced control refers to humans' ability to regulate attention in the processing of target information (e.g., the color of a word in the color-word Stroop task) based on experience with conflict created by distracting information (e.g., an incongruent color word), and to do so either in a proactive (preparatory) or a reactive (stimulus-driven) fashion. Interest in conflict-induced control has grown recently, as has the awareness that effects attributed to those processes might be affected by conflict-unrelated processes (e.g., the learning of stimulus-response associations). This awareness has resulted in the recommendation to move away from traditional interference paradigms with small stimulus/response sets and towards paradigms with larger sets (at least four targets, distractors, and responses), paradigms that allow better control of non-conflict processes. Using larger sets, however, is not always feasible. Doing so in the Stroop task, for example, would require either multiple arbitrary responses that are difficult for participants to learn (e.g., manual responses to colors) or non-arbitrary responses that can be difficult for researchers to collect (e.g., vocal responses in online experiments). Here, we present a spatial version of the Stroop task that solves many of those problems. In this task, participants respond to one of six directions indicated by an arrow, each requiring a specific, non-arbitrary manual response, while ignoring the location where the arrow is displayed. We illustrate the usefulness of this task by showing the results of two experiments in which evidence for proactive and reactive control was obtained while controlling for the impact of non-conflict processes.

Improving Understanding of Visual Snow by Quantifying its Appearance and Effect on Vision.

Purpose: Visual snow is the hallmark of the neurological condition visual snow syndrome (VSS) but the characteristics of the visual snow percept remain poorly defined. This study aimed to quantify its appearance, interobserver variability, and effect on measured visual performance and self-reported visual quality. Methods: Twenty-three participants with VSS estimated their visual snow dot size, separation, luminance, and flicker rate by matching to a simulation. To assess whether visual snow masks vision, we compared pattern discrimination thresholds for textures that were similar in spatial scale to visual snow as well as more coarse than visual snow, in participants with VSS, and with and without external noise simulating visual snow in 23 controls. Results: Mean and 95% confidence intervals for visual snow appearance were: size (6.0, 5.8-6.3 arcseconds), separation (2.0, 1.7-2.3 arcmin), luminance (72.4, 58.1-86.8 cd/m2), and flicker rate (25.8, 18.9-32.8 frames per image at 120 hertz [Hz]). Participants with finer dot spacing estimates also reported greater visibility of their visual snow (τb = -0.41, 95% confidence interval [CI] = -0.62 to -0.13, P = 0.01). In controls, adding simulated fine-scale visual snow to textures increased thresholds for fine but not coarse textures (F(1, 22) = 4.98, P = 0.036, ηp2 = 0.19). In VSS, thresholds for fine and coarse textures were similar (t(22) = 0.54, P = 0.60), suggesting that inherent visual snow does not act like external noise in controls. Conclusions: Our quantitative estimates of visual snow constrain its likely neural origins, may aid differential diagnosis, and inform future investigations of how it affects vision. Methods to quantify visual snow are needed for evaluation of potential treatments.

Perceptual dimensions of wood materials.

Materials exhibit an extraordinary range of visual appearances. Characterizing and quantifying appearance is important not only for basic research on perceptual mechanisms but also for computer graphics and a wide range of industrial applications. Although methods exist for capturing and representing the optical properties of materials and how they vary across surfaces (Haindl & Filip, 2013), the representations are typically very high-dimensional, and how these representations relate to subjective perceptual impressions of material appearance remains poorly understood. Here, we used a data-driven approach to characterizing the perceived appearance characteristics of 30 samples of wood veneer using a "visual fingerprint" that describes each sample as a multidimensional feature vector, with each dimension capturing a different aspect of the appearance. Fifty-six crowd-sourced participants viewed triplets of movies depicting different wood samples as the sample rotated. Their task was to report which of the two match samples was subjectively most similar to the test sample. In another online experiment, 45 participants rated 10 wood-related appearance characteristics for each of the samples. The results reveal a consistent embedding of the samples across both experiments and a set of nine perceptual dimensions capturing aspects including the roughness, directionality, and spatial scale of the surface patterns. We also showed that a weighted linear combination of 11 image statistics, inspired by the rating characteristics, predicts perceptual dimensions well.

Neural mechanisms of Chinese character recognition, updating, and maintenance in the N-back task.

Using the N-back task, we investigated how memory load influences the neural activity of the Chinese character cognitive subprocess (recognition, updating, and maintenance) in Mainland Chinese speakers. Twenty-seven participants completed the Chinese character N-back paradigm while having their event-related potentials recorded. The study employed time and frequency domain analyses of EEG data. Results showed that accuracy decreased and response times increased with larger N values. For ERPs, N2pc and P300 amplitudes decreased and SW amplitude increased with larger N values. For time frequency analyses, the desynchronization of alpha oscillations decreased after stimulus onset, but the synchronization of alpha oscillations increased during the maintenance phase. The results suggest that greater memory load is related to a decrease in cognitive resources during updating and an increase in cognitive resources during information maintenance. The results of a behavioral-ERP data structural equation model analysis showed that the ERP indicators in the maintenance phase predicted behavioral performance.

Lateralized displays reveal the perceptual locus of the syllable transposition effect in Korean.

Studies of letter transposition effects in alphabetic scripts provide compelling evidence that letter position is encoded flexibly during reading, potentially during an early, perceptual stage of visual word recognition. Recent studies additionally suggest similar flexibility in the spatial encoding of syllabic information in the Korean Hangul script. With the present research, we conducted two experiments to investigate the locus of this syllabic transposition effect. In Experiment 1, lexical decisions for foveal stimulus presentations were less accurate and slower for four-syllable nonwords created by transposing two syllables in a base word as compared to control nonwords, replicating prior evidence for a transposed syllable effect in Korean word recognition. In Experiment 2, the same stimuli were presented to the right and left visual hemifields (i.e., RVF and LVF), which project both unilaterally and contralaterally to each participant's left and right cerebral hemisphere (i.e., LH and RH) respectively, using lateralized stimulus displays. Lexical decisions revealed a syllable transposition effect in the accuracy and latency of lexical decisions for both RVF and LVF presentations. However, response times for correct responses were longer in the LVF, and therefore the RH, as compared to the RVF/LH. As the LVF/RH appears to be selectively sensitive to the visual-perceptual attributes of words, the findings suggest that this syllable transposition effect partly finds its locus within a perceptual stage of processing. We discuss these findings in relation to current models of the spatial encoding of orthographic information during visual word recognition and accounts of visual word recognition in Korean.

Decoding familiar visual object categories in the mu rhythm oscillatory response.

Whilst previous research has linked attenuation of the mu rhythm to the observation of specific visual categories, and even to a potential role in action observation via a putative mirror neuron system, much of this work has not considered what specific type of information might be coded in this oscillatory response when triggered via vision. Here, we sought to determine whether the mu rhythm contains content-specific information about the identity of familiar (and also unfamiliar) graspable objects. In the present study, right-handed participants (N = 27) viewed images of both familiar (apple, wine glass) and unfamiliar (cubie, smoothie) graspable objects, whilst performing an orthogonal task at fixation. Multivariate pattern analysis (MVPA) revealed significant decoding of familiar, but not unfamiliar, visual object categories in the mu rhythm response. Thus, simply viewing familiar graspable objects may automatically trigger activation of associated tactile and/or motor properties in sensorimotor areas, reflected in the mu rhythm. In addition, we report significant attenuation in the central beta band for both familiar and unfamiliar visual objects, but not in the mu rhythm. Our findings highlight how analysing two different aspects of the oscillatory response - either attenuation or the representation of information content - provide complementary views on the role of the mu rhythm in response to viewing graspable object categories.

Neuronal tuning and population representations of shape and category in human visual cortex.

Object recognition and categorization are essential cognitive processes which engage considerable neural resources in the human ventral visual stream. However, the tuning properties of human ventral stream neurons for object shape and category are virtually unknown. We performed large-scale recordings of spiking activity in human Lateral Occipital Complex in response to stimuli in which the shape dimension was dissociated from the category dimension. Consistent with studies in nonhuman primates, the neuronal representations were primarily shape-based, although we also observed category-like encoding for images of animals. Surprisingly, linear decoders could reliably classify stimulus category even in data sets that were entirely shape-based. In addition, many recording sites showed an interaction between shape and category tuning. These results represent a detailed study on shape and category coding at the neuronal level in the human ventral visual stream, furnishing essential evidence that reconciles human imaging and macaque single-cell studies.

Disrupting dorsal hippocampus impairs category learning in rats.

Categorization requires a balance of mechanisms that can generalize across common features and discriminate against specific details. A growing literature suggests that the hippocampus may accomplish these mechanisms by using fundamental mechanisms like pattern separation, pattern completion, and memory integration. Here, we assessed the role of the rodent dorsal hippocampus (HPC) in category learning by combining inhibitory DREADDs (Designer Receptors Exclusively Activated by Designer Drugs) and simulations using a neural network model. Using touchscreens, we trained rats to categorize distributions of visual stimuli containing black and white gratings that varied along two continuous dimensions. Inactivating the dorsal HPC impaired category learning and generalization, suggesting that the rodent HPC plays an important role during categorization. Hippocampal inactivation had no effect on a control discrimination task that used identical trial procedures as the categorization tasks, suggesting that the impairments were specific to categorization. Model simulations were conducted with variants of a neural network to assess the impact of selective deficits on category learning. The hippocampal inactivation groups were best explained by a model that injected random noise into the computation that compared the similarity between category stimuli and existing memory representations. This model is akin to a deficit in mechanisms of pattern completion, which retrieves similar memory representations using partial information.

Impact of early visual experience on later usage of color cues.

Human visual recognition is remarkably robust to chromatic changes. In this work, we provide a potential account of the roots of this resilience based on observations with 10 congenitally blind children who gained sight late in life. Several months or years following their sight-restoring surgeries, the removal of color cues markedly reduced their recognition performance, whereas age-matched normally sighted children showed no such decrement. This finding may be explained by the greater-than-neonatal maturity of the late-sighted children's color system at sight onset, inducing overly strong reliance on chromatic cues. Simulations with deep neural networks corroborate this hypothesis. These findings highlight the adaptive significance of typical developmental trajectories and provide guidelines for enhancing machine vision systems.