Visual Remapping.

Our visual system is fundamentally retinotopic. When viewing a stable scene, each eye movement shifts object features and locations on the retina. Thus, sensory representations must be updated, or remapped, across saccades to align presaccadic and postsaccadic inputs. The earliest remapping studies focused on anticipatory, presaccadic shifts of neuronal spatial receptive fields. Over time, it has become clear that there are multiple forms of remapping and that different forms of remapping may be mediated by different neural mechanisms. This review attempts to organize the various forms of remapping into a functional taxonomy based on experimental data and ongoing debates about forward versus convergent remapping, presaccadic versus postsaccadic remapping, and spatial versus attentional remapping. We integrate findings from primate neurophysiological, human neuroimaging and behavioral, and computational modeling studies. We conclude by discussing persistent open questions related to remapping, with specific attention to binding of spatial and featural information during remapping and speculations about remapping's functional significance.

Saccades Trigger Predictive Updating of Attentional Topography in Area V4.

During natural behavior, saccades and attention act together to allocate limited neural resources. Attention is generally mediated by retinotopic visual neurons; therefore, specific neurons representing attended features change with each saccade. We investigated the neural mechanisms that allow attentional targeting in the face of saccades. Specifically, we looked for predictive changes in attentional modulation state or receptive field position that could stabilize attentional representations across saccades in area V4, known to be necessary for attention-dependent behavior. We recorded from neurons in monkeys performing a novel spatiotopic attention task, in which performance depended on accurate saccade compensation. Measurements of attentional modulation revealed a predictive attentional "hand-off" corresponding to a presaccadic transfer of attentional state from neurons inside the attentional focus before the saccade to those that will be inside the focus after the saccade. The predictive nature of the hand-off ensures that attentional brain maps are properly configured immediately after each saccade.

Core Differences in Synaptic Signaling Between Primary Visual and Dorsolateral Prefrontal Cortex.

Neurons in primary visual cortex (V1) are more resilient than those in dorsolateral prefrontal cortex (dlPFC) in aging, schizophrenia and Alzheimer's disease. The current study compared glutamate and neuromodulatory actions in macaque V1 to those in dlPFC, and found striking regional differences. V1 neuronal firing to visual stimuli depended on AMPA receptors, with subtle NMDA receptor contributions, while dlPFC depends primarily on NMDA receptors. Neuromodulatory actions also differed between regions. In V1, cAMP signaling increased neuronal firing, and the phosphodiesterase PDE4A was positioned to regulate cAMP effects on glutamate release from axons. HCN channels in V1 were classically located on distal dendrites, and enhanced cell firing. These data contrast with dlPFC, where PDE4A and HCN channels are concentrated in thin spines, and cAMP-HCN signaling gates inputs and weakens firing. These regional differences may explain why V1 neurons are more resilient than dlPFC neurons to the challenges of age and disease.

Perisaccadic Updating of Visual Representations and Attentional States: Linking Behavior and Neurophysiology.

During natural vision, saccadic eye movements lead to frequent retinal image changes that result in different neuronal subpopulations representing the same visual feature across fixations. Despite these potentially disruptive changes to the neural representation, our visual percept is remarkably stable. Visual receptive field remapping, characterized as an anticipatory shift in the position of a neuron's spatial receptive field immediately before saccades, has been proposed as one possible neural substrate for visual stability. Many of the specific properties of remapping, e.g., the exact direction of remapping relative to the saccade vector and the precise mechanisms by which remapping could instantiate stability, remain a matter of debate. Recent studies have also shown that visual attention, like perception itself, can be sustained across saccades, suggesting that the attentional control system can also compensate for eye movements. Classical remapping could have an attentional component, or there could be a distinct attentional analog of visual remapping. At this time we do not yet fully understand how the stability of attentional representations relates to perisaccadic receptive field shifts. In this review, we develop a vocabulary for discussing perisaccadic shifts in receptive field location and perisaccadic shifts of attentional focus, review and synthesize behavioral and neurophysiological studies of perisaccadic perception and perisaccadic attention, and identify open questions that remain to be experimentally addressed.

Linear and non-linear properties of feature selectivity in V4 neurons.

Extrastriate area V4 is a critical component of visual form processing in both humans and non-human primates. Previous studies have shown that the tuning properties of V4 neurons demonstrate an intermediate level of complexity that lies between the narrow band orientation and spatial frequency tuning of neurons in primary visual cortex and the highly complex object selectivity seen in inferotemporal neurons. However, the nature of feature selectivity within this cortical area is not well understood, especially in the context of natural stimuli. Specifically, little is known about how the tuning properties of V4 neurons, measured in isolation, translate to feature selectivity within natural scenes. In this study, we assessed the degree to which preferences for natural image components can readily be inferred from classical orientation and spatial frequency tuning functions. Using a psychophysically-inspired method we isolated and identified the specific visual "driving features" occurring in natural scene photographs that reliably elicited spiking activity from single V4 neurons. We then compared the measured driving features to those predicted based on the spectral receptive field (SRF), estimated from responses to narrowband sinusoidal grating stimuli. This approach provided a quantitative framework for assessing the degree to which linear feature selectivity was preserved during natural vision. First, we found evidence of both spectrally and spatially tuned suppression within the receptive field, neither of which were present in the linear SRF. Second, we found driving features that were stable during translation of the image across the receptive field (due to small fixational eye movements). The degree of translation invariance fell along a continuum, with some cells showing nearly complete invariance across the receptive field and others exhibiting little to no position invariance. This form of limited translation invariance could indicate that a subset of V4 neurons are insensitive to small fixational eye movements, supporting perceptual stability during natural vision.

NMDA receptors subserve persistent neuronal firing during working memory in dorsolateral prefrontal cortex.

Neurons in the primate dorsolateral prefrontal cortex (dlPFC) generate persistent firing in the absence of sensory stimulation, the foundation of mental representation. Persistent firing arises from recurrent excitation within a network of pyramidal Delay cells. Here, we examined glutamate receptor influences underlying persistent firing in primate dlPFC during a spatial working memory task. Computational models predicted dependence on NMDA receptor (NMDAR) NR2B stimulation, and Delay cell persistent firing was abolished by local NR2B NMDAR blockade or by systemic ketamine administration. AMPA receptors (AMPARs) contributed background depolarization to sustain network firing. In contrast, many Response cells were sensitive to AMPAR blockade and increased firing after systemic ketamine, indicating that models of ketamine actions should be refined to reflect neuronal heterogeneity. The reliance of Delay cells on NMDAR may explain why insults to NMDARs in schizophrenia or Alzheimer's disease profoundly impair cognition.

Surround suppression and sparse coding in visual and barrel cortices.

During natural vision the entire retina is stimulated. Likewise, during natural tactile behaviors, spatially extensive regions of the somatosensory surface are co-activated. The large spatial extent of naturalistic stimulation means that surround suppression, a phenomenon whose neural mechanisms remain a matter of debate, must arise during natural behavior. To identify common neural motifs that might instantiate surround suppression across modalities, we review models of surround suppression and compare the evidence supporting the competing ideas that surround suppression has either cortical or sub-cortical origins in visual and barrel cortex. In the visual system there is general agreement lateral inhibitory mechanisms contribute to surround suppression, but little direct experimental evidence that intracortical inhibition plays a major role. Two intracellular recording studies of V1, one using naturalistic stimuli (Haider et al., 2010), the other sinusoidal gratings (Ozeki et al., 2009), sought to identify the causes of reduced activity in V1 with increasing stimulus size, a hallmark of surround suppression. The former attributed this effect to increased inhibition, the latter to largely balanced withdrawal of excitation and inhibition. In rodent primary somatosensory barrel cortex, multi-whisker responses are generally weaker than single whisker responses, suggesting multi-whisker stimulation engages similar surround suppressive mechanisms. The origins of suppression in S1 remain elusive: studies have implicated brainstem lateral/internuclear interactions and both thalamic and cortical inhibition. Although the anatomical organization and instantiation of surround suppression in the visual and somatosensory systems differ, we consider the idea that one common function of surround suppression, in both modalities, is to remove the statistical redundancies associated with natural stimuli by increasing the sparseness or selectivity of sensory responses.

Neuronal basis of age-related working memory decline.

Many of the cognitive deficits of normal ageing (forgetfulness, distractibility, inflexibility and impaired executive functions) involve prefrontal cortex (PFC) dysfunction. The PFC guides behaviour and thought using working memory, which are essential functions in the information age. Many PFC neurons hold information in working memory through excitatory networks that can maintain persistent neuronal firing in the absence of external stimulation. This fragile process is highly dependent on the neurochemical environment. For example, elevated cyclic-AMP signalling reduces persistent firing by opening HCN and KCNQ potassium channels. It is not known if molecular changes associated with normal ageing alter the physiological properties of PFC neurons during working memory, as there have been no in vivo recordings, to our knowledge, from PFC neurons of aged monkeys. Here we characterize the first recordings of this kind, revealing a marked loss of PFC persistent firing with advancing age that can be rescued by restoring an optimal neurochemical environment. Recordings showed an age-related decline in the firing rate of DELAY neurons, whereas the firing of CUE neurons remained unchanged with age. The memory-related firing of aged DELAY neurons was partially restored to more youthful levels by inhibiting cAMP signalling, or by blocking HCN or KCNQ channels. These findings reveal the cellular basis of age-related cognitive decline in dorsolateral PFC, and demonstrate that physiological integrity can be rescued by addressing the molecular needs of PFC circuits.

Spatial attention, feature-based attention, and saccades: three sides of one coin?

The last three decades has seen a steady growth of neuroscience research aimed at understanding the functions and sources of top-down attentional modulation in the brain. This correlates with recognition that attention may be a necessary component of sensory systems to support natural behaviors in natural environments. Complexity and clutter are two of the most recognizable hallmarks of natural environments, which can simultaneously contain vitally important and completely irrelevant stimuli. Attention serves as an adaptive filter providing each sensory modality preferential processing routes for important stimuli while suppressing responses to distracters, thus optimizing use of limited neural resources. In other words, attention is the family of mechanisms by which organisms are able to effectively and selectively allocate limited neural resources to achieve specific behavioral goals. This review provides some historical context for considering attentional frameworks and modern neurophysiological attention research, focusing on visual attention. A taxonomy of common attentional effects and neural mechanisms is provided, along with consideration of the specific relationship between attention and saccade planning. We examine the validity of premotor theories of attention, which posit that attention and saccade planning are one and the same. While there is strong evidence that attention and oculomotor planning are similar, with shared neural substrates, there is also evidence that these two functions are not synonymous. Finally, we examine neurophysiological explanations for dysfunction in attention-deficit/hyperactivity disorder and the hypothesis that social impairment in autism spectrum disorders is partially attributable to perturbations of attentional control circuitry.

Sparse coding in striate and extrastriate visual cortex.

Theoretical studies of mammalian cortex argue that efficient neural codes should be sparse. However, theoretical and experimental studies have used different definitions of the term "sparse" leading to three assumptions about the nature of sparse codes. First, codes that have high lifetime sparseness require few action potentials. Second, lifetime-sparse codes are also population-sparse. Third, neural codes are optimized to maximize lifetime sparseness. Here, we examine these assumptions in detail and test their validity in primate visual cortex. We show that lifetime and population sparseness are not necessarily correlated and that a code may have high lifetime sparseness regardless of how many action potentials it uses. We measure lifetime sparseness during presentation of natural images in three areas of macaque visual cortex, V1, V2, and V4. We find that lifetime sparseness does not increase across the visual hierarchy. This suggests that the neural code is not simply optimized to maximize lifetime sparseness. We also find that firing rates during a challenging visual task are higher than theoretical values based on metabolic limits and that responses in V1, V2, and V4 are well-described by exponential distributions. These findings are consistent with the hypothesis that neurons are optimized to maximize information transmission subject to metabolic constraints on mean firing rate.

Attention doesn't slide: spatiotopic updating after eye movements instantiates a new, discrete attentional locus.

During natural vision, eye movements can drastically alter the retinotopic (eye-centered) coordinates of locations and objects, yet the spatiotopic (world-centered) percept remains stable. Maintaining visuospatial attention in spatiotopic coordinates requires updating of attentional representations following each eye movement. However, this updating is not instantaneous; attentional facilitation temporarily lingers at the previous retinotopic location after a saccade, a phenomenon known as the retinotopic attentional trace. At various times after a saccade, we probed attention at an intermediate location between the retinotopic and spatiotopic locations to determine whether a single locus of attentional facilitation slides progressively from the previous retinotopic location to the appropriate spatiotopic location, or whether retinotopic facilitation decays while a new, independent spatiotopic locus concurrently becomes active. Facilitation at the intermediate location was not significant at any time, suggesting that top-down attention can result in enhancement of discrete retinotopic and spatiotopic locations without passing through intermediate locations.

Attentional facilitation throughout human visual cortex lingers in retinotopic coordinates after eye movements.

With each eye movement, the image of the world received by the visual system changes dramatically. To maintain stable spatiotopic (world-centered) visual representations, the retinotopic (eye-centered) coordinates of visual stimuli are continually remapped, even before the eye movement is completed. Recent psychophysical work has suggested that updating of attended locations occurs as well, although on a slower timescale, such that sustained attention lingers in retinotopic coordinates for several hundred milliseconds after each saccade. To explore where and when this "retinotopic attentional trace" resides in the cortical visual processing hierarchy, we conducted complementary functional magnetic resonance imaging and event-related potential (ERP) experiments using a novel gaze-contingent task. Human subjects executed visually guided saccades while covertly monitoring a fixed spatiotopic target location. Although subjects responded only to stimuli appearing at the attended spatiotopic location, blood oxygen level-dependent responses to stimuli appearing after the eye movement at the previously, but no longer, attended retinotopic location were enhanced in visual cortical area V4 and throughout visual cortex. This retinotopic attentional trace was also detectable with higher temporal resolution in the anterior N1 component of the ERP data, a well established signature of attentional modulation. Together, these results demonstrate that, when top-down spatiotopic signals act to redirect visuospatial attention to new retinotopic locations after eye movements, facilitation transiently persists in the cortical regions representing the previously relevant retinotopic location.

Robustness of the retinotopic attentional trace after eye movements.

With each eye movement, the image received by the visual system changes drastically. To maintain stable spatiotopic (world-centered) representations, the relevant retinotopic (eye-centered) coordinates must be continually updated. Although updating or remapping of visual scene representations can occur very rapidly, J. D. Golomb, M. M. Chun, and J. A. Mazer (2008) demonstrated that representations of sustained attention update more slowly than the remapping literature would predict; attentional benefits at previously attended retinotopic locations linger after completion of the saccade, even when this location is no longer behaviorally relevant. The present study explores the robustness of this "retinotopic attentional trace." We report significant retinotopic facilitation despite attempts to eliminate or reduce it by enhancing spatiotopic reference frames with permanent visual cues in the stimulus display and by introducing a different task where the attended location is the saccade target itself. Our results support and extend our earlier model of native retinotopically organized salience maps that must be dynamically updated to reflect the task-relevant spatiotopic location with each saccade. Consistent with the idea that attentional facilitation arises from persistent, recurrent neural activity, it takes measurable time for this facilitation to decay, leaving behind a retinotopic attentional trace after the saccade has been executed, regardless of conflicting task demands.

Synaptic and network mechanisms of sparse and reliable visual cortical activity during nonclassical receptive field stimulation.

During natural vision, the entire visual field is stimulated by images rich in spatiotemporal structure. Although many visual system studies restrict stimuli to the classical receptive field (CRF), it is known that costimulation of the CRF and the surrounding nonclassical receptive field (nCRF) increases neuronal response sparseness. The cellular and network mechanisms underlying increased response sparseness remain largely unexplored. Here we show that combined CRF + nCRF stimulation increases the sparseness, reliability, and precision of spiking and membrane potential responses in classical regular spiking (RS(C)) pyramidal neurons of cat primary visual cortex. Conversely, fast-spiking interneurons exhibit increased activity and decreased selectivity during CRF + nCRF stimulation. The increased sparseness and reliability of RS(C) neuron spiking is associated with increased inhibitory barrages and narrower visually evoked synaptic potentials. Our experimental observations were replicated with a simple computational model, suggesting that network interactions among neuronal subtypes ultimately sharpen recurrent excitation, producing specific and reliable visual responses.

The native coordinate system of spatial attention is retinotopic.

Visual processing can be facilitated by covert attention at behaviorally relevant locations. If the eyes move while a location in the visual field is facilitated, what happens to the internal representation of the attended location? With each eye movement, the retinotopic (eye-centered) coordinates of the attended location change while the spatiotopic (world-centered) coordinates remain stable. To investigate whether the neural substrates of spatial attention reside in retinotopically and/or spatiotopically organized maps, we used a novel gaze-contingent behavioral paradigm that probed spatial attention at various times after eye movements. When task demands required maintaining a spatiotopic representation after the eye movement, we found facilitation at the retinotopic location of the spatial cue for 100-200 ms after the saccade, although this location had no behavioral significance. This task-irrelevant retinotopic representation dominated immediately after the saccade, whereas at later delays, the task-relevant spatiotopic representation prevailed. However, when task demands required maintaining the cue in retinotopic coordinates, a strong retinotopic benefit persisted long after the saccade, and there was no evidence of spatiotopic facilitation. These data suggest that the cortical and subcortical substrates of spatial attention primarily reside in retinotopically organized maps that must be dynamically updated to compensate for eye movements when behavioral demands require a spatiotopic representation of attention. Our conclusion is that the visual system's native or low-level representation of endogenously maintained spatial attention is retinotopic, and remapping of attention to spatiotopic coordinates occurs slowly and only when behaviorally necessary.

Attention to stimulus features shifts spectral tuning of V4 neurons during natural vision.

Previous neurophysiological studies suggest that attention can alter the baseline or gain of neurons in extrastriate visual areas but that it cannot change tuning. This suggests that neurons in visual cortex function as labeled lines whose meaning does not depend on task demands. To test this common assumption, we used a system identification approach to measure spatial frequency and orientation tuning in area V4 during two attentionally demanding visual search tasks, one that required fixation and one that allowed free viewing during search. We found that spatial attention modulates response baseline and gain but does not alter tuning, consistent with previous reports. In contrast, feature-based attention often shifts neuronal tuning. These tuning shifts are inconsistent with the labeled-line model and tend to enhance responses to stimulus features that distinguish the search target. Our data suggest that V4 neurons behave as matched filters that are dynamically tuned to optimize visual search.

Alpha2A-adrenoceptors strengthen working memory networks by inhibiting cAMP-HCN channel signaling in prefrontal cortex.

Spatial working memory (WM; i.e., "scratchpad" memory) is constantly updated to guide behavior based on representational knowledge of spatial position. It is maintained by spatially tuned, recurrent excitation within networks of prefrontal cortical (PFC) neurons, evident during delay periods in WM tasks. Stimulation of postsynaptic alpha2A adrenoceptors (alpha2A-ARs) is critical for WM. We report that alpha2A-AR stimulation strengthens WM through inhibition of cAMP, closing Hyperpolarization-activated Cyclic Nucleotide-gated (HCN) channels and strengthening the functional connectivity of PFC networks. Ultrastructurally, HCN channels and alpha2A-ARs were colocalized in dendritic spines in PFC. In electrophysiological studies, either alpha2A-AR stimulation, cAMP inhibition or HCN channel blockade enhanced spatially tuned delay-related firing of PFC neurons. Conversely, delay-related network firing collapsed under conditions of excessive cAMP. In behavioral studies, either blockade or knockdown of HCN1 channels in PFC improved WM performance. These data reveal a powerful mechanism for rapidly altering the strength of WM networks in PFC.

Goal-related activity in V4 during free viewing visual search. Evidence for a ventral stream visual salience map.

Natural exploration of complex visual scenes depends on saccadic eye movements toward important locations. Saccade targeting is thought to be mediated by a retinotopic map that represents the locations of salient features. In this report, we demonstrate that extrastriate ventral area V4 contains a retinotopic salience map that guides exploratory eye movements during a naturalistic free viewing visual search task. In more than half of recorded cells, visually driven activity is enhanced prior to saccades that move the fovea toward the location previously occupied by a neuron's spatial receptive field. This correlation suggests that bottom-up processing in V4 influences the oculomotor planning process. Half of the neurons also exhibit top-down modulation of visual responses that depends on search target identity but not visual stimulation. Convergence of bottom-up and top-down processing streams in area V4 results in an adaptive, dynamic map of salience that guides oculomotor planning during natural vision.

Response properties of neurons in the core of the central nucleus of the inferior colliculus of the barn owl.

The central nucleus of the inferior colliculus (ICC) is particularly important for the processing of interaural time differences (ITDs). In the barn owl, neuronal best frequencies in a subnucleus of the ICC, the ICCcore, span the animal's entire hearing range (approximately equal to 200-10 000 Hz). This means that low-frequency ITD-sensitive ICCcore neurons in the owl can be directly compared to ITD-sensitive mammalian ICC neurons with similar best frequencies as well as to the high-frequency ITD-sensitive neurons usually studied in owls. This report represents a first attempt to systematically describe important physiological properties of ICCcore neurons in the barn owl, with particular attention to the low-frequency region (< 2 kHz). Responses were obtained from 133 neurons or small clusters of neurons; recording sites were confirmed by histological reconstruction of electrode tracks based on electrolytic lesions. Iso-intensity frequency response functions were typically approximately equal to 1 octave wide in the low-frequency range and approximately equal to 1/3 octave wide in the high-frequency range. Most neurons were ITD-tuned; both noise and pure tone stimuli yielded periodic ITD tuning curves with several equivalent response maxima. In most cases ITD tuning curves had a response peak within the barn owl's physiological ITD range. ITD tuning widths were inversely correlated with neuronal best frequency. None of the ICCcore neurons studied were sensitive to interaural level differences. Monaural inputs to ICCcore cells were typically binaurally balanced, i.e. they exhibited similar response thresholds, dynamic ranges, slopes and saturation levels, for both left and right ear monaural stimulation.