Visual spatial location influences selection of instinctive behaviours in mouse.

Visual stimuli can elicit instinctive approach and avoidance behaviours. In mouse, vision is known to be important for both avoidance of an overhead threat and approach toward a potential terrestrial prey. The stimuli used to characterize these behaviours, however, vary in both spatial location (overhead or near the ground plane) and visual feature (rapidly expanding disc or slowly moving disc). We therefore asked how mice responded to the same visual features presented in each location. We found that a looming black disc induced escape behaviour when presented overhead or to the side of the animal, but the escapes produced by side-looms were less vigorous and often preceded by freezing behaviour. Similarly, small moving discs induced freezing behaviour when presented overhead or to the side of the animal, but side sweeps also elicited approach behaviours, such that mice explored the area of the arena near where the stimulus had been presented. Our observations therefore show that mice combine cues to the location and features of visual stimuli when selecting among potential behaviours.

Altered low-frequency brain rhythms precede changes in gamma power during tauopathy.

Neurodegenerative disorders are associated with widespread disruption to brain activity and brain rhythms. Some disorders are linked to dysfunction of the membrane-associated protein Tau. Here, we ask how brain rhythms are affected in rTg4510 mouse model of tauopathy, at an early stage of tauopathy (5 months), and at a more advanced stage (8 months). We measured brain rhythms in primary visual cortex in presence or absence of visual stimulation, while monitoring pupil diameter and locomotion to establish behavioral state. At 5 months, we found increased low-frequency rhythms during resting state in tauopathic animals, associated with periods of abnormally increased neural synchronization. At 8 months, this increase in low-frequency rhythms was accompanied by a reduction of power in the gamma range. Our results therefore show that slower rhythms are impaired earlier than gamma rhythms in this model of tauopathy, and suggest that electrophysiological measurements can track the progression of tauopathic neurodegeneration.

Functional Organisation of the Mouse Superior Colliculus.

The superior colliculus (SC) is a highly conserved area of the mammalian midbrain that is widely implicated in the organisation and control of behaviour. SC receives input from a large number of brain areas, and provides outputs to a large number of areas. The convergence and divergence of anatomical connections with different areas and systems provides challenges for understanding how SC contributes to behaviour. Recent work in mouse has provided large anatomical datasets, and a wealth of new data from experiments that identify and manipulate different cells within SC, and their inputs and outputs, during simple behaviours. These data offer an opportunity to better understand the roles that SC plays in these behaviours. However, some of the observations appear, at first sight, to be contradictory. Here we review this recent work and hypothesise a simple framework which can capture the observations, that requires only a small change to previous models. Specifically, the functional organisation of SC can be explained by supposing that three largely distinct circuits support three largely distinct classes of simple behaviours-arrest, turning towards, and the triggering of escape or capture. These behaviours are hypothesised to be supported by the optic, intermediate and deep layers, respectively.

Brief Stimuli Cast a Persistent Long-Term Trace in Visual Cortex.

Visual processing is strongly influenced by recent stimulus history, a phenomenon termed adaptation. Prominent theories cast adaptation as a consequence of optimized encoding of visual information by exploiting the temporal statistics of the world. However, this would require the visual system to track the history of individual briefly experienced events, within a stream of visual input, to build up statistical representations over longer timescales. Here, using an openly available dataset from the Allen Brain Observatory, we show that neurons in the early visual cortex of the mouse indeed maintain long-term traces of individual past stimuli that persist despite the presentation of several intervening stimuli, leading to long-term and stimulus-specific adaptation over dozens of seconds. Long-term adaptation was selectively expressed in cortical, but not in thalamic, neurons, which only showed short-term adaptation. Early visual cortex thus maintains concurrent stimulus-specific memory traces of past input, enabling the visual system to build up a statistical representation of the world to optimize the encoding of new information in a changing environment.SIGNIFICANCE STATEMENT In the natural world, previous sensory input is predictive of current input over multisecond timescales. The visual system could exploit these predictabilities by adapting current visual processing to the long-term history of visual input. However, it is unclear whether the visual system can track the history of individual briefly experienced images, within a stream of input, to build up statistical representations over such long timescales. Here, we show that neurons in early visual cortex of the mouse brain exhibit remarkably long-term adaptation to brief stimuli, persisting over dozens of seconds, and despite the presentation of several intervening stimuli. The visual cortex thus maintains long-term traces of individual briefly experienced past images, enabling the formation of statistical representations over extended timescales.

Plasticity in visual cortex is disrupted in a mouse model of tauopathy.

Alzheimer's disease and other dementias are thought to underlie a progressive impairment of neural plasticity. Previous work in mouse models of Alzheimer's disease shows pronounced changes in artificially-induced plasticity in hippocampus, perirhinal and prefrontal cortex. However, it is not known how degeneration disrupts intrinsic forms of brain plasticity. Here we characterised the impact of tauopathy on a simple form of intrinsic plasticity in the visual system, which allowed us to track plasticity at both long (days) and short (minutes) timescales. We studied rTg4510 transgenic mice at early stages of tauopathy (5 months) and a more advanced stage (8 months). We recorded local field potentials in the primary visual cortex while animals were repeatedly exposed to a stimulus over 9 days. We found that both short- and long-term visual plasticity were already disrupted at early stages of tauopathy, and further reduced in older animals, such that it was abolished in mice expressing mutant tau. Additionally, visually evoked behaviours were disrupted in both younger and older mice expressing mutant tau. Our results show that visual cortical plasticity and visually evoked behaviours are disrupted in the rTg4510 model of tauopathy. This simple measure of plasticity may help understand how tauopathy disrupts neural circuits, and offers a translatable platform for detection and tracking of the disease.

Calibrating Vision: Concepts and Questions.

The idea that visual coding and perception are shaped by experience and adjust to changes in the environment or the observer is universally recognized as a cornerstone of visual processing, yet the functions and processes mediating these calibrations remain in many ways poorly understood. In this article we review a number of facets and issues surrounding the general notion of calibration, with a focus on plasticity within the encoding and representational stages of visual processing. These include how many types of calibrations there are - and how we decide; how plasticity for encoding is intertwined with other principles of sensory coding; how it is instantiated at the level of the dynamic networks mediating vision; how it varies with development or between individuals; and the factors that may limit the form or degree of the adjustments. Our goal is to give a small glimpse of an enormous and fundamental dimension of vision, and to point to some of the unresolved questions in our understanding of how and why ongoing calibrations are a pervasive and essential element of vision.

Lévy walk dynamics explain gamma burst patterns in primate cerebral cortex.

Lévy walks describe patterns of intermittent motion with variable step sizes. In complex biological systems, Lévy walks (non-Brownian, superdiffusive random walks) are associated with behaviors such as search patterns of animals foraging for food. Here we show that Lévy walks also describe patterns of oscillatory activity in primate cerebral cortex. We used a combination of empirical observation and modeling to investigate high-frequency (gamma band) local field potential activity in visual motion-processing cortical area MT of marmoset monkeys. We found that gamma activity is organized as localized burst patterns that propagate across the cortical surface with Lévy walk dynamics. Lévy walks are fundamentally different from either global synchronization, or regular propagating waves, because they include large steps that enable activity patterns to move rapidly over cortical modules. The presence of Lévy walk dynamics therefore represents a previously undiscovered mode of brain activity, and implies a novel way for the cortex to compute. We apply a biophysically realistic circuit model to explain that the Lévy walk dynamics arise from critical-state transitions between asynchronous and localized propagating wave states, and that these dynamics yield optimal spatial sampling of the cortical sheet. We hypothesise that Lévy walk dynamics could help the cortex to efficiently process variable inputs, and to find links in patterns of activity among sparsely spiking populations of neurons.

Creating and controlling visual environments using BonVision.

Real-time rendering of closed-loop visual environments is important for next-generation understanding of brain function and behaviour, but is often prohibitively difficult for non-experts to implement and is limited to few laboratories worldwide. We developed BonVision as an easy-to-use open-source software for the display of virtual or augmented reality, as well as standard visual stimuli. BonVision has been tested on humans and mice, and is capable of supporting new experimental designs in other animal models of vision. As the architecture is based on the open-source Bonsai graphical programming language, BonVision benefits from native integration with experimental hardware. BonVision therefore enables easy implementation of closed-loop experiments, including real-time interaction with deep neural networks, and communication with behavioural and physiological measurement and manipulation devices.

Retinal ganglion cells and the magnocellular, parvocellular, and koniocellular subcortical visual pathways from the eye to the brain.

In primates including humans, most retinal ganglion cells send signals to the lateral geniculate nucleus (LGN) of the thalamus. The anatomical and functional properties of the two major pathways through the LGN, the parvocellular (P) and magnocellular (M) pathways, are now well understood. Neurones in these pathways appear to convey a filtered version of the retinal image to primary visual cortex for further analysis. The properties of the P-pathway suggest it is important for high spatial acuity and red-green color vision, while those of the M-pathway suggest it is important for achromatic visual sensitivity and motion vision. Recent work has sharpened our understanding of how these properties are built in the retina, and described subtle but important nonlinearities that shape the signals that cortex receives. In addition to the P- and M-pathways, other retinal ganglion cells also project to the LGN. These ganglion cells are larger than those in the P- and M-pathways, have different retinal connectivity, and project to distinct regions of the LGN, together forming heterogenous koniocellular (K) pathways. Recent work has started to reveal the properties of these K-pathways, in the retina and in the LGN. The functional properties of K-pathways are more complex than those in the P- and M-pathways, and the K-pathways are likely to have a distinct contribution to vision. They provide a complementary pathway to the primary visual cortex, but can also send signals directly to extrastriate visual cortex. At the level of the LGN, many neurones in the K-pathways seem to integrate retinal with non-retinal inputs, and some may provide an early site of binocular convergence.

Dynamic Contextual Modulation in Superior Colliculus of Awake Mouse.

The responses of neurons in the visual pathway depend on the context in which a stimulus is presented. Responses to predictable stimuli are usually suppressed, highlighting responses to unexpected stimuli that might be important for behavior. Here, we established how context modulates the response of neurons in the superior colliculus (SC), a region important in orienting toward or away from visual stimuli. We made extracellular recordings from single units in the superficial layers of SC in awake mice. We found strong suppression of visual response by spatial context (surround suppression) and temporal context (adaptation). Neurons showing stronger surround suppression also showed stronger adaptation effects. In neurons where it was present, surround suppression was dynamic and was reduced by adaptation. Adaptation's effects further revealed two components to surround suppression: one component that was weakly tuned for orientation and adaptable, and another component that was more strongly tuned but less adaptable. The selectivity of the tuned component was flexible, such that suppression was stronger when the stimulus over the surround matched that over the receptive field. Our results therefore reveal strong interactions between spatial and temporal context in regulating the flow of signals through mouse SC, and suggest the presence of a subpopulation of neurons that might signal novelty in either space or time.

Fractal spike dynamics and neuronal coupling in the primate visual system.

KEY POINTS: We measured fractal (self-similar) fluctuations in ongoing spiking activity in subcortical (lateral geniculate nucleus, LGN) and cortical (area MT) visual areas in anaesthetised marmosets. Cells in the evolutionary ancient koniocellular LGN pathway and in area MT show high-amplitude fractal fluctuations, whereas evolutionarily newer parvocellular and magnocellular LGN cells do not. Spiking activity in koniocellular cells and MT cells shows substantial correlation to the local population activity, whereas activity in parvocellular and magnocellular cells is less correlated with local activity. We develop a model consisting of a fractal process and a global rate modulation which can reproduce and explain the fundamental relationship between fractal fluctuations and population coupling in LGN and MT. The model provides a unified account of apparently disparate aspects of neural spiking activity and can improve our understanding of information processing in evolutionary ancient and modern visual pathways. ABSTRACT: The brain represents and processes information through patterns of spiking activity, which is influenced by local and widescale brain circuits as well as intrinsic neural dynamics. Whether these influences have independent or linked effects on spiking activity is, however, not known. Here we measured spiking activity in two visual centres, the lateral geniculate nucleus (LGN) and cortical area MT, in marmoset monkeys. By combining the Fano-factor time curve, power spectral analysis and rescaled range analysis, we reveal inherent fractal fluctuations of spiking activity in LGN and MT. We found that the evolutionary ancient koniocellular (K) pathway in LGN and area MT exhibits strong fractal fluctuations at short (<1 s) time scales. Parvocellular (P) and magnocellular (M) LGN cells show weaker fractal fluctuations at longer (multi-second) time scales. In both LGN and MT, the amplitude and time scale of fractal fluctuations can explain short and long time scale spiking dynamics. We further show differential neuronal coupling of LGN and MT cells to local population spiking activity. The population coupling is intrinsically linked to fractal fluctuations: neurons showing stronger fluctuations are more strongly correlated to the local population activity. To understand this relationship, we modelled spiking activity using a fractal inhomogeneous Poisson process with dynamic rate, which is the product of an intrinsic stochastic fractal rate and a global modulatory gain. Our model explains the intrinsic links between neuronal spike rate and population coupling in LGN and MT, and establishes a unified account of dynamic spiking properties in afferent visual pathways.

The koniocellular whiteboard.

In 1994 Vivien Casagrande published a review paper in which she summarized evidence for a koniocellular pathway to visual cortex. Here we try to explain how that review moved the field forward, and summarize some key unanswered questions about koniocellular pathways.

Integration of visual and whisker signals in rat superior colliculus.

Multisensory integration is a process by which signals from different sensory modalities are combined to facilitate detection and localization of external events. One substrate for multisensory integration is the midbrain superior colliculus (SC) which plays an important role in orienting behavior. In rodent SC, visual and somatosensory (whisker) representations are in approximate registration, but whether and how these signals interact is unclear. We measured spiking activity in SC of anesthetized hooded rats, during presentation of visual- and whisker stimuli that were tested simultaneously or in isolation. Visual responses were found in all layers, but were primarily located in superficial layers. Whisker responsive sites were primarily found in intermediate layers. In single- and multi-unit recording sites, spiking activity was usually only sensitive to one modality, when stimuli were presented in isolation. By contrast, we observed robust and primarily suppressive interactions when stimuli were presented simultaneously to both modalities. We conclude that while visual and whisker representations in SC of rat are partially overlapping, there is limited excitatory convergence onto individual sites. Multimodal integration may instead rely on suppressive interactions between modalities.

Visual response properties of neurons in the superficial layers of the superior colliculus of awake mouse.

KEY POINTS: In rodents, including mice, the superior colliculus is the major target of the retina, but its visual response is not well characterized. In the present study, extracellular recordings from single nerve cells in the superficial layers of the superior colliculus were made in awake, head-restrained mice, and their responses to visual stimuli were measured. It was found that these neurons show brisk, highly sensitive and short latency visual responses, a preference for black over white stimuli, and diverse responses to moving patterns. At least five broad classes can be defined by variation in functional properties among units. The results of the present study demonstrate that eye movements have a measurable impact on visual responses in awake animals and show how they may be mitigated in analyses. ABSTRACT: The mouse is an increasingly important animal model of visual function in health and disease. In mice, most retinal signals are routed through the superficial layers of the midbrain superior colliculus, and it is well established that much of the visual behaviour of mice relies on activity in the superior colliculus. The functional organization of visual signals in the mouse superior colliculus is, however, not well established in awake animals. We therefore made extracellular recordings from the superficial layers of the superior colliculus in awake mice, while the animals were viewing visual stimuli including flashed spots and drifting gratings. We find that neurons in the superficial layers of the superior colliculus of awake mouse generally show short latency, brisk responses. Receptive fields are usually 'ON-OFF' with a preference for black stimuli, and are weakly non-linear in response to gratings and other forms of luminance modulation. Population responses to drifting gratings are highly contrast sensitive, with a robust response to spatial frequencies above 0.3 cycles degree-1 and temporal frequencies above 15 Hz. The receptive fields are also often speed-tuned or direction-selective. Analysis of the response across multiple stimulus dimensions reveals at least five functionally distinct groups of units. We also find that eye movements affect measurements of receptive field properties in awake animals, and show how these may be mitigated in analyses. Qualitatively similar responses were obtained in urethane-anaesthetized animals, although receptive fields in awake animals had higher contrast sensitivity, shorter visual latency and a stronger response to high temporal frequencies.

Temporal Contingencies Determine Whether Adaptation Strengthens or Weakens Normalization.

A fundamental and nearly ubiquitous feature of sensory encoding is that neuronal responses are strongly influenced by recent experience, or adaptation. Theoretical and computational studies have proposed that many adaptation effects may result in part from changes in the strength of normalization signals. Normalization is a "canonical" computation in which a neuron's response is modulated (normalized) by the pooled activity of other neurons. Here, we test whether adaptation can alter the strength of cross-orientation suppression, or masking, a paradigmatic form of normalization evident in primary visual cortex (V1). We made extracellular recordings of V1 neurons in anesthetized male macaques and measured responses to plaid stimuli composed of two overlapping, orthogonal gratings before and after prolonged exposure to two distinct adapters. The first adapter was a plaid consisting of orthogonal gratings and led to stronger masking. The second adapter presented the same orthogonal gratings in an interleaved manner and led to weaker masking. The strength of adaptation's effects on masking depended on the orientation of the test stimuli relative to the orientation of the adapters, but was independent of neuronal orientation preference. Changes in masking could not be explained by altered neuronal responsivity. Our results suggest that normalization signals can be strengthened or weakened by adaptation depending on the temporal contingencies of the adapting stimuli. Our findings reveal an interplay between two widespread computations in cortical circuits, adaptation and normalization, that enables flexible adjustments to the structure of the environment, including the temporal relationships among sensory stimuli.SIGNIFICANCE STATEMENT Two fundamental features of sensory responses are that they are influenced by adaptation and that they are modulated by the activity of other nearby neurons via normalization. Our findings reveal a strong interaction between these two aspects of cortical computation. Specifically, we show that cross-orientation masking, a form of normalization, can be strengthened or weakened by adaptation depending on the temporal contingencies between sensory inputs. Our findings support theoretical proposals that some adaptation effects may involve altered normalization and offer a network-based explanation for how cortex adjusts to current sensory demands.

Receptive Field Properties of Koniocellular On/Off Neurons in the Lateral Geniculate Nucleus of Marmoset Monkeys.

The koniocellular (K) layers of the primate dorsal lateral geniculate nucleus house a variety of visual receptive field types, not all of which have been fully characterized. Here we made single-cell recordings targeted to the K layers of diurnal New World monkeys (marmosets). A subset of recorded cells was excited by both increments and decrements of light intensity (on/off-cells). Histological reconstruction of the location of these cells confirmed that they are segregated to K layers; we therefore refer to these cells as K-on/off cells. The K-on/off cells show high contrast sensitivity, strong bandpass spatial frequency tuning, and their response magnitude is strongly reduced by stimuli larger than the excitatory receptive field (silent suppressive surrounds). Stationary counterphase gratings evoke unmodulated spike rate increases or frequency-doubled responses in K-on/off cells; such responses are largely independent of grating spatial phase. The K-on/off cells are not orientation or direction selective. Some (but not all) properties of K-on/off cells are consistent with those of local-edge-detector/impressed-by-contrast cells reported in studies of cat retina and geniculate, and broad-thorny ganglion cells recorded in macaque monkey retina. The receptive field properties of K-on/off cells and their preferential location in the ventral K layers (K1 and K2) make them good candidates for the direct projection from geniculate to extrastriate cortical area MT/V5. If so, they could contribute to visual information processing in the dorsal ("where" or "action") visual stream.SIGNIFICANCE STATEMENT We characterize cells in an evolutionary ancient part of the visual pathway in primates. The cells are located in the lateral geniculate nucleus (the main visual afferent relay nucleus), in regions called koniocellular layers that are known to project to extrastriate visual areas as well as primary visual cortex. The cells show high contrast sensitivity and rapid, transient responses to light onset and offset. Their properties suggest they could contribute to visual processing in the dorsal ("where" or "action") visual stream.

Interpreting the dimensions of neural feature representations revealed by dimensionality reduction.

Recent progress in understanding the structure of neural representations in the cerebral cortex has centred around the application of multivariate classification analyses to measurements of brain activity. These analyses have proved a sensitive test of whether given brain regions provide information about specific perceptual or cognitive processes. An exciting extension of this approach is to infer the structure of this information, thereby drawing conclusions about the underlying neural representational space. These approaches rely on exploratory data-driven dimensionality reduction to extract the natural dimensions of neural spaces, including natural visual object and scene representations, semantic and conceptual knowledge, and working memory. However, the efficacy of these exploratory methods is unknown, because they have only been applied to representations in brain areas for which we have little or no secondary knowledge. One of the best-understood areas of the cerebral cortex is area MT of primate visual cortex, which is known to be important in motion analysis. To assess the effectiveness of dimensionality reduction for recovering neural representational space we applied several dimensionality reduction methods to multielectrode measurements of spiking activity obtained from area MT of marmoset monkeys, made while systematically varying the motion direction and speed of moving stimuli. Despite robust tuning at individual electrodes, and high classifier performance, dimensionality reduction rarely revealed dimensions for direction and speed. We use this example to illustrate important limitations of these analyses, and suggest a framework for how to best apply such methods to data where the structure of the neural representation is unknown.

Visual Motion Discrimination by Propagating Patterns in Primate Cerebral Cortex.

Visual stimuli can evoke waves of neural activity that propagate across the surface of visual cortical areas. The relevance of these waves for visual processing is unknown. Here, we measured the phase and amplitude of local field potentials (LFPs) in electrode array recordings from the motion-processing medial temporal (MT) area of anesthetized male marmosets. Animals viewed grating or dot-field stimuli drifting in different directions. We found that, on individual trials, the direction of LFP wave propagation is sensitive to the direction of stimulus motion. Propagating LFP patterns are also detectable in trial-averaged activity, but the trial-averaged patterns exhibit different dynamics and behaviors from those in single trials and are similar across motion directions. We show that this difference arises because stimulus-sensitive propagating patterns are present in the phase of single-trial oscillations, whereas the trial-averaged signal is dominated by additive amplitude effects. Our results demonstrate that propagating LFP patterns can represent sensory inputs at timescales relevant to visually guided behaviors and raise the possibility that propagating activity patterns serve neural information processing in area MT and other cortical areas.SIGNIFICANCE STATEMENT Propagating wave patterns are widely observed in the cortex, but their functional relevance remains unknown. We show here that visual stimuli generate propagating wave patterns in local field potentials (LFPs) in a movement-sensitive area of the primate cortex and that the propagation direction of these patterns is sensitive to stimulus motion direction. We also show that averaging LFP signals across multiple stimulus presentations (trial averaging) yields propagating patterns that capture different dynamic properties of the LFP response and show negligible direction sensitivity. Our results demonstrate that sensory stimuli can modulate propagating wave patterns reliably in the cortex. The relevant dynamics are normally masked by trial averaging, which is a conventional step in LFP signal processing.

Dynamic population codes of multiplexed stimulus features in primate area MT.

The middle-temporal area (MT) of primate visual cortex is critical in the analysis of visual motion. Single-unit studies suggest that the response dynamics of neurons within area MT depend on stimulus features, but how these dynamics emerge at the population level, and how feature representations interact, is not clear. Here, we used multivariate classification analysis to study how stimulus features are represented in the spiking activity of populations of neurons in area MT of marmoset monkey. Using representational similarity analysis we distinguished the emerging representations of moving grating and dot field stimuli. We show that representations of stimulus orientation, spatial frequency, and speed are evident near the onset of the population response, while the representation of stimulus direction is slower to emerge and sustained throughout the stimulus-evoked response. We further found a spatiotemporal asymmetry in the emergence of direction representations. Representations for high spatial frequencies and low temporal frequencies are initially orientation dependent, while those for high temporal frequencies and low spatial frequencies are more sensitive to motion direction. Our analyses reveal a complex interplay of feature representations in area MT population response that may explain the stimulus-dependent dynamics of motion vision.NEW & NOTEWORTHY Simultaneous multielectrode recordings can measure population-level codes that previously were only inferred from single-electrode recordings. However, many multielectrode recordings are analyzed using univariate single-electrode analysis approaches, which fail to fully utilize the population-level information. Here, we overcome these limitations by applying multivariate pattern classification analysis and representational similarity analysis to large-scale recordings from middle-temporal area (MT) in marmoset monkeys. Our analyses reveal a dynamic interplay of feature representations in area MT population response.