Sensory input to cortex encoded on low-dimensional periphery-correlated subspaces.

As information about the world is conveyed from the sensory periphery to central neural circuits, it mixes with complex ongoing cortical activity. How do neural populations keep track of sensory signals, separating them from noisy ongoing activity? Here, we show that sensory signals are encoded more reliably in certain low-dimensional subspaces. These coding subspaces are defined by correlations between neural activity in the primary sensory cortex and upstream sensory brain regions; the most correlated dimensions were best for decoding. We analytically show that these correlation-based coding subspaces improve, reaching optimal limits (without an ideal observer), as noise correlations between cortex and upstream regions are reduced. We show that this principle generalizes across diverse sensory stimuli in the olfactory system and the visual system of awake mice. Our results demonstrate an algorithm the cortex may use to multiplex different functions, processing sensory input in low-dimensional subspaces separate from other ongoing functions.

Odor modality is transmitted to cortical brain regions from the olfactory bulb.

Odor perception is the impetus for important animal behaviors with two predominate modes of processing: odors pass through the front of the nose (orthonasal) while inhaling and sniffing, or through the rear (retronasal) during exhalation and while eating. Despite the importance of olfaction for an animal's well-being and that ortho and retro naturally occur, it is unknown how the modality (ortho vs. retro) is even transmitted to cortical brain regions, which could significantly affect how odors are processed and perceived. Using multielectrode array recordings in tracheotomized anesthetized rats, which decouples ortho-retro modality from breathing, we show that mitral cells in rat olfactory bulb can reliably and directly transmit orthonasal versus retronasal modality with ethyl butyrate, a common food odor. Drug manipulations affecting synaptic inhibition via GABAA lead to worse decoding of ortho versus retro, independent of whether overall inhibition increases or decreases, suggesting that the olfactory bulb circuit may naturally favor encoding this important aspect of odors. Detailed data analysis paired with a firing rate model that captures population trends in spiking statistics shows how this circuit can encode odor modality. We have not only demonstrated that ortho/retro information is encoded to downstream brain regions but also used modeling to demonstrate a plausible mechanism for this encoding; due to synaptic adaptation, it is the slower time course of the retronasal stimulation that causes retronasal responses to be stronger and less sensitive to inhibitory drug manipulations than orthonasal responses.NEW & NOTEWORTHY Whether ortho (sniffing odors) versus retro (exhalation and eating) is encoded from the olfactory bulb to other brain areas is not completely known. Using multielectrode array recordings in anesthetized rats, we show that the olfactory bulb transmits this information downstream via spikes. Altering inhibition degrades ortho/retro information on average. We use theory and computation to explain our results, which should have implications on cortical processing considering that only food odors occur retronasally.

Differences in olfactory bulb mitral cell spiking with ortho- and retronasal stimulation revealed by data-driven models.

The majority of olfaction studies focus on orthonasal stimulation where odors enter via the front nasal cavity, while retronasal olfaction, where odors enter the rear of the nasal cavity during feeding, is understudied. The coding of retronasal odors via coordinated spiking of neurons in the olfactory bulb (OB) is largely unknown despite evidence that higher level processing is different than orthonasal. To this end, we use multi-electrode array in vivo recordings of rat OB mitral cells (MC) in response to a food odor with both modes of stimulation, and find significant differences in evoked firing rates and spike count covariances (i.e., noise correlations). Differences in spiking activity often have implications for sensory coding, thus we develop a single-compartment biophysical OB model that is able to reproduce key properties of important OB cell types. Prior experiments in olfactory receptor neurons (ORN) showed retro stimulation yields slower and spatially smaller ORN inputs than with ortho, yet whether this is consequential for OB activity remains unknown. Indeed with these specifications for ORN inputs, our OB model captures the salient trends in our OB data. We also analyze how first and second order ORN input statistics dynamically transfer to MC spiking statistics with a phenomenological linear-nonlinear filter model, and find that retro inputs result in larger linear filters than ortho inputs. Finally, our models show that the temporal profile of ORN is crucial for capturing our data and is thus a distinguishing feature between ortho and retro stimulation, even at the OB. Using data-driven modeling, we detail how ORN inputs result in differences in OB dynamics and MC spiking statistics. These differences may ultimately shape how ortho and retro odors are coded.

Odor-evoked increases in olfactory bulb mitral cell spiking variability.

The spiking variability of neural networks has important implications for how information is encoded to higher brain regions. It has been well documented by numerous labs in many cortical and motor regions that spiking variability decreases with stimulus onset, yet whether this principle holds in the OB has not been tested. In stark contrast to this common view, we demonstrate that the onset of sensory input can cause an increase in the variability of neural activity in the mammalian OB. We show this in both anesthetized and awake rodents. Furthermore, we use computational models to describe the mechanisms of this phenomenon. Our findings establish sensory evoked increases in spiking variability as a viable alternative coding strategy.

Efficient calculation of heterogeneous non-equilibrium statistics in coupled firing-rate models.

Understanding nervous system function requires careful study of transient (non-equilibrium) neural response to rapidly changing, noisy input from the outside world. Such neural response results from dynamic interactions among multiple, heterogeneous brain regions. Realistic modeling of these large networks requires enormous computational resources, especially when high-dimensional parameter spaces are considered. By assuming quasi-steady-state activity, one can neglect the complex temporal dynamics; however, in many cases the quasi-steady-state assumption fails. Here, we develop a new reduction method for a general heterogeneous firing-rate model receiving background correlated noisy inputs that accurately handles highly non-equilibrium statistics and interactions of heterogeneous cells. Our method involves solving an efficient set of nonlinear ODEs, rather than time-consuming Monte Carlo simulations or high-dimensional PDEs, and it captures the entire set of first and second order statistics while allowing significant heterogeneity in all model parameters.

Investigating the Correlation-Firing Rate Relationship in Heterogeneous Recurrent Networks.

The structure of spiking activity in cortical networks has important implications for how the brain ultimately codes sensory signals. However, our understanding of how network and intrinsic cellular mechanisms affect spiking is still incomplete. In particular, whether cell pairs in a neural network show a positive (or no) relationship between pairwise spike count correlation and average firing rate is generally unknown. This relationship is important because it has been observed experimentally in some sensory systems, and it can enhance information in a common population code. Here we extend our prior work in developing mathematical tools to succinctly characterize the correlation and firing rate relationship in heterogeneous coupled networks. We find that very modest changes in how heterogeneous networks occupy parameter space can dramatically alter the correlation-firing rate relationship.

A geometric method for eigenvalue problems with low-rank perturbations.

We consider the problem of finding the spectrum of an operator taking the form of a low-rank (rank one or two) non-normal perturbation of a well-understood operator, motivated by a number of problems of applied interest which take this form. We use the fact that the system is a low-rank perturbation of a solved problem, together with a simple idea of classical differential geometry (the envelope of a family of curves) to completely analyse the spectrum. We use these techniques to analyse three problems of this form: a model of the oculomotor integrator due to Anastasio & Gad (2007 J. Comput. Neurosci.22, 239-254. (doi:10.1007/s10827-006-0010-x)), a continuum integrator model, and a non-local model of phase separation due to Rubinstein & Sternberg (1992 IMA J. Appl. Math.48, 249-264. (doi:10.1093/imamat/48.3.249)).

Symmetries Constrain Dynamics in a Family of Balanced Neural Networks.

We examine a family of random firing-rate neural networks in which we enforce the neurobiological constraint of Dale's Law-each neuron makes either excitatory or inhibitory connections onto its post-synaptic targets. We find that this constrained system may be described as a perturbation from a system with nontrivial symmetries. We analyze the symmetric system using the tools of equivariant bifurcation theory and demonstrate that the symmetry-implied structures remain evident in the perturbed system. In comparison, spectral characteristics of the network coupling matrix are relatively uninformative about the behavior of the constrained system.

A theoretical framework for analyzing coupled neuronal networks: Application to the olfactory system.

Determining how synaptic coupling within and between regions is modulated during sensory processing is an important topic in neuroscience. Electrophysiological recordings provide detailed information about neural spiking but have traditionally been confined to a particular region or layer of cortex. Here we develop new theoretical methods to study interactions between and within two brain regions, based on experimental measurements of spiking activity simultaneously recorded from the two regions. By systematically comparing experimentally-obtained spiking statistics to (efficiently computed) model spike rate statistics, we identify regions in model parameter space that are consistent with the experimental data. We apply our new technique to dual micro-electrode array in vivo recordings from two distinct regions: olfactory bulb (OB) and anterior piriform cortex (PC). Our analysis predicts that: i) inhibition within the afferent region (OB) has to be weaker than the inhibition within PC, ii) excitation from PC to OB is generally stronger than excitation from OB to PC, iii) excitation from PC to OB and inhibition within PC have to both be relatively strong compared to presynaptic inputs from OB. These predictions are validated in a spiking neural network model of the OB-PC pathway that satisfies the many constraints from our experimental data. We find when the derived relationships are violated, the spiking statistics no longer satisfy the constraints from the data. In principle this modeling framework can be adapted to other systems and be used to investigate relationships between other neural attributes besides network connection strengths. Thus, this work can serve as a guide to further investigations into the relationships of various neural attributes within and across different regions during sensory processing.

Practical approximation method for firing-rate models of coupled neural networks with correlated inputs.

Rapid experimental advances now enable simultaneous electrophysiological recording of neural activity at single-cell resolution across large regions of the nervous system. Models of this neural network activity will necessarily increase in size and complexity, thus increasing the computational cost of simulating them and the challenge of analyzing them. Here we present a method to approximate the activity and firing statistics of a general firing rate network model (of the Wilson-Cowan type) subject to noisy correlated background inputs. The method requires solving a system of transcendental equations and is fast compared to Monte Carlo simulations of coupled stochastic differential equations. We implement the method with several examples of coupled neural networks and show that the results are quantitatively accurate even with moderate coupling strengths and an appreciable amount of heterogeneity in many parameters. This work should be useful for investigating how various neural attributes qualitatively affect the spiking statistics of coupled neural networks.

When do correlations increase with firing rates in recurrent networks?

A central question in neuroscience is to understand how noisy firing patterns are used to transmit information. Because neural spiking is noisy, spiking patterns are often quantified via pairwise correlations, or the probability that two cells will spike coincidentally, above and beyond their baseline firing rate. One observation frequently made in experiments, is that correlations can increase systematically with firing rate. Theoretical studies have determined that stimulus-dependent correlations that increase with firing rate can have beneficial effects on information coding; however, we still have an incomplete understanding of what circuit mechanisms do, or do not, produce this correlation-firing rate relationship. Here, we studied the relationship between pairwise correlations and firing rates in recurrently coupled excitatory-inhibitory spiking networks with conductance-based synapses. We found that with stronger excitatory coupling, a positive relationship emerged between pairwise correlations and firing rates. To explain these findings, we used linear response theory to predict the full correlation matrix and to decompose correlations in terms of graph motifs. We then used this decomposition to explain why covariation of correlations with firing rate-a relationship previously explained in feedforward networks driven by correlated input-emerges in some recurrent networks but not in others. Furthermore, when correlations covary with firing rate, this relationship is reflected in low-rank structure in the correlation matrix.

When do microcircuits produce beyond-pairwise correlations?

Describing the collective activity of neural populations is a daunting task. Recent empirical studies in retina, however, suggest a vast simplification in how multi-neuron spiking occurs: the activity patterns of retinal ganglion cell (RGC) populations under some conditions are nearly completely captured by pairwise interactions among neurons. In other circumstances, higher-order statistics are required and appear to be shaped by input statistics and intrinsic circuit mechanisms. Here, we study the emergence of higher-order interactions in a model of the RGC circuit in which correlations are generated by common input. We quantify the impact of higher-order interactions by comparing the responses of mechanistic circuit models vs. "null" descriptions in which all higher-than-pairwise correlations have been accounted for by lower order statistics; these are known as pairwise maximum entropy (PME) models. We find that over a broad range of stimuli, output spiking patterns are surprisingly well captured by the pairwise model. To understand this finding, we study an analytically tractable simplification of the RGC model. We find that in the simplified model, bimodal input signals produce larger deviations from pairwise predictions than unimodal inputs. The characteristic light filtering properties of the upstream RGC circuitry suppress bimodality in light stimuli, thus removing a powerful source of higher-order interactions. This provides a novel explanation for the surprising empirical success of pairwise models.

Neural integrators for decision making: a favorable tradeoff between robustness and sensitivity.

A key step in many perceptual decision tasks is the integration of sensory inputs over time, but a fundamental questions remain about how this is accomplished in neural circuits. One possibility is to balance decay modes of membranes and synapses with recurrent excitation. To allow integration over long timescales, however, this balance must be exceedingly precise. The need for fine tuning can be overcome via a "robust integrator" mechanism in which momentary inputs must be above a preset limit to be registered by the circuit. The degree of this limiting embodies a tradeoff between sensitivity to the input stream and robustness against parameter mistuning. Here, we analyze the consequences of this tradeoff for decision-making performance. For concreteness, we focus on the well-studied random dot motion discrimination task and constrain stimulus parameters by experimental data. We show that mistuning feedback in an integrator circuit decreases decision performance but that the robust integrator mechanism can limit this loss. Intriguingly, even for perfectly tuned circuits with no immediate need for a robustness mechanism, including one often does not impose a substantial penalty for decision-making performance. The implication is that robust integrators may be well suited to subserve the basic function of evidence integration in many cognitive tasks. We develop these ideas using simulations of coupled neural units and the mathematics of sequential analysis.

A-current and type I/type II transition determine collective spiking from common input.

The mechanisms and impact of correlated, or synchronous, firing among pairs and groups of neurons are under intense investigation throughout the nervous system. A ubiquitous circuit feature that can give rise to such correlations consists of overlapping, or common, inputs to pairs and populations of cells, leading to common spike train responses. Here, we use computational tools to study how the transfer of common input currents into common spike outputs is modulated by the physiology of the recipient cells. We focus on a key conductance, g(A), for the A-type potassium current, which drives neurons between "type II" excitability (low g(A)), and "type I" excitability (high g(A)). Regardless of g(A), cells transform common input fluctuations into a tendency to spike nearly simultaneously. However, this process is more pronounced at low g(A) values. Thus, for a given level of common input, type II neurons produce spikes that are relatively more correlated over short time scales. Over long time scales, the trend reverses, with type II neurons producing relatively less correlated spike trains. This is because these cells' increased tendency for simultaneous spiking is balanced by an anticorrelation of spikes at larger time lags. These findings extend and interpret prior findings for phase oscillators to conductance-based neuron models that cover both oscillatory (superthreshold) and subthreshold firing regimes. We demonstrate a novel implication for neural signal processing: downstream cells with long time constants are selectively driven by type I cell populations upstream and those with short time constants by type II cell populations. Our results are established via high-throughput numerical simulations and explained via the cells' filtering properties and nonlinear dynamics.

Time scales of spike-train correlation for neural oscillators with common drive.

We examine the effect of the phase-resetting curve on the transfer of correlated input signals into correlated output spikes in a class of neural models receiving noisy superthreshold stimulation. We use linear-response theory to approximate the spike correlation coefficient in terms of moments of the associated exit time problem and contrast the results for type I vs type II models and across the different time scales over which spike correlations can be assessed. We find that, on long time scales, type I oscillators transfer correlations much more efficiently than type II oscillators. On short time scales this trend reverses, with the relative efficiency switching at a time scale that depends on the mean and standard deviation of input currents. This switch occurs over time scales that could be exploited by downstream circuits.

Bifurcation theory explains waveform variability in a congenital eye movement disorder.

In dynamical systems, configurations that permit flexible control are also prone to undesirable behavior. We study a bilateral model of the oculomotor pre-motor network that conforms with the neuroanatomical constraint that brainstem neurons project to cerebellar Purkinje cells on both sides, but Purkinje cells project back to brainstem neurons on the same side only. Bifurcation analysis reveals that this network asymmetry enables flexible control by the cerebellum of brainstem network dynamics, but small changes in connection pattern or strength lead to behavior that is unstable, oscillatory, or both. The model produces the full range of waveform types associated with the hereditary eye movement disorder know as congenital nystagmus, and is consistent with findings linking the disorder with abnormal connectivity or limited plasticity in the cerebellum.