Back-Propagation Learning in Deep Spike-By-Spike Networks.

Artificial neural networks (ANNs) are important building blocks in technical applications. They rely on noiseless continuous signals in stark contrast to the discrete action potentials stochastically exchanged among the neurons in real brains. We propose to bridge this gap with Spike-by-Spike (SbS) networks which represent a compromise between non-spiking and spiking versions of generative models. What is missing, however, are algorithms for finding weight sets that would optimize the output performances of deep SbS networks with many layers. Here, a learning rule for feed-forward SbS networks is derived. The properties of this approach are investigated and its functionality is demonstrated by simulations. In particular, a Deep Convolutional SbS network for classifying handwritten digits achieves a classification performance of roughly 99.3% on the MNIST test data when the learning rule is applied together with an optimizer. Thereby it approaches the benchmark results of ANNs without extensive parameter optimization. We envision this learning rule for SBS networks to provide a new basis for research in neuroscience and for technical applications, especially when they become implemented on specialized computational hardware.

Attention Selectively Gates Afferent Signal Transmission to Area V4.

Selective attention allows focusing on only part of the incoming sensory information. Neurons in the extrastriate visual cortex reflect such selective processing when different stimuli are simultaneously present in their large receptive fields. Their spiking response then resembles the response to the attended stimulus when presented in isolation. Unclear is where in the neuronal pathway attention intervenes to achieve such selective signal routing and processing. To investigate this question, we tagged two equivalent visual stimuli by independent broadband luminance noise and used the spectral coherence of these behaviorally irrelevant signals with the field potential of a local neuronal population in male macaque monkeys' area V4 as a measure for their respective causal influences. This new experimental paradigm revealed that signal transmission was considerably weaker for the not-attended stimulus. Furthermore, our results show that attention does not need to modulate responses in the input populations sending signals to V4 to selectively represent a stimulus, nor do they suggest a change of the V4 neurons' output gain depending on their feature similarity with the stimuli. Our results rather imply that selective attention uses a gating mechanism comprising the synaptic "inputs" that transmit signals from upstream areas into the V4 neurons. A minimal model implementing attention-dependent routing by gamma-band synchrony replicated the attentional gating effect and the signals' spectral transfer characteristics. It supports the proposal that selective interareal gamma-band synchrony subserves signal routing and explains our experimental finding that attention selectively gates signals already at the level of afferent synaptic input.SIGNIFICANCE STATEMENT Depending on the behavioral context, the brain needs to channel the flow of information through its networks of massively interconnected neurons. We designed an experiment that allows to causally assess routing of information originating from an attended object. We found that attention "gates" signals at the interplay between afferent fibers and the local neurons. A minimal model demonstrated that coherent gamma-rhythmic activity (∼60 Hz) between local neurons and their afferent-providing input neurons can realize the gating. Importantly, the attended signals did not need to be amplified already in an earlier processing stage, nor did they get amplified by a simple output response modulation. The method provides a useful tool to study mechanisms of dynamic network configuration underlying cognitive processes.

Implications for a Wireless, External Device System to Study Electrocorticography.

Implantable neuronal interfaces to the brain are an important keystone for future medical applications. However, entering this field of research is difficult since such an implant requires components from many different areas of technology. Since the complete avoidance of wires is important due to the risk of infections and other long-term problems, means for wirelessly transmitting data and energy are a necessity which adds to the requirements. In recent literature, many high-tech components for such implants are presented with remarkable properties. However, these components are typically not freely available for such a system. Every group needs to re-develop their own solution. This raises the question if it is possible to create a reusable design for an implant and its external base-station, such that it allows other groups to use it as a starting point. In this article, we try to answer this question by presenting a design based exclusively on commercial off-the-shelf components and studying the properties of the resulting system. Following this idea, we present a fully wireless neuronal implant for simultaneously measuring electrocorticography signals at 128 locations from the surface of the brain. All design files are available as open source.

Marginally subcritical dynamics explain enhanced stimulus discriminability under attention.

Recent experimental and theoretical work has established the hypothesis that cortical neurons operate close to a critical state which describes a phase transition from chaotic to ordered dynamics. Critical dynamics are suggested to optimize several aspects of neuronal information processing. However, although critical dynamics have been demonstrated in recordings of spontaneously active cortical neurons, little is known about how these dynamics are affected by task-dependent changes in neuronal activity when the cortex is engaged in stimulus processing. Here we explore this question in the context of cortical information processing modulated by selective visual attention. In particular, we focus on recent findings that local field potentials (LFPs) in macaque area V4 demonstrate an increase in γ-band synchrony and a simultaneous enhancement of object representation with attention. We reproduce these results using a model of integrate-and-fire neurons where attention increases synchrony by enhancing the efficacy of recurrent interactions. In the phase space spanned by excitatory and inhibitory coupling strengths, we identify critical points and regions of enhanced discriminability. Furthermore, we quantify encoding capacity using information entropy. We find a rapid enhancement of stimulus discriminability with the emergence of synchrony in the network. Strikingly, only a narrow region in the phase space, at the transition from subcritical to supercritical dynamics, supports the experimentally observed discriminability increase. At the supercritical border of this transition region, information entropy decreases drastically as synchrony sets in. At the subcritical border, entropy is maximized under the assumption of a coarse observation scale. Our results suggest that cortical networks operate at such near-critical states, allowing minimal attentional modulations of network excitability to substantially augment stimulus representation in the LFPs.

Toward high performance, weakly invasive brain computer interfaces using selective visual attention.

Brain-computer interfaces have been proposed as a solution for paralyzed persons to communicate and interact with their environment. However, the neural signals used for controlling such prostheses are often noisy and unreliable, resulting in a low performance of real-world applications. Here we propose neural signatures of selective visual attention in epidural recordings as a fast, reliable, and high-performance control signal for brain prostheses. We recorded epidural field potentials with chronically implanted electrode arrays from two macaque monkeys engaged in a shape-tracking task. For single trials, we classified the direction of attention to one of two visual stimuli based on spectral amplitude, coherence, and phase difference in time windows fixed relative to stimulus onset. Classification performances reached up to 99.9%, and the information about attentional states could be transferred at rates exceeding 580 bits/min. Good classification can already be achieved in time windows as short as 200 ms. The classification performance changed dynamically over the trial and modulated with the task's varying demands for attention. For all three signal features, the information about the direction of attention was contained in the γ-band. The most informative feature was spectral amplitude. Together, these findings establish a novel paradigm for constructing brain prostheses as, for example, virtual spelling boards, promising a major gain in performance and robustness for human brain-computer interfaces.

Attention improves object representation in visual cortical field potentials.

Selective attention improves perception and modulates neuronal responses, but how attention-dependent changes of cortical activity improve the processing of attended objects is an open question. Changes in total signal strength or enhancements in signal-to-noise ratio have been proposed as putative mechanisms. However, it is still not clear whether, and to what extent, these processes contribute to the large perceptual improvements. We studied the ability to discriminate states of activity in visual cortex evoked by differently shaped objects depending on selective attention in monkeys. We found that gamma-band activity from V4 and V1 contains a high amount of information about stimulus shape, which increases for V4 recordings considerably with attention in successful trials, but not in case of behavioral errors. This effect resulted from enhanced differences between the stimulus-specific distributions of power spectral amplitudes. It could be explained neither by enhancements of signal-to-noise ratios, nor by changes in total signal power. Instead our results indicate that attention causes underlying cortical network states to become more distinct for different stimuli, providing a new neurophysiological explanation for improvements of behavioral performance by attention. The absence of the enhancement in discriminability in trials with behavioral errors demonstrates the relevance of this novel neural mechanism for perception.

Efficient computation based on stochastic spikes.

The speed and reliability of mammalian perception indicate that cortical computations can rely on very few action potentials per involved neuron. Together with the stochasticity of single-spike events in cortex, this appears to imply that large populations of redundant neurons are needed for rapid computations with action potentials. Here we demonstrate that very fast and precise computations can be realized also in small networks of stochastically spiking neurons. We present a generative network model for which we derive biologically plausible algorithms that perform spike-by-spike updates of the neuron's internal states and adaptation of its synaptic weights from maximizing the likelihood of the observed spike patterns. Paradigmatic computational tasks demonstrate the online performance and learning efficiency of our framework. The potential relevance of our approach as a model for cortical computation is discussed.

Towards on-line adaptation of neuro-prostheses with neuronal evaluation signals.

Many experiments have successfully demonstrated that prosthetic devices for restoring lost body functions can in principle be controlled by brain signals. However, stable long-term application of these devices, required for paralyzed patients, may suffer substantially from on-going signal changes for example adapting neural activities or movements of the electrodes recording brain activity. These changes currently require tedious re-learning procedures which are conducted and supervised under laboratory conditions, hampering the everyday use of such devices. As an efficient alternative to current methods we here propose an on-line adaptation scheme that exploits a hypothetical secondary signal source from brain regions reflecting the user's affective evaluation of the current neuro- prosthetic's performance. For demonstrating the feasibility of our idea, we simulate a typical prosthetic setup controlling a virtual robotic arm. Hereby we use the additional, hypothetical evaluation signal to adapt the decoding of the intended arm movement which is subjected to large non-stationarities. Even with weak signals and high noise levels typically encountered in recording brain activities, our simulations show that prosthetic devices can be adapted successfully during everyday usage, requiring no special training procedures. Furthermore, the adaptation is shown to be stable against large changes in neural encoding and/or in the recording itself.

Second order phase transition in neural rate coding: binary encoding is optimal for rapid signal transmission.

Here, we derive optimal tuning functions for minimum mean square reconstruction from neural rate responses subjected to Poisson noise. The shape of these tuning functions strongly depends on the length T of the time window within which action potentials (spikes) are counted in order to estimate the underlying firing rate. A phase transition towards pure binary encoding occurs if the maximum mean spike count becomes smaller than approximately three. For a particular function class, we prove the existence of a second-order phase transition. The analytically derived critical decoding time window length is in precise agreement with numerical results. Our analysis reveals that binary rate encoding should dominate in the brain wherever time is the critical constraint.