Inhomogeneous retino-cortical mapping is supported and stabilized with correlation-learning during self-motion.

In primates, the area of primary visual cortex representing a fixed area of visual space decreases with increasing eccentricity. We identify visual situations to which this inhomogeneous retino-cortical mapping is well adapted and study their relevance during natural vision and development. We assume that cortical activations caused by stationary objects during self-motion along the direction of gaze travel on average with constant speed across the cortical surface, independent of retinal eccentricity. This is the case if the distribution of objects corresponds to an ellipsoid with the observer in its center. We apply the resulting flow field to train a simple network of pulse coding neurons with Hebbian learning and demonstrate that the density of learned receptive field centers is in close agreement with primate retino-cortical magnification. In addition, the model reproduces the increase of receptive field size and the decrease of its peak sensitivity with increasing eccentricity. Our results suggest that self-motion may have played an important role in the evolution of the visual system and that cortical magnification can be refined and stabilized by Hebbian learning mechanisms in ontogenesis under natural viewing conditions.

Different types of signal coupling in the visual cortex related to neural mechanisms of associative processing and perception.

The hypothesis of object representation by synchronization in the visual cortex has been supported by our recent experiments in monkeys. They demonstrated local synchrony among gamma activities (30-90 Hz) and their perceptual modulation, according to the rules of figure-ground segregation. However, gamma-synchrony in primary visual cortex is restricted to few mm, challenging the synchronization hypothesis for larger cortical object representations. The restriction is due to randomly changing phase relations among locally synchronized patches which, however, form continuous waves of gamma-activity, traveling across object representations. The phase continuity of these waves may support coding of object continuity. Interactions across still larger distances, measured among cortical areas in human data, involve amplitude envelopes of gamma signals. Based on models with spiking neurons we discuss potentially underlying mechanisms. Most important for gamma synchronization are local facilitatory connections with distance-dependent delays. They also explain the occurrence of gamma waves and the restriction of gamma-synchrony. Fast local feedback inhibition generates gamma oscillations and supports local synchrony, while slow shunting inhibitory feedback supports figure-ground segregation. Finally, dispersion in inter-areal far projections destroys coherence of gamma signals, but preserves their amplitude modulations. In conclusion, we propose that the hypothesis of associative processing by gamma synchronization be extended to more general forms of signal coupling.

Neural mechanisms of visual associative processing.

This is a review of our work on multiple microelectrode recordings from the visual cortex of monkeys and subdural recordings from humans--related to the potential underlying neural mechanisms. The former hypothesis of object representation by synchronization in visual cortex (or more generally: of flexible associative processing) has been supported by our recent experiments in monkeys. They demonstrated local synchrony among rhythmic or stochastic gamma-activities (30-90 Hz) and perceptual modulation, according to the rules of figure-ground segregation. However, gamma-synchrony in primary visual cortex is restricted to few millimeters, challenging the synchronization hypothesis for larger cortical object representations. We found that the spatial restriction is due to gamma-waves, traveling in random directions across the object representations. It will be argued that phase continuity of these waves can support the coding of object continuity. Based on models with spiking neurons, potentially underlying neural mechanisms are proposed: (i) Fast inhibitory feedback loops can generate locally synchronized gamma-activities; (ii) Hebbian learning of lateral and feed forward connections with distance-dependent delays can explain the stabilization of cortical retinotopy, the limited size of synchronization, the occurrence of gamma-waves, and the larger receptive fields at successive levels; (iii) slow inhibitory feedback can support figure-ground segregation; (iv) temporal dispersion in far projections destroys coherence of fast signals but preserves slow amplitude modulations. In conclusion, it is proposed that the hypothesis of flexible associative processing by gamma-synchronization, including coherent representations of visual objects, has to be extended to more general forms of signal coupling.