Neural activity shaping in visual prostheses with deep learning.

OBJECTIVE: The visual perception provided by retinal prostheses is limited by the overlapping current spread of adjacent electrodes. This reduces the spatial resolution attainable with unipolar stimulation. Conversely, simultaneous multipolar stimulation guided by the measured neural responses - Neural Activity Shaping (NAS) - can attenuate excessive spread of excitation allowing for more precise control over the pattern of neural activation. However, predicting the results of a multipolar stimulus pattern is a challenging task. Previous attempts focused on analytical solutions based on an assumed linear nonlinear model of retinal response; an Analytical Model Inversion (AMI) approach. Here, we propose a model-free solution for NAS, using Artificial Neural Networks (ANNs) that could be trained with data acquired from the implant. APPROACH: Our method consists of two ANNs trained sequentially. The Measurement Predictor Network (MPN) is trained on data from the implant and is used to predict how the retina responds to multipolar stimulation. The Stimulus Generator Network (STG) is trained on a large dataset of natural images and uses the trained MPN to determine efficient multipolar stimulus patterns by learning its inverse model. We validate our method in silico using a realistic model of retinal response to multipolar stimulation. Main Results: We show that our ANN-based NAS approach produces sharper retinal activations than the conventional unipolar stimulation strategy. As a theoretical bench-mark of optimal NAS results, we implemented AMI stimulation by inverting the model used to simulate the retina. Our ANN strategy produced equivalent results to AMI, while not being restricted to any specific type of retina model and being three orders of magnitude more computationally efficient. SIGNIFICANCE: Our novel protocol provides a method for efficient and personalized retinal stimulation, which may improve the visual experience and quality of life of retinal prosthesis users. .

Data-driven modelling of visual receptive fields: comparison between the generalized quadratic model and the nonlinear input model.

Objective: Neurons in primary visual cortex (V1) display a range of sensitivity in their response to translations of their preferred visual features within their receptive field: from high specificity to a precise position through to complete invariance. This visual feature selectivity and invariance is frequently modeled by applying a selection of linear spatial filters to the input image, that define the feature selectivity, followed by a nonlinear function that combines the filter outputs, that defines the invariance, to predict the neural response. We compare two such classes of model, that are both popular and parsimonious, the generalized quadratic model (GQM) and the nonlinear input model (NIM). These two classes of model differ primarily in that the NIM can accommodate a greater diversity in the form of nonlinearity that is applied to the outputs of the filters.Approach: We compare the two model types by applying them to data from multielectrode recordings from cat primary visual cortex in response to spatially white Gaussian noise After fitting both classes of model to a database of 342 single units (SUs), we analyze the qualitative and quantitative differences in the visual feature processing performed by the two models and their ability to predict neural response.Main results: We find that the NIM predicts response rates on a held-out data at least as well as the GQM for 95% of SUs. Superior performance occurs predominantly for those units with above average spike rates and is largely due to the NIMs ability to capture aspects of the model's nonlinear function cannot be captured with the GQM rather than differences in the visual features being processed by the two different models.Significance: These results can help guide model choice for data-driven receptive field modelling.

Characterization of extracellular spike waveforms recorded in wallaby primary visual cortex.

Extracellular recordings were made from 642 units in the primary visual cortex (V1) of a highly visual marsupial, the Tammar wallaby. The receptive field (RF) characteristics of the cells were objectively estimated using the non-linear input model (NIM), and these were correlated with spike shapes. We found that wallaby cortical units had 68% regular spiking (RS), 12% fast spiking (FS), 4% triphasic spiking (TS), 5% compound spiking (CS) and 11% positive spiking (PS). RS waveforms are most often associated with recordings from pyramidal or spiny stellate cell bodies, suggesting that recordings from these cell types dominate in the wallaby cortex. In wallaby, 70-80% of FS and RS cells had orientation selective RFs and had evenly distributed linear and nonlinear RFs. We found that 47% of wallaby PS units were non-orientation selective and they were dominated by linear RFs. Previous studies suggest that the PS units represent recordings from the axon terminals of non-orientation selective cells originating in the lateral geniculate nucleus (LGN). If this is also true in wallaby, as strongly suggested by their low response latencies and bursty spiking properties, the results suggest that significantly more neurons in wallaby LGN are already orientation selective. In wallaby, less than 10% of recorded spikes had triphasic (TS) or sluggish compound spiking (CS) waveforms. These units had a mixture of orientation selective and non-oriented properties, and their cellular origins remain difficult to classify.

Quantifying visual acuity for pre-clinical testing of visual prostheses.

Objective.Visual prostheses currently restore only limited vision. More research and pre-clinical work are required to improve the devices and stimulation strategies that are used to induce neural activity that results in visual perception. Evaluation of candidate strategies and devices requires an objective way to convert measured and modelled patterns of neural activity into a quantitative measure of visual acuity.Approach.This study presents an approach that compares evoked patterns of neural activation with target and reference patterns. A d-prime measure of discriminability determines whether the evoked neural activation pattern is sufficient to discriminate between the target and reference patterns and thus provides a quantified level of visual perception in the clinical Snellen and MAR scales. The magnitude of the resulting value was demonstrated using scaled standardized 'C' and 'E' optotypes.Main results.The approach was used to assess the visual acuity provided by two alternative stimulation strategies applied to simulated retinal implants with different electrode pitch configurations and differently sized spreads of neural activity. It was found that when there is substantial overlap in neural activity generated by different electrodes, an estimate of acuity based only upon electrode pitch is incorrect; our proposed method gives an accurate result in both circumstances.Significance.Quantification of visual acuity using this approach in pre-clinical development will allow for more rapid and accurate prototyping of improved devices and neural stimulation strategies.

Orientation pinwheels in primary visual cortex of a highly visual marsupial.

Primary visual cortices in many mammalian species exhibit modular and periodic orientation preference maps arranged in pinwheel-like layouts. The role of inherited traits as opposed to environmental influences in determining this organization remains unclear. Here, we characterize the cortical organization of an Australian marsupial, revealing pinwheel organization resembling that of eutherian carnivores and primates but distinctly different from the simpler salt-and-pepper arrangement of eutherian rodents and rabbits. The divergence of marsupials from eutherians 160 million years ago and the later emergence of rodents and rabbits suggest that the salt-and-pepper structure is not the primitive ancestral form. Rather, the genetic code that enables complex pinwheel formation is likely widespread, perhaps extending back to the common therian ancestors of modern mammals.

Preferential modulation of individual retinal ganglion cells by electrical stimulation.

Objective.Retinal prostheses have had limited success in vision restoration through electrical stimulation of surviving retinal ganglion cells (RGCs) in the degenerated retina. This is partly due to non-preferential stimulation of all RGCs near a single stimulating electrode, which include cells that conflict in their response properties and their contribution to visiual processing. Our study proposes a stimulation strategy to preferentially stimulate individual RGCs based on their temporal electrical receptive fields (tERFs).Approach.We recorded the responses of RGCs using whole-cell patch clamping and demonstrated the stimulation strategy, first using intracellular stimulation, then via extracellular stimulation.Main results. We successfully reconstructed the tERFs according to the RGC response to Gaussian white noise current stimulation. The characteristics of the tERFs were extracted and compared based on the morphological and light response types of the cells. By re-delivering stimulation trains that were composed of the tERFs obtained from different cells, we could preferentially stimulate individual RGCs as the cells showed lower activation thresholds to their own tERFs.Significance.This proposed stimulation strategy implemented in the next generation of recording and stimulating retinal prostheses may improve the quality of artificial vision.

How Stimulus Statistics Affect the Receptive Fields of Cells in Primary Visual Cortex.

We studied the changes that neuronal receptive field (RF) models undergo when the statistics of the stimulus are changed from those of white Gaussian noise (WGN) to those of natural scenes (NSs), by fitting the models to multielectrode data recorded from primary visual cortex (V1) of female cats. This allowed the estimation of both a cascade of linear filters on the stimulus, as well as the static nonlinearities that map the output of the filters to the neuronal spike rates. We found that cells respond differently to these two classes of stimuli, with mostly higher spike rates and shorter response latencies to NSs than to WGN. The most striking finding was that NSs resulted in RFs that had additional uncovered filters compared with WGN. This finding was not an artifact of the higher spike rates observed for NSs relative to WGN, but rather was related to a change in coding. Our results reveal a greater extent of nonlinear processing in V1 neurons when stimulated using NSs compared with WGN. Our findings indicate the existence of nonlinear mechanisms that endow V1 neurons with context-dependent transmission of visual information.SIGNIFICANCE STATEMENT This study addresses a fundamental question about the concept of the receptive field (RF): does the encoding of information depend on the context or statistical regularities of the stimulus type? We applied state-of-the-art RF modeling techniques to data collected from multielectrode recordings from cat visual cortex in response to two statistically distinct stimulus types: white Gaussian noise and natural scenes. We find significant differences between the RFs that emerge from our data-driven modeling. Natural scenes result in far more complex RFs that combine multiple features in the visual input. Our findings reveal that different regimes or modes of operation are at work in visual cortical processing depending on the information present in the visual input. The complexity of V1 neural coding appears to be dependent on the complexity of the stimulus. We believe this new finding will have interesting implications for our understanding of the efficient transmission of information in sensory systems, which is an integral assumption of many computational theories (e.g., efficient and predictive coding of sensory processing in the brain).

Learning receptive field properties of complex cells in V1.

There are two distinct classes of cells in the primary visual cortex (V1): simple cells and complex cells. One defining feature of complex cells is their spatial phase invariance; they respond strongly to oriented grating stimuli with a preferred orientation but with a wide range of spatial phases. A classical model of complete spatial phase invariance in complex cells is the energy model, in which the responses are the sum of the squared outputs of two linear spatially phase-shifted filters. However, recent experimental studies have shown that complex cells have a diverse range of spatial phase invariance and only a subset can be characterized by the energy model. While several models have been proposed to explain how complex cells could learn to be selective to orientation but invariant to spatial phase, most existing models overlook many biologically important details. We propose a biologically plausible model for complex cells that learns to pool inputs from simple cells based on the presentation of natural scene stimuli. The model is a three-layer network with rate-based neurons that describes the activities of LGN cells (layer 1), V1 simple cells (layer 2), and V1 complex cells (layer 3). The first two layers implement a recently proposed simple cell model that is biologically plausible and accounts for many experimental phenomena. The neural dynamics of the complex cells is modeled as the integration of simple cells inputs along with response normalization. Connections between LGN and simple cells are learned using Hebbian and anti-Hebbian plasticity. Connections between simple and complex cells are learned using a modified version of the Bienenstock, Cooper, and Munro (BCM) rule. Our results demonstrate that the learning rule can describe a diversity of complex cells, similar to those observed experimentally.

Neural activity shaping utilizing a partitioned target pattern.

Electrical stimulation of neural tissue is used in both clinical and experimental devices to evoke a desired spatiotemporal pattern of neural activity. These devices induce a local field that drives neural activation, referred to as an activating function or generator signal. In visual prostheses, the spread of generator signal from each electrode within the neural tissue results in a spread of visual perception, referred to as a phosphene.Objective.In cases where neighbouring phosphenes overlap, it is desirable to use current steering or neural activity shaping strategies to manipulate the generator signal between the electrodes to provide greater control over the total pattern of neural activity. Applying opposite generator signal polarities in neighbouring regions of the retina forces the generator signal to pass through zero at an intermediate point, thus inducing low neural activity that may be perceived as a high-contrast line. This approach provides a form of high contrast visual perception, but it requires partitioning of the target pattern into those regions that use positive or negative generator signals. This discrete optimization is an NP-hard problem that is subject to being trapped in detrimental local minima.Approach.This investigation proposes a new partitioning method using image segmentation to determine the most beneficial positive and negative generator signal regions. Utilizing a database of 1000 natural images, the method is compared to alternative approaches based upon the mean squared error of the outcome.Main results.Under nominal conditions and with a set computation limit, partitioning provided improvement for 32% of these images. This percentage increased to 89% when utilizing image pre-processing to emphasize perceptual features of the images. The percentage of images that were dealt with most effectively with image segmentation increased as lower computation limits were imposed on the algorithms.Significance.These results provide a new method to increase the resolution of neural stimulating arrays and thus improve the experience of visual prosthesis users.

Analysis of extracellular spike waveforms and associated receptive fields of neurons in cat primary visual cortex.

KEY POINTS: Extracellular spikes recorded in the visual cortex (Area 17/18, V1) are commonly classified into either regular-spiking (RS) or fast-spiking (FS). Using multi-electrode arrays positioned in cat V1 and a broadband stimulus, we show that there is also a distinct class with positive-spiking (PS) waveforms. PS units were associated mainly with non-oriented receptive fields while RS and FS units had orientation-selective receptive fields. We suggest that PS units are recordings of axons originating from the thalamus. This conclusion was reinforced by our finding that we could record PS units after cortical silencing, but not record RS and FS units. The importance of our findings is that we were able to correlate spike shapes with receptive field characteristics with high precision using multi-electrode extracellular recording techniques. This allows considerable increases in the amount of information that can be extracted from future cortical experiments. ABSTRACT: Extracellular spike waveforms from recordings in the visual cortex have been classified into either regular-spiking (RS) or fast-spiking (FS) units. While both these types of spike waveforms are negative-dominant, we show that there are also distinct classes of spike waveforms in visual Area 17/18 (V1) of anaesthetised cats with positive-dominant waveforms, which are not regularly reported. The spatial receptive fields (RFs) of these different spike waveform types were estimated, which objectively revealed the existence of oriented and non-oriented RFs. We found that units with positive-dominant spikes, which have been associated with recordings from axons in the literature, had mostly non-oriented RFs (84%), which are similar to the centre-surround RFs observed in the dorsal lateral geniculate nucleus (dLGN). Thus, we hypothesise that these positive-dominant waveforms may be recordings from dLGN afferents. We recorded from V1 before and after the application of muscimol (a cortical silencer) and found that the positive-dominant spikes (PS) remained while the RS and FS cells did not. We also noted that the PS units had spiking characteristics normally associated with dLGN units (i.e. higher response spike rates, lower response latencies and higher proportion of burst spikes). Our findings show quantitatively that it is possible to correlate the RF properties of cortical neurons with particular spike waveforms. This has implications for how extracellular recordings should be interpreted and complex experiments can now be contemplated that would have been very challenging previously, such as assessing the feedforward connectivity between brain areas in the same location of cortical tissue.

In vivo feasibility of epiretinal stimulation using ultrananocrystalline diamond electrodes.

OBJECTIVE: Due to their increased proximity to retinal ganglion cells (RGCs), epiretinal visual prostheses present the opportunity for eliciting phosphenes with low thresholds through direct RGC activation. This study characterised the in vivo performance of a novel prototype monolithic epiretinal prosthesis, containing Nitrogen incorporated ultrananocrystalline (N-UNCD) diamond electrodes. APPROACH: A prototype implant containing up to twenty-five 120 × 120 µm N-UNCD electrodes was implanted into 16 anaesthetised cats and attached to the retina either using a single tack or via magnetic coupling with a suprachoroidally placed magnet. Multiunit responses to retinal stimulation using charge-balanced biphasic current pulses were recorded acutely in the visual cortex using a multichannel planar array. Several stimulus parameters were varied including; the stimulating electrode, stimulus polarity, phase duration, return configuration and the number of electrodes stimulated simultaneously. MAIN RESULTS: The rigid nature of the device and its form factor necessitated complex surgical procedures. Surgeries were considered successful in 10/16 animals and cortical responses to single electrode stimulation obtained in eight animals. Clinical imaging and histological outcomes showed severe retinal trauma caused by the device in situ in many instances. Cortical measures were found to significantly depend on the surgical outcomes of individual experiments, phase duration, return configuration and the number of electrodes stimulated simultaneously, but not stimulus polarity. Cortical thresholds were also found to increase over time within an experiment. SIGNIFICANCE: The study successfully demonstrated that an epiretinal prosthesis containing diamond electrodes could produce cortical activity with high precision, albeit only in a small number of cases. Both surgical approaches were highly challenging in terms of reliable and consistent attachment to and stabilisation against the retina, and often resulted in severe retinal trauma. There are key challenges (device form factor and attachment technique) to be resolved for such a device to progress towards clinical application, as current surgical techniques are unable to address these issues.

Mechanisms of Feature Selectivity and Invariance in Primary Visual Cortex.

Visual object identification requires both selectivity for specific visual features that are important to the object's identity and invariance to feature manipulations. For example, a hand can be shifted in position, rotated, or contracted but still be recognized as a hand. How are the competing requirements of selectivity and invariance built into the early stages of visual processing? Typically, cells in the primary visual cortex are classified as either simple or complex. They both show selectivity for edge-orientation but complex cells develop invariance to edge position within the receptive field (spatial phase). Using a data-driven model that extracts the spatial structures and nonlinearities associated with neuronal computation, we quantitatively describe the balance between selectivity and invariance in complex cells. Phase invariance is frequently partial, while invariance to orientation and spatial frequency are more extensive than expected. The invariance arises due to two independent factors: (1) the structure and number of filters and (2) the form of nonlinearities that act upon the filter outputs. Both vary more than previously considered, so primary visual cortex forms an elaborate set of generic feature sensitivities, providing the foundation for more sophisticated object processing.

Minimizing axon bundle activation of retinal ganglion cells with oriented rectangular electrodes.

OBJECTIVE: Retinal prostheses aim to restore vision in patients with retinal degenerative diseases, such as age-related macular degeneration and retinitis pigmentosa. By implanting an array of microelectrodes, such a device creates percepts in patients through electrical stimulation of surviving retinal neurons. A challenge for retinal prostheses when trying to return high quality vision is the unintended activation of retinal ganglion cells through the stimulation of passing axon bundles, which leads to patients reporting large, elongated patches of light instead of focal spots. APPROACH: In this work, we used calcium imaging to record the responses of retinal ganglion cells to electrical stimulation in explanted retina using rectangular electrodes placed with different orientations relative to the axon bundles. MAIN RESULTS: We showed that narrow, rectangular electrodes oriented parallel to the axon bundles can achieve focal stimulation. To further improve the strategy, we studied the impact of different stimulation waveforms and electrode configurations. We found the selectivity for focal stimulation to be higher when using short (33 µs), anodic-first biphasic pulses, with long electrode lengths and at least 50 µm electrode-to-retinal separation. Focal stimulation was, in fact, less selective when the electrodes made direct contact with the retinal surface due to unwanted preferential stimulation of the proximal axon bundles. SIGNIFICANCE: When employed in retinal prostheses, the proposed stimulation strategy is expected to provide improved quality of vision to the blind.

Stimulation Strategies for Improving the Resolution of Retinal Prostheses.

Electrical stimulation using implantable devices with arrays of stimulating electrodes is an emerging therapy for neurological diseases. The performance of these devices depends greatly on their ability to activate populations of neurons with high spatiotemporal resolution. To study electrical stimulation of populations of neurons, retina serves as a useful model because the neural network is arranged in a planar array that is easy to access. Moreover, retinal prostheses are under development to restore vision by replacing the function of damaged light sensitive photoreceptors, which makes retinal research directly relevant for curing blindness. Here we provide a progress review on stimulation strategies developed in recent years to improve the resolution of electrical stimulation in retinal prostheses. We focus on studies performed with explanted retinas, in which electrophysiological techniques are the most advanced. We summarize achievements in improving the spatial and temporal resolution of electrical stimulation of the retina and methods to selectively stimulate neurons with different visual functions. Future directions for retinal prostheses development are also discussed, which could provide insights for other types of neuromodulatory devices in which high-resolution electrical stimulation is required.

Hybrid diamond/ carbon fiber microelectrodes enable multimodal electrical/chemical neural interfacing.

Implantable medical devices are now in regular use to treat or ameliorate medical conditions, including movement disorders, chronic pain, cardiac arrhythmias, and hearing or vision loss. Aside from offering alternatives to pharmaceuticals, one major advantage of device therapy is the potential to monitor treatment efficacy, disease progression, and perhaps begin to uncover elusive mechanisms of diseases pathology. In an ideal system, neural stimulation, neural recording, and electrochemical sensing would be conducted by the same electrode in the same anatomical region. Carbon fiber (CF) microelectrodes are the appropriate size to achieve this goal and have shown excellent performance, in vivo. Their electrochemical properties, however, are not suitable for neural stimulation and electrochemical sensing. Here, we present a method to deposit high surface area conducting diamond on CF microelectrodes. This unique hybrid microelectrode is capable of recording single-neuron action potentials, delivering effective electrical stimulation pulses, and exhibits excellent electrochemical dopamine detection. Such electrodes are needed for the next generation of miniaturized, closed-loop implants that can self-tune therapies by monitoring both electrophysiological and biochemical biomarkers.

Determination of the electrical impedance of neural tissue from its microscopic cellular constituents.

The electrical properties of neural tissue are important in a range of different applications in biomedical engineering and basic science. These properties are characterized by the electrical admittivity of the tissue, which is the inverse of the specific tissue impedance. OBJECTIVE: Here we derived analytical expressions for the admittivity of various models of neural tissue from the underlying electrical and morphological properties of the constituent cells. APPROACH: Three models are considered: parallel bundles of fibers, fibers contained in stacked laminae and fibers crossing each other randomly in all three-dimensional directions. MAIN RESULTS: An important and novel aspect that emerges from considering the underlying cellular composition of the tissue is that the resulting admittivity has both spatial and temporal frequency dependence, a property not shared with conventional conductivity-based descriptions. The frequency dependence of the admittivity results in non-trivial spatiotemporal filtering of electrical signals in the tissue models. These effects are illustrated by considering the example of pulsatile stimulation with a point source electrode. It is shown how changing temporal parameters of a current pulse, such as pulse duration, alters the spatial profile of the extracellular potential. In a second example, it is shown how the degree of electrical anisotropy can change as a function of the distance from the electrode, despite the underlying structurally homogeneity of the tissue. These effects are discussed in terms of different current pathways through the intra- and extra-cellular spaces, and how these relate to near- and far-field limits for the admittivity (which reduce to descriptions in terms of a simple conductivity). SIGNIFICANCE: The results highlight the complexity of the electrical properties of neural tissue and provide mathematical methods to model this complexity.

Improved visual acuity using a retinal implant and an optimized stimulation strategy.

OBJECTIVE: Retinal prosthetic devices hold great promise for the treatment of retinal degenerative diseases such as retinitis pigmentosa and age-related macular degeneration. Through electrical stimulation of the surviving retinal neurons, these devices evoke visual signals that are then relayed to the brain. Currently, the visual prostheses used in clinical trials have few electrodes, thus limiting visual acuity. Electrode arrays with high electrode densities have been developed using novel technologies, including diamond growth and laser machining, and these may provide a more promising route to achieve high visual acuity in blind patients. APPROACH: Here, we studied the potential spatial resolution of electrical stimulation using diamond electrodes. We did this by labeling retinal ganglion cells in whole mount retina with a calcium indicator in wild-type rats and those with retinal degeneration. We imaged the ganglion cell responses to a range of stimulation parameters, including pulse duration and return electrode configuration. MAIN RESULTS: With sub-retinal stimulation, in which electrodes were in contact with the intact or degenerated photoreceptor layer, we found that biphasic pulses of 0.1 ms phase duration and a local return configuration was the most effective in confining the retinal ganglion cell activation patterns, while also remaining within the safety limits of the materials and providing the best power efficiency. SIGNIFICANCE: These results provide an optimized stimulation strategy for retinal implants, which if implemented in a retinal prosthetic is expected to improve the achievable visual acuity.

Toward a Biologically Plausible Model of LGN-V1 Pathways Based on Efficient Coding.

Increasing evidence supports the hypothesis that the visual system employs a sparse code to represent visual stimuli, where information is encoded in an efficient way by a small population of cells that respond to sensory input at a given time. This includes simple cells in primary visual cortex (V1), which are defined by their linear spatial integration of visual stimuli. Various models of sparse coding have been proposed to explain physiological phenomena observed in simple cells. However, these models have usually made the simplifying assumption that inputs to simple cells already incorporate linear spatial summation. This overlooks the fact that these inputs are known to have strong non-linearities such the separation of ON and OFF pathways, or separation of excitatory and inhibitory neurons. Consequently these models ignore a range of important experimental phenomena that are related to the emergence of linear spatial summation from non-linear inputs, such as segregation of ON and OFF sub-regions of simple cell receptive fields, the push-pull effect of excitation and inhibition, and phase-reversed cortico-thalamic feedback. Here, we demonstrate that a two-layer model of the visual pathway from the lateral geniculate nucleus to V1 that incorporates these biological constraints on the neural circuits and is based on sparse coding can account for the emergence of these experimental phenomena, diverse shapes of receptive fields and contrast invariance of orientation tuning of simple cells when the model is trained on natural images. The model suggests that sparse coding can be implemented by the V1 simple cells using neural circuits with a simple biologically plausible architecture.

Synaptic Basis for Contrast-Dependent Shifts in Functional Identity in Mouse V1.

A central transformation that occurs within mammalian visual cortex is the change from linear, polarity-sensitive responses to nonlinear, polarity-insensitive responses. These neurons are classically labelled as either simple or complex, respectively, on the basis of their response linearity (Skottun et al., 1991). While the difference between cell classes is clear when the stimulus strength is high, reducing stimulus strength diminishes the differences between the cell types and causes some complex cells to respond as simple cells (Crowder et al., 2007; van Kleef et al., 2010; Hietanen et al., 2013). To understand the synaptic basis for this shift in behavior, we used in vivo whole-cell recordings while systematically shifting stimulus contrast. We find systematic shifts in the degree of complex cell responses in mouse primary visual cortex (V1) at the subthreshold level, demonstrating that synaptic inputs change in concert with the shifts in response linearity and that the change in response linearity is not simply due to the threshold nonlinearity. These shifts are consistent with a visual cortex model in which the recurrent amplification acts as a critical component in the generation of complex cell responses (Chance et al., 1999).

Global activity shaping strategies for a retinal implant.

OBJECTIVE: Retinal prostheses provide visual perception via electrical stimulation of the retina using an implanted array of electrodes. The retinal activation resulting from each electrode is not point-like; instead each electrode introduces a spread of retinal activation that may overlap with activations from other electrodes. With most conventional stimulation strategies this overlap leads to image blur. Here we propose a 'shaping' algorithm that uses multiple electrodes to manipulate the current between electrodes in a desired way. APPROACH: We assume a forward model for the conversion of electrode strengths to retinal activation. Three alternative global shaping algorithms are developed by calculating reverse models under different assumptions: linear inversion using singular value decomposition to produce the pseudoinverse, a linearly constrained quadratic program, and a binary quadratic program to partition the target pattern. The algorithms were assessed using both the mean squared error between the resulting images and desired images, as well as their adherence to the maximum allowed electrode currents. MAIN RESULTS: Under wide activation spreads the linear inversion algorithm gave improved solutions but faced two limitations: under low-noise conditions the electrode amplitudes exceeded their set limit; the set of solutions did not include the possibility of using negative local currents to induce retinal activation. The linearly constrained quadratic program and binary quadratic program respectively addressed these problems, but required much greater computation time. SIGNIFICANCE: This provides a framework for improving the resolution of future retinal implants, especially those with high density electrode arrays.