Simplified calcium signaling cascade for synaptic plasticity.

We propose a model for synaptic plasticity based on a calcium signaling cascade. The model simplifies the full signaling pathways from a calcium influx to the phosphorylation (potentiation) and dephosphorylation (depression) of glutamate receptors that are gated by fictive C1 and C2 catalysts, respectively. This model is based on tangible chemical reactions, including fictive catalysts, for long-term plasticity rather than the conceptual theories commonplace in various models, such as preset thresholds of calcium concentration. Our simplified model successfully reproduced the experimental synaptic plasticity induced by different protocols such as (i) a synchronous pairing protocol and (ii) correlated presynaptic and postsynaptic action potentials (APs). Further, the ocular dominance plasticity (or the experimental verification of the celebrated Bienenstock-Cooper-Munro theory) was reproduced by two model synapses that compete by means of back-propagating APs (bAPs). The key to this competition is synapse-specific bAPs with reference to bAP-boosting on the physiological grounds.

Artificial Neural Network for Response Inference of a Nonvolatile Resistance-Switch Array.

An artificial neural network was utilized in the behavior inference of a random crossbar array (10 × 9 or 28 × 27 in size) of nonvolatile binary resistance-switches (in a high resistance state (HRS) or low resistance state (LRS)) in response to a randomly applied voltage array. The employed artificial neural network was a multilayer perceptron (MLP) with leaky rectified linear units. This MLP was trained with 500,000 or 1,000,000 examples. For each example, an input vector consisted of the distribution of resistance states (HRS or LRS) over a crossbar array plus an applied voltage array. That is, for a M × N array where voltages are applied to its M rows, the input vector was M × (N + 1) long. The calculated (correct) current array for each random crossbar array was used as data labels for supervised learning. This attempt was successful such that the correlation coefficient between inferred and correct currents reached 0.9995 for the larger crossbar array. This result highlights MLP that leverages its versatility to capture the quantitative linkage between input and output across the highly nonlinear crossbar array.

Scalable excitatory synaptic circuit design using floating gate based leaky integrators.

We propose a scalable synaptic circuit realizing spike timing dependent plasticity (STDP)-compatible with randomly spiking neurons. The feasible working of the circuit was examined by circuit simulation using the BSIM 4.6.0 model. A distinguishable feature of the circuit is the use of floating-gate integrators that provide the compact implementation of biologically plausible relaxation time scale. This relaxation occurs on the basis of charge tunneling that mainly relies upon area-independent tunnel barrier properties (e.g. barrier width and height) rather than capacitance. The circuit simulations feature (i) weight-dependent STDP that spontaneously limits the synaptic weight growth, (ii) competitive synaptic adaptation within both unsupervised and supervised frameworks with randomly spiking neurons. The estimated power consumption is merely 34 pW, perhaps meeting one of the most crucial principles (power-efficiency) of neuromorphic engineering. Finally, a means of fine-tuning the STDP behavior is provided.

Chameleonic electrochemical metallization cells: dual-layer solid electrolyte-inducing various switching behaviours.

We present 'unusual' resistive switching behaviours in electrochemical metallization (ECM) cells utilizing a dual-layer (SiOx/GeSex: SiOx on GeSex) solid electrolyte (SE). The observed switching behaviour markedly varies with the thickness of the upper SiOx layer and compliance current: (i) monostable switching, (ii) counter-eightwise bipolar switching, and (iii) combination of monostable and eightwise bipolar switching behaviours. Focusing on cases (i) and (iii), electrical and chemical analyses on these chameleonic cells were performed in an attempt to gain clues to the understanding of the observed complexity. The chemical analysis indicated the upper SiOx layer as a chemical potential well for Cu ions-Cu ions were largely confined in the well. This non-uniform distribution of Cu across the SE perhaps hints at the mechanism for the complex behaviour; it may be a 'zero-sum game' between SiOx and GeSex layers, in which the two layers fight over the limited number of Cu atoms/ions.

Leaky Integrate-and-Fire Neuron Circuit Based on Floating-Gate Integrator.

The artificial spiking neural network (SNN) is promising and has been brought to the notice of the theoretical neuroscience and neuromorphic engineering research communities. In this light, we propose a new type of artificial spiking neuron based on leaky integrate-and-fire (LIF) behavior. A distinctive feature of the proposed FG-LIF neuron is the use of a floating-gate (FG) integrator rather than a capacitor-based one. The relaxation time of the charge on the FG relies mainly on the tunnel barrier profile, e.g., barrier height and thickness (rather than the area). This opens up the possibility of large-scale integration of neurons. The circuit simulation results offered biologically plausible spiking activity (<100 Hz) with a capacitor of merely 6 fF, which is hosted in an FG metal-oxide-semiconductor field-effect transistor. The FG-LIF neuron also has the advantage of low operation power (<30 pW/spike). Finally, the proposed circuit was subject to possible types of noise, e.g., thermal noise and burst noise. The simulation results indicated remarkable distributional features of interspike intervals that are fitted to Gamma distribution functions, similar to biological neurons in the neocortex.

Relaxation oscillator-realized artificial electronic neurons, their responses, and noise.

A proof-of-concept relaxation oscillator-based leaky integrate-and-fire (ROLIF) neuron circuit is realized by using an amorphous chalcogenide-based threshold switch and non-ideal operational amplifier (op-amp). The proposed ROLIF neuron offers biologically plausible features such as analog-type encoding, signal amplification, unidirectional synaptic transmission, and Poisson noise. The synaptic transmission between pre- and postsynaptic neurons is achieved through a passive synapse (simple resistor). The synaptic resistor coupled to the non-ideal op-amp realizes excitatory postsynaptic potential (EPSP) evolution that evokes postsynaptic neuron spiking. In an attempt to generalize our proposed model, we theoretically examine ROLIF neuron circuits adopting different non-ideal op-amps having different gains and slew rates. The simulation results indicate the importance of gain in postsynaptic neuron spiking, irrespective of the slew rate (as long as the rate exceeds a particular value), providing the basis for the ROLIF neuron circuit design. Eventually, the behavior of a postsynaptic neuron in connection to multiple presynaptic neurons via synapses is highlighted in terms of EPSP evolution amid simultaneously incident asynchronous presynaptic spikes, which in fact reveals an important role of the random noise in spatial integration.

Reliability of neuronal information conveyed by unreliable neuristor-based leaky integrate-and-fire neurons: a model study.

We conducted simulations on the neuronal behavior of neuristor-based leaky integrate-and-fire (NLIF) neurons. The phase-plane analysis on the NLIF neuron highlights its spiking dynamics--determined by two nullclines conditional on the variables on the plane. Particular emphasis was placed on the operational noise arising from the variability of the threshold switching behavior in the neuron on each switching event. As a consequence, we found that the NLIF neuron exhibits a Poisson-like noise in spiking, delimiting the reliability of the information conveyed by individual NLIF neurons. To highlight neuronal information coding at a higher level, a population of noisy NLIF neurons was analyzed in regard to probability of successful information decoding given the Poisson-like noise of each neuron. The result demonstrates highly probable success in decoding in spite of large variability--due to the variability of the threshold switching behavior--of individual neurons.

Multiprotocol-induced plasticity in artificial synapses.

We suggest a 'universal' electrical circuit for the realization of an artificial synapse that exhibits long-term plasticity induced by different protocols. The long-term plasticity of the artificial synapse is basically attributed to the nonvolatile resistance change of the bipolar resistive switch in the circuit. The synaptic behaviour realized by the circuit is termed 'universal' inasmuch as (i) the shape of the action potential is not required to vary so as to implement different plasticity-induction behaviours, activity-dependent plasticity (ADP) and spike-timing-dependent plasticity (STDP), (ii) the behaviours satisfy several essential features of a biological chemical synapse including firing-rate and spike-timing encoding and unidirectional synaptic transmission, and (iii) both excitatory and inhibitory synapses can be realized using the same circuit but different diode polarity in the circuit. The feasibility of the suggested circuit as an artificial synapse is demonstrated by conducting circuit calculations and the calculation results are introduced in comparison with biological chemical synapses.