On convergence properties of the brain-state-in-a-convex-domain.

Convergence in the presence of multiple equilibrium points is one of the most fundamental dynamical properties of a neural network (NN). Goal of the paper is to investigate convergence for the classic Brain-State-in-a-Box (BSB) NN model and some of its relevant generalizations named Brain-State-in-a-Convex-Body (BSCB). In particular, BSCB is a class of discrete-time NNs obtained by projecting a linear system onto a convex body of Rn. The main result in the paper is that the BSCB is convergent when the matrix of the linear system is symmetric and positive semidefinite or, otherwise, it is symmetric and the step size does not exceed a given bound depending only on the minimum eigenvalue of the matrix. This result generalizes previous results in the literature for BSB and BSCB and it gives a solid foundation for the use of BSCB as a content addressable memory (CAM). The result is proved via Lyapunov method and LaSalle's Invariance Principle for discrete-time systems and by using some fundamental inequalities enjoyed by the projection operator onto convex sets as Bourbaki-Cheney-Goldstein inequality.

Memristor Neural Networks for Linear and Quadratic Programming Problems.

This article introduces a new class of memristor neural networks (NNs) for solving, in real-time, quadratic programming (QP) and linear programming (LP) problems. The networks, which are called memristor programming NNs (MPNNs), use a set of filamentary-type memristors with sharp memristance transitions for constraint satisfaction and an additional set of memristors with smooth memristance transitions for memorizing the result of a computation. The nonlinear dynamics and global optimization capabilities of MPNNs for QP and LP problems are thoroughly investigated via a recently introduced technique called the flux-charge analysis method. One main feature of MPNNs is that the processing is performed in the flux-charge domain rather than in the conventional voltage-current domain. This enables exploiting the unconventional features of memristors to obtain advantages over the traditional NNs for QP and LP problems operating in the voltage-current domain. One advantage is that operating in the flux-charge domain allows for reduced power consumption, since in an MPNN, voltages, currents, and, hence, power vanish when the quick analog transient is over. Moreover, an MPNN works in accordance with the fundamental principle of in-memory computing, that is, the nonlinearity of the memristor is used in the dynamic computation, but the same memristor is also used to memorize in a nonvolatile way the result of a computation.

Memristor Circuits for Simulating Neuron Spiking and Burst Phenomena.

Since the introduction of memristors, it has been widely recognized that they can be successfully employed as synapses in neuromorphic circuits. This paper focuses on showing that memristor circuits can be also used for mimicking some features of the dynamics exhibited by neurons in response to an external stimulus. The proposed approach relies on exploiting multistability of memristor circuits, i.e., the coexistence of infinitely many attractors, and employing a suitable pulse-programmed input for switching among the different attractors. Specifically, it is first shown that a circuit composed of a resistor, an inductor, a capacitor and an ideal charge-controlled memristor displays infinitely many stable equilibrium points and limit cycles, each one pertaining to a planar invariant manifold. Moreover, each limit cycle is approximated via a first-order periodic approximation analytically obtained via the Describing Function (DF) method, a well-known technique in the Harmonic Balance (HB) context. Then, it is shown that the memristor charge is capable to mimic some simplified models of the neuron response when an external independent pulse-programmed current source is introduced in the circuit. The memristor charge behavior is generated via the concatenation of convergent and oscillatory behaviors which are obtained by switching between equilibrium points and limit cycles via a properly designed pulse timing of the current source. The design procedure takes also into account some relationships between the pulse features and the circuit parameters which are derived exploiting the analytic approximation of the limit cycles obtained via the DF method.

Nonlinear Networks With Mem-Elements: Complex Dynamics via Flux-Charge Analysis Method.

Nonlinear dynamic memory elements, as memristors, memcapacitors, and meminductors (also known as mem-elements), are of paramount importance in conceiving the neural networks, mem-computing machines, and reservoir computing systems with advanced computational primitives. This paper aims to develop a systematic methodology for analyzing complex dynamics in nonlinear networks with such emerging nanoscale mem-elements. The technique extends the flux-charge analysis method (FCAM) for nonlinear circuits with memristors to a broader class of nonlinear networks N containing also memcapacitors and meminductors. After deriving the constitutive relation and equivalent circuit in the flux-charge domain of each two-terminal element in N , this paper focuses on relevant subclasses of N for which a state equation description can be obtained. On this basis, salient features of the dynamics are highlighted and studied analytically: 1) the presence of invariant manifolds in the autonomous networks; 2) the coexistence of infinitely many different reduced-order dynamics on manifolds; and 3) the presence of bifurcations due to changing the initial conditions for a fixed set of parameters (also known as bifurcations without parameters). Analytic formulas are also given to design nonautonomous networks subject to pulses that drive trajectories through different manifolds and nonlinear reduced-order dynamics. The results, in this paper, provide a method for a comprehensive understanding of complex dynamical features and computational capabilities in nonlinear networks with mem-elements, which is fundamental for a holistic approach in neuromorphic systems with such emerging nanoscale devices.

New Conditions for Global Asymptotic Stability of Memristor Neural Networks.

Recent papers in the literature introduced a class of neural networks (NNs) with memristors, named dynamic-memristor (DM) NNs, such that the analog processing takes place in the charge-flux domain, instead of the typical current-voltage domain as it happens for Hopfield NNs and standard cellular NNs. One key advantage is that, when a steady state is reached, all currents, voltages, and power of a DM-NN drop off, whereas the memristors act as nonvolatile memories that store the processing result. Previous work in the literature addressed multistability of DM-NNs, i.e., convergence of solutions in the presence of multiple asymptotically stable equilibrium points (EPs). The goal of this paper is to study a basically different dynamical property of DM-NNs, namely, to thoroughly investigate the fundamental issue of global asymptotic stability (GAS) of the unique EP of a DM-NN in the general case of nonsymmetric neuron interconnections. A basic result on GAS of DM-NNs is established using Lyapunov method and the concept of Lyapunov diagonally stable matrices. On this basis, some relevant classes of nonsymmetric DM-NNs enjoying the property of GAS are highlighted.

Memristor standard cellular neural networks computing in the flux-charge domain.

The paper introduces a class of memristor neural networks (NNs) that are characterized by the following salient features. (a) The processing of signals takes place in the flux-charge domain and is based on the time evolution of memristor charges. The processing result is given by the constant asymptotic values of charges that are stored in the memristors acting as non-volatile memories in steady state. (b) The dynamic equations describing the memristor NNs in the flux-charge domain are analogous to those describing, in the traditional voltage-current domain, the dynamics of a standard (S) cellular (C) NN, and are implemented by using a realistic model of memristors as that proposed by HP. This analogy makes it possible to use the bulk of results in the SCNN literature for designing memristor NNs to solve processing tasks in real time. Convergence of memristor NNs in the presence of multiple asymptotically stable equilibrium points is addressed and some applications to image processing tasks are presented to illustrate the real-time processing capabilities. Computing in the flux-charge domain is shown to have significant advantages with respect to computing in the voltage-current domain. One advantage is that, when a steady state is reached, currents, voltages and hence power in a memristor NN vanish, whereas memristors keep in memory the processing result. This is basically different from SCNNs for which currents, voltages and power do not vanish at a steady state, and batteries are needed to keep in memory the processing result.

Convergence and Multistability of Nonsymmetric Cellular Neural Networks With Memristors.

Recent work has considered a class of cellular neural networks (CNNs) where each cell contains an ideal capacitor and an ideal flux-controlled memristor. One main feature is that during the analog computation the memristor is assumed to be a dynamic element, hence each cell is second-order with state variables given by the capacitor voltage and the memristor flux. Such CNNs, named dynamic memristor (DM)-CNNs, were proved to be convergent when a symmetry condition for the cell interconnections is satisfied. The goal of this paper is to investigate convergence and multistability of DM-CNNs in the general case of nonsymmetric interconnections. The main result is that convergence holds when there are (possibly) nonsymmetric, non-negative interconnections between cells and an irreducibility assumption is satisfied. This result appears to be similar to the classic convergence result for standard (S)-CNNs with positive cell-linking templates. Yet, due to the presence of DMs, a DM-CNN displays some basically different and peculiar dynamical properties with respect to S-CNNs. One key difference is that the DM-CNN processing is based on the time evolution of memristor fluxes instead of capacitor voltages as it happens for S-CNNs. Moreover, when a steady state is reached, all voltages and currents, and hence power consumption of a DM-CNN vanish. This notwithstanding the memristors are able to store in a nonvolatile way the result of the processing. Voltages, currents and power instead do not vanish when an S-CNN reaches a steady state.

Unilateral paravertebral block compared with subarachnoid anesthesia for the management of postoperative pain syndrome after inguinal herniorrhaphy: a randomized controlled clinical trial.

Inguinal herniorrhaphy is a common surgical procedure. The aim of this investigation was to determine whether unilateral paravertebral block could provide better control of postoperative pain syndrome compared with unilateral subarachnoid block (SAB). A randomized controlled study was conducted using 50 patients with unilateral inguinal hernias. The patients were randomized to receive either paravertebral block (S group) or SAB (C group). Paravertebral block was performed by injecting a total of 20 mL of 0.5% levobupivacaine from T9 to T12 under ultrasound guidance, whereas SAB was performed by injecting 13 mg of 0.5% levobupivacaine at the L3 to L4 level. Data regarding anesthesia, hemodynamic changes, side effects, time spent in the postanesthesia care unit, the Karnofsky Performance Status, acute pain and neuropathic disturbances were recorded. Paravertebral block provided good anesthesia of the inguinal region without patient or surgeon discomfort, with better hemodynamic stability and safety and with a reduced time to discharge from the postanesthesia care unit compared with SAB. During the postsurgical and posthospital discharge follow-ups, rest and incident pain and neuropathic positive phenomena were better controlled in the S group than in the C group. The consumption of painkillers was higher in the C group than in the S group throughout the follow-up period. Paravertebral block can be considered a viable alternative to common anesthetic procedures performed for inguinal hernia repair surgery. Paravertebral block provided good management of acute postoperative pain and limited neuropathic postoperative disturbances.

Discontinuous Neural Networks for Finite-Time Solution of Time-Dependent Linear Equations.

This paper considers a class of nonsmooth neural networks with discontinuous hard-limiter (signum) neuron activations for solving time-dependent (TD) systems of algebraic linear equations (ALEs). The networks are defined by the subdifferential with respect to the state variables of an energy function given by the L 1 norm of the error between the state and the TD-ALE solution. It is shown that when the penalty parameter exceeds a quantitatively estimated threshold the networks are able to reach in finite time, and exactly track thereafter, the target solution of the TD-ALE. Furthermore, this paper discusses the tightness of the estimated threshold and also points out key differences in the role played by this threshold with respect to networks for solving time-invariant ALEs. It is also shown that these convergence results are robust with respect to small perturbations of the neuron interconnection matrices. The dynamics of the proposed networks are rigorously studied by using tools from nonsmooth analysis, the concept of subdifferential of convex functions, and that of solutions in the sense of Filippov of dynamical systems with discontinuous nonlinearities.

Nonsmooth Neural Network for Convex Time-Dependent Constraint Satisfaction Problems.

This paper introduces a nonsmooth (NS) neural network that is able to operate in a time-dependent (TD) context and is potentially useful for solving some classes of NS-TD problems. The proposed network is named nonsmooth time-dependent network (NTN) and is an extension to a TD setting of a previous NS neural network for programming problems. Suppose C(t), t ≥ 0, is a nonempty TD convex feasibility set defined by TD inequality constraints. The constraints are in general NS (nondifferentiable) functions of the state variables and time. NTN is described by the subdifferential with respect to the state variables of an NS-TD barrier function and a vector field corresponding to the unconstrained dynamics. This paper shows that for suitable values of the penalty parameter, the NTN dynamics displays two main phases. In the first phase, any solution of NTN not starting in C(0) at t=0 is able to reach the moving set C(·) in finite time th , whereas in the second phase, the solution tracks the moving set, i.e., it stays within C(t) for all subsequent times t ≥ t(h). NTN is thus able to find an exact feasible solution in finite time and also to provide an exact feasible solution for subsequent times. This new and peculiar dynamics displayed by NTN is potentially useful for addressing some significant TD signal processing tasks. As an illustration, this paper discusses a number of examples where NTN is applied to the solution of NS-TD convex feasibility problems.

Necessary and sufficient condition for multistability of neural networks evolving on a closed hypercube.

The paper considers nonsmooth neural networks described by a class of differential inclusions termed differential variational inequalities (DVIs). The DVIs include the relevant class of neural networks, introduced by Li, Michel and Porod, described by linear systems evolving in a closed hypercube of R(n). The main result in the paper is a necessary and sufficient condition for multistability of DVIs with nonsymmetric and cooperative (nonnegative) interconnections between neurons. The condition is easily checkable and provides a sharp bound between DVIs that can store multiple patterns, as asymptotically stable equilibria, and those for which this is not possible. Numerical examples and simulations are presented to confirm and illustrate the theoretic findings.

Limit set dichotomy and multistability for a class of cooperative neural networks with delays.

Recent papers have pointed out the interest to study convergence in the presence of multiple equilibrium points (EPs) (multistability) for neural networks (NNs) with nonsymmetric cooperative (nonnegative) interconnections and neuron activations modeled by piecewise linear (PL) functions. One basic difficulty is that the semiflows generated by such NNs are monotone but, due to the horizontal segments in the PL functions, are not eventually strongly monotone (ESM). This notwithstanding, it has been shown that there are subclasses of irreducible interconnection matrices for which the semiflows, although they are not ESM, enjoy convergence properties similar to those of ESM semiflows. The results obtained so far concern the case of cooperative NNs without delays. The goal of this paper is to extend some of the existing results to the relevant case of NNs with delays. More specifically, this paper considers a class of NNs with PL neuron activations, concentrated delays, and a nonsymmetric cooperative interconnection matrix A and delay interconnection matrix A(τ). The main result is that when A+A(τ) satisfies a full interconnection condition, then the generated semiflows, which are monotone but not ESM, satisfy a limit set dichotomy analogous to that valid for ESM semiflows. It follows that there is an open and dense set of initial conditions, in the state space of continuous functions on a compact interval, for which the solutions converge toward an EP. The result holds in the general case where the NNs possess multiple EPs, i.e., is a result on multistability, and is valid for any constant value of the delays.

Global robust stability criteria for interval delayed full-range cellular neural networks.

This brief considers a class of delayed full-range (FR) cellular neural networks (CNNs) with uncertain interconnections between neurons modeled by means of intervalized matrices. Using mathematical tools from the theory of differential inclusions, a fundamental result on global robust stability of standard (S) CNNs is extended to prove global robust exponential stability for the corresponding class (same interconnection weights and inputs) of FR-CNNs. The result is of theoretical interest since, in general, the equivalence between the dynamical behavior of FR-CNNs and S-CNNs is not guaranteed.