A Biomimetic Circuit for Electronic Skin With Application in Hand Prosthesis.

One major challenge in upper limb prostheses is providing sensory feedback to amputees. Reproducing the spiking patterns of human primary tactile afferents can be considered as the first step for this challenging problem. In this study, a novel biomimetic circuit for SA-I and RA-I afferents is proposed to functionally replicate the spiking response of the biological tactile afferents to indentation stimuli. The circuit has been designed, laid out, and simulated in TSMC 180nm CMOS technology with a 1.8V supply voltage. A pair of SA-I and RA-I afferent circuits consume [Formula: see text] of power. The occupied silicon area is [Formula: see text] for 32 afferents. To provide the inputs for circuit testing, a patch of skin with a grid of mechanoreceptors is simulated and tested by an edge stimulus presented at different orientations. Experimental data are collected using indentation of 3D-printed edges at different orientations on a tactile sensor mounted on a robotic arm. Inspired by innervation patterns observed in biology, the artificial afferents are connected to several neighboring mechanoreceptors with different weights to form complex receptive fields which cover the entire mechanoreceptor grid. Machine learning algorithms are applied offline to classify the edge orientations based on the pattern of neural responses. Our results show that the complex receptive fields arising from the innervation pattern led to smaller circuit area and lower power consumption, while facilitating data encoding from high-resolution sensors. The proposed biomimetic circuit and tactile encoding example demonstrate potential applications in modern tactile sensing modules for developing novel bio-robotic and prosthetic technologies.

A functional spiking neuronal network for tactile sensing pathway to process edge orientation.

To obtain deeper insights into the tactile processing pathway from a population-level point of view, we have modeled three stages of the tactile pathway from the periphery to the cortex in response to indentation and scanned edge stimuli at different orientations. Three stages in the tactile pathway are, (1) the first-order neurons which innervate the cutaneous mechanoreceptors, (2) the cuneate nucleus in the midbrain and (3) the cortical neurons of the somatosensory area. In the proposed network, the first layer mimics the spiking patterns generated by the primary afferents. These afferents have complex skin receptive fields. In the second layer, the role of lateral inhibition on projection neurons in the cuneate nucleus is investigated. The third layer acts as a biomimetic decoder consisting of pyramidal and cortical interneurons that correspond to heterogeneous receptive fields with excitatory and inhibitory sub-regions on the skin. In this way, the activity of pyramidal neurons is tuned to the specific edge orientations. By modifying afferent receptive field size, it is observed that the larger receptive fields convey more information about edge orientation in the first spikes of cortical neurons when edge orientation stimuli move across the patch of skin. In addition, the proposed spiking neural model can detect edge orientation at any location on the simulated mechanoreceptor grid with high accuracy. The results of this research advance our knowledge about tactile information processing and can be employed in prosthetic and bio-robotic applications.

Sensory stimulation enhances phantom limb perception and movement decoding.

OBJECTIVE: A major challenge for controlling a prosthetic arm is communication between the device and the user's phantom limb. We show the ability to enhance phantom limb perception and improve movement decoding through targeted transcutaneous electrical nerve stimulation in individuals with an arm amputation. APPROACH: Transcutaneous nerve stimulation experiments were performed with four participants with arm amputation to map phantom limb perception. We measured myoelectric signals during phantom hand movements before and after participants received sensory stimulation. Using electroencephalogram (EEG) monitoring, we measured the neural activity in sensorimotor regions during phantom movements and stimulation. In one participant, we also tracked sensory mapping over 2 years and movement decoding performance over 1 year. MAIN RESULTS: Results show improvements in the participants' ability to perceive and move the phantom hand as a result of sensory stimulation, which leads to improved movement decoding. In the extended study with one participant, we found that sensory mapping remains stable over 2 years. Sensory stimulation improves within-day movement decoding while performance remains stable over 1 year. From the EEG, we observed cortical correlates of sensorimotor integration and increased motor-related neural activity as a result of enhanced phantom limb perception. SIGNIFICANCE: This work demonstrates that phantom limb perception influences prosthesis control and can benefit from targeted nerve stimulation. These findings have implications for improving prosthesis usability and function due to a heightened sense of the phantom hand.

Neuromorphic vision and tactile fusion for upper limb prosthesis control.

A major issue with upper limb prostheses is the disconnect between sensory information perceived by the user and the information perceived by the prosthesis. Advances in prosthetic technology introduced tactile information for monitoring grasping activity, but visual information, a vital component in the human sensory system, is still not fully utilized as a form of feedback to the prosthesis. For able-bodied individuals, many of the decisions for grasping or manipulating an object, such as hand orientation and aperture, are made based on visual information before contact with the object. We show that inclusion of neuromorphic visual information, combined with tactile feedback, improves the ability and efficiency of both able-bodied and amputee subjects to pick up and manipulate everyday objects. We discovered that combining both visual and tactile information in a real-time closed loop feedback strategy generally decreased the completion time of a task involving picking up and manipulating objects compared to using a single modality for feedback. While the full benefit of the combined feedback was partially obscured by experimental inaccuracies of the visual classification system, we demonstrate that this fusion of neuromorphic signals from visual and tactile sensors can provide valuable feedback to a prosthetic arm for enhancing real-time function and usability.