Full-hand electrotactile feedback using electronic skin and matrix electrodes for high-bandwidth human-machine interfacing.

Tactile feedback is relevant in a broad range of human-machine interaction systems (e.g. teleoperation, virtual reality and prosthetics). The available tactile feedback interfaces comprise few sensing and stimulation units, which limits the amount of information conveyed to the user. The present study describes a novel technology that relies on distributed sensing and stimulation to convey comprehensive tactile feedback to the user of a robotic end effector. The system comprises six flexible sensing arrays (57 sensors) integrated on the fingers and palm of a robotic hand, embedded electronics (64 recording channels), a multichannel stimulator and seven flexible electrodes (64 stimulation pads) placed on the volar side of the subject's hand. The system was tested in seven subjects asked to recognize contact positions and identify contact sliding on the electronic skin, using distributed anode configuration (DAC) and single dedicated anode configuration. The experiments demonstrated that DAC resulted in substantially better performance. Using DAC, the system successfully translated the contact patterns into electrotactile profiles that the subjects could recognize with satisfactory accuracy ([Formula: see text] for static and [Formula: see text] for dynamic patterns). The proposed system is an important step towards the development of a high-density human-machine interfacing between the user and a robotic hand. This article is part of the theme issue 'Advanced neurotechnologies: translating innovation for health and well-being'.

Embedded Electrotactile Feedback System for Hand Prostheses Using Matrix Electrode and Electronic Skin.

As the technology moves towards more human-like bionic limbs, it is necessary to develop a feedback system that provides active touch feedback to a user of a prosthetic hand. Most of the contemporary sensory substitution methods comprise simple position and force sensors combined with few discrete stimulation units, and hence they are characterized with a limited amount of information that can be transmitted by the feedback. The present study describes a novel system for tactile feedback integrating advanced multipoint sensing (electronic skin) and stimulation (matrix electrodes). The system comprises a flexible sensing array (16 sensors) integrated on the index finger of a Michelangelo prosthetic hand mockup, embedded interface electronics and multichannel stimulator connected to a flexible matrix electrode (24 pads). The developed system conveys contact information (binary detections) to the user. To demonstrate the feasibility, the system was tested in six able-bodied subjects who were asked to recognize static patterns (contact position) with two different spatial resolutions and dynamic movement patterns (i.e., sliding along and/or across the finger) presented on the electronic skin. The experiments demonstrated that the system successfully translated the mechanical interaction into electrotactile profiles, which the subjects could recognize with good performance. The success rates (mean ± standard deviation) for the static patterns were 91 ± 4% and 58 ± 10% for low and high spatial resolution, respectively, while the success rate for sliding touch was 94 ± 4%. These results demonstrate that the developed system is an important step towards a new generation of tactile feedback interfaces that can provide high-bandwidth connection between the user and his/her bionic limb. Such systems would allow mimicking spatially distributed natural feedback, thereby facilitating the control and embodiment of the artificial device into the user body scheme.

Validation of Screen-Printed Electronic Skin Based on Piezoelectric Polymer Sensors.

This paper proposes a validation method of the fabrication technology of a screen-printed electronic skin based on polyvinylidene fluoride-trifluoroethylene P(VDF-TrFE) piezoelectric polymer sensors. This required researchers to insure, through non-direct sensor characterization, that printed sensors were working as expected. For that, we adapted an existing model to non-destructively extract sensor behavior in pure compression (i.e., the d33 piezocoefficient) by indentation tests over the skin surface. Different skin patches, designed to sensorize a glove and a prosthetic hand (11 skin patches, 104 sensors), have been tested. Reproducibility of the sensor response and its dependence upon sensor position on the fabrication substrate were examined, highlighting the drawbacks of employing large A3-sized substrates. The average value of d33 for all sensors was measured at incremental preloads (1-3 N). A systematic decrease has been checked for patches located at positions not affected by substrate shrinkage. In turn, sensor reproducibility and d33 adherence to literature values validated the e-skin fabrication technology. To extend the predictable behavior to all skin patches and thus increase the number of working sensors, the size of the fabrication substrate is to be decreased in future skin fabrication. The tests also demonstrated the efficiency of the proposed method to characterize embedded sensors which are no more accessible for direct validation.

Smart Tactile Sensing Systems Based on Embedded CNN Implementations.

Embedding machine learning methods into the data decoding units may enable the extraction of complex information making the tactile sensing systems intelligent. This paper presents and compares the implementations of a convolutional neural network model for tactile data decoding on various hardware platforms. Experimental results show comparable classification accuracy of 90.88% for Model 3, overcoming similar state-of-the-art solutions in terms of time inference. The proposed implementation achieves a time inference of 1.2 ms while consuming around 900 µ J. Such an embedded implementation of intelligent tactile data decoding algorithms enables tactile sensing systems in different application domains such as robotics and prosthetic devices.

Experimental Assessment of the Interface Electronic System for PVDF-Based Piezoelectric Tactile Sensors.

Tactile sensors are widely employed to enable the sense of touch for applications such as robotics and prosthetics. In addition to the selection of an appropriate sensing material, the performance of the tactile sensing system is conditioned by its interface electronic system. On the other hand, due to the need to embed the tactile sensing system into a prosthetic device, strict requirements such as small size and low power consumption are imposed on the system design. This paper presents the experimental assessment and characterization of an interface electronic system for piezoelectric tactile sensors for prosthetic applications. The interface electronic is proposed as part of a wearable system intended to be integrated into an upper limb prosthetic device. The system is based on a low power arm-microcontroller and a DDC232 device. Electrical and electromechanical setups have been implemented to assess the response of the interface electronic with PVDF-based piezoelectric sensors. The results of electrical and electromechanical tests validate the correct functionality of the proposed system.