Highly Robust and Wearable Facial Expression Recognition via Deep-Learning-Assisted, Soft Epidermal Electronics.

The facial expressions are a mirror of the elusive emotion hidden in the mind, and thus, capturing expressions is a crucial way of merging the inward world and virtual world. However, typical facial expression recognition (FER) systems are restricted by environments where faces must be clearly seen for computer vision, or rigid devices that are not suitable for the time-dynamic, curvilinear faces. Here, we present a robust, highly wearable FER system that is based on deep-learning-assisted, soft epidermal electronics. The epidermal electronics that can fully conform on faces enable high-fidelity biosignal acquisition without hindering spontaneous facial expressions, releasing the constraint of movement, space, and light. The deep learning method can significantly enhance the recognition accuracy of facial expression types and intensities based on a small sample. The proposed wearable FER system is superior for wide applicability and high accuracy. The FER system is suitable for the individual and shows essential robustness to different light, occlusion, and various face poses. It is totally different from but complementary to the computer vision technology that is merely suitable for simultaneous FER of multiple individuals in a specific place. This wearable FER system is successfully applied to human-avatar emotion interaction and verbal communication disambiguation in a real-life environment, enabling promising human-computer interaction applications.

Electrically compensated, tattoo-like electrodes for epidermal electrophysiology at scale.

Epidermal electrophysiology is widely carried out for disease diagnosis, performance monitoring, human-machine interaction, etc. Compared with thick, stiff, and irritating gel electrodes, emerging tattoo-like epidermal electrodes offer much better wearability and versatility. However, state-of-the-art tattoo-like electrodes are limited in size (e.g., centimeters) to perform electrophysiology at scale due to challenges including large-area fabrication, skin lamination, and electrical interference from long interconnects. Therefore, we report large-area, soft, breathable, substrate- and encapsulation-free electrodes designed into transformable filamentary serpentines that can be rapidly fabricated by cut-and-paste method. We propose a Cartan curve-inspired transfer process to minimize strain in the electrodes when laminated on nondevelopable skin surfaces. Unwanted signals picked up by the unencapsulated interconnects can be eliminated through a previously unexplored electrical compensation strategy. These tattoo-like electrodes can comfortably cover the whole chest, forearm, or neck for applications such as multichannel electrocardiography, sign language recognition, prosthetic control or mapping of neck activities.