Improved tactile speech perception and noise robustness using audio-to-tactile sensory substitution with amplitude envelope expansion.

Recent advances in haptic technology could allow haptic hearing aids, which convert audio to tactile stimulation, to become viable for supporting people with hearing loss. A tactile vocoder strategy for audio-to-tactile conversion, which exploits these advances, has recently shown significant promise. In this strategy, the amplitude envelope is extracted from several audio frequency bands and used to modulate the amplitude of a set of vibro-tactile tones. The vocoder strategy allows good consonant discrimination, but vowel discrimination is poor and the strategy is susceptible to background noise. In the current study, we assessed whether multi-band amplitude envelope expansion can effectively enhance critical vowel features, such as formants, and improve speech extraction from noise. In 32 participants with normal touch perception, tactile-only phoneme discrimination with and without envelope expansion was assessed both in quiet and in background noise. Envelope expansion improved performance in quiet by 10.3% for vowels and by 5.9% for consonants. In noise, envelope expansion improved overall phoneme discrimination by 9.6%, with no difference in benefit between consonants and vowels. The tactile vocoder with envelope expansion can be deployed in real-time on a compact device and could substantially improve clinical outcomes for a new generation of haptic hearing aids.

Local field potential sharp waves with diversified impact on cortical neuronal encoding of haptic input.

Cortical sensory processing is greatly impacted by internally generated activity. But controlling for that activity is difficult since the thalamocortical network is a high-dimensional system with rapid state changes. Therefore, to unwind the cortical computational architecture there is a need for physiological 'landmarks' that can be used as frames of reference for computational state. Here we use a waveshape transform method to identify conspicuous local field potential sharp waves (LFP-SPWs) in the somatosensory cortex (S1). LFP-SPW events triggered short-lasting but massive neuronal activation in all recorded neurons with a subset of neurons initiating their activation up to 20 ms before the LFP-SPW onset. In contrast, LFP-SPWs differentially impacted the neuronal spike responses to ensuing tactile inputs, depressing the tactile responses in some neurons and enhancing them in others. When LFP-SPWs coactivated with more distant cortical surface (ECoG)-SPWs, suggesting an involvement of these SPWs in global cortical signaling, the impact of the LFP-SPW on the neuronal tactile response could change substantially, including inverting its impact to the opposite. These cortical SPWs shared many signal fingerprint characteristics as reported for hippocampal SPWs and may be a biomarker for a particular type of state change that is possibly shared byboth hippocampus and neocortex.

A review of assessment methods for measuring individual differences in oral somatosensory perception.

While taste and smell perception have been thoroughly investigated, our understanding of oral somatosensory perception remains limited. Further, assessing and measuring individual differences in oral somatosensory perception pose notable challenges. This review aimed to evaluate the existing methods to assess oral somatosensory perception by examining and comparing the strengths and limitations of each method. The review highlighted the lack of standardized assessment methods and the various procedures within each method. Tactile sensitivity can be assessed using several methods, but each method measures different tactile dimensions. Further investigations are needed to confirm its correlation with texture sensitivity. In addition, measuring a single textural attribute may not provide an overall representation of texture sensitivity. Thermal sensitivity can be evaluated using thermal-change detection or temperature discrimination tests. The chemesthetic sensitivity tests involve either localized or whole-mouth stimulation tests. The choice of an appropriate method for assessing oral somatosensory sensitivity depends on several factors, including the specific research objectives and the target population. Each method has its unique intended purpose, strengths, and limitations, so no universally superior approach exists. To overcome some of the limitations associated with certain methods, the review offers alternative or complementary approaches that could be considered. Researchers can enhance the comprehensive assessment of oral somatosensory sensitivity by carefully selecting and potentially combining methods. In addition, a standardized protocol remains necessary for each method.

Beyond algorithms: The human touch machine-generated titles for enhancing click-through rates on social media.

Artificial intelligence (AI) has the potential to revolutionize various domains by automating language-driven tasks. This study evaluates the effectiveness of an AI-assisted methodology, called the "POP Title AI Five-Step Optimization Method," in optimizing content titles on the RED social media platform. By leveraging advancements in natural language generation, this methodology aims to enhance the impact of titles by incorporating emotional sophistication and cultural proficiency, addressing existing gaps in AI capabilities. The methodology entails training generative models using human-authored examples that align with the aspirations of the target audience. By incorporating popular keywords derived from user searches, the relevance and discoverability of titles are enhanced. Audience-centric filtering is subsequently employed to further refine the generated outputs. Furthermore, human oversight is introduced to provide essential intuition that AI systems alone may lack. A total of one thousand titles, generated by AI, underwent linguistic and engagement analyses. Qualitatively, 65% of the titles exhibited intrigue and conveyed meaning comparable to those generated by humans. However, attaining full emotional sophistication remained a challenge. Quantitatively, titles emphasizing curiosity and contrast demonstrated positive correlations with user interactions, thus validating the efficacy of these techniques. Consequently, the machine-generated titles achieved coherence on par with 65% of human-generated titles, signifying significant progress and potential for further refinement. Nevertheless, achieving socio-cultural awareness is vital to match human understanding across diverse contexts, thus presenting a critical avenue for future improvement in the methodology. Continuous advancements in AI can enhance adaptability and reduce subjectivity by promoting flexibility instead of relying solely on manual reviews. As AI gains a deeper understanding of humanity, opportunities for its application across various industries through experiential reasoning abilities emerge. This case study exemplifies the nurturing of AI's potential by refining its skills through an evolutionary process.

Biomimetic bimodal haptic perception using triboelectric effect.

Multimodal haptic perception is essential for enhancing perceptual experiences in augmented reality applications. To date, several artificial tactile interfaces have been developed to perceive pressure and precontact signals, while simultaneously detecting object type and softness with quantified modulus still remains challenging. Here, inspired by the campaniform sensilla on insect antennae, we proposed a hemispherical bimodal intelligent tactile sensor (BITS) array using the triboelectric effect. The system is capable of softness identification, modulus quantification, and material type recognition. In principle, due to the varied deformability of materials, the BITS generates unique triboelectric output fingerprints when in contact with the tested object. Furthermore, owing to the different electron affinities, the BITS array can accurately recognize material type (99.4% accuracy), facilitating softness recognition (100% accuracy) and modulus quantification. It is promising that the BITS based on the triboelectric effect has the potential to be miniaturized to provide real-time accurate haptic information as an artificial antenna toward applications of human-machine integration.

Healing Function for Abraded Fingerprint Ridges in Tactile Texture Sensors.

Tactile texture sensors are designed to evaluate the sensations felt when a human touches an object. Prior studies have demonstrated the necessity for these sensors to have compliant ridges on their surfaces that mimic human fingerprints. These features enable the simulation of contact phenomena, especially friction and vibration, between human fingertips and objects, enhancing the tactile sensation evaluation. However, the ridges on tactile sensors are susceptible to abrasion damage from repeated use. To date, the healing function of abraded ridges has not been proposed, and its effectiveness needs to be demonstrated. In this study, we investigated whether the signal detection capabilities of a sensor with abraded epidermal ridges could be restored by healing the ridges using polyvinyl chloride plastisol as the sensor material. We developed a prototype tactile sensor with an embedded strain gauge, which was used to repeatedly scan roughness specimens. After more than 1000 measurements, we observed significant deterioration in the sensor's output signal level. The ridges were then reshaped using a mold with a heating function, allowing the sensor to partially regain its original signal levels. This method shows potential for extending the operational lifespan of tactile texture sensors with compliant ridges.

Primary somatosensory cortical processing in tactile communication.

Touch is an essential form of non-verbal communication. While language and its neural basis are widely studied, tactile communication is less well understood. We used fMRI and multivariate pattern analyses in pairs of emotionally close adults to examine the neural basis of human-to-human tactile communication. In each pair, a participant was designated either as sender or as receiver. The sender was instructed to communicate specific messages by touching only the arm of the receiver, who was inside the scanner. The receiver then identified the message based on the touch expression alone. We designed two multivariate decoder algorithms-one based on the sender's intent (sender-decoder), and another based on the receiver's response (receiver-decoder). We identified several brain areas that significantly predicted behavioural accuracy of the receiver. Regarding our a priori region of interest, the receiver's primary somatosensory cortex (S1), both decoders were able to accurately differentiate the messages based on neural activity patterns here. The receiver-decoder, which relied on the receivers' interpretations of the touch expressions, outperformed the sender-decoder, which relied on the sender's intent. Our results identified a network of brain areas involved in human-to-human tactile communication and supported the notion of non-sensory factors being represented in S1. This article is part of the theme issue 'Sensing and feeling: an integrative approach to sensory processing and emotional experience'.

Precise tactile localization on the human fingernail.

Fingernails are specialized features of the primate hand, which are believed to contribute to manual dexterity. The sensorimotor functions of fingernails, however, remain poorly understood. This study investigates the ability of humans to precisely localize touches applied to the fingernail plate. Nine different locations on the fingernail were touched and participants judged the location by clicking a mouse cursor on a photograph of their finger. Performance in this condition was compared with stimuli applied to the skin of the fingertip. The results showed that participants are able to localize touch on the fingernails at substantially higher than chance levels. Moreover, the precision of this ability is not appreciably lower than that of the fingertips. These results show that the fingernail is a highly sensitive sensory organ, which is capable of providing rich spatial information about tactile stimuli.

Functional performance of a vibrotactile sensory substitution device in people with profound vision loss.

SIGNIFICANCE: This study has shown a vibrotactile sensory substitution device (SSD) prototype, VibroSight, has the potential to improve functional outcomes (i.e., obstacle avoidance, face detection) for people with profound vision loss, even with brief familiarization (<20 minutes). PURPOSE: Mobility aids such as long canes are still the mainstay of support for most people with vision loss, but they do have limitations. Emerging technologies such as SSDs are gaining widespread interest in the low vision community. The aim of this project was to assess the efficacy of a prototype vibrotactile SSD for people with profound vision loss in the face detection and obstacle avoidance tasks. METHODS: The VibroSight device was tested in a movement laboratory setting. The first task involved obstacle avoidance, in which participants were asked to walk through an obstacle course. The second was a face detection task, in which participants were asked to step toward the first face they detected. Exit interviews were also conducted to gather user experience data. Both people with low vision (n = 7) and orientation and mobility instructors (n = 4) completed the tasks. RESULTS: In obstacle avoidance task, participants were able to use the device to detect (p<0.001) and avoid (p<0.001) the obstacles within a significantly larger range, but were slower (p<0.001), when compared with without the device. In face detection task, participants demonstrated a great level of accuracy, precision, and sensitivity when using the device. Interviews revealed a positive user experience, although participants identified that they would require a lighter and compact design for real-world use. CONCLUSIONS: Overall, the results verified the functionality of vibrotactile SSD prototype. Further research is warranted to evaluate the user performance after an extended training program and to add new features, such as object recognition software algorithms, into the device.

Early attentional processing and cortical remapping strategies of tactile stimuli in adults with an early and late-onset visual impairment: A cross-sectional study.

Neuroplastic changes appear in people with visual impairment (VI) and they show greater tactile abilities. Improvements in performance could be associated with the development of enhanced early attentional processes based on neuroplasticity. Currently, the various early attentional and cortical remapping strategies that are utilized by people with early (EB) and late-onset blindness (LB) remain unclear. Thus, more research is required to develop effective rehabilitation programs and substitution devices. Our objective was to explore the differences in spatial tactile brain processing in adults with EB, LB and a sighted control group (CG). In this cross-sectional study 27 participants with VI were categorized into EB (n = 14) and LB (n = 13) groups. They were then compared with a CG (n = 15). A vibrotactile device and event-related potentials (ERPs) were utilized while participants performed a spatial tactile line recognition task. The P100 latency and cortical areas of maximal activity were analyzed during the task. The three groups had no statistical differences in P100 latency (p>0.05). All subjects showed significant activation in the right superior frontal areas. Only individuals with VI activated the left superior frontal regions. In EB subjects, a higher activation was found in the mid-frontal and occipital areas. A higher activation of the mid-frontal, anterior cingulate cortex and orbitofrontal zones was observed in LB participants. Compared to the CG, LB individuals showed greater activity in the left orbitofrontal zone, while EB exhibited greater activity in the right superior parietal cortex. The EB had greater activity in the left orbitofrontal region compared to the LB. People with VI may not have faster early attentional processing. EB subjects activate the occipital lobe and right superior parietal cortex during tactile stimulation because of an early lack of visual stimuli and a multimodal information processing. In individuals with LB and EB the orbitofrontal area is activated, suggesting greater emotional processing.

Krause corpuscles are genital vibrotactile sensors for sexual behaviours.

Krause corpuscles, which were discovered in the 1850s, are specialized sensory structures found within the genitalia and other mucocutaneous tissues1-4. The physiological properties and functions of Krause corpuscles have remained unclear since their discovery. Here we report the anatomical and physiological properties of Krause corpuscles of the mouse clitoris and penis and their roles in sexual behaviour. We observed a high density of Krause corpuscles in the clitoris compared with the penis. Using mouse genetic tools, we identified two distinct somatosensory neuron subtypes that innervate Krause corpuscles of both the clitoris and penis and project to a unique sensory terminal region of the spinal cord. In vivo electrophysiology and calcium imaging experiments showed that both Krause corpuscle afferent types are A-fibre rapid-adapting low-threshold mechanoreceptors, optimally tuned to dynamic, light-touch and mechanical vibrations (40-80 Hz) applied to the clitoris or penis. Functionally, selective optogenetic activation of Krause corpuscle afferent terminals evoked penile erection in male mice and vaginal contraction in female mice, while genetic ablation of Krause corpuscles impaired intromission and ejaculation of males and reduced sexual receptivity of females. Thus, Krause corpuscles of the clitoris and penis are highly sensitive mechanical vibration detectors that mediate sexually dimorphic mating behaviours.

Can you feel the force just right? Tactile force feedback for training of minimally invasive surgery-evaluation of vibration feedback for adequate force application.

BACKGROUND: Tissue handling is a crucial skill for surgeons and is challenging to learn. The aim of this study was to develop laparoscopic instruments with different integrated tactile vibration feedback by varying different tactile modalities and assess its effect on tissue handling skills. METHODS: Standard laparoscopic instruments were equipped with a vibration effector, which was controlled by a microcomputer attached to a force sensor platform. One of three different vibration feedbacks (F1: double vibration > 2 N; F2: increasing vibration relative to force; F3: one vibration > 1.5 N and double vibration > 2 N) was applied to the instruments. In this multicenter crossover trial, surgical novices and expert surgeons performed two laparoscopic tasks (Peg transfer, laparoscopic suture, and knot) each with all the three vibration feedback modalities and once without any feedback, in a randomized order. The primary endpoint was force exertion. RESULTS: A total of 57 subjects (15 surgeons, 42 surgical novices) were included in the trial. In the Peg transfer task, there were no differences between the tactile feedback modalities in terms of force application. However, in subgroup analysis, the use of F2 resulted in a significantly lower mean-force application (p-value = 0.02) among the student group. In the laparoscopic suture and knot task, all participants exerted significantly lower mean and peak forces using F2 (p-value < 0.01). These findings remained significant after subgroup analysis for both, the student and surgeon groups individually. The condition without tactile feedback led to the highest mean and peak force exertion compared to the three other feedback modalities. CONCLUSION: Continuous tactile vibration feedback decreases the mean and peak force applied during laparoscopic training tasks. This effect is more pronounced in demanding tasks such as laparoscopic suturing and knot tying and might be more beneficial for students. Laparoscopic tasks without feedback lead to increased force application.

Tactile versus motor imagery: differences in corticospinal excitability assessed with single-pulse TMS.

Tactile Imagery (TI) remains a fairly understudied phenomenon despite growing attention to this topic in recent years. Here, we investigated the effects of TI on corticospinal excitability by measuring motor evoked potentials (MEPs) induced by single-pulse transcranial magnetic stimulation (TMS). The effects of TI were compared with those of tactile stimulation (TS) and kinesthetic motor imagery (kMI). Twenty-two participants performed three tasks in randomly assigned order: imagine finger tapping (kMI); experience vibratory sensations in the middle finger (TS); and mentally reproduce the sensation of vibration (TI). MEPs increased during both kMI and TI, with a stronger increase for kMI. No statistically significant change in MEP was observed during TS. The demonstrated differential effects of kMI, TI and TS on corticospinal excitability have practical implications for devising the imagery-based and TS-based brain-computer interfaces (BCIs), particularly the ones intended to improve neurorehabilitation by evoking plasticity changes in sensorimotor circuitry.

An Artificial Universal Tactile Nociceptor Based on 2D Polymer Film Memristor Arrays with Tunable Resistance Switching Behaviors.

Nociceptor is an important receptor in the organism's sensory system; it can perceive harmful stimuli and send signals to the brain in order to protect the body in time. The injury degree of nociceptor can be divided into three stages: self-healing injury, treatable injury, and permanent injury. However, the current studies on nociceptor simulation are limited to the self-healing stage due to the limitation of the untunable resistance switching behavior of memristors. In this study, we constructed Al/2DPTPAK+TAPB/Ag memristor arrays with adjustable memory behaviors to emulate the nociceptor of biological neural network of all three stages. For this purpose, a PDMS/AgNWs/ITO/PET pressure sensor was assembled to mimic the tactile perception of the skin. The memristor arrays can not only simulate all the response of nociceptor, i.e., the threshold, relaxation, no adaptation, and sensitization with the self-healing injury, but can also simulate the treatable injury and the permanent injury. These behaviors are both demonstrated with a single memristor and in the form of pattern mapping of the memristor array.

A Skin-Inspired High-Performance Tactile Sensor for Accurate Recognition of Object Softness.

High-performance tactile sensors with skin-sensing properties are crucial for intelligent perception in next-generation smart devices. However, previous studies have mainly focused on the sensitivity and response range of tactile sensation while neglecting the ability to recognize object softness. Therefore, achieving a precise perception of the softness remains a challenge. Here, we report an integrated tactile sensor consisting of a central hole gradient structure pressure sensor and a planar structure strain sensor. The recognition of softness and tactile perception is achieved through the synergistic effect of pressure sensors that sense the applied pressure and strain sensors that recognize the strain of the target object. The results indicate that the softness evaluation parameter (SC) of the integrated structural tactile sensor increases from 0.14 to 0.47 along with Young's modulus of the object decreasing from 2.74 to 0.45 MPa, demonstrating accurate softness recognition. It also exhibits a high sensitivity of 10.55 kPa-1 and an ultrawide linear range of 0-1000 kPa, showing an excellent tactile sensing capability. Further, an intelligent robotic hand system based on integrated structural tactile sensors was developed, which can identify the softness of soft foam and glass and grasp them accurately, indicating human skin-like sensing and grasping capabilities.

An Instrumented Glove for Restoring Sensorimotor Function of the Hand Through Augmented Sensory Feedback.

The loss of sensitivity of the upper limb due to neurological injuries severely limits the ability to manipulate objects, hindering personal independence. Non-invasive augmented sensory feedback techniques are used to promote neural plasticity hence to restore the grasping function. This work presents a wearable device for restoring sensorimotor hand functions based on Discrete Event-driven Sensory Control policy. It consists of an instrumented glove that, relying on piezoelectric sensors, delivers short-lasting vibrotactile stimuli synchronously with the relevant mechanical events (i.e., contact and release) of the manipulation. We first performed a feasibility study on healthy participants (20) that showed overall good performances of the device, with touch-event detection accuracy of 96.2% and a response delay of 22 ms. Later, we pilot tested it on two participants with limited sensorimotor functions. When using the device, they improved their hand motor coordination while performing tests for hand motor coordination assessment (i.e., pick and place test, pick and lift test). In particular, they exhibited more coordinated temporal correlations between grip force and load force profiles and enhanced performances when transferring objects, quantitatively proving the effectiveness of the device.

Interleaved Multi-Contact Peripheral Nerve Stimulation to Enhance Reproduction of Tactile Sensation: A Computational Modeling Study.

Peripheral nerve stimulation (PNS) is an effective means to elicit sensation for rehabilitation of people with loss of a limb or limb function. While most current PNS paradigms deliver current through single electrode contacts to elicit each tactile percept, multi-contact extraneural electrodes offer the opportunity to deliver PNS with groups of contacts individually or simultaneously. Multi-contact PNS strategies could be advantageous in developing biomimetic PNS paradigms to recreate the natural neural activity during touch, because they may be able to selectively recruit multiple distinct neural populations. We used computational models and optimization approaches to develop a novel biomimetic PNS paradigm that uses interleaved multi-contact (IMC) PNS to approximate the critical neural coding properties underlying touch. The IMC paradigm combines field shaping, in which two contacts are active simultaneously, with pulse-by-pulse contact and parameter variations throughout the touch stimulus. We show in simulation that IMC PNS results in better neural code mimicry than single contact PNS created with the same optimization techniques, and that field steering via two-contact IMC PNS results in better neural code mimicry than one-contact IMC PNS. We also show that IMC PNS results in better neural code mimicry than existing PNS paradigms, including prior biomimetic PNS. Future clinical studies will determine if the IMC paradigm can improve the naturalness and usefulness of sensory feedback for those with neurological disorders.

Creation of a biological sensorimotor interface for bionic reconstruction.

Neuromuscular control of bionic arms has constantly improved over the past years, however, restoration of sensation remains elusive. Previous approaches to reestablish sensory feedback include tactile, electrical, and peripheral nerve stimulation, however, they cannot recreate natural, intuitive sensations. Here, we establish an experimental biological sensorimotor interface and demonstrate its potential use in neuroprosthetics. We transfer a mixed nerve to a skeletal muscle combined with glabrous dermal skin transplantation, thus forming a bi-directional communication unit in a rat model. Morphological analyses indicate reinnervation of the skin, mechanoreceptors, NMJs, and muscle spindles. Furthermore, sequential retrograde labeling reveals specific sensory reinnervation at the level of the dorsal root ganglia. Electrophysiological recordings show reproducible afferent signals upon tactile stimulation and tendon manipulation. The results demonstrate the possibility of surgically creating an interface for both decoding efferent motor control, as well as encoding afferent tactile and proprioceptive feedback, and may indicate the way forward regarding clinical translation of biological communication pathways for neuroprosthetic applications.

Refraining from spontaneous face touch is linked to personality traits, reduced memory performance and EEG changes.

Spontaneous touches of one's face (sFST) were suggested to serve cognitive-emotional regulation processes. During the pandemic, refraining from face-touching was recommended, yet, accompanying effects and the influence of personal attributes remain unclear. Ninety participants (45 female, 45 male) filled out a questionnaire concerning personality, anxiety screening and ADHD screening. Subsequently, they performed a delayed verbal memory recall task four times. After two times, sixty participants were instructed to refrain from face-touching (experimental group). Thirty participants did not receive behavioral instructions (control group). To identify face-touches and conduct further analysis, Video, EMG, and EEG data were recorded. Two samples were formed, depending on the adherence to completely refrain from face-touching (adherent, non-adherent sample) and compared to each other and the control group. EEG analyses uncovered that refraining from face-touching is accompanied by increased beta-power at sensorimotor sites and, exclusively in the non-adherent sample, at frontal sites. Decreased memory performance was found exclusively in subsamples, who non-adherently touched their face while retaining words. In terms of questionnaire results, lower Conscientiousness and higher ADHD screening scores were revealed by the non-adherent compared to the adherent sample. No differences were found among the subsamples. The presented results indicate that refraining from face-touching is related to personal attributes, accompanied by neurophysiological shifts and for a portion of humans by lower memory performance, supporting the notion that sFST serve processes beyond sensorimotor.

Biosymbiotic haptic feedback - Sustained long term human machine interfaces.

Haptic technology permeates diverse fields and is receiving renewed attention for VR and AR applications. Advances in flexible electronics, facilitate the integration of haptic technologies into soft wearable systems, however, because of small footprint requirements face challenges of operational time requiring either large batteries, wired connections or frequent recharge, restricting the utility of haptic devices to short-duration tasks or low duty cycles, prohibiting continuously assisting applications. Currently many chronic applications are not investigated because of this technological gap. Here, we address wireless power and operation challenges with a biosymbiotic approach enabling continuous operation without user intervention, facilitated by wireless power transfer, eliminating the need for large batteries, and offering long-term haptic feedback without adhesive attachment to the body. These capabilities enable haptic feedback for robotic surgery training and posture correction over weeks of use with neural net computation. The demonstrations showcase that this device class expands use beyond conventional brick and strap or epidermally attached devices enabling new fields of use for imperceptible therapeutic and assistive haptic technologies supporting care and disease management.