Tactile Echoes: Multisensory Augmented Reality for the Hand.

Touch interactions are central to many human activities, but there are few technologies for computationally augmenting free-hand interactions with real environments. Here, we describe Tactile Echoes, a finger-wearable system for augmenting touch interactions with physical objects. This system captures and processes touch-elicited vibrations in real-time in order to enliven tactile experiences. In this article, we process these signals via a parametric signal processing network in order to generate responsive tactile and auditory feedback. Just as acoustic echoes are produced through the delayed replication and modification of sounds, so are Tactile Echoes produced through transformations of vibrotactile inputs in the skin. The echoes also reflect the contact interactions and touched objects involved. A transient tap produces discrete echoes, while a continuous slide yields sustained feedback. We also demonstrate computational and spatial tracking methods that allow these effects to be selectively assigned to different objects or actions. A large variety of distinct multisensory effects can be designed via ten processing parameters. We investigated how Tactile Echoes are perceived in several perceptual experiments using multidimensional scaling methods. This allowed us to deduce low-dimensional, semantically grounded perceptual descriptions. We present several virtual and augmented reality applications of Tactile Echoes. In a user study, we found that these effects made interactions more responsive and engaging. Our findings show how to endow a large variety of touch interactions with expressive multisensory effects.

Elastohydrodynamic friction of robotic and human fingers on soft micropatterned substrates.

Frictional sliding between patterned surfaces is of fundamental and practical importance in the haptic engineering of soft materials. In emerging applications such as remote surgery and soft robotics, thin fluid films between solid surfaces lead to a multiphysics coupling between solid deformation and fluid dissipation. Here, we report a scaling law that governs the peak friction values of elastohydrodynamic lubrication on patterned surfaces. These peaks, absent in smooth tribopairs, arise due to a separation of length scales in the lubricant flow. The framework is generated by varying the geometry, elasticity and fluid properties of soft tribopairs and measuring the lubricated friction with a triborheometer. The model correctly predicts the elastohydrodynamic lubrication friction of a bioinspired robotic fingertip and human fingers. Its broad applicability can inform the future design of robotic hands or grippers in realistic conditions, and open up new ways of encoding friction into haptic signals.

Dynamics and Perception in the Thermal Grill Illusion.

A basic challenge in perception research is to understand how sensory inputs from physical environments and the body are integrated in order to facilitate perceptual inferences. Thermal perception, which arises through heat transfer between extrinsic sources and body tissues, is an integral part of natural haptic experiences, and thermal feedback technologies have potential applications in wearable computing, virtual reality, and other areas. While physics dictates that thermal percepts can be slow, often unfolding over timescales measured in seconds, much faster perceptual responses can occur in the thermal grill illusion. The latter refers to a burning-like sensation that can be evoked when innocuous warm and cool stimuli are applied to the skin in juxtaposed fashion. Here, we show that perceptual response times to the thermal grill illusion decrease systematically with perceived intensity. Using results from behavioral experiments in combination with a physics-based description of tissue heating, we develop a simple model explaining the perception of the illusion through the evolution of internal tissue temperatures. The results suggest that improved understanding of the physical mechanisms of tissue heating may aid our understanding of thermal perception, as exemplified by the thermal grill illusion, and might point toward more efficient methods for thermal feedback.