A Friction-Driven Strategy for Agile Steering Wheel Manipulation by Humanoid Robots.

Vehicle driving can substantially enhance the maneuverability of humanoid robots. Agile steering wheel manipulation requires rapid rotation in narrow spaces such as a cab, serving as the foundation for increasing driving speed, especially in an obstacle avoidance scenario. Generally, there are 3 human driving strategies, "Hand-to-Hand," "Hand-over-Hand," and "One-Hand." Based on the human driving motion data, we quantitatively analyze these strategies from 3 aspects, motion range of joint combination, motion region of the shoulder, and velocity of the manipulation. Then, a friction-driven manipulation strategy using one hand is proposed utilizing the similarity between a humanoid robot and a driver (human). It effectively addresses the requirements of both a small range of motion and rapid manipulation. To prevent the deformation of the steering wheel caused by excessive force, we construct an operating force model specifically for the steering wheel. This model accurately describes the relationship between the rotation resistance and the state of the steering wheel. In addition, we propose a quadratic programming (QP)-based control framework to servo the robot to track the end-effector position and target wrench output by this model. Finally, the effectiveness of this paper is evaluated through an obstacle avoidance scenario, achieving a maximum rotation velocity of 3.14 rad/s.

The Role of Audio-Visual Feedback in a Thought-Based Control of a Humanoid Robot: A BCI Study in Healthy and Spinal Cord Injured People.

The efficient control of our body and successful interaction with the environment are possible through the integration of multisensory information. Brain-computer interface (BCI) may allow people with sensorimotor disorders to actively interact in the world. In this study, visual information was paired with auditory feedback to improve the BCI control of a humanoid surrogate. Healthy and spinal cord injured (SCI) people were asked to embody a humanoid robot and complete a pick-and-place task by means of a visual evoked potentials BCI system. Participants observed the remote environment from the robot's perspective through a head mounted display. Human-footsteps and computer-beep sounds were used as synchronous/asynchronous auditory feedback. Healthy participants achieved better placing accuracy when listening to human footstep sounds relative to a computer-generated sound. SCI people demonstrated more difficulty in steering the robot during asynchronous auditory feedback conditions. Importantly, subjective reports highlighted that the BCI mask overlaying the display did not limit the observation of the scenario and the feeling of being in control of the robot. Overall, the data seem to suggest that sensorimotor-related information may improve the control of external devices. Further studies are required to understand how the contribution of residual sensory channels could improve the reliability of BCI systems.

Audio-visual feedback improves the BCI performance in the navigational control of a humanoid robot.

Advancement in brain computer interfaces (BCI) technology allows people to actively interact in the world through surrogates. Controlling real humanoid robots using BCI as intuitively as we control our body represents a challenge for current research in robotics and neuroscience. In order to successfully interact with the environment the brain integrates multiple sensory cues to form a coherent representation of the world. Cognitive neuroscience studies demonstrate that multisensory integration may imply a gain with respect to a single modality and ultimately improve the overall sensorimotor performance. For example, reactivity to simultaneous visual and auditory stimuli may be higher than to the sum of the same stimuli delivered in isolation or in temporal sequence. Yet, knowledge about whether audio-visual integration may improve the control of a surrogate is meager. To explore this issue, we provided human footstep sounds as audio feedback to BCI users while controlling a humanoid robot. Participants were asked to steer their robot surrogate and perform a pick-and-place task through BCI-SSVEPs. We found that audio-visual synchrony between footsteps sound and actual humanoid's walk reduces the time required for steering the robot. Thus, auditory feedback congruent with the humanoid actions may improve motor decisions of the BCI's user and help in the feeling of control over it. Our results shed light on the possibility to increase robot's control through the combination of multisensory feedback to a BCI user.