The left-right reversed visual feedback of the hand affects multisensory interaction within peripersonal space.

The interaction between vision and touch, known as the crossmodal congruency effect, has been extensively investigated in several research studies. Recent studies have revealed that the crossmodal congruency effect involves body representations. However, it is unclear how bodily information (e.g., location, posture, motion) is linked to visual and tactile inputs. Three experiments were conducted to investigate this issue. In Experiment 1, participants performed a crossmodal congruency task in which both their hand appearance and the motor trajectories were left-right reversed. The results showed that the crossmodal congruency effect was not observed in the reversal condition, whereas participants showed significant crossmodal congruency in the control condition, in which there was no visual manipulation of the hand. In Experiments 2 and 3, where either the hand appearance or motor trajectory was left-right reversed individually, a significant crossmodal congruency effect was observed. This study demonstrated that visual manipulation of hand appearance and motor trajectories both affected the crossmodal congruency effect, although neither showed a dominant effect that solely altered the crossmodal congruency effect. The present results provide insights into the relationship between visual-tactile interactions and bodily information.

Adaptation to delayed visual feedback of the body movement extends multisensory peripersonal space.

The space surrounding the body in which individuals interact with the environment is known as the peripersonal space (PPS). Previous studies have reported that PPS has multisensory nature. However, the relationship between the multisensory nature of PPS and an individuals' defensive actions has not been fully clarified to date. We investigated this relationship by examining the multisensory representation of PPS under situations in which visual feedback of body movements was delayed by using a virtual reality system. The results indicated that body-movement delays extended the multisensory PPS, suggesting that body-movement delays increased the potential threat of distant objects because it was necessary to prepare defensive actions sooner. The previous findings can be interpreted that PPS is modulated by the spatio-temporal relationship between people and external stimuli. This view may provide evidence of interactions between defensive and nondefensive functions of the multisensory PPS.

Does response facilitation to visuo-tactile stimuli around a remote-controlled hand avatar reflect peripersonal space or attentional bias?

People react faster to visuo-tactile stimuli presented near the body (i.e., in peripersonal space) than to tactile stimuli presented alone. This multi-sensory facilitation effect has been used as a measurement of peripersonal space. Previous research has reported that peripersonal space representations can be modulated by actively using hand-held tools or disconnected hand avatars. However, previous research has ignored the possibility that the attentional effect of active tool use could affect multi-sensory facilitation. In the present study, we delivered tactile stimuli to participants' left or right hand concurrently with visual stimuli presented near a virtual hand avatar operated by the movements of participants' left or right hand, which was shown far in a virtual environment and disconnected from the body. Participants reacted to tactile stimuli while ignoring the visual stimuli. The results indicated a multi-sensory facilitation effect when tactile stimuli were delivered to the hand used to operate the hand avatar. In contrast, the facilitation was not observed when the tactile stimuli were delivered to the hand that is not operating the hand avatar. These results suggest that the strength of the multi-sensory facilitation effect differed across conditions, even though the visual attention captured around the hand avatar was controlled across conditions. We concluded that the modulation of peripersonal space resulting from using tools or avatars is nearly independent of visual attention captured around tools or avatars.

Remote hand: Hand-centered peripersonal space transfers to a disconnected hand avatar.

The space surrounding our body is called peripersonal space (PPS). It has been reported that visuo-tactile facilitation occurs more strongly within PPS than outside PPS. Furthermore, previous research has revealed several methods by which PPS can be extended. The present study provides the first behavioral evidence of the transfer of PPS in a virtual environment by a novel technique. PPS representation was investigated using a remote-controlled hand avatar presented far from the body in a virtual environment. Participants showed strongest visuo-tactile facilitation at the far space around the remote hand and no facilitation at the near space around the real hand, suggesting that PPS transfers from near the body to the space around the hand avatar. The present results extend previous findings of the plasticity of PPS and demonstrate flexibility of PPS representation beyond the physical and anatomical limits of body representation.

Disconnected hand avatar can be integrated into the peripersonal space.

Several studies have shown that space immediately surrounding the body, or the peripersonal space is represented differently in the brain from the more distant extra-personal space. Moreover, the boundary of peripersonal space can be extended to space surrounding the tip of a tool held by the hand. However, it is not known if tools need to be connected to the body to modulate the peripersonal space. We used a line bisection task to investigate whether peripersonal space representation surrounds a virtual hand avatar that is disconnected from the body. Healthy participants conducted a line bisection task by responding with either a virtual hand avatar or a laser pointer. The to-be-bisected lines were presented either in peripersonal or extra-personal space. When the lines were placed in extra-personal space, the virtual hand avatar was presented near the line such that the hand avatar was far from participants and disconnected from their bodies. Results indicated a shift in the line bisection bias from the left to the right as the line presentation distance increased when using the laser pointer, whereas no shift in bias was observed when using the virtual hand avatar. This result indicates that objects resembling human hands presented even at a distance and disconnected from the body can be integrated into the peripersonal space, which suggests that peripersonal space representation is more flexible than previously reported.

The relationship between the body and the environment in the virtual world: The interpupillary distance affects the body size perception.

Previous research suggests that the size of one's body is used as a metric to scale the external world. On the other hand, the influence of information from the external world on the perception of body size is unclear. It has been suggested that increased inter-pupillary distance (IPD) leads people to perceive the external world as smaller than it actually is. The present study investigated the effect of the IPD on body size perception, and the relationship between the perceived scale of the body and the external world when the IPD is manipulated. To this end, in a virtual environment, we manipulated the IPD as well as the size and presence of participants' hands, while participant's eye height was increased vertically. Results showed that, when participants' eye height was increased and their hands were enlarged, people with a fixed IPD perceived the size of their body to be large (like a giant) while the external world was perceived to be changed minimally. Alternatively, people with increased IPD perceived that the external world as having shrank, whereas their perception of their body size changed little. However, when a viewers' virtual hands were not shown, the IPD did not affect the individual's percept of body size, although the IPD did affect one's perception of the external world. These results suggest that, when the ratio of the size between one's body and the external world are explicit, the perceived size of one's body is affected by the IPD or perceived scale of the external world that is affected by the IPD.