Kinematic-Based Classification of Social Gestures and Grasping by Humans and Machine Learning Techniques.

The affective motion of humans conveys messages that other humans perceive and understand without conventional linguistic processing. This ability to classify human movement into meaningful gestures or segments plays also a critical role in creating social interaction between humans and robots. In the research presented here, grasping and social gesture recognition by humans and four machine learning techniques (k-Nearest Neighbor, Locality-Sensitive Hashing Forest, Random Forest and Support Vector Machine) is assessed by using human classification data as a reference for evaluating the classification performance of machine learning techniques for thirty hand/arm gestures. The gestures are rated according to the extent of grasping motion on one task and the extent to which the same gestures are perceived as social according to another task. The results indicate that humans clearly rate differently according to the two different tasks. The machine learning techniques provide a similar classification of the actions according to grasping kinematics and social quality. Furthermore, there is a strong association between gesture kinematics and judgments of grasping and the social quality of the hand/arm gestures. Our results support previous research on intention-from-movement understanding that demonstrates the reliance on kinematic information for perceiving the social aspects and intentions in different grasping actions as well as communicative point-light actions.

Cognition modulates action-to-perception transfer in ambiguous perception.

Can cognition penetrate action-to-perception transfer? Participants observed a structure-from-motion cylinder of ambiguous rotation direction. Beforehand, they experienced one of two mechanical models: An unambiguous cylinder was connected to a rod by either a belt (cylinder and rod rotating in the same direction) or by gears (both rotating in opposite directions). During ambiguous cylinder presentation, mechanics and rod were invisible, making both conditions visually identical. Observers inferred the rod's direction from their moment-by-moment subjective perceptual interpretation of the ambiguous cylinder. They reported the (hidden) rod's direction by rotating a manipulandum in either the same or the opposite direction. With respect to their effect on perceptual stability, the resulting match/nonmatch between perceived cylinder rotation and manipulandum rotation showed a significant interaction with the cognitive model they had previously been biased with. For the "belt" model, congruency between cylinder perception and manual action is induced by same-direction report. Here, we found that same-direction movement stabilized the perceived motion direction, replicating a known congruency effect. For the "gear" model, congruency between perception and action is-in contrast-induced by opposite-direction report. Here, no effect of perception-action congruency was found: Perceptual congruency and cognitive model nullified each other. Hence, an observer's internal model of a machine's operation guides action-to-perception transfer.

Continuous flash suppression: Manual action affects eye movements but not the reported percept.

Diverse paradigms, including ambiguous stimuli and mental imagery, have suggested a shared representation between motor and perceptual domains. We examined the effects of manual action on ambiguous perception in a continuous flash suppression (CFS) experiment. Specifically, we asked participants to try to perceive a suppressed grating while rotating a manipulandum. In one condition, the grating's motion was fully controlled by the manipulandum movement; in another condition the coupling was weak; and in a third condition, no movement was executed. We found no effect of the movement condition on the subjectively reported visibility of the grating, which is in contrast to previous studies that allowed for more top-down influence. However, we did observe an effect on eye movements: the gain of the optokinetic nystagmus induced by the grating was modulated by its coupling to the manual movement. Our results (a) indicate that action-to-perception transfer can occur on different levels of perceptual organization, (b) demonstrate that CFS involves the shared representations between action and perception differently than paradigms used in earlier studies, and

Biological motion distorts size perception.

Visual illusions explore the limits of sensory processing and provide an ideal testbed to study perception. Size illusions - stimuli whose size is consistently misperceived - do not only result from sensory cues, but can also be induced by cognitive factors, such as social status. Here we investigate, whether the ecological relevance of biological motion can also distort perceived size. We asked observers to judge the size of point-light walkers (PLWs), configurations of dots whose movements induce the perception of human movement, and visually matched control stimuli (inverted PLWs). We find that upright PLWs are consistently judged as larger than inverted PLWs, while static point-light figures do not elicit the same effect. We also show the phenomenon using an indirect paradigm: observers judged the relative size of a disc that followed an inverted PLW larger than a disc following an upright PLW. We interpret this as a contrast effect: The upright PLW is perceived larger and thus the subsequent disc is judged smaller. Together, these results demonstrate that ecologically relevant biological-motion stimuli are perceived larger than visually matched control stimuli. Our findings present a novel case of illusory size perception, where ecological importance leads to a distorted perception of size.