Developmental Prosopagnosia and Elastic Versus Static Face Recognition in an Incidental Learning Task.

Previous research on the beneficial effect of motion has postulated that learning a face in motion provides additional cues to recognition. Surprisingly, however, few studies have examined the beneficial effect of motion in an incidental learning task and developmental prosopagnosia (DP) even though such studies could provide more valuable information about everyday face recognition compared to the perception of static faces. In the current study, 18 young adults (Experiment 1) and five DPs and 10 age-matched controls (Experiment 2) participated in an incidental learning task during which both static and elastically moving unfamiliar faces were sequentially presented and were to be recognized in a delayed visual search task during which the faces could either keep their original presentation or switch (from static to elastically moving or vice versa). In Experiment 1, performance in the elastic-elastic condition reached a significant improvement relative to the elastic-static and static-elastic condition, however, no significant difference could be detected relative to the static-static condition. Except for higher scores in the elastic-elastic compared to the static-elastic condition in the age-matched group, no other significant differences were detected between conditions for both the DPs and the age-matched controls. The current study could not provide compelling evidence for a general beneficial effect of motion. Age-matched controls performed generally worse than DPs, which may potentially be explained by their higher rates of false alarms. Factors that could have influenced the results are discussed.

Flexible Orientation Tuning of Visual Representations of Human Body Postures: Evidence From Long-Term Priming.

The proficiency of human observers to identify body postures is examined in three experiments. We use a posture decision task in which participants are primed with either anatomically possible or impossible postures (in the latter case the upper and lower body face in opposite directions). In a long-term priming paradigm (i.e., in an initial priming block of trials and a subsequent test phase several minutes later), we manipulate the relation between priming and test postures with respect to the identity of the person in the body postures (Experiment 1), the prototypicality of the depth orientations (Experiment 2), and the variability of the priming orientations (Experiment 3). Reaction time to the test postures is the main dependent variable. In Experiment 1 it is found that priming of postures does not depend on the exact visual appearance of the actor (either same priming and test female or male figure or different figures), supporting the hypothesis that posture priming primarily is determined by the spatial relations between the body parts and much less by characteristics of the person involved. Long-term priming in our paradigm apparently is based on the reactivation of high-level posture representations that make abstraction of the identity of the human figure. In Experiment 2 we observe that privileged or prototypical orientations (e.g., 3/4 views) do not affect long-term priming of body postures. In Experiment 3, we find that increasing or decreasing the variability between the priming and test figures influences reaction time performance. Collectively, these results provide a better understanding of the flexibility (e.g., invariant to identity) and limits (e.g., depending on depth orientation) of the processes supporting human posture recognition.

Measuring facial identity and emotion integration using the redundancy gain paradigm.

Early theories on face perception posit that invariant (i.e., identity) and changeable (i.e., expression) facial aspects are processed separately. However, many researchers have countered the hypothesis of parallel processes with findings of interactions between identity and emotion perception. The majority of tasks measuring interactions between identity and emotion employ a selective attention design, in which participants are instructed to attend to one dimension (e.g., identity) while the other dimension varies orthogonally (e.g., emotion), but is task irrelevant. Recently, a divided attention design (i.e., the redundancy gain paradigm) in which both identity and emotion are task relevant was employed to assess the interaction between identity and emotion. A redundancy gain is calculated by a drop in reaction time in trials in which a target from both dimensions is present in the stimulus face (e.g., "sad Person A"), compared with trials with only a single target present (e.g., "sad" or "Person A"). Redundancy gains are hypothesized to point to an interactive activation of both dimensions, and as such, could complement designs adopting a selective attention task. The initial aim of the current study was to reproduce the earlier findings with this paradigm on identity and emotion perception (Yankouskaya, Booth, & Humphreys, Attention, Perception, & Psychophysics, 74(8), 1692-1711, 2012), but our study failed to replicate the results. In a series of subtasks, multiple aspects of the design were manipulated separately in our goal to shed light on the factors that influence the redundancy gain effect in faces. A redundancy gain was eventually obtained after controlling for contingencies and stimulus presentation time.

Holistic integration of gaze cues in visual face and body perception: Evidence from the composite design.

A considerable amount of research on identity recognition and emotion identification with the composite design points to the holistic processing of these aspects in faces and bodies. In this paradigm, the interference from a nonattended face half on the perception of the attended half is taken as evidence for holistic processing (i.e., a composite effect). Far less research, however, has been dedicated to the concept of gaze. Nonetheless, gaze perception is a substantial component of face and body perception, and holds critical information for everyday communicative interactions. Furthermore, the ability of human observers to detect direct versus averted eye gaze is effortless, perhaps similar to identity perception and emotion recognition. However, the hypothesis of holistic perception of eye gaze has never been tested directly. Research on gaze perception with the composite design could facilitate further systematic comparison with other aspects of face and body perception that have been investigated using the composite design (i.e., identity and emotion). In the present research, a composite design was administered to assess holistic processing of gaze cues in faces (Experiment 1) and bodies (Experiment 2). Results confirmed that eye and head orientation (Experiment 1A) and head and body orientation (Experiment 2A) are integrated in a holistic manner. However, the composite effect was not completely disrupted by inversion (Experiments 1B and 2B), a finding that will be discussed together with implications for future research.

The Effect of Head Orientation on Perceived Gaze Direction: Revisiting Gibson and Pick (1963) and Cline (1967).

Two biases in perceived gaze direction have been observed when eye and head orientation are not aligned. An overshoot effect indicates that perceived gaze direction is shifted away from head orientation (i.e., a repulsive effect), whereas a towing effect indicates that perceived gaze direction falls in between head and eye orientation (i.e., an attraction effect). In the 60s, three influential papers have been published with respect to the effect of head orientation on perceived gaze direction (Gibson and Pick, 1963; Cline, 1967; Anstis et al., 1969). Throughout the years, the results of two of these (Gibson and Pick, 1963; Cline, 1967) have been interpreted differently by a number of authors. In this paper, we critically discuss potential sources of confusion that have led to differential interpretations of both studies. At first sight, the results of Cline (1967), despite having been a major topic of discussion, unambiguously seem to indicate a towing effect whereas Gibson and Pick's (1963) results seem to be the most ambiguous, although they have never been questioned in the literature. To shed further light on this apparent inconsistency, we repeated the critical experiments reported in both studies. Our results indicate an overshoot effect in both studies.

Communicative interactions in point-light displays: Choosing among multiple response alternatives.

Vision scientists are increasingly relying on the point-light technique as a way to investigate the perception of human motion. Unfortunately, the lack of standardized stimulus sets has so far limited the use of this technique for studying social interaction. Here, we describe a new tool to study the interaction between two agents starting from point-light displays: the Communicative Interaction Database - 5AFC format (CID-5). The CID-5 consists of 14 communicative and seven non-communicative individual actions performed by two agents. Stimuli were constructed by combining motion capture techniques and 3-D animation software to provide precise control over the computer-generated actions. For each action stimulus, we provide coordinate files and movie files depicting the action as seen from four different perspectives. Furthermore, the archive contains a text file with a list of five alternative action descriptions to construct forced-choice paradigms. In order to validate the CID-5 format, we provide normative data collected to assess action identification within a 5AFC tasks. The CID-5 archive is freely downloadable from http://bsb-lab.org/research/ and from the supplementary materials of this article.

The Multilingual CID-5: A New Tool to Study the Perception of Communicative Interactions in Different Languages.

The investigation of the ability to perceive, recognize, and judge upon social intentions, such as communicative intentions, on the basis of body motion is a growing research area. Cross-cultural differences in ability to perceive and interpret biological motion, however, have been poorly investigated so far. Progress in this domain strongly depends on the availability of suitable stimulus material. In the present method paper, we describe the multilingual CID-5, an extension of the CID-5 database, allowing for the investigation of how non-conventional communicative gestures are classified and identified by speakers of different languages. The CID-5 database contains 14 communicative interactions and 7 non-communicative actions performed by couples of agents and presented as point-light displays. For each action, the database provides movie files with the point-light animation, text files with the 3-D spatial coordinates of the point-lights, and five different response alternatives. In the multilingual CID-5 the alternatives were translated into seven languages (Chinese, Dutch, English, French, German, Italian, and Polish). Preliminary data collected to assess the recognizability of the actions in the different languages suggest that, for most of the action stimuli, information presented in point-light displays is sufficient for the distinctive classification of the action as communicative vs. individual, as well as for identification of the specific communicative gesture performed by the actor in all the available languages.

Perceiving where another person is looking: the integration of head and body information in estimating another person's gaze.

The process through which an observer allocates his/her attention based on the attention of another person is known as joint attention. To be able to do this, the observer effectively has to compute where the other person is looking. It has been shown that observers integrate information from the head and the eyes to determine the gaze of another person. Most studies have documented that observers show a bias called the overshoot effect when eyes and head are misaligned. That is, when the head is not oriented straight to the observer, perceived gaze direction is sometimes shifted in the direction opposite to the head turn. The present study addresses whether body information is also used as a cue to compute perceived gaze direction. In Experiment 1, we observed a similar overshoot effect in both behavioral and saccadic responses when manipulating body orientation. In Experiment 2, we explored whether the overshoot effect was due to observers assuming that the eyes are oriented further than the head when head and body orientation are misaligned. We removed horizontal eye information by presenting the stimulus from a side view. Head orientation was now manipulated in a vertical direction and the overshoot effect was replicated. In summary, this study shows that body orientation is indeed used as a cue to determine where another person is looking.

Perceiving the direction of articulatory motion in point-light actions.

Human observers are able to perceive the motion direction of actions (either forward or backward) on the basis of the articulatory, relative motion of the limbs, even when the actions are shown under point-light conditions. However, most studies have focused on the action of walking. The primary purpose of the present study is to further investigate the perception of articulatory motion in different point-light actions (walking, crawling, hand walking, and rowing). On each trial, participants were presented with a forward or backward moving person and they had to decide on the direction of articulatory motion of the person. We analyzed sensitivity (d') as well as response bias (c). In addition to the type of action, the diagnosticity of the available information was manipulated by varying the visibility of the body parts (full body, only upper limbs, or only lower limbs) and the viewpoint from which the action was seen (from frontal view to sagittal view). We observe that, depending on the specific action, perception of direction of motion is driven by different body parts. Implications for the possible existence of a life detector, i.e., an evolutionarily old and innate visual filter that is tuned to quickly and automatically detect the presence of a moving living organism and direct attention to it, are discussed.

Holistic processing of human body postures: evidence from the composite effect.

The perception of socially relevant stimuli (e.g., faces and bodies) has received considerable attention in the vision science community. It is now widely accepted that human faces are processed holistically and not only analytically. One observation that has been taken as evidence for holistic face processing is the face composite effect: two identical top halves of a face tend to be perceived as being different when combined with different bottom halves. This supports the hypothesis that face processing proceeds holistically. Indeed, the interference effect disappears when the two face parts are misaligned (blocking holistic perception). In the present study, we investigated whether there is also a composite effect for the perception of body postures: are two identical body halves perceived as being in different poses when the irrelevant body halves differ from each other? Both a horizontal (i.e., top-bottom body halves; Experiment 1) and a vertical composite effect (i.e., left-right body halves; Experiment 2) were examined by means of a delayed matching-to-sample task. Results of both experiments indicate the existence of a body posture composite effect. This provides evidence for the hypothesis that body postures, as faces, are processed holistically.

Further explorations of the facing bias in biological motion perception: perspective cues, observer sex, and response times.

The human visual system has evolved to be highly sensitive to visual information about other persons and their movements as is illustrated by the effortless perception of point-light figures or 'biological motion'. When presented orthographically, a point-light walker is interpreted in two anatomically plausible ways: As 'facing the viewer' or as 'facing away' from the viewer. However, human observers show a 'facing bias': They perceive such a point-light walker as facing towards them in about 70-80% of the cases. In studies exploring the role of social and biological relevance as a possible account for the facing bias, we found a 'figure gender effect': Male point-light figures elicit a stronger facing bias than female point-light figures. Moreover, we also found an 'observer gender effect': The 'figure gender effect' was stronger for male than for female observers. In the present study we presented to 11 males and 11 females point-light walkers of which, very subtly, the perspective information was manipulated by modifying the earlier reported 'perspective technique'. Proportions of 'facing the viewer' responses and reaction times were recorded. Results show that human observers, even in the absence of local shape or size cues, easily pick up on perspective cues, confirming recent demonstrations of high visual sensitivity to cues on whether another person is potentially approaching. We also found a consistent difference in how male and female observers respond to stimulus variations (figure gender or perspective cues) that cause variations in the perceived in-depth orientation of a point-light walker. Thus, the 'figure gender effect' is possibly caused by changes in the relative locations and motions of the dots that the perceptual system tends to interpret as perspective cues. Third, reaction time measures confirmed the existence of the facing bias and recent research showing faster detection of approaching than receding biological motion.

Time will show: real time predictions during interpersonal action perception.

Predictive processes are crucial not only for interpreting the actions of individual agents, but also to predict how, in the context of a social interaction between two agents, the actions of one agent relate to the actions of a second agent. In the present study we investigated whether, in the context of a communicative interaction between two agents, observers can use the actions of one agent to predict when the action of a second agent will take place. Participants observed point-light displays of two agents (A and B) performing separate actions. In the communicative condition, the action performed by agent B responded to a communicative gesture performed by agent A. In the individual condition, agent A's communicative action was substituted with a non-communicative action. For each condition, we manipulated the temporal coupling of the actions of the two agents, by varying the onset of agent A's action. Using a simultaneous masking detection task, we demonstrated that the timing manipulation had a critical effect on the communicative condition, with the visual discrimination of agent B increasing linearly while approaching the original interaction timing. No effect of the timing manipulation was found for the individual condition. Our finding complements and extends previous evidence for interpersonal predictive coding, suggesting that the communicative gestures of one agent can serve not only to predict what the second agent will do, but also when his/her action will take place.

Are you approaching me? Motor execution influences perceived action orientation.

Human observers are especially sensitive to the actions of conspecifics that match their own actions. This has been proposed to be critical for social interaction, providing the basis for empathy and joint action. However, the precise relation between observed and executed actions is still poorly understood. Do ongoing actions change the way observers perceive others' actions? To pursue this question, we exploited the bistability of depth-ambiguous point-light walkers, which can be perceived as facing towards the viewer or as facing away from the viewer. We demonstrate that point-light walkers are perceived more often as facing the viewer when the observer is walking on a treadmill compared to when the observer is performing an action that does not match the observed behavior (e.g., cycling). These findings suggest that motor processes influence the perceived orientation of observed actions: Acting observers tend to perceive similar actions by conspecifics as oriented towards themselves. We discuss these results in light of the possible mechanisms subtending action-induced modulation of perception.

Integrating biological motion: the role of grouping in the perception of point-light actions.

The human visual system is highly sensitive to biological motion and manages to organize even a highly reduced point-light stimulus into a vivid percept of human action. The current study investigated to what extent the origin of this saliency of point-light displays is related to its intrinsic Gestalt qualities. In particular, we studied whether biological motion perception is facilitated when the elements can be grouped according to good continuation and similarity as Gestalt principles of perceptual organization. We found that both grouping principles enhanced biological motion perception but their effects differed when stimuli were inverted. These results provide evidence that Gestalt principles of good continuity and similarity also apply to more complex and dynamic meaningful stimuli.

The second-agent effect: communicative gestures increase the likelihood of perceiving a second agent.

BACKGROUND: Beyond providing cues about an agent's intention, communicative actions convey information about the presence of a second agent towards whom the action is directed (second-agent information). In two psychophysical studies we investigated whether the perceptual system makes use of this information to infer the presence of a second agent when dealing with impoverished and/or noisy sensory input. METHODOLOGY/PRINCIPAL FINDINGS: Participants observed point-light displays of two agents (A and B) performing separate actions. In the Communicative condition, agent B's action was performed in response to a communicative gesture by agent A. In the Individual condition, agent A's communicative action was replaced with a non-communicative action. Participants performed a simultaneous masking yes-no task, in which they were asked to detect the presence of agent B. In Experiment 1, we investigated whether criterion c was lowered in the Communicative condition compared to the Individual condition, thus reflecting a variation in perceptual expectations. In Experiment 2, we manipulated the congruence between A's communicative gesture and B's response, to ascertain whether the lowering of c in the Communicative condition reflected a truly perceptual effect. Results demonstrate that information extracted from communicative gestures influences the concurrent processing of biological motion by prompting perception of a second agent (second-agent effect). CONCLUSIONS/SIGNIFICANCE: We propose that this finding is best explained within a Bayesian framework, which gives a powerful rationale for the pervasive role of prior expectations in visual perception.

Perceptual grouping of object contours survives saccades.

Human observers explore scenes by shifting their gaze from object to object. Before each eye movement, a peripheral glimpse of the next object to be fixated has however already been caught. Here we investigate whether the perceptual organization extracted from such a preview could guide the perceptual analysis of the same object during the next fixation. We observed that participants were indeed significantly faster at grouping together spatially separate elements into an object contour, when the same contour elements had also been grouped together in the peripheral preview display. Importantly, this facilitation occurred despite a change in the grouping cue defining the object contour (similarity versus collinearity). We conclude that an intermediate-level description of object shape persists in the visual system across gaze shifts, providing it with a robust basis for balancing efficiency and continuity during scene exploration.

The effect of looming and receding sounds on the perceived in-depth orientation of depth-ambiguous biological motion figures.

BACKGROUND: The focus in the research on biological motion perception traditionally has been restricted to the visual modality. Recent neurophysiological and behavioural evidence, however, supports the idea that actions are not represented merely visually but rather audiovisually. The goal of the present study was to test whether the perceived in-depth orientation of depth-ambiguous point-light walkers (plws) is affected by the presentation of looming or receding sounds synchronized with the footsteps. METHODOLOGY/PRINCIPAL FINDINGS: In Experiment 1 orthographic frontal/back projections of plws were presented either without sound or with sounds of which the intensity level was rising (looming), falling (receding) or stationary. Despite instructions to ignore the sounds and to only report the visually perceived in-depth orientation, plws accompanied with looming sounds were more often judged to be facing the viewer whereas plws paired with receding sounds were more often judged to be facing away from the viewer. To test whether the effects observed in Experiment 1 act at a perceptual level rather than at the decisional level, in Experiment 2 observers perceptually compared orthographic plws without sound or paired with either looming or receding sounds to plws without sound but with perspective cues making them objectively either facing towards or facing away from the viewer. Judging whether either an orthographic plw or a plw with looming (receding) perspective cues is visually most looming becomes harder (easier) when the orthographic plw is paired with looming sounds. CONCLUSIONS/SIGNIFICANCE: The present results suggest that looming and receding sounds alter the judgements of the in-depth orientation of depth-ambiguous point-light walkers. While looming sounds are demonstrated to act at a perceptual level and make plws look more looming, it remains a challenge for future research to clarify at what level in the processing hierarchy receding sounds affect how observers judge the in-depth perception of plws.

Communicative interactions improve visual detection of biological motion.

BACKGROUND: In the context of interacting activities requiring close-body contact such as fighting or dancing, the actions of one agent can be used to predict the actions of the second agent. In the present study, we investigated whether interpersonal predictive coding extends to interactive activities--such as communicative interactions--in which no physical contingency is implied between the movements of the interacting individuals. METHODOLOGY/PRINCIPAL FINDINGS: Participants observed point-light displays of two agents (A and B) performing separate actions. In the communicative condition, the action performed by agent B responded to a communicative gesture performed by agent A. In the individual condition, agent A's communicative action was substituted with a non-communicative action. Using a simultaneous masking detection task, we demonstrate that observing the communicative gesture performed by agent A enhanced visual discrimination of agent B. CONCLUSIONS/SIGNIFICANCE: Our finding complements and extends previous evidence for interpersonal predictive coding, suggesting that the communicative gestures of one agent can serve as a predictor for the expected actions of the respondent, even if no physical contact between agents is implied.

The facing bias in biological motion perception: structure, kinematics, and body parts.

Depth-ambiguous point-light walkers (PLWs) elicit a facing bias: Observers perceive a PLW as facing toward them more often than as facing away (Vanrie,Dekeyser, & Verfaillie, Perception, 33, 547-560, 2004). While the facing bias correlates with the PLW's perceived gender (Brooks et al., Current Biology, 18, R728-R729, 2008; Schouten, Troje, Brooks, van der Zwan, & Verfaillie, Attention, Perception, & Psychophysics, 72,1256-1260, 2010), it remains unclear whether the change in perceived in-depth orientation is caused by a change in perceived gender. In Experiment 1, we show that structural and kinematic stimulus properties that lead to the same changes in perceived gender elicit opposite changes in perceived in-depth orientation, indicating that the relation between perceived gender and in-depth orientation is not causal. The results of Experiments 2 and 3 further suggest that the perceived in-depth orientation of PLWs is strongly affected by locally acting stimulus properties. The facing bias seems to be induced by stimulus properties in the lower part of the PLW.

The role of social cues in the deployment of spatial attention: head-body relationships automatically activate directional spatial codes in a Simon task.

The role of body orientation in the orienting and allocation of social attention was examined using an adapted Simon paradigm. Participants categorized the facial expression of forward facing, computer-generated human figures by pressing one of two response keys, each located left or right of the observers' body midline, while the orientation of the stimulus figure's body (trunk, arms, and legs), which was the task-irrelevant feature of interest, was manipulated (oriented toward the left or right visual hemifield) with respect to the spatial location of the required response. We found that when the orientation of the body was compatible with the required response location, responses were slower relative to when body orientation was incompatible with the response location. In line with a model put forward by Hietanen (1999), this reverse compatibility effect suggests that body orientation is automatically processed into a directional spatial code, but that this code is based on an integration of head and body orientation within an allocentric-based frame of reference. Moreover, we argue that this code may be derived from the motion information implied in the image of a figure when head and body orientation are incongruent. Our results have implications for understanding the nature of the information that affects the allocation of attention for social orienting.