Autistic young people adaptively use gaze to facilitate joint attention during multi-gestural dyadic interactions.

LAY ABSTRACT: Autistic people have been said to have 'problems' with joint attention, that is, looking where someone else is looking. Past studies of joint attention have used tasks that require autistic people to continuously look at and respond to eye-gaze cues. But joint attention can also be done using other social cues, like pointing. This study looked at whether autistic and non-autistic young people use another person's eye gaze during joint attention in a task that did not require them to look at their partner's face. In the task, each participant worked together with their partner to find a computer-generated object in virtual reality. Sometimes the participant had to help guide their partner to the object, and other times, they followed their partner's lead. Participants were told to point to guide one another but were not told to use eye gaze. Both autistic and non-autistic participants often looked at their partner's face during joint attention interactions and were faster to respond to their partner's hand-pointing when the partner also looked at the object before pointing. This shows that autistic people can and do use information from another person's eyes, even when they don't have to. It is possible that, by not forcing autistic young people to look at their partner's face and eyes, they were better able to gather information from their partner's face when needed, without being overwhelmed. This shows how important it is to design tasks that provide autistic people with opportunities to show what they can do.

Evidence for the adaptive parsing of non-communicative eye movements during joint attention interactions.

During social interactions, the ability to detect and respond to gaze-based joint attention bids often involves the evaluation of non-communicative eye movements. However, very little is known about how much humans are able to track and parse spatial information from these non-communicative eye movements over time, and the extent to which this influences joint attention outcomes. This was investigated in the current study using an interactive computer-based joint attention game. Using a fully within-subjects design, we specifically examined whether participants were quicker to respond to communicative joint attention bids that followed predictive, as opposed to random or no, non-communicative gaze behaviour. Our results suggest that in complex, dynamic tasks, people adaptively use and dismiss non-communicative gaze information depending on whether it informs the locus of an upcoming joint attention bid. We also went further to examine the extent to which this ability to track dynamic spatial information was specific to processing gaze information. This was achieved by comparing performance to a closely matched non-social task where eye gaze cues were replaced with dynamic arrow stimuli. Whilst we found that people are also able to track and use dynamic non-social information from arrows, there was clear evidence for a relative advantage for tracking gaze cues during social interactions. The implications of these findings for social neuroscience and autism research are discussed.

Perceptions of intelligence & sentience shape children's interactions with robot reading companions.

The potential for robots to support education is being increasingly studied and rapidly realised. However, most research evaluating education robots has neglected to examine the fundamental features that make them more or less effective, given the needs and expectations of learners. This study explored how children's perceptions, expectations and experiences are shaped by aesthetic and functional features during interactions with different robot 'reading buddies'. We collected a range of quantitative and qualitative measures of subjective experience before and after children read a book with one of three different robots. An inductive thematic analysis revealed that robots have the potential offer children an engaging and non-judgemental social context to promote reading engagement. This was supported by children's perceptions of robots as being intelligent enough to read, listen and comprehend the story, particularly when they had the capacity to talk. A key challenge in the use of robots for this purpose was the unpredictable nature of robot behaviour, which remains difficult to perfectly control and time using either human operators or autonomous algorithms. Consequently, some children found the robots' responses distracting. We provide recommendations for future research seeking to position seemingly sentient and intelligent robots as an assistive tool within and beyond education settings.

Autonomous social robots are real in the mind's eye of many.

Clark and Fischer's dismissal of extant human-robot interaction research approaches limits opportunities to understand major variables shaping people's engagement with social robots. Instead, this endeavour categorically requires multidisciplinary approaches. We refute the assumption that people cannot (correctly or incorrectly) represent robots as autonomous social agents. This contradicts available empirical evidence, and will become increasingly tenuous as robot automation improves.

Social/dialogical roles of social robots in supporting children's learning of language and literacy-A review and analysis of innovative roles.

One of the many purposes for which social robots are designed is education, and there have been many attempts to systematize their potential in this field. What these attempts have in common is the recognition that learning can be supported in a variety of ways because a learner can be engaged in different activities that foster learning. Up to now, three roles have been proposed when designing these activities for robots: as a teacher or tutor, a learning peer, or a novice. Current research proposes that deciding in favor of one role over another depends on the content or preferred pedagogical form. However, the design of activities changes not only the content of learning, but also the nature of a human-robot social relationship. This is particularly important in language acquisition, which has been recognized as a social endeavor. The following review aims to specify the differences in human-robot social relationships when children learn language through interacting with a social robot. After proposing categories for comparing these different relationships, we review established and more specific, innovative roles that a robot can play in language-learning scenarios. This follows Mead's (1946) theoretical approach proposing that social roles are performed in interactive acts. These acts are crucial for learning, because not only can they shape the social environment of learning but also engage the learner to different degrees. We specify the degree of engagement by referring to Chi's (2009) progression of learning activities that range from active, constructive, toward interactive with the latter fostering deeper learning. Taken together, this approach enables us to compare and evaluate different human-robot social relationships that arise when applying a robot in a particular social role.

Objects that induce face pareidolia are prioritized by the visual system.

The human visual system has evolved specialized neural mechanisms to rapidly detect faces. Its broad tuning for facial features is thought to underlie the illusory perception of faces in inanimate objects, a phenomenon called face pareidolia. Recent studies on face pareidolia suggest that the mechanisms underlying face processing, at least at the early stages of visual encoding, may treat objects that resemble faces as real faces; prioritizing their detection. In our study, we used breaking continuous flash suppression (b-CFS) to examine whether the human visual system prioritizes the detection of objects that induce face pareidolia over stimuli matched for object content. Similar to previous b-CFS results using real face stimuli, we found that participants detected the objects with pareidolia faces faster than object-matched control stimuli. Given that face pareidolia has been more frequently reported amongst individuals prone to hallucinations, we also explored whether this rapid prioritization is intact in individuals with schizophrenia, and found evidence suggesting that it was. Our findings suggest that face pareidolia engages a broadly tuned mechanism that facilitates rapid face detection. This may involve the proposed fast subcortical pathway that operates outside of visual awareness.

Gaze facilitates responsivity during hand coordinated joint attention.

The coordination of attention between individuals is a fundamental part of everyday human social interaction. Previous work has focused on the role of gaze information for guiding responses during joint attention episodes. However, in many contexts, hand gestures such as pointing provide another valuable source of information about the locus of attention. The current study developed a novel virtual reality paradigm to investigate the extent to which initiator gaze information is used by responders to guide joint attention responses in the presence of more visually salient and spatially precise pointing gestures. Dyads were instructed to use pointing gestures to complete a cooperative joint attention task in a virtual environment. Eye and hand tracking enabled real-time interaction and provided objective measures of gaze and pointing behaviours. Initiators displayed gaze behaviours that were spatially congruent with the subsequent pointing gestures. Responders overtly attended to the initiator's gaze during the joint attention episode. However, both these initiator and responder behaviours were highly variable across individuals. Critically, when responders did overtly attend to their partner's face, their saccadic reaction times were faster when the initiator's gaze was also congruent with the pointing gesture, and thus predictive of the joint attention location. These results indicate that humans attend to and process gaze information to facilitate joint attention responsivity, even in contexts where gaze information is implicit to the task and joint attention is explicitly cued by more spatially precise and visually salient pointing gestures.

Bottom-up processing of fearful and angry facial expressions is intact in schizophrenia.

INTRODUCTION: Judgments of emotion from faces are reportedly impaired in schizophrenia. However, it is unclear whether this is due to a top-down cognitive deficit in evaluating sensory information or a fundamental bottom-up perturbation in the early stages of face encoding. This study examined whether deficits in emotion processing reflect imprecision in the initial preconscious registration of emotional face expressions within the visual system. METHODS: Using continuous flash suppression (CFS), we presented participants (18 patients with schizophrenia, 8M/10F; 20 healthy controls, 13M/7F) with fearful and angry faces. Previous CFS research on healthy participants reveals that fearful facial expressions gain privileged access to awareness over angry faces-demonstrating the visual system's ability to discriminate these emotions at a preconscious level. We used this same approach to probe the integrity of early emotion encoding whilst minimising the potential contribution of any top-down cognitive biases on perceptual judgments. RESULTS: In both groups, fearful faces were perceived faster than angry faces, with no differences observed between patients and controls. CONCLUSIONS: Emotion processing difficulties in schizophrenia are unlikely to reflect an early sensory deficit, but rather a deficit in social cognition that has a top-down impact on the conscious evaluation of facial expressions.

Autistic traits and loneliness in autism are associated with increased tendencies to anthropomorphise.

Anthropomorphism-the attribution of human qualities to non-human objects-is believed to be a natural tendency which may serve several adaptive functions. One possibility is that anthropomorphism provides an egocentric heuristic by which we can understand the world. It may also be a strategy for reducing our subjective sense of loneliness. However, not all humans exhibit the same propensity to anthropomorphise. Recent findings suggest that autistic individuals may be more likely to anthropomorphise than non-autistic individuals. In Study 1, we conducted a large-scale survey of autistic traits and dispositional anthropomorphism in the general population (n = 870). We found that individuals who reported having more autistic traits had an increased dispositional tendency to anthropomorphise non-human entities. In Study 2, we more closely examined variation in anthropomorphism tendencies in a sample of autistic adults (n = 90) to better understand what might drive increased anthropomorphism in this population. We found that those with greater anthropomorphism tendencies experienced greater levels of self-reported loneliness. We propose that increased anthropomorphism might reflect reduced opportunities for social connection for autistic people and those with more autistic traits.

The effect of non-communicative eye movements on joint attention.

Eye movements provide important signals for joint attention. However, those eye movements that indicate bids for joint attention often occur among non-communicative eye movements. This study investigated the influence of these non-communicative eye movements on subsequent joint attention responsivity. Participants played an interactive game with an avatar which required both players to search for a visual target on a screen. The player who discovered the target used their eyes to initiate joint attention. We compared participants' saccadic reaction times (SRTs) to the avatar's joint attention bids when they were preceded by non-communicative eye movements that predicted the location of the target (Predictive Search), did not predict the location of the target (Random Search), and when there were no non-communicative eye gaze movements prior to joint attention (No Search). We also included a control condition in which participants completed the same task, but responded to a dynamic arrow stimulus instead of the avatar's eye movements. For both eye and arrow conditions, participants had slower SRTs in Random Search trials than No Search and Predictive Search trials. However, these effects were smaller for eyes than for arrows. These data suggest that joint attention responsivity for eyes is relatively stable to the presence and predictability of spatial information conveyed by non-communicative gaze. Contrastingly, random sequences of dynamic arrows had a much more disruptive impact on subsequent responsivity compared with predictive arrow sequences. This may reflect specialised social mechanisms and expertise for selectively responding to communicative eye gaze cues during dynamic interactions, which is likely facilitated by the integration of ostensive eye contact cues.

Gaze direction biases emotion categorisation in schizophrenia.

The successful integration of eye gaze direction and emotion cues from faces is important not only for co-ordinated interactions, but also for the detection of social signals alerting us to threat posed by a conspecific, or elsewhere in our immediate environment. It is now well-established that people with schizophrenia experience aberrant eye gaze and facial emotion processing. These social-cognitive differences might contribute to the maintenance of socially-themed delusions which are characterised by the hyper-attribution of threatening intentions to others. However, no study has directly examined whether the mechanisms which govern the integration of eye gaze and emotion information diverge in schizophrenia, and more importantly, whether this reflects a fundamental 'bottom-up' perceptual deficit or a 'top-down' cognitive bias. Fifteen outpatients diagnosed with schizophrenia and 21 healthy age- and IQ-matched controls performed an emotion categorisation task (anger/fear) on morphed facial expressions of anger or fear, displaying either direct or averted gaze. Results in both controls and patients replicated the previous finding that combinations of anger with direct gaze, and fear with averted gaze - which signal a relevant threat to the observer - benefited from more accurate emotion recognition than alternate gaze-emotion combinations. Bayesian model selection revealed that for patients this effect was mediated by a shift in decision bias towards emotions which signal self-relevant threat, rather than a change in sensitivity as observed in controls. These results critically highlight a different cognitive mechanism governing gaze and face-cued emotion integration in schizophrenia, which has a top-down influence on the evaluation of perceptual input.

Appearance-based trust processing in schizophrenia.

OBJECTIVES: Schizophrenia is characterized by impaired social interactions and altered trust. In the general population, trust is often based on facial appearance, with limited validity but enormous social consequences. The aim was to examine trust processing in schizophrenia and specifically to examine how people with schizophrenia use facial appearance as well as actual partner fairness to guide trusting decisions. DESIGN: An experimental economic game study. METHODS: Here, we tested how patients with schizophrenia and control participants (each N = 24) use facial trustworthiness appearance and partner fairness behaviour to guide decisions in a multi-round Trust Game. In the Trust Game, participants lent money to 'partners' whose facial appearance was either untrustworthy or trustworthy, and who either played fairly or unfairly. Clinical symptoms were measured as well as explicit trustworthiness impressions. RESULTS: Overall, the patients with schizophrenia showed unimpaired explicit facial trustworthiness impressions and unimpaired facial appearance biases in the Trust Game. Crucially, patients and controls significantly differed so that the patients with schizophrenia did not learn to discriminate in the Trust Game based on actual partner fairness, unlike control participants. CONCLUSION: A failure to discriminate trust has important implications for everyday functioning in schizophrenia, as forming accurate trustworthiness beliefs is an essential social skill. Critically, without relying on more valid trust cues, people with schizophrenia may be especially susceptible to the misleading effect of appearance when making trusting decisions. PRACTITIONER POINTS: Findings People with schizophrenia made very similar facial trustworthiness impressions to healthy controls and also used facial appearance to guide trust decisions similarly to controls. However, the patient group were less able to explicitly distinguish between fair and unfair partners based on their behaviour compared with the control group. Moreover, people with schizophrenia failed to use actual partner fairness to guide their financial decisions in the Trust Game, unlike controls, and this impairment was specific to a social task. People with schizophrenia may be particularly reliant on facial appearance when trusting others, as they may struggle to incorporate more valid trustworthiness information in their decision-making, such as actual partner fairness.

No influence of eye gaze on emotional face processing in the absence of conscious awareness.

The human brain has evolved specialised mechanisms to enable the rapid detection of threat cues, including emotional face expressions (e.g., fear and anger). However, contextual cues - such as gaze direction - influence the ability to recognise emotional expressions. For instance, anger paired with direct gaze, and fear paired with averted gaze are more accurately recognised compared to alternate conjunctions of these features. It is argued that this is because gaze direction conveys the relevance and locus of the threat to the observer. Here, we used continuous flash suppression (CFS) to assess whether the modulatory effect of gaze direction on emotional face processing occurs outside of conscious awareness. Previous research using CFS has demonstrated that fearful facial expressions are prioritised by the visual system and gain privileged access to awareness over other expressed emotions. We hypothesised that if the modulatory effects of gaze on emotional face processing occur also at this level, then the gaze-emotion conjunctions signalling self-relevant threat will reach awareness faster than those that do not. We report that fearful faces gain privileged access to awareness over angry faces, but that gaze direction does not modulate this effect. Thus, our findings suggest that previously reported effects of gaze direction on emotional face processing are likely to occur once the face is detected, where the self-relevance and locus of the threat can be consciously appraised.

The mind minds minds: The effect of intentional stance on the neural encoding of joint attention.

Recent neuroimaging studies have observed that the neural processing of social cues from a virtual reality character appears to be affected by "intentional stance" (i.e., attributing mental states, agency, and "humanness"). However, this effect could also be explained by individual differences or perceptual effects resulting from the design of these studies. The current study used a new design that measured centro-parietal P250, P350, and N170 event-related potentials (ERPs) in 20 healthy adults while they initiated gaze-related joint attention with a virtual character ("Alan") in two conditions. In one condition, they were told that Alan was controlled by a human; in the other, they were told that he was controlled by a computer. When participants believed Alan was human, his congruent gaze shifts, which resulted in joint attention, generated significantly larger P250 ERPs than his incongruent gaze shifts. In contrast, his incongruent gaze shifts triggered significantly larger increases in P350 ERPs than his congruent gaze shifts. These findings support previous studies suggesting that intentional stance affects the neural processing of social cues from a virtual character. The outcomes also suggest the use of the P250 and P350 ERPs as objective indices of social engagement during the design of socially approachable robots and virtual agents.

Intact prioritisation of unconscious face processing in schizophrenia.

INTRODUCTION: Faces provide a rich source of social information, crucial for the successful navigation of daily social interactions. People with schizophrenia suffer a wide range of social-cognitive deficits, including abnormalities in face perception. However, to date, studies of face perception in schizophrenia have primarily employed tasks that require patients to make judgements about the faces. It is, thus, unclear whether the reported deficits reflect an impairment in encoding visual face information, or biased social-cognitive evaluative processes. METHODS: We assess the integrity of early unconscious face processing in 21 out-patients diagnosed with Schizophrenia or Schizoaffective Disorder (15M/6F) and 21 healthy controls (14M/7F). In order to control for any direct influence of higher order cognitive processes, we use a behavioural paradigm known as breaking continuous flash suppression (b-CFS), where participants simply respond to the presence and location of a face. In healthy adults, this method has previously been used to show that upright faces gain rapid and privileged access to conscious awareness over inverted faces and other inanimate objects. RESULTS: Here, we report similar effects in patients, suggesting that the early unconscious stages of face processing are intact in schizophrenia. CONCLUSION: Our data indicate that face processing deficits reported in the literature must manifest at a conscious stage of processing, where the influence of mentalizing or attribution biases might play a role.

Responding to joint attention bids in schizophrenia: An interactive eye-tracking study.

This study investigated social cognition in schizophrenia using a virtual reality paradigm to capture the dynamic processes of evaluating and responding to eye gaze as an intentional communicative cue. A total of 21 patients with schizophrenia and 21 age-, gender-, and IQ-matched healthy controls completed an interactive computer game with an on-screen avatar that participants believed was controlled by an off-screen partner. On social trials, participants were required to achieve joint attention by correctly interpreting and responding to gaze cues. Participants also completed non-social trials in which they responded to an arrow cue within the same task context. While patients and controls took equivalent time to process communicative intent from gaze shifts, patients made significantly more errors than controls when responding to the directional information conveyed by gaze, but not arrow, cues. Despite no differences in response times to gaze cues between groups, patients were significantly slower than controls when responding to arrow cues. This is the opposite pattern of results previously observed in autistic adults using the same task and suggests that, despite general impairments in attention orienting or oculomotor control, patients with schizophrenia demonstrate a facilitation effect when responding to communicative gaze cues. Findings indicate a hyper-responsivity to gaze cues of communicative intent in schizophrenia. The possible effects of self-referential biases when evaluating gaze direction are discussed, as are clinical implications.

Should I trust you? Autistic traits predict reduced appearance-based trust decisions.

Facial impressions of trustworthiness guide social decisions in the general population, as shown by financial lending in economic Trust Games. As an exception, autistic boys fail to use facial impressions to guide trust decisions, despite forming typical facial trustworthiness impressions (Autism, 19, 2015a, 1002). Here, we tested whether this dissociation between forming and using facial impressions of trustworthiness extends to neurotypical men with high levels of autistic traits. Forty-six Caucasian men completed a multi-turn Trust Game, a facial trustworthiness impressions task, the Autism-Spectrum Quotient, and two Theory of Mind tasks. As hypothesized, participants' levels of autistic traits had no observed effect on the impressions formed, but negatively predicted the use of those impressions in trust decisions. Thus, the dissociation between forming and using facial impressions of trustworthiness extends to the broader autism phenotype. More broadly, our results identify autistic traits as an important source of individual variation in the use of facial impressions to guide behaviour. Interestingly, failure to use these impressions could potentially represent rational behaviour, given their limited validity.

The association between poor reading and internalising problems: A systematic review and meta-analysis.

Numerous studies have demonstrated an association between learning disabilities and internalising problems such as anxiety and depression. However, our understanding of this association for people with specific types of learning disability - such as poor reading - is poorly understood. Here, we present the first systematic review and meta-analysis of studies that have examined associations between poor reading and internalising problems - including anxiety and depression - in children, adolescents, and adults. Our systematic search identified 34 studies comprising 16,275 participants (N = 2491 poor readers). Our meta-analysis revealed statistically significant differences between poor readers and typical readers on general measures of internalising problems (d = 0.41), as well as specific measures of anxiety (d = 0.41) and depression (d = 0.23). These outcomes suggest that poor readers are at moderate risk for experiencing internalising problems compared to typical readers, which appears to stem from a greater risk for anxiety than depression.

Joint attention difficulties in autistic adults: An interactive eye-tracking study.

Joint attention - the ability to coordinate attention with a social partner - is critical for social communication, learning and the regulation of interpersonal relationships. Infants and young children with autism demonstrate impairments in both initiating and responding to joint attention bids in naturalistic settings. However, little is known about joint attention abilities in adults with autism. Here, we tested 17 autistic adults and 17 age- and nonverbal intelligence quotient-matched controls using an interactive eye-tracking paradigm in which participants initiated and responded to joint attention bids with an on-screen avatar. Compared to control participants, autistic adults completed fewer trials successfully. They were also slower to respond to joint attention bids in the first block of testing but performed as well as controls in the second block. There were no group differences in responding to spatial cues on a non-social task with similar attention and oculomotor demands. These experimental results were mirrored in the subjective reports given by participants, with some commenting that they initially found it challenging to communicate using eye gaze, but were able to develop strategies that allowed them to achieve joint attention. Our study indicates that for many autistic individuals, subtle difficulties using eye-gaze information persist well into adulthood.

Perceptual integration of head and eye cues to gaze direction in schizophrenia.

The perceptual mechanisms that underlie social experience in schizophrenia are increasingly becoming a target of empirical research. In the context of low-level vision, there is evidence for a reduction in the integration of sensory features in schizophrenia (e.g. increased thresholds for contour detection and motion coherence). In the context of higher-level vision, comparable differences in the integration of sensory features of the face could in theory impair the recognition of important social cues. Here we examine how the sense of where other people are looking relies upon the integration of eye-region cues and head-region cues. Adults with schizophrenia viewed face images designed to elicit the 'Wollaston illusion', a perceptual phenomenon in which the perceived gaze direction associated with a given pair of eyes is modulated by the surrounding sensory context. We performed computational modelling of these psychophysical data to quantify individual differences in the use of facial cues to gaze direction. We find that adults with schizophrenia exhibit a robust perceptual effect whereby their sense of other people's direction of gaze is strongly biased by sensory cues relating to head orientation in addition to eye region information. These results indicate that the visual integration of facial cues to gaze direction in schizophrenia is intact, helping to constrain theories of reduced integrative processing in higher-level and lower-level vision. In addition, robust gaze processing was evident in the tested participants despite reduced performance on a theory of mind task designed to assess higher-level social cognition.