Smartphone-based gaze estimation for in-home autism research.

Atypical gaze patterns are a promising biomarker of autism spectrum disorder. To measure gaze accurately, however, it typically requires highly controlled studies in the laboratory using specialized equipment that is often expensive, thereby limiting the scalability of these approaches. Here we test whether a recently developed smartphone-based gaze estimation method could overcome such limitations and take advantage of the ubiquity of smartphones. As a proof-of-principle, we measured gaze while a small sample of well-assessed autistic participants and controls watched videos on a smartphone, both in the laboratory (with lab personnel) and in remote home settings (alone). We demonstrate that gaze data can be efficiently collected, in-home and longitudinally by participants themselves, with sufficiently high accuracy (gaze estimation error below 1° visual angle on average) for quantitative, feature-based analysis. Using this approach, we show that autistic individuals have reduced gaze time on human faces and longer gaze time on non-social features in the background, thereby reproducing established findings in autism using just smartphones and no additional hardware. Our approach provides a foundation for scaling future research with larger and more representative participant groups at vastly reduced cost, also enabling better inclusion of underserved communities.

Comparing data quality from an online and in-person lab sample on dynamic theory of mind tasks.

Nearly half the published research in psychology is conducted with online samples, but the preponderance of these studies rely primarily on self-report measures. The current study validated data quality from an online sample on a novel, dynamic task by comparing performance between an in-lab and online sample on two dynamic measures of theory of mind-the ability to infer others' mental states. Theory of mind is a cognitively complex construct that has been widely studied across multiple domains of psychology. One task was based on the show The Office®, and has been previously validated by the authors with in-lab samples. The second was a novel task based on the show Nathan for You®, which was selected to account for familiarity effects associated with The Office. Both tasks measured various dimensions of theory of mind (inferring beliefs, understanding motivations, detecting deception, identifying faux pas, and understanding emotions). The in-person lab samples (N = 144 and 177, respectively) completed the tasks between-subject, whereas the online sample (N = 347 from Prolific Academic) completed them within-subject, with order counterbalanced. The online sample's performance across both tasks was reliable (Cronbach's α = .66). For The Office, the in-person sample outperformed the online sample on some types of theory of mind, but this was driven by their greater familiarity with the show. Indeed, for the relatively unfamiliar show Nathan for You, performance did not differ between the two samples. Together, these results suggest that crowdsourcing platforms elicit reliable performance on novel, dynamic, complex tasks.

Determining Whether Older Adults Use Similar Strategies to Young Adults in Theory of Mind Tasks.

OBJECTIVES: Theory of mind-the ability to infer others' mental states-declines over the life span, potentially due to cognitive decline. However, it is unclear whether deficits emerge because older adults use the same strategies as young adults, albeit less effectively, or use different or no strategies. The current study compared the similarity of older adults' theory of mind errors to young adults' and a random model. METHODS: One hundred twenty older adults (MAge = 74.68 years; 64 female) and 111 young adults (MAge = 19.1; 61 female) completed a novel theory of mind task (clips from an episode of the sitcom The Office®), and a standard measure of cognitive function (Logical Memory II). Monte Carlo resampling estimated the likelihood that older adults' error patterns were more similar to young adults' or a random distribution. RESULTS: Age deficits emerged on the theory of mind task. Poorer performance was associated with less similarity to young adults' response patterns. Overall, older adults' response patterns were ~2.7 million times more likely to match young adults' than a random model. Critically, one fourth of older adults' errors were more similar to the random distribution. Poorer memory ability contributed to this relationship. DISCUSSION: Age deficits in theory of mind performance may be driven by a subset of older adults and be related to disparities in strategy use. A certain amount of cognitive ability may be necessary for older adults to engage similar strategies to young adults' during theory of mind.

Atypical gaze patterns in autistic adults are heterogeneous across but reliable within individuals.

BACKGROUND: Across behavioral studies, autistic individuals show greater variability than typically developing individuals. However, it remains unknown to what extent this variability arises from heterogeneity across individuals, or from unreliability within individuals. Here, we focus on eye tracking, which provides rich dependent measures that have been used extensively in studies of autism. Autistic individuals have an atypical gaze onto both static visual images and dynamic videos that could be leveraged for diagnostic purposes if the above open question could be addressed. METHODS: We tested three competing hypotheses: (1) that gaze patterns of autistic individuals are less reliable or noisier than those of controls, (2) that atypical gaze patterns are individually reliable but heterogeneous across autistic individuals, or (3) that atypical gaze patterns are individually reliable and also homogeneous among autistic individuals. We collected desktop-based eye tracking data from two different full-length television sitcom episodes, at two independent sites (Caltech and Indiana University), in a total of over 150 adult participants (N = 48 autistic individuals with IQ in the normal range, 105 controls) and quantified gaze onto features of the videos using automated computer vision-based feature extraction. RESULTS: We found support for the second of these hypotheses. Autistic people and controls showed equivalently reliable gaze onto specific features of videos, such as faces, so much so that individuals could be identified significantly above chance using a fingerprinting approach from video epochs as short as 2 min. However, classification of participants into diagnostic groups based on their eye tracking data failed to produce clear group classifications, due to heterogeneity in the autistic group. LIMITATIONS: Three limitations are the relatively small sample size, assessment across only two videos (from the same television series), and the absence of other dependent measures (e.g., neuroimaging or genetics) that might have revealed individual-level variability that was not evident with eye tracking. Future studies should expand to larger samples across longer longitudinal epochs, an aim that is now becoming feasible with Internet- and phone-based eye tracking. CONCLUSIONS: These findings pave the way for the investigation of autism subtypes, and for elucidating the specific visual features that best discriminate gaze patterns-directions that will also combine with and inform neuroimaging and genetic studies of this complex disorder.

Edge-centric analysis of time-varying functional brain networks with applications in autism spectrum disorder.

The interaction between brain regions changes over time, which can be characterized using time-varying functional connectivity (tvFC). The common approach to estimate tvFC uses sliding windows and offers limited temporal resolution. An alternative method is to use the recently proposed edge-centric approach, which enables the tracking of moment-to-moment changes in co-fluctuation patterns between pairs of brain regions. Here, we first examined the dynamic features of edge time series and compared them to those in the sliding window tvFC (sw-tvFC). Then, we used edge time series to compare subjects with autism spectrum disorder (ASD) and healthy controls (CN). Our results indicate that relative to sw-tvFC, edge time series captured rapid and bursty network-level fluctuations that synchronize across subjects during movie-watching. The results from the second part of the study suggested that the magnitude of peak amplitude in the collective co-fluctuations of brain regions (estimated as root sum square (RSS) of edge time series) is similar in CN and ASD. However, the trough-to-trough duration in RSS signal is greater in ASD, compared to CN. Furthermore, an edge-wise comparison of high-amplitude co-fluctuations showed that the within-network edges exhibited greater magnitude fluctuations in CN. Our findings suggest that high-amplitude co-fluctuations captured by edge time series provide details about the disruption of functional brain dynamics that could potentially be used in developing new biomarkers of mental disorders.

Children with ASD establish joint attention during free-flowing toy play without face looks.

Children's ability to share attention with another person (i.e., achieve joint attention) is critical for learning about their environments in general1-3 and supporting language and object word learning in particular.1,4-14 While joint attention (JA) as it pertains to autism spectrum disorder (ASD) is often more narrowly operationalized as arising from eye gaze or explicit pointing cues alone,2,5,10,15-19 recent evidence demonstrates that JA in natural environments can be achieved more broadly through multiple other pathways beyond gaze and gestures.2,4,20-31 Here, we use dual head-mounted eye tracking to examine pathways into and characteristics of JA episodes during free-flowing parent-child toy play, comparing children with ASD to typically developing (TD) children. Moments of JA were defined objectively as both the child's and parent's gaze directed to the same object at the same time. Consistent with previous work in TD children,4,21,25,30-32 we found that both TD and ASD children rarely look at their parent's face in this unstructured free play context. Nevertheless, both groups achieved similarly high rates of JA that far exceeded chance, suggesting the use of alternative pathways into JA. We characterize these alternate pathways, find they occur at similar levels across both groups, and achieve similar ends: namely, for both groups, targets of JA are named more frequently by parents in those moments than non-jointly attended objects. These findings broaden the conceptualization of JA abilities and impairment in ASD and raise questions regarding the mechanistic role of the face-gaze-mediated JA pathway in ASD.

Video-evoked fMRI BOLD responses are highly consistent across different data acquisition sites.

Naturalistic imaging paradigms, in which participants view complex videos in the scanner, are increasingly used in human cognitive neuroscience. Videos evoke temporally synchronized brain responses that are similar across subjects as well as within subjects, but the reproducibility of these brain responses across different data acquisition sites has not yet been quantified. Here, we characterize the consistency of brain responses across independent samples of participants viewing the same videos in functional magnetic resonance imaging (fMRI) scanners at different sites (Indiana University and Caltech). We compared brain responses collected at these different sites for two carefully matched datasets with identical scanner models, acquisition, and preprocessing details, along with a third unmatched dataset in which these details varied. Our overall conclusion is that for matched and unmatched datasets alike, video-evoked brain responses have high consistency across these different sites, both when compared across groups and across pairs of individuals. As one might expect, differences between sites were larger for unmatched datasets than matched datasets. Residual differences between datasets could in part reflect participant-level variability rather than scanner- or data- related effects. Altogether our results indicate promise for the development and, critically, generalization of video fMRI studies of individual differences in healthy and clinical populations alike.

Visual search: Heritability and association with general intelligence.

Visual search guides goal-directed action in humans and many other species, and it has been studied extensively in the past. Yet, no study has investigated the relative contributions of genes and environments to individual differences in visual search performance, or to which extent etiologies are shared with broader cognitive phenotypes. To address this gap, we studied visual search and general intelligence in 156 monozygotic (MZ) and 158 same-sex dizygotic (DZ) twin pairs. We found that different indexes of visual search performance (response latency and visual search efficiency) were moderately heritable. Phenotypic correlations between visual search and intelligence were small-to-moderate, and only a small proportion of the genetic variance in visual search was shared with genetic variance in intelligence. We discuss these findings in the context of the "generalist genes hypothesis" stating that different cognitive functions have a common genetic basis.

Social Cognitive Abilities Predict Unique Aspects of Older Adults' Personal Social Networks.

OBJECTIVES: The current study explores whether personal social network characteristics are associated with older adults' memory and/or social cognitive function (e.g., ability to infer other's mental states-theory of mind). METHOD: 120 older adults completed a social network interview, a memory measure, and 2 core measures of social cognitive functions: emotion recognition and theory of mind. RESULTS: Variation in memory and social cognitive abilities predicted distinct aspects of older adults' social networks. Having better memory predicted having larger, less-dense social networks, but better theory of mind was associated with having at least one acquaintance in the network, and having more heterogeneous social relationships within the network. DISCUSSION: Together our findings suggest that disparate social cognitive abilities may serve unique functions, facilitating maintenance of beneficial social connections.

Probing the Ni2+ -selective Response of Fluorescent Probe NiSensor-1 with the NiCast Photocaged Complex.

CTEA (N,N-bis[2-(carboxylmethyl)thioethyl]amine) is a mixed donor ligand that has been incorporated into multiple fluorescent sensors such as NiSensor-1 that was reported to be selective for Ni2+ . Other metal ions such as Zn2+ do not produce an emission response in aqueous solution. To investigate the coordination chemistry and selectivity of this receptor, we prepared NiCast, a photocage containing the CTEA receptor. Cast photocages undergo a photoreaction that decreases electron density on a metal-bound aniline nitrogen atom, which shifts the binding equilibrium toward unbound metal ion. The unique selectivity of CTEA was examined by measuring the binding affinity of NiCast and the CTEA receptor for Ni2+ , Zn2+ , Cd2+ and Cu2+ under different conditions. In aqueous solution, Ni2+ binds more strongly to the aniline nitrogen atom than Cd2+ ; however, in CH3 CN, the change in affinity virtually disappears. The crystal structure of [Cu(CTEA)], which exhibits a Jahn-Teller-distorted square pyramidal structure, was also analyzed to gain more insight into the underlying coordination chemistry. These studies suggest that the fluorescence selectivity of NiSensor-1 in aqueous solution is due to a stronger interaction between the aniline nitrogen atom and Ni2+ compared to other divalent metal ions except Cu2+ .

Using head-mounted eye tracking to examine visual and manual exploration during naturalistic toy play in children with and without autism spectrum disorder.

Multimodal exploration of objects during toy play is important for a child's development and is suggested to be abnormal in children with autism spectrum disorder (ASD) due to either atypical attention or atypical action. However, little is known about how children with ASD coordinate their visual attention and manual actions during toy play. The current study aims to understand if and in what ways children with ASD generate exploratory behaviors to toys in natural, unconstrained contexts by utilizing head-mounted eye tracking to quantify moment-by-moment attention. We found no differences in how 24- to 48-mo children with and without ASD distribute their visual attention, generate manual action, or coordinate their visual and manual behaviors during toy play with a parent. Our findings suggest an intact ability and willingness of children with ASD to explore toys and suggest that context is important when studying child behavior.

High-amplitude cofluctuations in cortical activity drive functional connectivity.

Resting-state functional connectivity is used throughout neuroscience to study brain organization and to generate biomarkers of development, disease, and cognition. The processes that give rise to correlated activity are, however, poorly understood. Here we decompose resting-state functional connectivity using a temporal unwrapping procedure to assess the contributions of moment-to-moment activity cofluctuations to the overall connectivity pattern. This approach temporally resolves functional connectivity at a timescale of single frames, which enables us to make direct comparisons of cofluctuations of network organization with fluctuations in the blood oxygen level-dependent (BOLD) time series. We show that surprisingly, only a small fraction of frames exhibiting the strongest cofluctuation amplitude are required to explain a significant fraction of variance in the overall pattern of connection weights as well as the network's modular structure. These frames coincide with frames of high BOLD activity amplitude, corresponding to activity patterns that are remarkably consistent across individuals and identify fluctuations in default mode and control network activity as the primary driver of resting-state functional connectivity. Finally, we demonstrate that cofluctuation amplitude synchronizes across subjects during movie watching and that high-amplitude frames carry detailed information about individual subjects (whereas low-amplitude frames carry little). Our approach reveals fine-scale temporal structure of resting-state functional connectivity and discloses that frame-wise contributions vary across time. These observations illuminate the relation of brain activity to functional connectivity and open a number of directions for future research.

Difficulties maintaining prolonged fixation and attention-deficit/hyperactivity symptoms share genetic influences in childhood.

This study investigated the association between the ability to maintain prolonged (2-minute) fixation on a visual target and ADHD traits in a sample consisting of 120 monozygotic and 120 dizygotic twin pairs, aged 9 to 14 years. More intrusive saccades during the task was associated with higher level of parent-reported ADHD traits. Both intrusive saccades and ADHD symptoms had high heritability estimates, and there was a moderate genetic correlation between number of intrusive saccades and ADHD. This study suggests that inability to maintain ocular fixation for longer times is etiologically linked to ADHD traits in the general population.

Temporal fluctuations in the brain's modular architecture during movie-watching.

Brain networks are flexible and reconfigure over time to support ongoing cognitive processes. However, tracking statistically meaningful reconfigurations across time has proven difficult. This has to do largely with issues related to sampling variability, making instantaneous estimation of network organization difficult, along with increased reliance on task-free (cognitively unconstrained) experimental paradigms, limiting the ability to interpret the origin of changes in network structure over time. Here, we address these challenges using time-varying network analysis in conjunction with a naturalistic viewing paradigm. Specifically, we developed a measure of inter-subject network similarity and used this measure as a coincidence filter to identify synchronous fluctuations in network organization across individuals. Applied to movie-watching data, we found that periods of high inter-subject similarity coincided with reductions in network modularity and increased connectivity between cognitive systems. In contrast, low inter-subject similarity was associated with increased system segregation and more rest-like architectures. We then used a data-driven approach to uncover clusters of functional connections that follow similar trajectories over time and are more strongly correlated during movie-watching than at rest. Finally, we show that synchronous fluctuations in network architecture over time can be linked to a subset of features in the movie. Our findings link dynamic fluctuations in network integration and segregation to patterns of inter-subject similarity, and suggest that moment-to-moment fluctuations in functional connectivity reflect shared cognitive processing across individuals.

Accurate prediction of individual subject identity and task, but not autism diagnosis, from functional connectomes.

Despite enthusiasm about the potential for using fMRI-based functional connectomes in the development of biomarkers for autism spectrum disorder (ASD), the literature is full of negative findings-failures to distinguish ASD functional connectomes from those of typically developing controls (TD)-and positive findings that are inconsistent across studies. Here, we report on a new study designed to either better differentiate ASD from TD functional connectomes-or, alternatively, to refine our understanding of the factors underlying the current state of affairs. We scanned individuals with ASD and controls both at rest and while watching videos with social content. Using multiband fMRI across repeat sessions, we improved both data quantity and scanning duration by collecting up to 2 hr of data per individual. This is about 50 times the typical number of temporal samples per individual in ASD fcMRI studies. We obtained functional connectomes that were discriminable, allowing for near-perfect individual identification regardless of diagnosis, and equally reliable in both groups. However, contrary to what one might expect, we did not consistently or robustly observe in the ASD group either reductions in similarity to TD functional connectivity (FC) patterns or shared atypical FC patterns. Accordingly, FC-based predictions of diagnosis group achieved accuracy levels around chance. However, using the same approaches to predict scan type (rest vs. video) achieved near-perfect accuracy. Our findings suggest that neither the limitations of resting state as a "task," data resolution, data quantity, or scan duration can be considered solely responsible for failures to differentiate ASD from TD functional connectomes.

Volitional eye movement control and ADHD traits: a twin study.

BACKGROUND: Top-down volitional command of eye movements may serve as a candidate endophenotype of ADHD, an important function underlying goal-directed action in everyday life. In this twin study, we examined the relation between performance on a response inhibition eye-tracking paradigm and parent-rated ADHD traits in a population-based twin sample. We hypothesized that altered eye movement control is associated with the severity of ADHD traits and that this association is attributable to genetic factors. METHODS: A total of 640 twins (320 pairs, 50% monozygotic) aged 9-14 years) from the Child and Adolescent Twin Study in Sweden (CATSS) participated. Twins performed the antisaccade task indexing inhibitory alterations as either direction errors (following exogenous cues rather than instructions) or premature anticipatory eye movements (failure to wait for cues). We calculated the associations of eye movement control and ADHD traits using linear regression mixed-effects models and genetic and environmental influences with multivariate twin models. RESULTS: Premature anticipatory eye movements were positively associated with inattentive traits (ß = .17; 95% CI: 0.04, 0.31), while controlling for hyperactive behaviors and other covariates. Both premature anticipatory eye movements and inattention were heritable (h2  = 0.40, 95% CI: 0.22, 0.56; h2  = 0.55; 95% CI: 0.42, 0.65; respectively), and their genetic correlation was small but statistically significant (r = .19, 95% CI: 0.02, 0.36). However, the genetic correlation did not remain significant after adjusting for covariates (age, sex, hyperactivity traits, IQ). No link was found between direction errors and ADHD traits. CONCLUSIONS: This study indicates that there is a specific, genetically influenced, relation between top-down eye movement control and the inattentive traits typical of ADHD.

Nonreplication of functional connectivity differences in autism spectrum disorder across multiple sites and denoising strategies.

A rapidly growing number of studies on autism spectrum disorder (ASD) have used resting-state fMRI to identify alterations of functional connectivity, with the hope of identifying clinical biomarkers or underlying neural mechanisms. However, results have been largely inconsistent across studies, and there remains a pressing need to determine the primary factors influencing replicability. Here, we used resting-state fMRI data from the Autism Brain Imaging Data Exchange to investigate two potential factors: denoising strategy and data site (which differ in terms of sample, data acquisition, etc.). We examined the similarity of both group-averaged functional connectomes and group-level differences (ASD vs. control) across 33 denoising pipelines and four independently-acquired datasets. The group-averaged connectomes were highly consistent across pipelines (r = 0.92 ± 0.06) and sites (r = 0.88 ± 0.02). However, the group differences, while still consistent within site across pipelines (r = 0.76 ± 0.12), were highly inconsistent across sites regardless of choice of denoising strategies (r = 0.07 ± 0.04), suggesting lack of replication may be strongly influenced by site and/or cohort differences. Across-site similarity remained low even when considering the data at a large-scale network level or when considering only the most significant edges. We further show through an extensive literature survey that the parameters chosen in the current study (i.e., sample size, age range, preprocessing methods) are quite representative of the published literature. These results highlight the importance of examining replicability in future studies of ASD, and, more generally, call for extra caution when interpreting alterations in functional connectivity across groups of individuals.

Visual Disengagement: Genetic Architecture and Relation to Autistic Traits in the General Population.

Visual disengagement has been hypothesized as an endophenotype for autism. In this study we used twin modelling to assess the role of genetics in basic measures of visual disengagement, and tested their putative association to autistic traits in the general population. We used the Gap Overlap task in a sample of 492 twins. Results showed that most of the covariance among eye movement latencies across conditions was shared and primarily genetic. Further, there were unique genetic contributions to the Gap condition, but not to the Overlap condition-i.e. the one theorized to capture visual disengagement. We found no phenotypic association between autistic traits and disengagement, thus not supporting the hypothesis of visual disengagement as an endophenotype for autistic traits.

Developing Social Communication Skills Using Dual First-Person Video Recording Glasses: A Novel Intervention for Adolescents with Autism.

Adolescents with autism often experience pronounced difficulties with social communication, and novel interventions designed to improve core abilities are greatly needed. This study examines if providing immediate video feedback, an extension of video self-modeling, can aid adolescents with autism to self-identify strengths and irregularities from their social interactions. Using multiple baseline design across four participants, individuals engaged in naturalistic conversations wearing video recording glasses. During the intervention, videos were reviewed immediately and participants recognized when they were not following typical social-communicative convention. Based on observational data coded from videos, all four participants modified their behavior during subsequent conversations. Although adolescents with autism may hypothetically know to behave, viewing themselves on video may provide practical cues to support social insight and behavioral change.