Development and Replication of Objective Measurements of Social Visual Engagement to Aid in Early Diagnosis and Assessment of Autism.

Importance: Autism spectrum disorder is a common and early-emerging neurodevelopmental condition. While 80% of parents report having had concerns for their child's development before age 2 years, many children are not diagnosed until ages 4 to 5 years or later. Objective: To develop an objective performance-based tool to aid in early diagnosis and assessment of autism in children younger than 3 years. Design, Setting, and Participants: In 2 prospective, consecutively enrolled, broad-spectrum, double-blind studies, we developed an objective eye-tracking-based index test for children aged 16 to 30 months, compared its performance with best-practice reference standard diagnosis of autism (discovery study), and then replicated findings in an independent sample (replication study). Discovery and replication studies were conducted in specialty centers for autism diagnosis and treatment. Reference standard diagnoses were made using best-practice standardized protocols by specialists blind to eye-tracking results. Eye-tracking tests were administered by staff blind to clinical results. Children were enrolled from April 27, 2013, until September 26, 2017. Data were analyzed from March 28, 2018, to January 3, 2019. Main Outcomes and Measures: Prespecified primary end points were the sensitivity and specificity of the eye-tracking-based index test compared with the reference standard. Prespecified secondary end points measured convergent validity between eye-tracking-based indices and reference standard assessments of social disability, verbal ability, and nonverbal ability. Results: Data were collected from 1089 children: 719 children (mean [SD] age, 22.4 [3.6] months) in the discovery study, and 370 children (mean [SD] age, 25.4 [6.0] months) in the replication study. In discovery, 224 (31.2%) were female and 495 (68.8%) male; in replication, 120 (32.4%) were female and 250 (67.6%) male. Based on reference standard expert clinical diagnosis, there were 386 participants (53.7%) with nonautism diagnoses and 333 (46.3%) with autism diagnoses in discovery, and 184 participants (49.7%) with nonautism diagnoses and 186 (50.3%) with autism diagnoses in replication. In the discovery study, the area under the receiver operating characteristic curve was 0.90 (95% CI, 0.88-0.92), sensitivity was 81.9% (95% CI, 77.3%-85.7%), and specificity was 89.9% (95% CI, 86.4%-92.5%). In the replication study, the area under the receiver operating characteristic curve was 0.89 (95% CI, 0.86-0.93), sensitivity was 80.6% (95% CI, 74.1%-85.7%), and specificity was 82.3% (95% CI, 76.1%-87.2%). Eye-tracking test results correlated with expert clinical assessments of children's individual levels of ability, explaining 68.6% (95% CI, 58.3%-78.6%), 63.4% (95% CI, 47.9%-79.2%), and 49.0% (95% CI, 33.8%-65.4%) of variance in reference standard assessments of social disability, verbal ability, and nonverbal cognitive ability, respectively. Conclusions and Relevance: In two diagnostic studies of children younger than 3 years, objective eye-tracking-based measurements of social visual engagement quantified diagnostic status as well as individual levels of social disability, verbal ability, and nonverbal ability in autism. These findings suggest that objective measurements of social visual engagement can be used to aid in autism diagnosis and assessment.

Meaning in Measurement: Evaluating Young Autistic Adults' Active Engagement and Expressed Interest in Quality-of-Life Goals.

The need for support programs and meaningful measurement of outcomes with autistic adults is growing. To date, success in autism intervention has been defined based on changes in discretely defined, observable behaviors with limited consideration of the person's experience, motivations, or the complex contexts in which these skills are used. Behavioral skill-building interventions are effective at increasing or decreasing specific behaviors, but a purely behavioral focus is not enough for meaningful improvements in adult quality of life (QoL). To reflect real-life impact, intervention and measurement must go beyond quantitative estimates of changes in skills regardless of context of use and focus on enhancing and evaluating functional outcomes and adult QoL that includes active engagement with the adult and provides rigor in qualitative evaluation. This article reports on efforts to assess active engagement of verbally fluent young autistic adults in a supported university-based residential pilot program built around self-set wellness goals for healthy, engaged, responsible, and empowered adult living. Program evaluation used an exploratory process for evaluating QoL learning, while also being open to how future work can discern participant meanings in measurement. The pilot used a mixed-methods approach to measure entry skills and interests, codetermine personal wellness goals, inform program content with participants, and measure QoL learning in terms of active engagement, expressed interest, and changes in self-appraisal of competence, confidence, and identity. Participants' QoL learning, replication of QoL learning measurement methods, and further exploration of strategies to put participant meanings in QoL learning measurement are discussed. Lay summary: Why was this study done?: This study piloted a measurement strategy for deciding what to measure and support in real-world contexts of independent living and on-campus experiences in a 3-week residential program for young autistic adults.What was the purpose of this study?: The study aimed to measure and support autistic adults' quality of life (QoL) learning in terms of the extent to which pursuing self-set wellness goals, with supports, positively impacted autistic adults' active engagement (e.g., participation in wellness activities), and expressed interest (e.g., willingness to participate).Why was this program developed?: The program was developed because more young adults on the spectrum are aging into adulthood without personalized, respectful, and meaningful supports to promote engaged adult living. We wanted to build on our experience and feedback from autistic adults, family, and partners who have engaged in weekly social engagement groups on a university campus and called for more comprehensive transition programs.What did the program do?: The project was a pilot of an on-campus program aimed at facilitating personally meaningful improvements in QoL through empowering autistic adults to act on their personal motivations, interests, and goals. It also emphasized learning through experiences in real-life contexts, in collaboration with other participants, campus resources, community members, and program staff.How did the researchers evaluate the new program?: The program team used both quantitative and qualitative methods. Quantitative methods included standard self-report tools that autistic adults used to rate their safety needs, adult self-direction skills, autism-related self-concept, priority of self-set wellness goals, and confidence in abilities to achieve and learn more about one's own wellness goals. Predetermined qualitative methods included analysis of themes from participants' narrative data from their wellness interviews with participants and open-response items from self-report tools. The program was also responsive through a preprogram wellness interview with parents, staff's field notes about of participants' behaviors, conversational interactions with participants, and team discussions. Researchers contextualized and synthesized the data into narrative case studies about each participant's wellness journey.What were the early findings and what do they add to what was already known?: Results showed that the program was able to facilitate participants' QoL learning in personal wellness goals in collaboration with campus and community resources. Participants expressed meaningful changes in their expressed interests, active engagement, and self-concept through participating in this brief residential on-campus program.What are potential weaknesses of this pilot?: Weaknesses included a short time period of 3 weeks, a small participant count of 5, and the resource-intense supports needed for the program.What are the next steps?: The next steps are to adjust the program based on participant feedback and pursue creation of a multiyear program to continue piloting the measurement and support strategies for facilitating autistic adults' active wellness engagement and self-determined independent living.How will these findings and this work help autistic adults now or in the future?: This work informs future wellness interventions for measuring and supporting autistic adults' efforts to self-determine meaningful changes to their QoL.

Examining the Relationship Between Parental Symptomatology and Treatment Outcomes in Children with Autism Spectrum Disorder.

This report examines the relationship between treatment response in children with ASD and parents' affective symptomatology. This study examined 29 children with ASD in a manualized group psychotherapy program, Resilience Builder Program® (RBP), where emotional and social functioning of parent and child were measured through pre- and post-treatment questionnaires. Greater parental symptomatology was associated with children's reduced response to RBP in resilience-based emotion regulation skills. Greater parental interpersonal sensitivity (ß = - .27, p = .024) predicted worse post-treatment scores in child communication skills, greater parental anxious symptoms (ß = - .45, p = .005) predicted worse post-treatment scores in child emotional control, and greater parental depressive (ß = .27, p = .041) and anxious symptoms (ß = .36, p = .004) predicted worse post-treatment scores in child internalizing problems.

Screening for Autism Spectrum Disorder: Profiles of Children Who Are Missed.

OBJECTIVE: To characterize children presenting with concerns for autism spectrum disorder (ASD) missed by parent-report screeners and to examine benefits of a combined screening approach with the Modified Checklist for Autism in Toddlers, Revised (M-CHAT-R) and the Ages and Stages Questionnaire, Third Edition (ASQ-3). METHODS: Participants included were 154 children aged 16 to 42 months presenting for an evaluation at an autism center. Caregivers completed the M-CHAT-R, ASQ-3, and a demographic questionnaire. Children participated in an autism diagnostic evaluation consisting of the Mullen Scales of Early Learning (Mullen) and Autism Diagnostic Observation Schedule, Second Edition (ADOS-2). RESULTS: A total of 124 children (81%) were diagnosed with ASD. The M-CHAT-R identified 85% (n = 105) of these children. Children with ASD missed by the M-CHAT-R had significantly higher scores on the Mullen and significantly lower scores on the ADOS-2. Of the ASQ-3 domains, the majority (n = 102, 82%) of children with ASD failed the communication domain; missed cases showed similar patterns of higher Mullen scores and lower ADOS-2 scores. When adopting a combined screening approach, using a failed screen from either the M-CHAT-R or ASQ-3 communication domain, 93% of children were identified. Parent-reported concerns on an open-ended questionnaire revealed ASD red flags for many missed cases. CONCLUSION: Children with ASD missed by screeners had higher scores on developmental testing and lower scores on the ADOS-2; however, children still performed below average on developmental tests. Our findings suggest that a combined screening approach was most effective for identifying children with ASD from a sample group referred for an ASD evaluation.

Assessing Risk of Bias in Randomized Controlled Trials for Autism Spectrum Disorder.

AIM: To determine construct validity and reliability indicators of the Cochrane risk of bias (RoB) tool in the context of randomized clinical trials (RCTs) for autism spectrum disorder (ASD). METHODS: Confirmatory factor analysis was used to evaluate a unidimensional model consisting of 9 RoB categorical indicators evaluated across 94 RCTs addressing interventions for ASD. RESULTS: Only five of the nine original RoB items returned good fit indices and so were retained in the analysis. Only one of this five had very high factor loadings. The remaining four indicators had more measurement error than common variance with the RoB latent factor. Together, the five indicators showed poor reliability (ω = 0.687; 95% CI: 0.613-0.761). CONCLUSION: Although the Cochrane model of RoB for ASD exhibited good fit indices, the majorities of the items have more residual variance than common variance and, therefore, did not adequately capture the RoB in ASD intervention trials.