Cardiff Online Cognitive Assessment in a National Sample: Cross-Sectional Web-Based Study.

BACKGROUND: Psychiatric disorders are associated with cognitive impairment. We have developed a web-based, 9-task cognitive battery to measure the core domains affected in people with psychiatric disorders. To date, this assessment has been used to collect data on a clinical sample of participants with psychiatric disorders. OBJECTIVE: The aims of this study were (1) to establish a briefer version of the battery (called the Cardiff Online Cognitive Assessment [CONCA]) that can give a valid measure of cognitive ability ("g") and (2) to collect normative data and demonstrate CONCA's application in a health population sample. METHODS: Based on 6 criteria and data from our previous study, we selected 5 out of the original 9 tasks to include in CONCA. These included 3 core tasks that were sufficient to derive a measure of "g" and 2 optional tasks. Participants from a web-based national cohort study (HealthWise Wales) were invited to complete CONCA. Completion rates, sample characteristics, performance distributions, and associations between cognitive performance and demographic characteristics and mental health measures were examined. RESULTS: A total of 3679 participants completed at least one CONCA task, of which 3135 completed all 3 core CONCA tasks. Performance on CONCA was associated with age (B=-0.05, SE 0.002; P<.001), device (tablet computer: B=-0.26, SE 0.05; P<.001; smartphone: B=-0.46, SE 0.05; P<.001), education (degree: B=1.68, SE 0.14; P<.001), depression symptoms (B=-0.04, SE 0.01; P<.001), and anxiety symptoms (B=-0.04, SE 0.01; P<.001). CONCLUSIONS: CONCA provides a valid measure of "g," which can be derived using as few as 3 tasks that take no more than 15 minutes. Performance on CONCA showed associations with demographic characteristics in the expected direction and was associated with current depression and anxiety symptoms. The effect of device on cognitive performance is an important consideration for research using web-based assessments.

Web-Based Cognitive Testing in Psychiatric Research: Validation and Usability Study.

BACKGROUND: Cognitive impairments are features of many psychiatric disorders and affect functioning. A barrier to cognitive research on psychiatric disorders is the lack of large cross-disorder data sets. However, the collection of cognitive data can be logistically challenging and expensive. Web-based collection may be an alternative; however, little is known about who does and does not complete web-based cognitive assessments for psychiatric research. OBJECTIVE: The aims of this study are to develop a web-based cognitive battery for use in psychiatric research, validate the battery against the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) Consensus Cognitive Battery, and compare the characteristics of the participants who chose to take part with those of the individuals who did not participate. METHODS: Tasks were developed by The Many Brains Project and selected to measure the domains specified by the MATRICS initiative. We undertook a cross-validation study of 65 participants with schizophrenia, bipolar disorder, depression, or no history of psychiatric disorders to compare the web-based tasks with the MATRICS Consensus Cognitive Battery. Following validation, we invited participants from 2 large ongoing genetic studies, which recruited participants with psychiatric disorders to complete the battery and evaluated the demographic and clinical characteristics of those who took part. RESULTS: Correlations between web-based and MATRICS tasks ranged between 0.26 and 0.73. Of the 961 participants, 887 (92.3%) completed at least one web-based task, and 644 (67%) completed all tasks, indicating adequate completion rates. Predictors of web-based participation included being female (odds ratio [OR] 1.3, 95% CI 1.07-1.58), ethnicity other than White European (OR 0.66, 95% CI 0.46-0.96), higher levels of education (OR 1.19, 95% CI 1.11-1.29), diagnosis of an eating disorder (OR 2.17, 95% CI 1.17-4) or depression and anxiety (OR 5.12, 95% CI 3.38-7.83), and absence of a diagnosis of schizophrenia (OR 0.59, 95% CI 0.35-0.94). Lower performance on the battery was associated with poorer functioning (B=-1.76, SE 0.26; P<.001). CONCLUSIONS: Our findings offer valuable insights into the advantages and disadvantages of testing cognitive function remotely for mental health research.