The Dyad-Adaptive Paced Auditory Serial Addition Test (DA-PASAT): Normative data and the effects of repeated testing, simulated malingering, and traumatic brain injury.

The Paced Auditory Serial Addition Test (PASAT) is widely used to evaluate processing speed and executive function in patients with multiple sclerosis, traumatic brain injury, and other neurological disorders. In the PASAT, subjects listen to sequences of digits while continuously reporting the sum of the last two digits presented. Four different stimulus onset asynchronies (SOAs) are usually tested, with difficulty increasing as SOAs are reduced. Ceiling effects are common at long SOAs, while the digit delivery rate often exceeds the subject's processing capacity at short SOAs, causing some subjects to stop performing altogether. In addition, subjects may adopt an "alternate answer" strategy at short SOAs, which reduces the test's demands on working-memory and processing speed. Consequently, studies have shown that the number of dyads (consecutive correct answers) is a more sensitive measure of PASAT performance than the overall number of correct sums. Here, we describe a 2.5-minute computerized test, the Dyad-Adaptive PASAT (DA-PASAT), where SOAs are adjusted with a 2:1 staircase, decreasing after each pair of correct responses and increasing after misses. Processing capacity is reflected in the minimum SOA (minSOA) achieved in 54 trials. Experiment 1 gathered normative data in two large populations: 1617 subjects in New Zealand ranging in age from 18 to 65 years, and 214 Californians ranging in age from 18 to 82 years. Minimum SOAs were influenced by age, education, and daily hours of computer-use. Minimum SOA z-scores, calculated after factoring out the influence of these factors, were virtually identical in the two control groups, as were response times (RTs) and dyad ratios (the proportion of hits occurring in dyads). Experiment 2 measured the test-retest reliability of the DA-PASAT in 44 young subjects who underwent three test sessions at weekly intervals. High intraclass correlation coefficients (ICCs) were found for minSOAs (0.87), response times (0.76), and dyad ratios (0.87). Performance improved across test sessions for all measures. Experiment 3 investigated the effects of simulated malingering in 50 subjects: 42% of simulated malingerers produced abnormal (p< 0.05) minSOA z-scores. Simulated malingerers with abnormal scores were distinguished with 87% sensitivity and 69% specificity from control subjects with abnormal scores by excessive differences between training performance and the actual test. Experiment 4 investigated patients with traumatic brain injury (TBI): patients with mild TBI performed within the normal range while patients with severe TBI showed deficits. The DA-PASAT reduces the time and stress of PASAT assessment while gathering sensitive measures of dyad processing that reveal the effects of aging, malingering, and traumatic brain injury on performance.

Computerized Analysis of Verbal Fluency: Normative Data and the Effects of Repeated Testing, Simulated Malingering, and Traumatic Brain Injury.

In verbal fluency (VF) tests, subjects articulate words in a specified category during a short test period (typically 60 s). Verbal fluency tests are widely used to study language development and to evaluate memory retrieval in neuropsychiatric disorders. Performance is usually measured as the total number of correct words retrieved. Here, we describe the properties of a computerized VF (C-VF) test that tallies correct words and repetitions while providing additional lexical measures of word frequency, syllable count, and typicality. In addition, the C-VF permits (1) the analysis of the rate of responding over time, and (2) the analysis of the semantic relationships between words using a new method, Explicit Semantic Analysis (ESA), as well as the established semantic clustering and switching measures developed by Troyer et al. (1997). In Experiment 1, we gathered normative data from 180 subjects ranging in age from 18 to 82 years in semantic ("animals") and phonemic (letter "F") conditions. The number of words retrieved in 90 s correlated with education and daily hours of computer-use. The rate of word production declined sharply over time during both tests. In semantic conditions, correct-word scores correlated strongly with the number of ESA and Troyer-defined semantic switches as well as with an ESA-defined semantic organization index (SOI). In phonemic conditions, ESA revealed significant semantic influences in the sequence of words retrieved. In Experiment 2, we examined the test-retest reliability of different measures across three weekly tests in 40 young subjects. Different categories were used for each semantic ("animals", "parts of the body", and "foods") and phonemic (letters "F", "A", and "S") condition. After regressing out the influences of education and computer-use, we found that correct-word z-scores in the first session did not differ from those of the subjects in Experiment 1. Word production was uniformly greater in semantic than phonemic conditions. Intraclass correlation coefficients (ICCs) of correct-word z-scores were higher for phonemic (0.91) than semantic (0.77) tests. In semantic conditions, good reliability was also seen for the SOI (ICC = 0.68) and ESA-defined switches in semantic categories (ICC = 0.62). In Experiment 3, we examined the performance of subjects from Experiment 2 when instructed to malinger: 38% showed abnormal (p< 0.05) performance in semantic conditions. Simulated malingerers with abnormal scores could be distinguished with 80% sensitivity and 89% specificity from subjects with abnormal scores in Experiment 1 using lexical, temporal, and semantic measures. In Experiment 4, we tested patients with mild and severe traumatic brain injury (mTBI and sTBI). Patients with mTBI performed within the normal range, while patients with sTBI showed significant impairments in correct-word z-scores and category shifts. The lexical, temporal, and semantic measures of the C-VF provide an automated and comprehensive description of verbal fluency performance.

A Computerized Test of Design Fluency.

Tests of design fluency (DF) assess a participant's ability to generate geometric patterns and are thought to measure executive functions involving the non-dominant frontal lobe. Here, we describe the properties of a rapidly administered computerized design-fluency (C-DF) test that measures response times, and is automatically scored. In Experiment 1, we found that the number of unique patterns produced over 90 s by 180 control participants (ages 18 to 82 years) correlated with age, education, and daily computer-use. Each line in the continuous 4-line patterns required approximately 1.0 s to draw. The rate of pattern production and the incidence of repeated patterns both increased over the 90 s test. Unique pattern z-scores (corrected for age and computer-use) correlated with the results of other neuropsychological tests performed on the same day. Experiment 2 analyzed C-DF test-retest reliability in 55 participants in three test sessions at weekly intervals and found high z-score intraclass correlation coefficients (ICC = 0.79). Z-scores in the first session did not differ significantly from those of Experiment 1, but performance improved significantly over repeated tests. Experiment 3 investigated the performance of Experiment 2 participants when instructed to simulate malingering. Z-scores were significantly reduced and pattern repetitions increased, but there was considerable overlap with the performance of the control population. Experiment 4 examined performance in veteran patients tested more than one year after traumatic brain injury (TBI). Patients with mild TBI performed within the normal range, but patients with severe TBI showed reduced z-scores. The C-DF test reliably measures visuospatial pattern generation ability and reveals performance deficits in patients with severe TBI.

The Bay Area Verbal Learning Test (BAVLT): Normative Data and the Effects of Repeated Testing, Simulated Malingering, and Traumatic Brain Injury.

Verbal learning tests (VLTs) are widely used to evaluate memory deficits in neuropsychiatric and developmental disorders. However, their validity has been called into question by studies showing significant differences in VLT scores obtained by different examiners. Here we describe the computerized Bay Area Verbal Learning Test (BAVLT), which minimizes inter-examiner differences by incorporating digital list presentation and automated scoring. In the 10-min BAVLT, a 12-word list is presented on three acquisition trials, followed by a distractor list, immediate recall of the first list, and, after a 30-min delay, delayed recall and recognition. In Experiment 1, we analyzed the performance of 195 participants ranging in age from 18 to 82 years. Acquisition trials showed strong primacy and recency effects, with scores improving over repetitions, particularly for mid-list words. Inter-word intervals (IWIs) increased with successive words recalled. Omnibus scores (summed over all trials except recognition) were influenced by age, education, and sex (women outperformed men). In Experiment 2, we examined BAVLT test-retest reliability in 29 participants tested with different word lists at weekly intervals. High intraclass correlation coefficients were seen for omnibus and acquisition scores, IWIs, and a categorization index reflecting semantic reorganization. Experiment 3 examined the performance of Experiment 2 participants when feigning symptoms of traumatic brain injury. Although 37% of simulated malingerers showed abnormal (p < 0.05) omnibus z-scores, z-score cutoffs were ineffective in discriminating abnormal malingerers from control participants with abnormal scores. In contrast, four malingering indices (recognition scores, primacy/recency effects, learning rate across acquisition trials, and IWIs) discriminated the two groups with 80% sensitivity and 80% specificity. Experiment 4 examined the performance of a small group of patients with mild or severe TBI. Overall, both patient groups performed within the normal range, although significant performance deficits were seen in some patients. The BAVLT improves the speed and replicability of verbal learning assessments while providing comprehensive measures of retrieval timing, semantic organization, and primacy/recency effects that clarify the nature of performance.

An improved spatial span test of visuospatial memory.

In the widely used Corsi Block Test and Wechsler Spatial Span Tests, participants must reproduce sequences of blocks in the order touched by the examiner until two trials are missed at the same sequence length. The examiner records either the maximum number of blocks correctly reported or the total number of correct lists. Here, we describe a computerized spatial span test (C-SST) that uses psychophysical procedures to quantify visuospatial mean span (MnS) with sub-digit precision. Results from 187 participants ranging in age from 18 to 82 years showed that accuracy declined gradually with list length around the MnS (by ∼30% per item). Simulation studies revealed high variance and biases in CBT and Wechsler measures, and demonstrated that the C-SST provided the most accurate estimate of true span (i.e., the sequence length producing 50% correct). MnS declined more rapidly with age than mean digit span (MnDS) measured in the same participants. Response times correlated with both MnS and MnDS scores. Error analysis showed that omission and transposition errors predominated, with weaker primacy and recency effects in spatial span than digit span testing. The C-SST improves the precision of spatial span testing and reveals significant differences between visuospatial and verbal working memory.

The Effects of Repeated Testing, Simulated Malingering, and Traumatic Brain Injury on High-Precision Measures of Simple Visual Reaction Time.

Simple reaction time (SRT), the latency to respond to a stimulus, has been widely used as a basic measure of processing speed. In the current experiments, we examined clinically-relevant properties of a new SRT test that presents visual stimuli to the left or right hemifield at varying stimulus onset asynchronies (SOAs). Experiment 1 examined test-retest reliability in 48 participants who underwent three test sessions at weekly intervals. In the first test, log-transformed (log-SRT) z-scores, corrected for the influence of age and computer-use, were well predicted by regression functions derived from a normative population of 189 control participants. Test-retest reliability of log-SRT z-scores was measured with an intraclass correlation coefficient (ICC = 0.83) and equaled or exceeded those of other SRT tests and other widely used tests of processing speed that are administered manually. No significant learning effects were observed across test sessions. Experiment 2 investigated the same participants when instructed to malinger during a fourth testing session: 94% showed abnormal log-SRT z-scores, with 83% producing log-SRT z-scores exceeding a cutoff of 3.0, a degree of abnormality never seen in full-effort conditions. Thus, a log-SRT z-score cutoff of 3.0 had a sensitivity (83%) and specificity (100%) that equaled or exceeded that of existing symptom validity tests. We argue that even expert malingerers, fully informed of the malingering-detection metric, would be unable to successfully feign impairments on the SRT test because of the precise control of SRT latencies that would be required. Experiment 3 investigated 26 patients with traumatic brain injury (TBI) tested more than 1 year post-injury. The 22 patients with mild TBI showed insignificantly faster SRTs than controls, but a small group of four patients with severe TBI showed slowed SRTs. Simple visual reaction time is a reliable measure of processing speed that is sensitive to the effects of malingering and TBI.

The Effects of Repeated Testing, Simulated Malingering, and Traumatic Brain Injury on Visual Choice Reaction Time.

Choice reaction time (CRT), the time required to discriminate and respond appropriately to different stimuli, is a basic measure of attention and processing speed. Here, we describe the reliability and clinical sensitivity of a new CRT test that presents lateralized visual stimuli and adaptively adjusts stimulus onset asynchronies using a staircase procedure. Experiment 1 investigated the test-retest reliability in three test sessions performed at weekly intervals. Performance in the first test session was accurately predicted from age and computer-use regression functions obtained in a previously studied normative cohort. Central processing time (CentPT), the difference between the CRTs and simple reaction time latencies measured in a separate experiment, accounted for 55% of CRT latency and more than 85% of CRT latency variance. Performance improved significantly across the three test sessions. High intraclass correlation coefficients were seen for CRTs (0.90), CentPTs (0.87), and an omnibus performance measure (0.81) that combined CRT and minimal SOA z-scores. Experiment 2 investigated performance in the same participants when instructed to feign symptoms of traumatic brain injury (TBI): 87% produced abnormal omnibus z-scores. Simulated malingerers showed greater elevations in simple reaction times than CRTs, and hence reduced CentPTs. Latency-consistency z-scores, based on the difference between the CRTs obtained and those predicted based on CentPT latencies, discriminated malingering participants from controls with high sensitivity and specificity. Experiment 3 investigated CRT test performance in military veterans who had suffered combat-related TBI and symptoms of post-traumatic stress disorder, and revealed small but significant deficits in performance in the TBI population. The results indicate that the new CRT test shows high test-retest reliability, can assist in detecting participants performing with suboptimal effort, and is sensitive to the effects of TBI on the speed and accuracy of visual processing.

Corrigendum: Age-related slowing of response selection and production in a visual choice reaction time task.

[This corrects the article on p. 193 in vol. 9, PMID: 25954175.].

Measuring executive function in control subjects and TBI patients with question completion time (QCT).

Questionnaire completion is a complex task that places demands on cognitive functions subserving reading, introspective memory, decision-making, and motor control. Although computerized questionnaires and surveys are used with increasing frequency in clinical practice, few studies have examined question completion time (QCT), the time required to complete each question. Here, we analyzed QCTs in 172 control subjects and 31 patients with traumatic brain injury (TBI) who completed two computerized questionnaires, the 17-question Post-Traumatic Stress Disorder (PTSD) Checklist (PCL) and the 25-question Cognitive Failures Questionnaire (CFQ). In control subjects, robust correlations were found between self-paced QCTs on the PCL and CFQ (r = 0.82). QCTs on individual questions correlated strongly with the number of words in the question, indicating the critical role of reading speed. QCTs increased significantly with age, and were reduced in females and in subjects with increased education and computer experience. QCT z-scores, corrected for age, education, computer use, and sex, correlated more strongly with each other than with the results of other cognitive tests. Patients with a history of severe TBI showed significantly delayed QCTs, but QCTs fell within the normal range in patients with a history of mild TBI. When questionnaires are used to gather relevant patient information, simultaneous QCT measures provide reliable and clinically sensitive measures of processing speed and executive function.

The Effects of Aging, Malingering, and Traumatic Brain Injury on Computerized Trail-Making Test Performance.

The trail making test (TMT) is widely used to assess speed of processing and executive function. However, normative data sets gathered at different sites show significant inconsistencies. Here, we describe a computerized version of the TMT (C-TMT) that increases the precision and replicability of the TMT by permitting a segment-by-segment analysis of performance and separate analyses of dwell-time, move-time, and error time. Experiment 1 examined 165 subjects of various ages and found that completion times on both the C-TMT-A (where subjects connect successively numbered circles) and the C-TMT-B (where subjects connect circles containing alternating letters and numbers) were strongly influenced by age. Experiment 2 examined 50 subjects who underwent three test sessions. The results of the first test session were well fit by the normative data gathered in Experiment 1. Sessions 2 and 3 demonstrated significant learning effects, particularly on the C-TMT-B, and showed good test-retest reliability. Experiment 3 examined performance in subjects instructed to feign symptoms of traumatic brain injury: 44% of subjects produced abnormal completion times on the C-TMT-A, and 18% on the C-TMT-B. Malingering subjects could be distinguished from abnormally slow controls based on (1) disproportionate increases in dwell-time on the C-TMT-A, and (2) greater deficits on the C-TMT-A than on the C-TMT-B. Experiment 4 examined the performance of 28 patients with traumatic brain injury: C-TMT-B completion times were slowed, and TBI patients showed reduced movement velocities on both tests. The C-TMT improves the reliability and sensitivity of the trail making test of processing speed and executive function.

Age-related slowing of response selection and production in a visual choice reaction time task.

Aging is associated with delayed processing in choice reaction time (CRT) tasks, but the processing stages most impacted by aging have not been clearly identified. Here, we analyzed CRT latencies in a computerized serial visual feature-conjunction task. Participants responded to a target letter (probability 40%) by pressing one mouse button, and responded to distractor letters differing either in color, shape, or both features from the target (probabilities 20% each) by pressing the other mouse button. Stimuli were presented randomly to the left and right visual fields and stimulus onset asynchronies (SOAs) were adaptively reduced following correct responses using a staircase procedure. In Experiment 1, we tested 1466 participants who ranged in age from 18 to 65 years. CRT latencies increased significantly with age (r = 0.47, 2.80 ms/year). Central processing time (CPT), isolated by subtracting simple reaction times (SRT) (obtained in a companion experiment performed on the same day) from CRT latencies, accounted for more than 80% of age-related CRT slowing, with most of the remaining increase in latency due to slowed motor responses. Participants were faster and more accurate when the stimulus location was spatially compatible with the mouse button used for responding, and this effect increased slightly with age. Participants took longer to respond to distractors with target color or shape than to distractors with no target features. However, the additional time needed to discriminate the more target-like distractors did not increase with age. In Experiment 2, we replicated the findings of Experiment 1 in a second population of 178 participants (ages 18-82 years). CRT latencies did not differ significantly in the two experiments, and similar effects of age, distractor similarity, and stimulus-response spatial compatibility were found. The results suggest that the age-related slowing in visual CRT latencies is largely due to delays in response selection and production.

Factors influencing the latency of simple reaction time.

Simple reaction time (SRT), the minimal time needed to respond to a stimulus, is a basic measure of processing speed. SRTs were first measured by Francis Galton in the 19th century, who reported visual SRT latencies below 190 ms in young subjects. However, recent large-scale studies have reported substantially increased SRT latencies that differ markedly in different laboratories, in part due to timing delays introduced by the computer hardware and software used for SRT measurement. We developed a calibrated and temporally precise SRT test to analyze the factors that influence SRT latencies in a paradigm where visual stimuli were presented to the left or right hemifield at varying stimulus onset asynchronies (SOAs). Experiment 1 examined a community sample of 1469 subjects ranging in age from 18 to 65. Mean SRT latencies were short (231, 213 ms when corrected for hardware delays) and increased significantly with age (0.55 ms/year), but were unaffected by sex or education. As in previous studies, SRTs were prolonged at shorter SOAs and were slightly faster for stimuli presented in the visual field contralateral to the responding hand. Stimulus detection time (SDT) was estimated by subtracting movement initiation time, measured in a speeded finger tapping test, from SRTs. SDT latencies averaged 131 ms and were unaffected by age. Experiment 2 tested 189 subjects ranging in age from 18 to 82 years in a different laboratory using a larger range of SOAs. Both SRTs and SDTs were slightly prolonged (by 7 ms). SRT latencies increased with age while SDT latencies remained stable. Precise computer-based measurements of SRT latencies show that processing speed is as fast in contemporary populations as in the Victorian era, and that age-related increases in SRT latencies are due primarily to slowed motor output.

The Effects of Repeat Testing, Malingering, and Traumatic Brain Injury on Computerized Measures of Visuospatial Memory Span.

Spatial span tests (SSTs) such as the Corsi Block Test (CBT) and the SST of the Wechsler Memory Scale are widely used to assess deficits in spatial working memory. We conducted three experiments to evaluate the test-retest reliability and clinical sensitivity of a new computerized spatial span test (C-SST) that incorporates psychophysical methods to improve the precision of spatial span measurement. In Experiment 1, we analyzed C-SST test-retest reliability in 49 participants who underwent three test sessions at weekly intervals. Intraclass correlation coefficients (ICC) were higher for a psychophysically derived mean span (MnS) metric (0.83) than for the maximal span and total correct metrics used in traditional spatial-span tests. Response times (ReTs) also showed high ICCs (0.93) that correlated negatively with MnS scores and correlated positively with response-time latencies from other tests of processing speed. Learning effects were insignificant. Experiment 2 examined the performance of Experiment 1 participants when instructed to feign symptoms of traumatic brain injury (TBI): 57% showed abnormal MnS z-scores. A MnS z-score cutoff of 3.0 correctly classified 36% of simulated malingerers and 91% of the subgroup of 11 control participants with abnormal spans. Malingerers also made more substitution errors than control participants with abnormal spans (sensitivity = 43%, specificity = 91%). In addition, malingerers showed no evidence of ReT slowing, in contrast to significant abnormalities seen on other malingered tests of processing speed. As a result, differences between ReT z-scores and z-scores on other processing speed tests showed very high sensitivity and specificity in distinguishing malingering and control participants with either normal or abnormal spans. Experiment 3 examined C-SST performance in a group of patients with predominantly mild TBI: neither MnS nor ReT z-scores showed significant group-level abnormalities. The C-SST improves the reliability and sensitivity of spatial span testing, can accurately detect malingering, and shows that visuospatial working memory is largely preserved in patients with predominantly mild TBI.