ABSTRACT
OBJECTIVE: : Replicate previous research on Logical Memory Recognition (LMRecog) and perform a critical item analysis. METHOD: : Performance validity was psychometrically operationalized in a mixed clinical sample of 213 adults. Classification of the LMRecog and nine critical items (CR-9) was computed. RESULTS: : LMRecog ≤20 produced a good combination of sensitivity (.30-.35) and specificity (.89-.90). CR-9 ≥5 and ≥6 had comparable classification accuracy. CR-9 ≥5 increased sensitivity by 4% over LMRecog ≤20; CR-9 ≥6 increased specificity by 6-8% over LMRecog ≤20; CR-9 ≥7 increased specificity by 8-15%. CONCLUSIONS: : Critical item analysis enhances the classification accuracy of the optimal LMRecog cutoff (≤20).
Subject(s)
Recognition, Psychology , Adult , Humans , Neuropsychological Tests , Reproducibility of Results , Sensitivity and SpecificityABSTRACT
This study was designed to examine the potential of the Delis-Kaplan Executive System (D-KEFS) version of the Trail Making Test (TMT) as a performance validity test (PVT). Data were collected from a mixed clinical sample of 157 consecutively referred outpatients (49% male, MAge = 47.1, MEducation = 13.6) undergoing neuropsychological assessment at an academic medical center in the northeastern United States. Sensitivity and specificity of the D-KEFS Trails to psychometrically defined invalid responding was calculated across various cutoffs and criterion PVTs. The D-KEFS Trails produced classification accuracy comparable to the original version of the TMT, hovering around the "Larrabee limit" (.50 sensitivity at .90 specificity). Different cutoffs (age-corrected scaled score ≤5 on Trails 1-3, ≤4 on Trails 4 and ≤8 on Trails 5) were needed to achieve the same classification accuracy across the five trials. Combining multiple cutoffs improved the signal detection performance. The study provides preliminary evidence of the utility of D-KEFS Trails as a PVT. Embedded PVTs are valuable, because they make a multivariate approach to validity assessment feasible. Combining validity indicators is superior to relying on single cutoffs. (PsycINFO Database Record
