Development and initial validation of the Scale of Scales (SOS) overreporting scores for the MMPI family of instruments.

Overreporting is a common problem that complicates psychological evaluations. A challenge facing the effective detection of overreporting is that many of the identified strategies (e.g., symptom severity approaches; see Rogers & Bender, 2020) are not incorporated into broadband measures of personality and psychopathology (e.g., Minnesota Multiphasic Personality Inventory family of instruments). While recent efforts have worked to incorporate some of these newer strategies, no such work has been conducted on the MMPI-3. For instance, recent symptom severity approaches have been used to identify patterns of multivariate base rate "skyline" elevations on the BASC, and similar strategies have been adopted into the PAI to measure psychopathology (Multi-Feigning Index; Gaines et al., 2013) and cognitive symptoms (Cognitive Bias Scale of Scales; Boress et al., 2022b). This study used data from a simulation study (n = 318) and an Active-Duty (AD) clinical sample (n = 290) to develop and cross-validate such a scale on the MMPI-2-RF and MMPI-3. Results suggest that the MMPI SOS (Scale of Scales) scores perform equitably to existing measures of overreporting on the MMPI-2-RF and MMPI-3 and incrementally predict a PVT-classified "known-group" of Active Duty service members. Effects were generally large in magnitude. Classification accuracy achieved desired specificity (.90) and approximated expected sensitivity (.30). Implications of these findings are discussed, which emphasize how alternative overreporting detection strategies may be useful to consider for the MMPI. These alternative strategies have room for expansion and refinement.

Cross validation of the response bias scale and the response bias scale-19 in active-duty personnel: use on the MMPI-2-RF and MMPI-3.

The Response Bias Scale (RBS) is the central measure of cognitive over-reporting in the MMPI-family of instruments. Relative to other clinical populations, the research evaluating the detection of over-reporting is more limited in Veteran and Active-Duty personnel, which has produced some psychometric variability across studies. Some have suggested that the original scale construction methods resulted in items which negatively impact classification accuracy and in response crafted an abbreviated version of the RBS (RBS-19; Ratcliffe et al., 2022; Spencer et al., 2022). In addition, the most recent edition of the MMPI is based on new normative data, which impacts the ability to use existing literature to determine effective cut-scores for the RBS (despite all items having been retained across MMPI versions). To date, no published research exists for the MMPI-3 RBS. The current study examined the utility of the RBS and the RBS-19 in a sample of Active-Duty personnel (n = 186) referred for neuropsychological evaluation. Using performance validity tests as the study criterion, we found that the RBS-19 was generally equitably to RBS in classification. Correlations with other MMPI-2-RF over- and under-reporting symptom validity tests were slightly stronger for RBS-19. Implications and directions for research and practice with RBS/RBS-19 are discussed, along with implications for neuropsychological assessment and response validity theory.

Determining the MMPI-3 SUI scale's cross-sectional and prospective utility in suicide risk assessment.

OBJECTIVE: In-depth suicide risk assessments are particularly important to long-term suicide prevention. Broadband measures of psychopathology, such as the Minnesota Multiphasic Personality Inventory (MMPI) instruments, assess suicide risk factors and various mental health comorbidities. With the recent release of the MMPI-3, the Suicidal/Death Ideation (SUI) scale underwent revisions to improve its construct validity and detection of suicide risk factors. Thus, we hypothesized the MMPI-3 SUI scale would demonstrate medium to large associations with suicidal experience and behaviors, future ideation, and interpersonal risk factors of suicide. METHODS: A sample of 124 college students screened for elevated depressive symptoms completed a brief longitudinal study. Participants completed a baseline session including the MMPI-3 and criterion measures and three brief follow-ups every 2 weeks. RESULTS: SUI scores were most robustly associated with increased risk for past suicidal ideation, planning, and perceived burdensomeness. Prospectively assessed suicidal ideation was also meaningfully associated with SUI. SUI scale elevations indicate an increased risk of suicide-related risk factors. CONCLUSION: The MMPI-3 is a valuable tool to inform long-term suicide prevention for those experiencing elevated depressive symptoms as the SUI scale can assess past, current, and future suicide-related risk factors, including suicidal ideation and behaviors.

Evaluation of telehealth administration of MMPI symptom validity scales.

INTRODUCTION: Telehealth assessment (TA) is a quickly emerging practice, offered with increasing frequency across many different clinical contexts. TA is also well-received by most patients, and there are numerous guidelines and training opportunities which can support effective telehealth practice. Although there are extensive recommended practices, these guidelines have rarely been evaluated empirically, particularly on personality measures. While existing research is limited, it does generally support the idea that TA and in-person assessment (IA) produce fairly equitable test scores. The MMPI-3, a recently released and highly popular personality and psychopathology measure has been the subject of several of those experimental or student (non-client) based studies; however, no study to date has evaluated these trends within a clinical sample. This study empirically tests for differences in TA and IA test scores on the MMPI-3 validity scores when following recommended administration procedures. METHOD: Data were from a retrospective chart review. Veterans (n = 550) who underwent psychological assessment in a Veterans Affairs Medical Center ADHD evaluation clinic were contrasted between in person and telehealth assessment modalities on the MMPI-2-RF and MMPI-3. Groups were compared using t tests, chi square, and base rates. RESULTS: Results suggest that there were minimal differences in elevation rates or mean scores across modality, supporting the use of TA. CONCLUSIONS: This study's findings support the use of the MMPI via TA with ADHD evaluations, Veterans, and in neuro/psychological evaluation settings more generally. Observed elevation rates and mean scores of this study were notably different from those seen in other VA service clinics sampled nationally, which is an area of future investigation.

Assessment of PTSD and Trauma Symptoms With the MMPI-3 in College Students: Validity and Incremental Utility of the Anxiety Related Experiences (ARX) Scale.

Post Traumatic Stress Disorder (PTSD) is heterogeneous in nature, which complicates diagnostic efforts and makes accurate assessment tools critical. The MMPI family of instruments are widely used broadband measures of psychopathology, including trauma symptomology. The MMPI-3's Anxiety Related Experiences scale (ARX) is an expansion of the MMPI-2-RF Anxiety (AXY) scale which has historically represented the MMPI family's best measure of trauma symptoms. This study expands research on ARX in 2 samples of college students (n = 332 [PCL-5 Criterion] & n = 58 [CAPS-5 Criterion]) by examining ARX's incremental, criterion, and classification validity. ARX incrementally predicted PCL-5 total and cluster scores beyond that accounted for by AXY (R2Δ = .01-.09). ARX accounted for the most unique variance, beyond RCd and RC7, in CAPS-5 interview ratings of intrusion symptoms (R2Δ = .16). ARX was strongly related to trauma symptomology broadly (r = .42-.58) and demonstrated strong screening ability at T65 (sensitivity = .37-.40; specificity = .91-.92) and stronger diagnostic screening at T75 (sensitivity = .31; specificity = .93). We discuss clinical considerations when using ARX for assessing PTSD.

Cross validation of the Personality Assessment Inventory (PAI) Cognitive Bias Scale of Scales (CB-SOS) over-reporting indicators in a military sample.

Following the development of the Cognitive Bias Scale (CBS), three other cognitive over-reporting indicators were created. This study cross-validates these new Cognitive Bias Scale of Scales (CB-SOS) measurements in a military sample and contrasts their performance to the CBS. We analyzed data from 288 active-duty soldiers who underwent neuropsychological evaluation. Groups were established based on performance validity testing (PVT) failure. Medium effects (d = .71 to .74) were observed between those passing and failing PVTs. The CB-SOS scales have high specificity (≥.90) but low sensitivity across the suggested cut scores. While all CB-SOS were able to achieve .90, lower scores were typically needed. CBS demonstrated incremental validity beyond CB-SOS-1 and CB-SOS-3; only CB-SOS-2 was incremental beyond CBS. In a military sample, the CB-SOS scales have more limited sensitivity than in its original validation, indicating an area of limited utility despite easier calculation. The CBS performs comparably, if not better, than CB-SOS scales. CB-SOS-2's differences in performance in this study and its initial validation suggest that its psychometric properties may be sample dependent. Given their ease of calculation and relatively high specificity, our study supports the interpretation of elevated CB-SOS scores indicating those who are likely to fail concurrent PVTs.

Investigating the Validity of the MMPI-3 Eating Concerns (EAT) scale across Men and Women in a University Sample.

Disordered eating is a major health epidemic that occurs at disproportionate rates among young adults and for which gender plays a major role in symptom presentation. Broadband psychological instruments have historically not included disordered eating as a core scale construct. The recent release of the Minnesota Multiphasic Personality Inventory-3 (MMPI-3) offers an opportunity to address this shortcoming through the newly developed Eating Concerns Scale (EAT) for which the existing literature is promising but limited. This study expands research on EAT by investigating its validity and comparing findings across gender. In 345 college students (102 men, 243 women), we examined gender differences between men and women in the EAT scale's structure, item endorsement rates, mean scores, and correlations with measures of body image and eating pathology. Differences emerged in item endorsement rate, scale score elevation rate, and correlation magnitudes. Broadly, findings further support EAT's use in detecting eating pathology and highlight ways in which the EAT scale may not effectively capture masculine expressions of eating pathology, namely binging and purging behaviors. To assess eating pathology more comprehensively, clinicians and researchers should consider including assessments of eating pathology inclusive of masculine eating patterns. Limitations and future research directions are also discussed.

Contrasting MMPI-3 validity scale effectiveness differences across in-person and telehealth administration procedures.

Psychological assessment underwent substantive challenges and changes when the COVID-19 pandemic began, and these changes are likely to endure given the rapid growth of telehealth clinical practice and assessment research using virtual procedures. COVID-19-related changes to assessment practices have impacted accordingly how we study overreporting scale functioning, including the modality through which we administer measures. No available research provides direct comparisons of overreporting scale effectiveness within simulation research across in-person and telehealth modalities, despite early support for novel instruments relying on remote procedures within the historic context of the pandemic. We used simulated feigning conditions collected using best telehealth practices to examine if, and how, overreporting scales differed in effectiveness by evaluating mean scores, elevation rates, and classification accuracy statistics, relative to parallel in-person conditions. Results indicate no meaningful differences in scale effectiveness, particularly when exclusion procedures included a posttest questionnaire. Our findings support telehealth assessment practice and the integration of research collected virtually into the traditional, in-person feigning literature. Limitations and future directions are discussed. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Screening Utility of the PHQ-2 and PHQ-9 for Depression in College Students: Relationships with Substantive Scales of the MMPI-3.

We investigated the validity and screening effectiveness of the PHQ-2 and PHQ-9 scores in 229 college students in a cross-sectional design. PHQ associations with Minnesota Multiphasic Personality Inventory-3 internalizing scales suggest PHQ scores are effective screening tools for college students and may aid in effective triage and service needs.

Evaluating Personality Assessment Inventory Response Patterns in Active-Duty Personnel With Head Injury Using a Latent Class Approach.

OBJECTIVE: Previous research has found that among those with brain injury, individuals have a variety of different potential symptom sets, which will be seen on the Personality Assessment Inventory (PAI). The number of different groups and what they measure have varied depending on the study. METHOD: In active-duty personnel with a remote history of mild traumatic brain injury (n = 384) who were evaluated at a neuropsychology clinic, we used a retrospective database to examine if there are different groups of individuals who have distinct sets of symptoms as measured on the PAI. We examined the potential of distinct groups of respondents by conducting a latent class analysis of the clinical scales. Post hoc testing of group structures was conducted on concurrently administered cognitive testing, performance validity tests, and the PAI subscales. RESULTS: Findings indicate a pattern of broad symptom severity as the most probable reason for multiple groups of respondents, suggesting that there are no distinct symptom sets observed within this population. Pathology levels were the most elevated on internalizing and thought disorder scales across the various class solutions. CONCLUSION: Findings indicate that among active-duty service members with remote brain injury, there are no distinct groups of respondents with different sets of symptom types as has been found in prior work with other neuropsychology samples. We conclude that the groups found are likely a function of general psychopathology present in the population/sample rather than bona fide differences.

Validation of the personality assessment inventory (PAI) cognitive bias (CBS) and cognitive bias scale of scales (CB-SOS) in a post-deployment veteran sample.

Objective: The present study evaluated the function of four cognitive, symptom validity scales on the Personality Assessment Inventory (PAI), the Cognitive Bias Scale (CBS) and the Cognitive Bias Scale of Scales (CB-SOS) 1, 2, and 3 in a sample of Veterans who volunteered for a study of neurocognitive functioning. Method: 371 Veterans (88.1% male, 66.1% White) completed a battery including the Miller Forensic Assessment of Symptoms Test (M-FAST), the Word Memory Test (WMT), and the PAI. Independent samples t-tests compared mean differences on cognitive bias scales between valid and invalid groups on the M-FAST and WMT. Area under the curve (AUC), sensitivity, specificity, and hit rate across various scale point-estimates were used to evaluate classification accuracy of the CBS and CB-SOS scales. Results: Group differences were significant with moderate effect sizes for all cognitive bias scales between the WMT-classified groups (d = .52-.55), and large effect sizes between the M-FAST-classified groups (d = 1.27-1.45). AUC effect sizes were moderate across the WMT-classified groups (.650-.676) and large across M-FAST-classified groups (.816-.854). When specificity was set to .90, sensitivity was higher for M-FAST and the CBS performed the best (sensitivity = .42). Conclusion: The CBS and CB-SOS scales seem to better detect symptom invalidity than performance invalidity in Veterans using cutoff scores similar to those found in prior studies with non-Veterans.

Comparison of the Memory Complaints Inventory and the PAI Cognitive Bias Scale in a Military Sample.

OBJECTIVE: The Memory Complaints Inventory (MCI) is a stand-alone memory-based symptom validity test (SVT). The measure is promising and has been used with relative frequency, but requires additional research (Armistead-Jehle & Shura, 2022). The current study sought to expand the empirical base of the MCI by comparing it to the Cognitive Bias Scale, a new symptom validity measure assessing cognitive over reporting on the Personality Assessment Inventory (PAI). METHOD: Retrospective review of 273 military service members seen for neuropsychological evaluation and administered both the PAI and MCI. RESULTS: Area under the curve values for the MCI overall mean score and MCI implausible scales for a PAI Cognitive Bias Scale (CBS) cut score of >14 were large in effect (0.77 and 0.78, respectively). The effect size between those that passed and failed the CBS on the mean of MCI scales was also large (d = 1.13). Classification statistics indicated that a cut score of 52% on the mean MCI scales and 29% on the mean MCI implausible subscales indicated specificities of 0.94 and 0.93 and sensitivities of 0.30 and 0.29, respectively. CONCLUSIONS: These data support the MCI as a cognitive SVT relative to the PAI CBS. We offer guidance on how to integrate these SVT measures in military samples.

Doctoral students' intention to use assessments in their career: The incremental role of self-reported competence.

OBJECTIVE: Attaining competence in assessment is a necessary step in graduate training and has been defined to include multiple domains of training relevant to this attainment. While important to ensure trainees meet these standards of training, it is critical to understand how and if competence shapes a trainees' professional identity, therein promoting lifelong competency. METHODS: The current study assessed currently enrolled graduate trainees' knowledge and perception of their capabilities related to assessment to determine if self-reported and performance-based competence would incrementally predict their intention to use assessment in their future above basic training characteristics and intended career interests. RESULTS: Self-reported competence, but not performance-based competence, played an incremental role in trainees' intention to use assessments in their careers. Multiple graduate training characteristics and practice experiences were insignificant predictors after accounting for other relative predictors (i.e., intended career settings, integrated reports). CONCLUSION: Findings are discussed about the critical importance of incorporating a hybrid competency-capability assessment training framework to further emphasize the role of trainee self-efficacy in hopes of promoting lifelong competence in their continued use of assessments.

Predicting Parental Mental Health During COVID-19: Economic Pressure, COVID-19 Stress, and Coping Strategies.

As the COVID-19 pandemic continues, understanding connections between economic pressures and mental health experiences is critical in comprehending how stressful global events can affect families. Although economic pressures and stress can negatively impact mental health, approach coping strategies may provide reductions in negative mental health experiences for parents compared to avoidant coping strategies. Despite recent work showing that stress resulting from the pandemic can have negative implications for the mental health of parents with young children, there is little known about the mental health of parents with adolescents. This study utilized a longitudinal sample of 198 parents (194 biological parents; 103 Fathers, and 91 Mothers) of adolescents and examined the mediating impact of COVID-19 stress on the relationship between economic pressure and subsequent depressive and anxious symptoms. Additionally, approach and avoidant coping strategies were examined as potential moderators between COVID-19 stress and later mental health. Results indicated that parents who experienced economic pressure reported worsening mental health across the school semester, with COVID-19 stress mediating this pathway. Further, approach coping strategies moderated the association between COVID-19 stress and later anxiety symptoms such that higher levels of coping associated with greater rates of later anxiety symptoms, while lower levels of coping associated with less anxiety symptoms later. Avoidant coping strategies also moderated these associations, such that greater use associated with greater depressive and anxious symptomology later. These findings emphasize that parents are experiencing worsening mental health following the onset of the pandemic and that there is an urgent need for increased mental health services to assist families during this time.

Evaluating the performance of the MMPI-3 over-reporting scales: Sophisticated simulators and the effects of comorbid conditions.

OBJECTIVE: We examined the utility of the Minnesota Multiphasic Personality Inventory-3 (MMPI-3) to detect feigned over-reporting using a symptom-based coaching simulation design across a control group and three diagnostic conditions: posttraumatic stress disorder (PTSD), minor traumatic brain injury (mTBI), and comorbid PTSD and mTBI. METHOD: Participants were310 college students who wererandomly assigned to one of the four conditions. For participants in the feigning conditions, they were provided with a descriptionof their respective disorder condition throughout the duration of the session and asked to feign according to their condition while completing the MMPI-3. RESULTS: MMPI-3 over-reporting scales perform well at classifying feigning. There is low sensitivity, high specificity, and effect magnitudes are medium to large range (1.12 - 2.47). There are no differences in scales assessing over-reporting between diagnostic conditions with dissimilar symptoms. CONCLUSIONS: Findings provide initial support for the use of the MMPI-3 overreporting scales for detecting feigned PTSD, mTBI, and comorbid PTSD and mTBI. Further, individuals feigning different disorders, namely PTSD, mTBI, and comorbid PTSD and mTBI, feign predominantly general psychopathological symptoms, making Fp the strongest scale in terms of detecting these feigned disorders. Future research will benefit from establishing relevant diagnostic comparison groups to contrast with this study and utilizing known-group designs withboth PVT and SVT administration.

The Influence of Service Era: Comparing Personality Assessment Inventory (PAI) Scale Scores Within a Posttraumatic Stress Disorder Treatment Clinic (PCT).

Research is mixed on the role of service era in symptom endorsement among Veterans, with differences emerging depending on the instrument evaluated. This study compares Personality Assessment Inventory (PAI) scale scores of VA test-takers who served during the Vietnam, Desert Storm, or Post-9/11 service eras. The sample was collected at a VA Posttraumatic Stress Disorder Clinical Team. Associations between gender and combat exposure were also examined as covariates. Results suggest that Veterans' self-report on the PAI is influenced by service era, even after accounting for gender and combat exposure during deployment. The largest differences were between Vietnam or Post-9/11 Veterans and those from the Gulf War era. Symptom differences typically varied across scales commonly associated with symptoms of trauma exposure/posttraumatic stress disorder. Implications for the clinical use of, and research with, the PAI and other broadband personality assessments within the VA healthcare system and trauma treatment settings are discussed.

Relationship of Personality Assessment Inventory (PAI) over-reporting scales to performance validity testing in a military neuropsychological sample.

This study evaluated the Personality Assessment Inventory's (PAI) symptom validity-based over-reporting scales with concurrently administered performance validity testing in a sample of active-duty military personnel seen within a neuropsychology clinic. We utilize two measures of performance validity to identify problematic performance validity (pass all/fail any) in 468 participants. Scale means, sensitivity, specificity, predictive value, and risk ratios were contrasted across symptom validity-based over-reporting scales. Results indicate that the Negative Impression Management (NIM), Malingering Index (MAL), and Multiscale Feigning Index (MFI) scales are the best at classifying failed performance validity testing with medium to large effects (d = .61-.73). In general, these scales demonstrated high specificity and low sensitivity. Roger's Discriminant Function (RDF) had negligible group differences and poor classification. The Feigned Adult ADHD index (FAA) performed inconsistently. This study provides support for the use of several PAI over-reporting scales at detecting probable patterns of performance-based invalid responses within a military sample. Military clinicians using NIM, MAL, or MFI are confident that those who elevate these scales at recommended cut scores are likely to fail concurrent performance validity testing. Use of the Feigned Adult FAA and RDF scales is discouraged due to their poor or mixed performance.

Applicant factors contributing to interview selection, ranking determination, and judgement of "Fit" among health service psychology internship training programs.

BACKGROUND: The predoctoral internshipAQ4 training year is the capstone training experience for health service doctoral students. Previous research has explored what applicant characteristics are desired by internship sites and has not thoroughly explored differences between types of sites or criteria importance at different stages of applicant consideration (interview vs. ranking). AIMS: We evaluate current perceptions of doctoral student internship applications by training directors. MATERIALS AND METHODS: Internship training directors of APA-accredited sites report on the importance of different application materials during interview and ranking decisions. We also compare these rankings across site types. RESULTS: Results indicate that internship sites were generally consistent in their criteria rankings; however, there were also some differences. Intern applicant "fit" continues to be the most important criteria by which applicants are judged at all stages of consideration. Qualitative analysis found that "fit" varied by site across themes of treatment, applicant, and site characteristics. DISCUSSION: We discuss implications in their preparation of internship applications. In addition to the practical guidance for students, we discuss how program changes can increase applicant site competitiveness.

Examining admission and formation outcomes for Catholic clergy applicants with the MMPI-2-RF: A prospective study.

Psychological evaluations of clergy applicants to the Catholic Church are an important gatekeeping mechanism during the admission process. However, limited research exists on the validity of assessments for this evaluative purpose and none have examined the predictive utility of the MMPI-2-RF to determine if an applicant will be accepted to formation, or if they ultimately ordained. This study fills that gap in the literature by investigating the predictive validity of MMPI-2-RF scales in 147 male applicants evaluated as part of their application for seminary or diaconate formation programs in a mid-sized Catholic diocese in the United States. Group analyses (e.g., Kruskal-Wallis tests) with admission status as the independent variable and MMPI-2-RF scales as the dependent variables yielded significant differences, most notably, those participants not admitted had higher mean scores on F-r, Fp-r, EID, RC7, THD, RC8, RC1, MLS, NUC, and JCP than the other three groups. Relative risk ratios were estimated for all MMPI-2-RF scales, indicating that higher scores are generally associated with a lower likelihood of admission and, ultimately, ordination. Limitations and future directions of research are also discussed. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

External Correlates of the MMPI-2-Restructured Form across a National Sample of Veterans.

This study examines the convergent validity of the substantive scales of the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) in the Veteran Affairs (VA) population. The sample includes test protocols drawn from all administrations of the MMPI-2-RF or MMPI-2 entered into the electronic medical record system between January 1, 2008 and May 31, 2015 at any VA across the United States. After excluding invalid protocols, substantive scale scores were correlated with external measures of depression, anxiety, and posttraumatic stress disorder if they were administered within |14| days of the MMPI-2/-RF. Results supported the convergent validity of the MMPI-2-RF emotional dysfunction domain scores. Discriminant validity for the remaining MMPI-2-RF substantive scale scores was also adequate. Limitations and implications of these findings are discussed.