All is well that replicates well: The replicability of reported moderation and interaction effects in leading organizational sciences journals.

We examine 244 independent tests of interaction effects published in recent issues of four leading journals in the organizational sciences in order to estimate the replicability of reported statistically significant interaction effects. A z-curve analysis (Brunner & Schimmack, 2020) of the distribution of p values indicates an estimated replicability of 37%, although this figure varied somewhat across the four journals. We also find that none of the coded studies reported having conducted a priori power analyses and that only one reported having preregistered their hypotheses-despite longstanding exhortations for researchers to plan their studies to have adequate power and to engage in open science practices. Our results suggest that moderation results that have been reported in these leading journals fail to meet the methodological and statistical burden that would lead us to recommend that scientists and practitioners rely on these findings to inform their research and practice. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Clarifying the association between adverse childhood experiences and postdeployment posttraumatic stress disorder symptom severity: A meta-analysis and large-sample investigation.

We report on two studies designed to shed light on the association between adverse childhood experiences (ACEs) and posttraumatic stress disorder (PTSD) symptom severity in military personnel. In particular, we examined the evidence for both additive and multiplicative associations between ACEs and combat exposure in predicting PTSD symptom severity. Study 1 was a meta-analysis of 50 samples (N > 50,000), and we found evidence for a moderate linear association between ACEs and PTSD symptom severity, ρ = .24. We also found that ACEs explained substantial variance in PTSD symptom severity after controlling for combat exposure, ΔR2 = .048. In Study 2, which is preregistered, we relied on a large sample of combat-deployed U.S. soldiers (N > 6,000) to examine evidence of a multiplicative association between ACEs and combat exposure in predicting PTSD symptom severity. In line with theoretical arguments that individuals who have experienced childhood trauma are more vulnerable to subsequent trauma exposure, we found a weak but meaningful interaction effect, ΔR2 = .00, p < .001, between ACEs and deployment-related traumatic events in the prediction of PTSD symptom severity. Implications for clinical applications and future research are discussed.

A meta-analysis on the crossover of workplace traumatic stress symptoms between partners.

Workers who are exposed to severe situations such as death, harassment, and others' suffering at work are vulnerable to symptoms of posttraumatic stress disorder (PTSD) and severe distress. This distress may extend to their intimate partners, despite their lack of firsthand experience with the traumatic stressors. Although theory and empirical research suggest that employees' traumatic distress can transmit to their partners, the magnitude of these effects and when, how, and why intimate partners develop secondary traumatic symptoms and distress are not as clear. Drawing from crossover theory as an organizing framework (Westman, 2001), our meta-analysis of 276 articles indicates that the relationship between employee PTSD/distress and spouse PTSD/distress is as strong as the relationship between employee trauma exposure and employee PTSD/distress (ρ = .26), suggesting that workers' PTSD/distress is as distressing for partners as the traumatic stressors are for workers encountering them firsthand. Our moderation tests further revealed that the trauma-exposed workers' vulnerability to traumatic stress symptoms was stronger in military than in nonmilitary settings, whereas the extent to which their symptoms crossover to their intimate partners did not vary across occupations. Mediation tests suggest that traumatic stress crossover is partially explained by the worsened quality of the couple's relationship (e.g., increased social support burden and undermining), consistent with the crossover via couple interaction explanation in crossover theory. On the other hand, there was mixed support for the mediating role of the partner's empathy, indicating further research and clarification are needed. Implications for crossover theory and practice are discussed. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

The common-sense model and mental illness outcomes: A meta-analysis.

Psychotherapists can improve their patients' outcomes during and after therapy by improving patients' self-management. Patients who do not effectively manage their mental illness generally have worse outcomes. Leventhal's Common-Sense Model of Self-Regulation theorizes that patients' perceptions of their illness (illness representations) guide their self-management, influencing health outcomes. The present study quantified the relations between illness representations, self-management and outcomes for mental illnesses. We conducted a meta-analysis and included articles if they reported (1) on adults with mental illnesses and (2) the correlation between mental illness representations and mental illness outcomes. Twenty-five articles were included which represented 28 independent samples. The pattern of correlations among illness representations (identity, consequences, timeline, control, coherence and emotional representations), self-management strategies (attendance, engagement and adherence to treatment) and mental illness outcomes (symptom severity and quality of life) was consistent with analyses from previous studies of mental and physical illnesses. The results found threat-related illness representations mostly had a large relationship with worse mental illness outcomes and self-management. Protective illness representations had a small-to-large relationship with better mental illness outcomes and self-management. The results suggest patients' perceptions of their mental illness may be a critical indicator of their mental illness outcomes, including symptom severity and quality of life. This theory-driven meta-analysis supports calls for the inclusion of illness representations in psychotherapy for mental illness.

Cultural incongruity predicts adjustment to college for student veterans.

Little is known about what predicts student service members' and veterans' (SSM/V) adjustment to college. In qualitative research, SSM/V report feeling they do not belong and are misunderstood by college communities, a phenomenon that counseling psychologists call cultural incongruity. The goal of the current study was to quantitatively examine the relationship between cultural incongruity and adjustment to college. We surveyed 814 SSM/V about their adjustment to college using the Student Adaptation to College Questionnaire. Cultural incongruity was operationalized in two ways: feelings of not belonging were measured via direct report and the association with adjustment to college assessed with regression. Feelings of being misunderstood about academic barriers were assessed by comparing SSM/V's perceptions of academic barriers and SSM/V's perceptions of how others view the SSM/V's academic barriers and the association with adjustment was assessed using polynomial regression and response surface analysis. Cultural incongruity predicted adjustment to college. After controlling for other known predictors, feelings of not belonging accounted for 18% of the variance in adjustment to college. Polynomial regression showed that feeling understood about academic barriers protected against the negative impact of the barrier on adjustment to college. Cultural incongruity predicts adjustment to college for SSM/V. Helping SSM/V feel their unique barriers to college adjustment are understood may blunt the impact of these barriers. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Using the common-sense model to understand health outcomes for medically unexplained symptoms: a meta-analysis.

Consistent with the common-sense model of self-regulation, illness representations are considered the key to improving health outcomes for medically unexplained symptoms and illnesses (MUS). Which illness representations are related to outcomes and how they are related is not well understood. In response, we conducted a meta-analysis of the relationship between illness representations, self-management/coping, and health outcomes (perceived disease state, psychological distress, and quality of life) for patients with MUS. We reviewed 23 studies and found that threat-related illness representations and emotional representations were related to worse health outcomes and more negative coping (moderate to large effect). Generally, increases in negative coping mediated (with a moderate to large effect) the relationship of threat/emotional illness representations and health outcomes. Protective illness representations were related to better health outcomes, less use of negative coping and greater use of positive coping (small to moderate effect). The relationship of protective illness representations to better health outcomes was mediated by decreases in negative coping (moderate to large effect) and increases in positive coping (moderate effect). Perceiving a psychological cause to the MUS was related to more negative health outcomes (moderate to large effect) and more negative emotional coping (small effect). The relationship of perceiving a psychological cause and more negative health outcomes was mediated by increases in negative emotional coping. Improving our understanding of how illness representations impact health outcomes can inform efforts to improve treatments for MUS. Our results suggest behavioural treatments should focus on reducing threat-related illness representations and negative coping.

Shall we serve the dark lords? A meta-analytic review of psychopathy and leadership.

Both scholars and the popular press have expressed concern regarding the potential prevalence of individuals with psychopathic tendencies in corporate leadership positions and the negative effects they may have on both individual workers and their organizations as a whole. However, research to date has been inconclusive as to whether such individuals are more likely to emerge as leaders or whether they are (in)effective leaders. To clarify the state of the literature, we conducted a meta-analysis on the association between psychopathic personality characteristics and leadership emergence, leadership effectiveness, and transformational leadership. Our results, based on data from 92 independent samples, showed a weak positive correlation for psychopathic tendencies and leadership emergence, a weak negative association for psychopathic tendencies and leadership effectiveness, and a moderate negative correlation for psychopathic tendencies and transformational leadership. Subgroup analyses on methodological factors did not indicate any differences from the main results. However, moderator analyses showed a gender difference in these associations such that psychopathic tendencies in men were weakly positively correlated with leadership emergence and effectiveness and negatively correlated with transformational leadership, while psychopathic tendencies in women were negatively associated with effectiveness and transformational leadership, and largely unassociated with emergence. In addition, small but consistent curvilinear associations were found for all leadership criteria. Overall, these results suggest that concern over psychopathic tendencies in organizational leaders may be overblown, but that gender can function to obscure real effects. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

The structure of group task performance-A second look at "collective intelligence": Comment on Woolley et al. (2010).

Collective intelligence has been described as a general factor that "explains a group's performance on a wide variety of tasks" (Woolley, Chabris, Pentland, Hashmi, & Malone, 2010, p. 686), much like the general intelligence factor explains individuals' performance on cognitive ability tasks. This construct has received widespread attention in both the media and academic community. In this article we reexamine the data from 6 previously published samples that have been used to examine the existence of the collective intelligence construct and show that the empirical support for the construct is generally weak. Specifically, we show that the general factor explains only little variance in the performance on many group tasks. We also highlight how 2 statistical artifacts-the apparent presence of low effort responding and the nested nature of the data-may also have inflated the little covariation that exists between group performance on different tasks. These findings suggest that there is insufficient support for the existence of a collective intelligence construct. (PsycINFO Database Record

Two is more valid than one: Examining the factor structure of the Self-Compassion Scale (SCS).

The Self-Compassion Scale (SCS; Neff, 2003a) is the most widely used measure of self-compassion. Self-compassion, as measured by the SCS, is robustly linked to psychological health (Macbeth & Gumley, 2012; Zessin, Dickhaüser, & Garbade, 2015). The SCS is currently understood as exhibiting a higher-order structure comprised of 6 first-order factors and 1 second-order general self-compassion factor. Recently, some researchers have questioned the internal validity of this 1-factor conceptualization, and posit that the SCS may instead be comprised of 2 general factors-self-compassion and self-coldness. The current paper provides an in-depth examination of the internal structure of the SCS using oblique, higher-order, and bifactor structural models in a sample of 1,115 college students. The bifactor model comprised of 2 general factors-self-compassion and self-coldness-and 6 specific factors demonstrated the best fit to the data. Results also indicated the Self-Coldness factor accounted for unique variance in depression, anxiety, and stress, whereas the Self-Compassion factor only accounted for unique variance in its association with depression, providing further evidence for the presence of 2 distinct factors. Results did not provide support for the 1-factor composition of self-compassion currently used in research. Implications for using, scoring, and interpreting the SCS are discussed. (PsycINFO Database Record

How distinctive are morningness and eveningness from the Big Five factors of personality? A meta-analytic investigation.

This study explores relations between measures of individuals' circadian preferences and the Big Five. To this end, we compared a model of circadian preferences that acknowledges morningness (M) and eveningness (E) as separate dimensions to that of a model that places M and E on a single continuum (M-E). Analyses of 620 correlations from 44 independent samples (N = 16,647) revealed weak to modest relations between both dimensions of circadian preferences and the Big Five personality traits. The strongest observed relation was found between Conscientiousness and M (ρ = .37). In the next step, regression analyses revealed that personality traits accounted for between 10.9% and 16.4% of the variance in circadian preferences. Of all the Big Five dimensions, Conscientiousness exhibited the strongest unique relation with M (ß = .32), E (ß = -.26), and M-E (ß = .32). Extraversion and Openness exhibited moderate unique relations with E (ß = .23 and ß = .17, respectively), whereas relations with M (ß = .00 and ß = .04), and M-E (ß = -.05 and ß = -.06) were relatively weak. Neuroticism exhibited a modest unique and negative relation with M (ß = -.16), and Agreeableness was largely unrelated to all circadian preference variables. To determine whether these findings translated into anything of applied significance, we explored relations between circadian preference and academic performance. M and E incremented slightly over the Big Five factors in predicting grade-point average. Theoretical and practical implications of these findings are discussed. (PsycINFO Database Record

Much ado about grit: A meta-analytic synthesis of the grit literature.

Grit has been presented as a higher order personality trait that is highly predictive of both success and performance and distinct from other traits such as conscientiousness. This paper provides a meta-analytic review of the grit literature with a particular focus on the structure of grit and the relation between grit and performance, retention, conscientiousness, cognitive ability, and demographic variables. Our results based on 584 effect sizes from 88 independent samples representing 66,807 individuals indicate that the higher order structure of grit is not confirmed, that grit is only moderately correlated with performance and retention, and that grit is very strongly correlated with conscientiousness. We also find that the perseverance of effort facet has significantly stronger criterion validities than the consistency of interest facet and that perseverance of effort explains variance in academic performance even after controlling for conscientiousness. In aggregate our results suggest that interventions designed to enhance grit may only have weak effects on performance and success, that the construct validity of grit is in question, and that the primary utility of the grit construct may lie in the perseverance facet. (PsycINFO Database Record

Assessing the Utility of Compound Trait Estimates of Narrow Personality Traits.

It has been argued that approximations of narrow traits can be made through linear combinations of broad traits such as the Big Five personality traits. Indeed, Hough and Ones ( 2001 ) used a qualitative analysis of scale content to arrive at a taxonomy of how Big Five traits might be combined to approximate various narrow traits. However, the utility of such compound trait approximations has yet to be established beyond specific cases such as integrity and customer service orientation. Using data from the Eugene-Springfield Community Sample (Goldberg, 2008 ), we explore the ability of linear composites of scores on Big Five traits to approximate scores on 127 narrow trait measures from 5 well-known non-Big-Five omnibus measures of personality. Our findings indicate that individuals' standing on more than 30 narrow traits can be well estimated from 3 different types of linear composites of scores on Big Five traits without a substantial sacrifice in criterion validity. We discuss theoretical accounts for why such relationships exist as well as the theoretical and practical implications of these findings for researchers and practitioners.

The Believability of Anxious Feelings and Thoughts Questionnaire (BAFT): a psychometric evaluation of cognitive fusion in a nonclinical and highly anxious community sample.

Cognitive fusion--or the tendency to buy into the literal meaning of thoughts, feelings, and bodily sensations--plays an important role in the etiology and maintenance of anxiety disorders and figures prominently in third-generation behavior therapies such as acceptance and commitment therapy (ACT). Nonetheless, there is a lack of validated self-report measures of cognitive fusion/defusion, particularly in the area of anxiety disorders. We attempted to fill this gap with the development and validation of a self-report cognitive fusion measure, the Believability of Anxious Feelings and Thoughts Questionnaire (BAFT), in both a healthy undergraduate sample (N = 432) and highly anxious community sample (N = 503) undergoing a 12-week online ACT intervention. Results suggested a hierarchical factor structure of the BAFT with three lower order factors and one hierarchical factor and excellent internal consistency for the total BAFT score (i.e., αs = .90 and .91 for the undergraduate and highly anxious samples, respectively) and for its factors. Additionally, the BAFT and all of its factors consistently showed strong construct validity with other relevant process and outcome measures in both samples, strong 12-week test-retest reliability (r = .77) in our highly anxious waitlist control subsample and responsiveness to treatment in our highly anxious intervention subsample. These findings suggest that the BAFT is a reliable and valid measure of cognitive fusion in both healthy and clinical populations.

An evaluation of the consequences of using short measures of the Big Five personality traits.

Researchers often use very abbreviated (e.g., 1-item, 2-item) measures of personality traits due to their convenience and ease of use as well as the belief that such measures can adequately capture an individual's personality. Using data from 2 samples (N = 437 employees, N = 355 college students), we show that this practice, particularly the use of single-item measures, can lead researchers to substantially underestimate the role that personality traits play in influencing important behaviors and thereby overestimate the role played by new constructs. That is, the use of very short measures of personality may substantially increase both the Type 1 and Type 2 error rates. We argue that even slightly longer measures can substantially increase the validity of research findings without significant inconvenience to the researcher or research participants.

Reference group effects in the measurement of personality and attitudes.

Reference-group effects (discovered in cross-cultural settings) occur when responses to self-report items are based not on respondents' absolute level of a construct but rather on their level relative to a salient comparison group. In this article, we examine the impact of reference-group effects on the assessment of self-reported personality and attitudes. Two studies illustrate that a reference-group effect can be induced by small changes to instruction sets, changes that mirror the instruction sets of commonly used measures of personality. Scales that specified different reference groups showed substantial reductions in criterion-related validities for academic performance, self-reported counterproductive behaviors, and self-reported health outcomes relative to reference-group-free versions of those scales.

Study Habits, Skills, and Attitudes: The Third Pillar Supporting Collegiate Academic Performance.

Study habit, skill, and attitude inventories and constructs were found to rival standardized tests and previous grades as predictors of academic performance, yielding substantial incremental validity in predicting academic performance. This meta-analysis (N = 72,431, k = 344) examines the construct validity and predictive validity of 10 study skill constructs for college students. We found that study skill inventories and constructs are largely independent of both high school grades and scores on standardized admissions tests but moderately related to various personality constructs; these results are inconsistent with previous theories. Study motivation and study skills exhibit the strongest relationships with both grade point average and grades in individual classes. Academic specific anxiety was found to be an important negative predictor of performance. In addition, significant variation in the validity of specific inventories is shown. Scores on traditional study habit and attitude inventories are the most predictive of performance, whereas scores on inventories based on the popular depth-of-processing perspective are shown to be least predictive of the examined criteria. Overall, study habit and skill measures improve prediction of academic performance more than any other noncognitive individual difference variable examined to date and should be regarded as the third pillar of academic success.

The multidimensional nature of ageism: construct validity and group differences.

The authors investigated the factor structure and construct validity of the Fraboni Scale of Ageism and the age and gender differences in ageism scores. Confirmatory factor analyses supported the multidimensional nature of FSA scores and generally corroborated the initial factor structure reported by M. Fraboni, with some notable exceptions. Essentially, the present findings were aligned with theoretical models of ageism that emphasize both cognitive facets and affective facets. That is, on the basis of their factor analytic findings, the authors redefined Fraboni's original factors of Antilocution, Avoidance, and Discrimination as Stereotypes, Separation, and Affective Attitudes, respectively, because of the clustering of items within factors. The revised 3-factor structure accounted for 36.4% of the variance in FSA scores. FSA factor scores significantly related to other scores from other measures of age-related attitudes, with higher correlations among factors that were similar in terms of their cognitive nature versus their affective nature. Finally, younger individuals and men had significantly higher ageism scores on the FSA than older individuals and women. The authors discussed the importance of adequately assessing ageism, with particular emphasis devoted to the understanding of age bias.