Assessing Social, Emotional, and Behavioral Skills in Just a Few Minutes: 96-, 45-, and 20-Item Short Forms of the BESSI.

Social, emotional, and behavioral (SEB) skills matter for individuals' well-being and success. The behavioral, emotional, and social skills inventory (BESSI) uses 192 items to assess 32 specific SEB skills across five broad skill domains. This research developed three short forms of the BESSI-192 and explored their measurement properties, predictive validity, and cross-cultural comparability. We found that BESSI-96, BESSI-45, and BESSI-20 largely captured the psychological content of the BESSI-192 measure, retained a robust multidimensional structure, and demonstrated adequate reliability. At the domain and facet level, the BESSI short forms showed patterns of associations with external criteria that were similar to the BESSI-192 and preserved most of the BESSI-192's predictive power. The BESSI short forms also demonstrated full or partial measurement invariance between the primarily U.S.-based and German adult samples. We conclude by discussing contexts in which the short forms may be useful for researchers and practitioners.

Measuring the Four Higher-Order Values in Schwartz's Theory: Validation of a 17-Item Inventory.

Schwartz's theory of basic human values is the dominant framework for assessing values. One of its strengths is that it allows for different levels of analysis. The 10 basic values can be reliably assigned to four higher-order dimensions: Openness to Change, Conservation, Self-Transcendence, and Self-Enhancement. In this paper, we examined the psychometric properties of the Higher-Order-Value Scale-17 (HOVS17), an inventory that economically assesses these higher-order values. We analyzed data from the GESIS Panel, an ongoing large-scale probability-based panel study that fields HOVS17 annually since 2013 and for which HOVS17 was originally developed. We found HOVS17 to have satisfactory psychometric properties. The 17 items were located in the two-dimensional multi-dimensional scaling (MDS) space as hypothesized. All four subscales were unidimensional, showed good fit when modeled as reflective latent variables, and had acceptable reliabilities as well as one-year test-retest stabilities (.65 to .69). The subscales correlated in theoretically plausible ways with a wide range of correlates and criteria, such as personality traits and well-being. This demonstrates that HOVS17 provides a sound basis for studying the development, precursors, and consequences of the higher-order values in the GESIS Panel and in future surveys that adopt HOVS17. We also discuss suggestions for further improvements of the inventory.

Measuring Global Character Dimensions: An Ant Colony Optimization Approach toward Three Core Strength Scales.

The Values in Action (VIA) framework encompasses 24 universally valued character strengths. Recent factor-analytic work has identified three global core strengths (metatraits) that proved to be well-interpretable and cross-culturally replicable: positivity, dependability, and mastery. However, there are no short scales to economically measure these core strengths that would encourage (large-scale) survey-based research on the global level of the VIA trait space. In the present study, we selected 18 items to measure the three metatraits from the 96-item IPIP-VIA-R inventory. To optimize the item selection while considering multiple psychometric criteria simultaneously, we made use of Ant Colony Optimization. Thereby, we obtained balanced-keyed scales that cover the heterogeneous constructs well, showed good model fit and reliability across six samples from Germany and the U.K. (total N = 2,754), and achieved scalar measurement invariance across countries. Furthermore, we demonstrated each scale's validity by locating the three core strengths in a nomological net with personality and value metatraits, life satisfaction, and behavioral criteria. Available in the public domain in English and German, these both valid and economical core strength scales may further stimulate integrative research on personality and values.

AI Psychometrics: Assessing the Psychological Profiles of Large Language Models Through Psychometric Inventories.

We illustrate how standard psychometric inventories originally designed for assessing noncognitive human traits can be repurposed as diagnostic tools to evaluate analogous traits in large language models (LLMs). We start from the assumption that LLMs, inadvertently yet inevitably, acquire psychological traits (metaphorically speaking) from the vast text corpora on which they are trained. Such corpora contain sediments of the personalities, values, beliefs, and biases of the countless human authors of these texts, which LLMs learn through a complex training process. The traits that LLMs acquire in such a way can potentially influence their behavior, that is, their outputs in downstream tasks and applications in which they are employed, which in turn may have real-world consequences for individuals and social groups. By eliciting LLMs' responses to language-based psychometric inventories, we can bring their traits to light. Psychometric profiling enables researchers to study and compare LLMs in terms of noncognitive characteristics, thereby providing a window into the personalities, values, beliefs, and biases these models exhibit (or mimic). We discuss the history of similar ideas and outline possible psychometric approaches for LLMs. We demonstrate one promising approach, zero-shot classification, for several LLMs and psychometric inventories. We conclude by highlighting open challenges and future avenues of research for AI Psychometrics.

Measuring Intellectual Curiosity across Cultures: Validity and Comparability of a New Scale in Six Languages.

Intellectual curiosity-the tendency to seek out and engage in opportunities for effortful cognitive activity-is a crucial construct in educational research and beyond. Measures of intellectual curiosity vary widely in psychometric quality, and few measures have demonstrated validity and comparability of scores across multiple languages. We analyzed a novel, six-item intellectual curiosity scale (ICS) originally developed for cross-national comparisons in the context of the OECD's Programme for the International Assessment of Adult Competencies (PIAAC). Samples from six countries representing six national languages (U.S. Germany, France, Spain, Poland, and Japan; total N = 5,557) confirmed that the ICS possesses very good psychometric properties. The scale is essentially unidimensional and showed excellent reliability estimates. On top of factorial validity, the scale demonstrated strict measurement invariance across demographic segments (gender, age groups, and educational strata) and at least partial scalar invariance across countries. As per its convergent and divergent associations with a broad range of constructs (e.g., Open-Mindedness and other Big Five traits, Perseverance, Sensation Seeking, Job Orientations, and Vocational Interests), it also showed convincing construct validity. Given its internal and external relationships, we recommend the ICS for assessing intellectual curiosity, especially in cross-cultural research applications, yet we also point out future research areas.

An English-Language adaptation and validation of the Justice Sensitivity Short Scales-8 (JSS-8).

The construct of justice sensitivity has four perspectives that capture individual differences in the strength of reactions to injustice when becoming a victim of injustice (victim sensitivity), when witnessing injustice as an outsider (observer sensitivity), when passively benefitting from an injustice done to others (beneficiary sensitivity), or when committing an injustice (perpetrator sensitivity). Individual differences in these four justice sensitivity perspectives are highly relevant in moral research. With just eight items in total, the Justice Sensitivity Short Scales-8 (JSS-8) are a very efficient way to measure the four perspectives. JSS-8 was initially constructed in German (Ungerechtigkeitssensibilität-Skalen-8, USS-8) and later translated into English. In the present study, we empirically validated this English-language adaptation in a heterogeneous quota sample from the UK. The results show that the psychometric properties (i.e., reliability, validity, standardization) of JSS-8 are good, and that they are comparable with those of the German-language source version. Because of the invariance of loadings, intercepts, and residual variances, researchers can compare manifest scale statistics (i.e., means, variances) of JSS-8 across the UK and Germany. JSS-8 is thus particularly suitable for measuring justice sensitivity in various research areas with constraints on assessment time and questionnaire space.

Why we need to abandon fixed cutoffs for goodness-of-fit indices: An extensive simulation and possible solutions.

To evaluate model fit in confirmatory factor analysis, researchers compare goodness-of-fit indices (GOFs) against fixed cutoff values (e.g., CFI > .950) derived from simulation studies. Methodologists have cautioned that cutoffs for GOFs are only valid for settings similar to the simulation scenarios from which cutoffs originated. Despite these warnings, fixed cutoffs for popular GOFs (i.e., χ2, χ2/df, CFI, RMSEA, SRMR) continue to be widely used in applied research. We (1) argue that the practice of using fixed cutoffs needs to be abandoned and (2) review time-honored and emerging alternatives to fixed cutoffs. We first present the most in-depth simulation study to date on the sensitivity of GOFs to model misspecification (i.e., misspecified factor dimensionality and unmodeled cross-loadings) and their susceptibility to further data and analysis characteristics (i.e., estimator, number of indicators, number and distribution of response options, loading magnitude, sample size, and factor correlation). We included all characteristics identified as influential in previous studies. Our simulation enabled us to replicate well-known influences on GOFs and establish hitherto unknown or underappreciated ones. In particular, the magnitude of the factor correlation turned out to moderate the effects of several characteristics on GOFs. Second, to address these problems, we discuss several strategies for assessing model fit that take the dependency of GOFs on the modeling context into account. We highlight tailored (or "dynamic") cutoffs as a way forward. We provide convenient tables with scenario-specific cutoffs as well as regression formulae to predict cutoffs tailored to the empirical setting of interest.

Aspiration-attainment gaps predict adolescents' subjective well-being after transition to vocational education and training in Germany.

An occupational aspiration-attainment gap (AAG) is defined as a discrepancy between the socioeconomic status (SES) of the aspired occupation and the one attained. We investigated how experiencing an occupational AAG after transition to vocational education and training (VET) affects three domains of subjective well-being (SWB) among adolescents in Germany (general life, job, and income satisfaction). Using longitudinal data from the German Socio-Economic Panel (SOEP), we could track respondents' SWB during the transition to and during VET. Results from latent growth curve models revealed that both under- and overachievement of aspirations (i.e., negative and positive AAGs) reduced initial levels of SWB after VET entry-especially work-related satisfaction (i.e., income and job satisfaction). Individuals with an AAG (both negative and positive) tended to experience a slightly larger increase in SWB during VET than those who met their aspirations. Overall, our results suggest that the decisive factor for adolescents' SWB is not the SES of the VET position they attain, but rather whether that position is the exact type of position to which they aspired.

Justice Evaluation of the Income Distribution (JEID): Development and validation of a short scale for the subjective assessment of objective differences in earnings.

Justice evaluations are proposed to provide a link between the objective level of inequality and the consequences at the individual and societal level. Available instruments, however, focus on the subjective perception of inequality and income distributions. In light of findings that subjective perceptions of inequality and income levels can be biased and subject to method effects, we present the newly developed Justice Evaluation of the Income Distribution (JEID) Scale, which captures justice evaluations of the actual earnings distribution. JEID comprises five items that provide respondents with earnings information for five groups at different segments along the distribution of earnings in a given country. We provide a German-language and an English-language version of the scale. The German-language version was developed and validated based on three comprehensive heterogeneous quota samples from Germany; the translated English-language version was validated in one comprehensive heterogeneous quota sample from the UK. Using latent profile analysis and k-means clustering, we identified three typical response patterns, which we labeled "inequality averse," "bottom-inequality averse," and "status quo justification." JEID was found to be related to normative orientations in the sense that egalitarian views were associated with stronger injustice evaluations at the bottom and top ends of the earnings distribution. With a completion time of between 1.50 and 2.75 min, the JEID scale can be applied in any self-report survey in the social sciences to investigate the distribution, precursors, and consequences of individuals' subjective evaluations of objective differences in earnings.

Measuring Six Facets of Curiosity in Germany and the UK: A German-Language Adaptation of the 5DCR and Its Comparability with the English-Language Source Version.

The five-dimensional curiosity-scale revised (5DCR) by Kashdan et al. (2020) is the most comprehensive curiosity inventory available to date. 5DCR measures six facets of curiosity with four items each. Here, we present a German-language adaptation of the 5DCR and comprehensively validate this adaptation in a diverse sample of adults from Germany (N = 486). Moreover, we provide new evidence on the original English-language 5DCR in a parallel sample from the UK (N = 483). In both countries, we investigate the six facets' reliability, factorial validity, and convergent and discriminant validity with a large set of individual-differences constructs. In addition, we analyze the measurement invariance of the curiosity facets across the UK and Germany and across socio-demographic subgroups defined by age, sex, and education. Findings demonstrate that the new German-language adaptation of 5DCR and its English-language source version show psychometric properties similar to the original studies by Kashdan et al. (2020) in the United States. All six curiosity facets reach at least partial scalar invariance across cultures, sex, education, and mostly also across age groups. The findings support the six-faceted theory of curiosity and show that 5DCR allows for a valid assessment of curiosity across cultures.

The impulsive behavior short scale-8 (I-8): A comprehensive validation of the English-language adaptation.

The Impulsive Behavior Short Scale-8 (I-8) measures the psychological construct of impulsivity with four subscales comprising two items each (completion time < 1 min). The aim of the present study was threefold: (1) to assess the psychometric properties (objectivity, reliability, and validity) of the English-language I-8; (2) to compare these psychometric properties with those of the original German-language source version of the scale; and (3) to test the cross-national comparability of the scale via measurement invariance tests. For this purpose, we used heterogeneous quota samples from the UK and Germany. Our results indicate that I-8 is a reliable and valid short scale with highly comparable psychometric properties across both language versions. In addition, I-8 showed a highly similar correlational pattern with various extraneous variables across the two nations. Furthermore, partial scalar invariance and full invariance of residual variances held, allowing the comparison of latent means and observed (co)variances across nations. I-8 lends itself as a measure of impulsive behavior especially in surveys in which assessment time is limited, such as in large-scale cross-national surveys.

The Behavioral, Emotional, and Social Skills Inventory (BESSI): Psychometric Properties of a German-Language Adaptation, Temporal Stabilities of the Skills, and Associations with Personality and Intelligence.

Social, emotional, and behavioral (SEB) skills comprise a broad set of abilities that are essential for building and maintaining relationships, regulating emotions, selecting and pursuing goals, or exploring novel stimuli. Toward an improved SEB skill assessment, Soto and colleagues recently introduced the Behavioral, Emotional, and Social Skills Inventory (BESSI). Measuring 32 facets from 5 domains with 192 items (assessment duration: ~15 min), BESSI constitutes the most extensive SEB inventory to date. However, so far, BESSI exists only in English. In three studies, we comprehensively validated a novel German-language adaptation, BESSI-G. Moreover, we expanded evidence on BESSI in three ways by (1) assessing the psychometric properties of the 32 individual skill facets, in addition to their domain-level structure; (2) providing first insights into the temporal stabilities of the 32 facets over 1.5 and 8 months; and (3) investigating the domains' and facets' associations with intelligence, in addition to personality traits. Results show that BESSI-G exhibits good psychometric properties (unidimensionality, reliability, factorial validity). Its domain-level structure is highly similar to that of the English-language source version. The facets show high temporal stabilities, convergent validity with personality traits, and discriminant validity with fluid and crystallized intelligence. We discuss implications for research on SEB skills.

The Internal-External Locus of Control Short Scale-4 (IE-4): A comprehensive validation of the English-language adaptation.

The Internal-External Locus of Control Short Scale-4 (IE-4) measures two dimensions of the personality trait locus of control with two items each. IE-4 was originally developed and validated in German and later translated into English. In the present study, we assessed the psychometric properties (i.e., objectivity, reliability, validity) of the English-language IE-4, compared these psychometric properties with those of the German-language source version, and tested measurement invariance across both language versions. Using heterogeneous quota samples from the UK and Germany, we find that the English-language adaptation has satisfactory reliability and plausible correlations with 11 external variables (e.g., general self-efficacy, self-esteem, impulsive behavior, Emotional Stability), which are comparable with those of the German-language source version. Moreover, metric measurement invariance of the scale holds when comparing the UK and Germany, implying the comparability of correlations based on the latent factors across the two nations. As an ultra-short scale (completion time < 30 s), IE-4 lends itself particularly to the assessment of locus of control in survey contexts in which assessment time or questionnaire space are limited. It can be applied in a variety of research disciplines, such as psychology, sociology, or economics.

Beyond Competencies: Associations between Personality and School Grades Are Largely Independent of Subject-Specific and General Cognitive Competencies.

The Big Five personality traits are established predictors of school grades. However, the mechanisms underlying these associations are not yet well understood. Effects of personality on grades might arise because behavioral tendencies facilitate learning and increase subject-specific competencies. Alternatively, personality effects on grades might be independent of cognitive competencies and reflect otherwise valued behaviors or teachers' grading practices. In the current study, we drew on large-scale data of 7th and 9th graders in Germany to explore the extent to which personality predicted grades even after accounting for competencies. Controlling for competencies and other key covariates, we cross-sectionally and longitudinally examined personality-grade associations across different school subjects, grade levels, and school types. Results indicate that the predictive power of personality is largely independent of subject-specific and general cognitive competencies. The largest effects emerged for conscientiousness. For openness, associations with grades partly overlapped with competencies, suggesting that openness may operate by fostering competencies. Overall, our results suggest that the associations between personality and grades unfold mostly independently of course mastery. This finding underlines the socioemotional value of personality in the classroom and encourages a more fine-grained view of the interplay between personality, competencies, classroom behavior, and grades.

Fluid Intelligence and Competence Development in Secondary Schooling: No Evidence for a Moderating Role of Conscientiousness.

Fluid intelligence and conscientiousness are important predictors of students' academic performance and competence gains. Although their individual contributions have been widely acknowledged, less is known about their potential interplay. Do students profit disproportionately from being both smart and conscientious? We addressed this question using longitudinal data from two large student samples of the German National Educational Panel Study. In the first sample, we analyzed reading and mathematics competencies of 3778 fourth graders (Mage = 9.29, 51% female) and gains therein until grade 7. In the second sample, we analyzed the same competencies in 4942 seventh graders (Mage = 12.49, 49% female) and gains therein until grade 9. The results of (moderated) latent change score models supported fluid intelligence as the most consistent predictor of competence levels and gains, whereas conscientiousness predicted initial competence levels in mathematics and reading as well as gains in mathematics (but not reading) only in the older sample. There was no evidence for interaction effects between fluid intelligence and conscientiousness. We found only one statistically significant synergistic interaction in the older sample for gains in reading competence, which disappeared when including covariates. Although our findings point to largely independent effects of fluid intelligence and conscientiousness on competence gains, we delineate avenues for future research to illuminate their potential interplay.

Personality Change Through Arts Education: A Review and Call for Further Research.

Education involving active engagement in the arts, herein called arts education, is often believed to foster the development of desirable personality traits and skills in children and adolescents. Yet the impact of arts education on personality development has rarely been systematically investigated. In the current article, we reviewed the literature on personality change through arts education. We identified 36 suitable experimental and quasi-experimental studies. Evidence from these studies tentatively suggests that arts-education programs can foster personality traits such as extraversion and conscientiousness but not self-esteem. In addition, the effects of arts education appeared to be stronger in early and middle childhood than in preadolescence and early adolescence. However, the evidence for the effectiveness of arts education was very limited among the few included true experiments. Furthermore, the reviewed studies were heterogenous and subject to content-related, methodological, and statistical limitations. Thus, the current evidence base is inconclusive as to the effects of arts education on personality development. By identifying potential effects of arts education and limitations of past research, our review serves as a call for more research and guidepost for future studies on arts education and personality change.

To Score or Not to Score? A Simulation Study on the Performance of Test Scores, Plausible Values, and SEM, in Regression With Socio-Emotional Skill or Personality Scales as Predictors.

This article addresses a fundamental question in the study of socio-emotional skills, personality traits, and related constructs: "To score or not to score?" When researchers use test scores or scale scores (i.e., fallible point estimates of a skill or trait) as predictors in multiple regression, measurement error in these scores tends to attenuate regression coefficients for the skill and inflate those of the covariates. Unlike for cognitive assessments, it is not fully established how severe this bias can be in socio-emotional skill assessments, that is, how well test scores recover the true regression coefficients - compared with methods designed to account for measurement error: structural equation modeling (SEM) and plausible values (PV). The different types of scores considered in this study are standardized mean scores (SMS), regression factor scores (RFS), empirical Bayes modal (EBM) score, weighted maximum likelihood estimates (WLE), and expected a posteriori (EAP) estimates. We present a simulation study in which we compared these approaches under conditions typical of socio-emotional skill and personality assessments. We examined the performance of five types of test scores, PV, and SEM with regard to two outcomes: (1) percent bias in regression coefficient of the skill in predicting an outcome; and (2) percent bias in the regression coefficient of a covariate. We varied the number of items, factor loadings/item discriminations, sample size, and relative strength of the relationship of the skill with the outcome. Results revealed that whereas different types of test scores were highly correlated with each other, the ensuing bias in regression coefficients varied considerably. The magnitude of bias was highest for WLE with short scales of low reliability. Bias when using SMS or WLE test scores was sometimes large enough to lead to erroneous research conclusions with potentially adverse implications for policy and practice (up to 55% for the regression coefficient of the skill and 20% for that of the covariate). EAP, EBM, and RFS performed better, producing only small bias in some conditions. Additional analyses showed that the performance of test scores also depended on whether standardized or unstandardized scores were used. Only PV and SEM performed well in all scenarios and emerged as the clearly superior options. We recommend that researchers use SEM, and preferably PV, in studies on the (incremental) predictive power of socio-emotional skills.

Two Forms of Social Inequality in Students' Socio-Emotional Skills: Do the Levels of Big Five Personality Traits and Their Associations With Academic Achievement Depend on Parental Socioeconomic Status?

Some researchers and policymakers advocate a stronger focus on fostering socio-emotional skills in the hope of helping students to succeed academically, especially those who are socially disadvantaged. Others have cautioned that this might increase, rather than reduce, social inequality because personality traits conducive to achievement are themselves unevenly distributed in disfavor of socially disadvantaged students. Our paper contributes to this debate. Analyzing representative, large-scale data on 9,300 ninth graders from the German National Educational Panel Study (NEPS) and using the Big Five personality traits as a measure of socio-emotional skills, we cast light on two related yet distinct aspects of social inequality in socio-emotional skills: First, do levels of personality traits conducive to achievement vary as a function of students' parental socioeconomic status (pSES)? Second, do the returns to personality traits in terms of trait-achievement relations vary as function of pSES? Results showed that differences in Big Five traits between students with different pSES were small (0.04 ≤ |r| ≤ 0.09), especially when compared with pSES-related differences in cognitive skills (fluid intelligence) and sex-related differences in personality. The returns to Conscientiousness-the personality trait most relevant to achievement-in terms of its relations to academic achievement were higher in higher- vs. lower-SES students. Trait-achievement relations did not vary as a function of pSES for the other Big Five traits. Overall, both types of inequality were limited in magnitude. We discuss the implications of these findings for policy and practice and delineate directions for further research.

Sources of individual differences in adults' ICT skills: A large-scale empirical test of a new guiding framework.

We develop an integrative conceptual framework that seeks to explain individual differences in the ability to use information and communication technologies (ICT skills). Building on practice engagement theory, this framework views the continued usage of digital technologies at work and in everyday life (ICT use) as the key prerequisite for the acquisition of ICT skills. At the same time, the framework highlights that ICT use is itself contingent upon individual and contextual preconditions. We apply this framework to data from two recent German large-scale studies (N = 2,495 and N = 2,786, respectively) that offer objective measures of adults' ICT skills. Findings support our framework's view of ICT use as a key prerequisite for ICT skills. Moreover, they demonstrate that literacy skills have strong associations with ICT skills, largely by virtue of their indirect associations through ICT use. By comparison, regional digital cultures (as proxied by internet domain registration rates) evince only limited explanatory power for individual differences in ICT skills.