The Effects of Questionnaire Length on the Relative Impact of Response Styles in Ambulatory Assessment.

Ambulatory assessment (AA) is becoming an increasingly popular research method in the fields of psychology and life science. Nevertheless, knowledge about the effects that design choices, such as questionnaire length (i.e., number of items per questionnaire), have on AA data quality is still surprisingly restricted. Additionally, response styles (RS), which threaten data quality, have hardly been analyzed in the context of AA. The aim of the current research was to experimentally manipulate questionnaire length and investigate the association between questionnaire length and RS in an AA study. We expected that the group with the longer (82-item) questionnaire would show greater reliance on RS relative to the substantive traits than the group with the shorter (33-item) questionnaire. Students (n = 284) received questionnaires three times a day for 14 days. We used a multigroup two-dimensional item response tree model in a multilevel structural equation modeling framework to estimate midpoint and extreme RS in our AA study. We found that the long questionnaire group showed a greater reliance on RS relative to trait-based processes than the short questionnaire group. Although further validation of our findings is necessary, we hope that researchers consider our findings when planning an AA study in the future.

Measurement reactivity in ambulatory assessment: Increase in emotional clarity over time independent of sampling frequency.

Ambulatory assessment (AA) studies are frequently used to study emotions, cognitions, and behavior in daily life. But does the measurement itself produce reactivity, that is, are the constructs that are measured influenced by participation? We investigated individual differences in intraindividual change in momentary emotional clarity and momentary pleasant-unpleasant mood over the course of an AA study. Specifically, we experimentally manipulated sampling frequency and hypothesized that the intraindividual change over time would be stronger when sampling frequency was high (vs. low). Moreover, we assumed that individual differences in dispositional mood regulation would moderate the direction of intraindividual change in momentary pleasant-unpleasant mood over time. Students (n = 313) were prompted either three or nine times a day for 1 week (data collection took place in 2019 and 2020). Multilevel growth curve models showed that momentary emotional clarity increased within participants over the course of the AA phase, but this increase did not differ between the two sampling frequency groups. Pleasant-unpleasant mood did not show a systematic trend over the course of the study, and mood regulation did not predict individual differences in mood change over time. Again, results were not moderated by the sampling frequency group. We discuss limitations of our study (e.g., WEIRD sample) and potential practical implications regarding sampling frequency in AA studies. Future studies should further systematically investigate the circumstances under which measurement reactivity is more likely to occur.

Modeling careless responding in ambulatory assessment studies using multilevel latent class analysis: Factors influencing careless responding.

As the number of studies using ambulatory assessment (AA) has been increasing across diverse fields of research, so has the necessity to identify potential threats to AA data quality such as careless responding. To date, careless responding has primarily been studied in cross-sectional surveys. The goal of the present research was to identify latent profiles of momentary careless responding on the occasion level and latent classes of individuals (who differ in the distribution of careless responding profiles across occasions) on the person level using multilevel latent class analysis (ML-LCA). We discuss which of the previously proposed indices seem promising for investigating careless responding in AA studies, and we show how ML-LCA can be applied to model careless responding in intensive longitudinal data. We used data from an AA study in which the sampling frequency (3 vs. 9 occasions per day, 7 days, n = 310 participants) was experimentally manipulated. We tested the effect of sampling frequency on careless responding using multigroup ML-LCA and investigated situational and respondent-level covariates. The results showed that four Level 1 profiles ("careful," "slow," and two types of "careless" responding) and four Level 2 classes ("careful," "frequently careless," and two types of "infrequently careless" respondents) could be identified. Sampling frequency did not have an effect on careless responding. On the person (but not the occasion) level, motivational variables were associated with careless responding. We hope that researchers might find the application of an ML-LCA approach useful to shed more light on factors influencing careless responding in AA studies. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

The effects of assessment intensity on participant burden, compliance, within-person variance, and within-person relationships in ambulatory assessment.

Considering the very large number of studies that have applied ambulatory assessment (AA) in the last decade across diverse fields of research, knowledge about the effects that these design choices have on participants' perceived burden, data quantity (i.e., compliance with the AA protocol), and data quality (e.g., within-person relationships between time-varying variables) is surprisingly restricted. The aim of the current research was to experimentally manipulate aspects of an AA study's assessment intensity-sampling frequency (Study 1) and questionnaire length (Study 2)-and to investigate their impact on perceived burden, compliance, within-person variability, and within-person relationships between time-varying variables. In Study 1, students (n = 313) received either 3 or 9 questionnaires per day for the first 7 days of the study. In Study 2, students (n = 282) received either a 33- or 82-item questionnaire three times a day for 14 days. Within-person variability and within-person relationships were investigated with respect to momentary pleasant-unpleasant mood and state extraversion. The results of Study 1 showed that a higher sampling frequency increased perceived burden but did not affect the other aspects we investigated. In Study 2, longer questionnaire length did not affect perceived burden or compliance but yielded a smaller degree of within-person variability in momentary mood (but not in state extraversion) and a smaller within-person relationship between state extraversion and mood. Differences between Studies 1 and 2 with respect to the type of manipulation of assessment intensity are discussed.

Compliance in Ambulatory Assessment Studies: Investigating Study and Sample Characteristics as Predictors.

Ambulatory assessment (AA) studies are becoming more and more popular. However, it can be challenging to motivate participants to comply with study protocols. The aim of the present study was to investigate possible predictors of compliance in AA studies with diverse samples and study designs. To do so, we extracted compliance information, study characteristics, and sample characteristics from 488 previously published studies. The average compliance across the studies was rather high. The total number of measurement occasions and the number of study days were negatively related to the compliance rate. Moreover, a higher percentage of healthy controls in clinical studies was associated with a higher compliance rate. By contrast, other study characteristics (e.g., the amount of financial compensation) and sample characteristics (clinical vs. healthy sample) were not related to compliance. The findings have implications for the design of future AA studies.

Using Scenarios for Measuring the Affective and Behavioral Components of Attitudes Toward Lesbians and Gay Men: Validation of the SABA Scale.

Attitude-change research requires sound attitude measures adequately predicting behavior. Most existing attitude measures focus on the cognitive (and some on the affective) attitude component (while neglecting the behavioral component). The present research introduces the SABA, a brief scale that consists of Scenarios measuring the Affective and Behavioral components of Attitudes toward lesbians and gay men. In two studies with student and non-student samples (n1 = 66, n2 = 202), we developed a 25-item scale and reduced it by performing exploratory factor analysis. Confirmatory factor analysis yielded two factors (affective and behavioral) for each version (SABA-L for attitudes toward lesbians, SABA-G for attitudes toward gay men). The reduced scales each contained five scenarios showing good reliability. High convergent validity and discriminant validity were shown using explicit and implicit attitude measures in a multitrait-multimethod analysis. Further, SABA scores correlated with the Modern Homonegativity Scale (MHS) and the Attitudes Toward Lesbians (ATL) and Gay Men Scale (ATG), but-as predicted-not with social anxiety and the Homopositivity Scale. The SABA's criterion and incremental validity were demonstrated in predicting attitude-related behavior better than the MHS. SABA scores showed established associations and differences in antigay attitudes based on age, religiousness, male role norms, authoritarianism, openness (SABA-G only), and sexual orientation, confirming (known-group) validity. Further, the SABA correlated less with the motivation to act without prejudice than the MHS, the ATL, and the ATG. Thus, outperforming existing attitude scales, the SABA appears to be a psychometrically sound instrument to measure attitudes toward lesbians and gay men.

Development of a Novel Method of Emotion Differentiation That Uses Open-Ended Descriptions of Momentary Affective States.

Emotion differentiation (ED) has been conceptualized as a trait that facilitates emotion regulation and increases well-being. Yet basic questions remain unanswered about how best to assess it and whether favorable outcomes can be observed only during times of stress. The goal of the present research was to develop a novel behavioral (specificity) index of ED. We conducted two daily diary studies (N = 111-190) in which we included different measures of ED, well-being, and emotion regulation. The different ED measures were largely unrelated to each other. In both studies, the specificity index of ED showed a positive association with daily well-being, but in Study 2, this association held only on days with a negative event. Results regarding ED and the use of emotion-regulation strategies were inconsistent across strategies and studies. Possible reasons for these mixed results (e.g., sample selection, context sensitivity of regulation strategies) are discussed.

Emotion regulation effectiveness accounts for the associations of self-reported emotion differentiation with well-being and depression.

Emotion differentiation has generally been viewed as a trait that is related to emotion regulation and well-being. There are theoretical considerations that state that the beneficial effect on well-being should be mediated by emotion regulation, but this indirect effect has yet to be tested. This study investigated this proposed indirect effect by linking emotion differentiation and well-being through emotion regulation effectiveness (maintaining positive feelings and improving negative feelings) and additionally tested whether a similar indirect effect would be found for depression as an outcome. In this online study of healthy and depressed individuals (N = 457), bivariate correlations showed that self-reported emotion differentiation, emotion regulation effectiveness, and well-being were positively related to each other as hypothesised. Depression was negatively associated with self-reported emotion differentiation, emotion regulation effectiveness, and well-being. The structural equation model clearly supported the indirect effects of all outcomes. Interestingly, maintaining positive feelings seemed to be a stronger intervening variable than improving negative feelings. Implications for therapy for depression are discussed.

A German version of the Three-Dimensional Work Fatigue Inventory (3D-WFI): Factor structure, internal consistency, and correlates.

Work fatigue represents an essential construct for understanding employee health and safety. In this study, we developed and explored the psychometric properties of a German version of the Three-Dimensional Work Fatigue Inventory and examined a set of hypothesized correlates of work fatigue. Data came from a sample of 439 German workers. Consistent with the original measure, confirmatory factor analyses supported a three-factor solution (physical, mental, and emotional work fatigue), and estimates of internal consistency reliability exceeded .90 for each dimension of work fatigue. The measure demonstrated a meaningful pattern of associations with predictors (time pressure, job control, psychological detachment, relaxation, and trait negative and positive affect) and an important outcome (work engagement). The German Three-Dimensional Work Fatigue Inventory will encourage research on an essential construct for employee health and safety using broader populations of workers.