The relationship between ambulance team's professional commitment, occupational anxiety, and resilience levels.

BACKGROUND: Individuals who have the ability to bounce back from stressful events, to recover from their troubles and adverse environmental conditions by getting stronger each time are known as resilient people. Some professions may cause more occupational anxiety than others due to their characteristics and working conditions. In this research, we aimed to develop a professional commitment scale for the ambulance team. Another aim was to analyze the relationships between professional commitment, occupational anxiety, resilience, gender, job, seniority and working unit variables. METHODS: In the study, data were collected from a total of 1142 emergency ambulance workers working in Emergency Ambulance and Emergency Call Centers in 34 different cities in Turkey. Data were collected using the "Professional Commitment of Ambulance Team Scale (PCATS), Occupational Anxiety Scale for Emergency Medical Service Professionals (OASEMSP), and Resilience Scale for Adults (RSA). Scale development analyses were carried out using Classical Test Theory (CTT) and Item Response Theory (IRT). Regression analysis were used to examine the relationships between professional commitment, occupational anxiety, resilience, gender, job, seniority and working unit. RESULTS: As a result of the exploratory factor analysis (EFA), it was determined that 8 items remaining in the professional commitment scale formed a single-factor structure, explaining 46% of the variance of professional commitment of the team. The Cronbach's Alpha reliability value was 0.867. Confirmatory factor analysis (CFA) confirmed the results of exploratory factor analysis. The Cronbach's Alpha reliability coefficient obtained through CTT was 0.868, and the marginal reliability coefficient within the scope of IRT was 0.877. The test-retest reliability coefficient was calculated as 0.832, which indicates that the scale is valid and reliable. CONCLUSIONS: The study revealed that resilience has a positive effect for professional commitment while occupational anxiety has a negative effect for professional commitment. In addition, having a moderate seniority has a negative (reducing) effect for professional commitment. Other variables (gender, job, and working unit) was found to have no significant impact on professional commitment.

[Study on the applicability of the Brief Job Stress Questionnaire based on classical test theory and item response theory].

Objective: To evaluate the quality and item characteristics of the Brief Job Stress Questionnaire (BJSQ) among employees in manufacturing and service industries. Methods: From December 2021 to December 2022, a total of 2077 employees from 4 manufacturing and service enterprises in Beijing were selected by the method of combining purpose sampling and convenience sampling. The Chinese version of BJSQ was used to carry out a survey on occupational stress from 57 items in 4 dimensions including job stress factors, stress response, social support factors and satisfaction. Classical test theory (CTT) was used to analyze the validity and reliability of the questionnaire. The Semejima hierarchical response model in item response theory (IRT) was used to analyze the differentiation a, difficulty coefficient b and information content of each item. Results: Among the 2077 subjects, the age M (Q(1), Q(3)) was 33 (28, 37) years old, and the working age M (Q(1), Q(3)) was 4 (2, 8) years. There were 723 (34.8%) people in manufacturing industry and 1354 (65.2%) people in service industry. Eleven common factors were extracted by exploratory factor analysis, with a cumulative variance contribution rate of 62.823%, the variance of the common factors of each entry ranging from 0.451 to 0.865, and the range of factor loading values from 0.413 to 0.825, with 5 items having cross-loadings. The results of the validation factor analysis showed that the model fit indexes of root means square error of approximation was 0.055, comparative fit index was 0.950, Tucker Lewis index was 0.948, and standardized root mean square was 0.066. Content validity results showed that the total scores of the Chinese version of the BJSQ were positively correlated with the scores of the 4 dimensions (r(s)=0.487-0.936, P<0.05) . The results of the reliability analysis showed that the Cronbach's alpha coefficient for the total questionnaire was 0.945, and the Cronbach's alpha coefficients of job stress factors, stress response and social support factors were 0.775, 0.957, and 0.830, respectively. The Spearman-Brown coefficient for the total questionnaire was 0.866, and for the 3 dimensions, it was 0.572, 0.882 and 0.772. The results of IRT analysis showed that only 1 of the 57 items had a differentiation a-value<0.30, the difficulty coefficient b-value of each item ranged from -12.02 to 11.09, of which 8 items had a difficulty coefficient that was too high, 3 items had a difficulty coefficient that was too low, and 3 items did not meet the requirements, and the average amount of information in each item ranged from 0.022 to 2.566, and there were 47 items with average amount of information>0.088 (5/57) . Conclusion: The Chinese version of BJSQ has good reliability and validity in the typical occupational groups of manufacturing and service industries in China, and most of the items have good performance, but some items still need to be further improved and optimized or deleted.

Psychometric evaluation of the pictorial scale of perceived movement skill competence in Chinese children: An item response theory analysis.

AIM: This study aimed to investigate the psychometric characteristics of the Pictorial Scale of Perceived Movement Skill Competence (PMSC) in Chinese children, utilizing the principles of item response theory (IRT). METHODS: A total of 284 children (147 boys), aged 4-10 years (Mage = 7.39, SD = 2.18), from four schools were recruited for testing, adhering to the principle of random sampling. The Rasch model was applied to evaluate the rating scale validity, local independence, scale dimensionality, person and item fit statistics, and differential item functioning (DIF). RESULTS: (1) The rating scale validity was confirmed by the monotonically increasing trend in both average item difficulty measures and Andrich thresholds. (2) However, the observation that standardized residual correlations for all items remained below 0.3 unequivocally confirmed the presence of local independence among the variables. (3) The scale's dimensions were substantiated, with Rasch measures explaining 40.6% of total variance, exceeding the 40% threshold. Additionally, the first contrast had an eigenvalue of 1.8 and explained 8.80% of the variance, both exceeding the minimum 3:1 ratio. Consequently, the unidimensionality assumption of the item was supported. (4) Person and item fit statistics indicated requisite reliability and separation, with all achieving suitable infit and outfit measures, and point-biserial correlations exceeding 0.55. (5) Regarding gender DIF, it was observed that the majority of items did not exhibit statistically significant gender DIF effects (p > 0.05) except item 8 (Bounce a ball, t = -2.74, p < 0.01, DIF = -0.51). CONCLUSION: Rasch analysis revealed that the instrument exhibited strong scale validity among Chinese children, adhering to the Rasch model's unidimensionality and local independence principles, with robust person and item reliability and separation. All items demonstrated a good fit. Additionally, the significant gender difference in item 8 (Bounce a ball) warrants further consideration. In conclusion, PMSC is suitable for assessing the PMSC of Chinese children.

Psychometric properties of the chinese version of multidimensional experiential avoidance questionnaire-30.

BACKGROUND: Experiential avoidance represents the tendency to avoid negative internal experiences, which is a key concept in Acceptance and Commitment Therapy. However, existing measures of experiential avoidance (i.e., Acceptance and Action Questionnaire-II, AAQ-II) have some limitations. This study aims to assess the psychometric properties of the Chinese version of Multidimensional Experiential Avoidance Questionnaire-30 (MEAQ-30) and provide evidence for the reliability and validity of this new instrument. METHODS: Two questionnaire surveys were conducted. The first sample (N = 546) was analyzed using classical test theory (CTT), and the second sample (N = 511) was analyzed using multidimensional item response theory (MIRT). RESULTS: CTT supported the six-factor structure of MEAQ-30, indicating good internal consistency and measurement invariance across genders. Furthermore, the Chinese version of MEAQ-30 showed satisfactory convergent and discriminant validity. The incremental validity test showed that after controlling for the effects of neuroticism and AAQ-II, the Chinese version of MEAQ-30 could still significantly predict depression, anxiety, and stress. MIRT indicated that 30 items had good discrimination and difficulty, and the six subscales were sufficiently reliable across the continuum of experiential avoidance. CONCLUSION: The Chinese version of MEAQ-30 has good reliability and validity and is suitable for assessing experiential avoidance among Chinese populations.

Item analysis on the quality of life scale for anxiety disorders QLICD-AD(V2.0) based on classical test theory and item response theory.

BACKGROUND: Anxiety disorders can cause serious physical and psychological damage, so many anxiety scales have been developed internationally to measure anxiety disorders, but due to the cultural differences and cultural dependence of quality of life between Chinese and Western cultures, it is difficult to reflect the main characteristics of Chinese patients. Therefore, we developed a scale suitable for Chinese patients with anxiety disorders: the Anxiety Disorders Scale of the Quality of Life Instruments for Chronic Diseases (QLICD-AD), hoping to achieve satisfactory QOL assessments for anxiety disorders. OBJECTIVES: Items from the Anxiety Disorders Scale of the Quality of Life in Chronic Disease Instrument QLICD-AD system were analyzed using CTT and IRT to lay the groundwork for further refinement of the scale to accurately measure anxiety disorders. METHODS: 120 patients with anxiety disorder were assessed using the QLICD-AD (V2.0). Descriptive statistics, variability method, correlation coefficient method, factor analysis and Cronbach's coefficient of CTT, and graded response model (GRM) of item response theory were used to analyze the items of the scale. RESULT: CTT analysis showed that the standard deviation of each item was between 0.928 and 1.466; Pearson correlation coefficients of item-to-domain were generally greater than 0.5 and also greater than that of item-to-other domain; the Cronbach 's of the total scale was 0.931, α of each domain was between 0.706 and 0.865. IRT analysis showed that the discrimination was between 1.14 and 1.44. The difficulty parameter of all items increased with the increase of grade. But some items (GPH6,GPH8,GPS3,GSO2-GSO4,AD2,AD5) difficulty parameters were less than 4 or greater than 4. The average of information amount was between 0.022 and 0.910. CONCLUSION: Based on CTT and IRT analysis, most items of the QLICD-AD (V2.0) scale have good performance and good differentiation, but a few items still need further revision. Suggests that the QLICD-AD (V2.0) appears to be a valid measure of anxiety disorders. It may effectively improve the diagnosticity of anxiety disorders, but due to the limitations of the current sample, further validation is needed in a broader population extrapolation trial.

Development and Validation of the Coronary Heart Disease Scale Among the System of Quality of Life Instruments for Chronic Diseases QLICD-CHD (V2.0) Based on Classical Test Theory and Generalizability Theory.

Objective: Coronary heart disease (CHD) is a common and frequent disease with a long and incurable course, and the quality of life of patients is severely reduced. This study was to develop and validate a quality of life scale for patients with CHD based on the Chinese context. Methods: The scale QLICD-CHD (V2.0) was developed based on the QLICD-CHD (V1.0), using a programmed decision procedures. Based on the data measuring QoL 3 times before and after treatments from 189 patients with CHD, the psychometric properties of the scale were evaluated with respect to validity, reliability and responsiveness employing correlation analysis, multi-trait scaling analysis, structural equation modeling, t-test and also G-study and D-study of generalizability theory analysis. The SF-36 scale was used as the criterion to evaluate the criterion-related validity. Paired t tests were conducted to evaluate the responsiveness on each domain/facet as well as the total of the scale, with Standardized Response Mean (SRM) being calculated. Results: The QLICD-CHD (V2.0) has been developed with 42 items in 4 domains. The Cronbach's α of the general module, the specific module and the total scale were 0.91, 0.92 and 0.91 respectively. The overall score and the test-retest reliability coefficients in all domains are higher than 0.60, except for the specific module. Correlation and factor analysis confirmed good construct validity and criterion-related validity. After treatments, the overall score and score of all domains have statistically significant changes (P<0.01). The SRM of domain-level score ranges from 0.27 to 0.50. Generalizability Theory further confirm the reliability of the scale through more accurate variance component studies. Conclusion: The QLICD-CHD (V2.0) could be used as a useful instrument in assessing QoL for patients with CHD, with good psychometric properties.

Development and validation of the patient-reported outcome for older people living with HIV/AIDS in China (PROHIV-OLD).

BACKGROUND: The involvement of quality of life as the UNAIDS fourth 90 target to monitor the global HIV response highlighted the development of patient-reported outcome (PRO) measures to help address the holistic needs of people living with HIV/AIDS (PLWHA) beyond viral suppression. This study developed and tested preliminary measurement properties of a new patient-reported outcome (PROHIV-OLD) measure designed specifically to capture influences of HIV on patients aged 50 and older in China. METHODS: Ninety-three older people living with HIV/AIDS (PLWHA) were interviewed to solicit items and two rounds of patient cognitive interviews were conducted to modify the content and wording of the initial items. A validation study was then conducted to refine the initial instrument and evaluate measurement properties. Patients were recruited between February 2021 and November 2021, and followed six months later after the first investigation. Classical test theory (CTT) and item response theory (IRT) were used to select items using the baseline data. The follow-up data were used to evaluate the measurement properties of the final instrument. RESULTS: A total of 600 patients were recruited at the baseline. Of the 485 patients who completed the follow-up investigation, 483 were included in the validation sample. The final scale of PROHIV-OLD contained 25 items describing five dimensions (physical symptoms, mental status, illness perception, family relationship, and treatment). All the PROHIV-OLD dimensions had satisfactory reliability with Cronbach's alpha coefficient, McDonald's ω, and composite reliability of each dimension being all higher than 0.85. Most dimensions met the test-retest reliability standard except for the physical symptoms dimension (ICC = 0.64). Confirmatory factor analysis supported the structural validity of the final scale, and the model fit index satisfied the criterion. The correlations between dimensions of PROHIV-OLD and MOS-HIV met hypotheses in general. Significant differences on scores of the PROHIV-OLD were found between demographic and clinical subgroups, supporting known-groups validity. CONCLUSIONS: The PROHIV-OLD was found to have good feasibility, reliability and validity for evaluating health outcome of Chinese older PLWHA. Other measurement properties such as responsiveness and interpretability will be further examined.

Recognize the Value of the Sum Score, Psychometrics' Greatest Accomplishment.

The sum score on a psychological test is, and should continue to be, a tool central in psychometric practice. This position runs counter to several psychometricians' belief that the sum score represents a pre-scientific conception that must be abandoned from psychometrics in favor of latent variables. First, we reiterate that the sum score stochastically orders the latent variable in a wide variety of much-used item response models. In fact, item response theory provides a mathematically based justification for the ordinal use of the sum score. Second, because discussions about the sum score often involve its reliability and estimation methods as well, we show that, based on very general assumptions, classical test theory provides a family of lower bounds several of which are close to the true reliability under reasonable conditions. Finally, we argue that eventually sum scores derive their value from the degree to which they enable predicting practically relevant events and behaviors. None of our discussion is meant to discredit modern measurement models; they have their own merits unattainable for classical test theory, but the latter model provides impressive contributions to psychometrics based on very few assumptions that seem to have become obscured in the past few decades. Their generality and practical usefulness add to the accomplishments of more recent approaches.

Development and validation of the missed intensive nursing care scale.

BACKGROUND: Missed nursing care is a pervasive issue in hospitals, nursing homes, and communities, posing a significant threat to patient safety and the quality of nursing care. It has adverse effects on patient satisfaction and the motivation of nursing staff. Understanding the causes and nature of these care omissions in clinical settings is essential for implementing effective interventions. This study aims to develop and validate a tool for assessing missed nursing care in adult intensive care units. METHODS: Semi-structured interviews, expert consultations conducted via the Delphi method and item analysis were used to develop the initial scale. Our analysis involved data collected from 400 nurses and employed correlation coefficient analysis, critical ratio assessment, Cronbach's α coefficient evaluation, discrete trend analysis, and factor analysis, which were grounded in both classical test theory and item response theory, allowing us to scrutinize and refine the items in the scale. To validate the scale, we conveniently sampled 550 nurses and assessed structural validity, internal reliability, split-half reliability, and test-retest reliability to ensure the scale's robustness and accuracy. RESULTS: The Missed Intensive Nursing Care Scale (MINCS) comprises three distinct components. Part A serves to collect general information about the participants. In Part B, the missed care elements are categorized into five domains, following the framework of Maslow's hierarchy of needs theory: physiology, safety, belongingness, esteem, and cognition. Part C is dedicated to detailing the reasons behind missed care, which encompass labor resources, material resources, communication factors, and managerial factors. Remarkably, the Cronbach's α coefficient for the MINCS stands at an impressive 0.951, with S-CVI values of 0.988 and 0.977 in Part B and C, respectively, underscoring the scale's exceptional reliability and validity. This demonstrates the scale's effectiveness in measuring missed nursing care while upholding rigorous standards of quality. CONCLUSIONS: The MINCS emerges as a robust and dependable instrument for quantifying instances of missed care within the ICU. Its efficacy makes it a valuable resource for informing the development of strategies aimed at averting and mitigating the adverse effects associated with missed nursing care.

When better is the enemy of good: two cautionary tales of conceptual validity versus parsimony in clinical psychometric research.

This paper presents an empirical challenge to the assumption that an item-response theory analysis always yields a better measure of a clinical construct. We summarize results from two measurement development studies that showed that such an analysis lost important content reflecting the conceptual model ("conceptual validity"). The cost of parsimony may thus be too high. Conceptual models that form the foundation of QOL measurement reflect the patient's experience. This experience may include concepts and items that are psychometrically "redundant" but capture distinct features of the concept. Good measurement is likely a balance between relying on IRT's quantitative metrics and recognizing the importance of conceptual validity and clinical utility.

A psychometric analysis of the Early Trauma Inventory-Short Form in Colombia: CTT and Rasch model.

BACKGROUND: Potential childhood traumatic experiences increase risk for mental and physical health disorders and their precise assessment can help to promote health prevention and promotion strategies for countries with limited data and measurement strategies like Colombia. OBJECTIVE: The goal of the present study is to strengthen evidence for the validity of scores from an adapted version of the Early Trauma Inventory self report-short form (ETI-SF) using Item Response Theory and by assessing factorial invariance across gender and education level. PARTICIPANTS AND SETTING: The study assessed a total of 1909 Colombian participants (66.16 % women, 32.16 % men, 1.68 % other gender; age range 18-72 years old). METHODS: Participants answered the ETI-SF via a web-based sampling strategy. RESULTS: The total scores of the scale showed good reliability coefficients (α = 0.81 and ω = 0.60). A specific analysis for the subscales showed good reliability for the emotional, physical, and sexual trauma subscales (αs and ωs >0.64), while general trauma showed lower than accepted reliability values (α =0.56 and ω = 0.37). Most of the individual items of the scale showed good calibration. The factorial invariance analysis suggests the possibility of some gender and educational differences. CONCLUSIONS: The study confirms particularly high rates of potential childhood traumatic experiences in Colombia and complement data for specific trauma types. Overall, the ETI-SF is confirmed as useful for Colombia, which highlights this scale as a good tool to use for public health assessment. Future research can continue the integration of diverse methods for estimating the quality of the scale.

Validating Parallel-Forms Tests for Assessing Anesthesia Resident Knowledge.

We created a serious game to teach first year anesthesiology (CA-1) residents to perform general anesthesia for cesarean delivery. We aimed to investigate resident knowledge gains after playing the game and having received one of 2 modalities of debriefing. We report on the development and validation of scores from parallel test forms for criterion-referenced interpretations of resident knowledge. The test forms were intended for use as pre- and posttests for the experiment. Validation of instruments measuring the study's primary outcome was considered essential for adding rigor to the planned experiment, to be able to trust the study's results. Parallel, multiple-choice test forms development steps included: (1) assessment purpose and population specification; (2) content domain specification and writing/selection of items; (3) content validation by experts of paired items by topic and cognitive level; and (4) empirical validation of scores from the parallel test forms using Classical Test Theory (CTT) techniques. Field testing involved online administration of 52 shuffled items from both test forms to 24 CA-1's, 21 second-year anesthesiology (CA-2) residents, 2 fellows, 1 attending anesthesiologist, and 1 of unknown rank at 3 US institutions. Items from each form yielded near-normal score distributions, with similar medians, ranges, and standard deviations. Evaluations of CTT item difficulty (item p values) and discrimination (D) indices indicated that most items met assumptions of criterion-referenced test design, separating experienced from novice residents. Experienced residents performed better on overall domain scores than novices (P < .05). Kuder-Richardson Formula 20 (KR-20) reliability estimates of both test forms were above the acceptability cut of .70, and parallel forms reliability estimate was high at .86, indicating results were consistent with theoretical expectations. Total scores of parallel test forms demonstrated item-level validity, strong internal consistency and parallel forms reliability, suggesting sufficient robustness for knowledge outcomes assessments of CA-1 residents.

Development and validation of the patient-reported outcome scale for chronic kidney disease.

PURPOSE: The patient-reported outcomes (PROs) measuring patient's experience and perception of disease are important components of approach to care. However, no tools are available to assess the PROs of chronic kidney disease (CKD). This study aims to develop and verify a PROs scale to evaluate clinical outcomes in CKD patients. METHODS: The theoretical structure model and original item pool were formed through a literature review, patient interviews and references to relevant scales. The Delphi method, classical test theory methods and item response theory method were used to select items and adjust dimensions to form the final scale. Altogether 360 CKD patients were recruited through convenience sampling. CKD-PROs could be evaluated from four aspects, namely reliability, content validity, construct validity, responsibility, and feasibility. RESULTS: The CKD-PROs scale covers 4 domains, including the physiological, psychological, social, and therapeutic domain, and 12 dimensions, 54 items. The Cronbach's α is 0.939, the split reliability coefficient is 0.945, and the correlation of the scores each item and domain's coefficients range from 0.413 to 0.669. The results of structure validity, content validity and reactivity showed that the multidimensional measurement of the scale met professional expectations. The recovery rate and effective rate of the scale were over 99%. CONCLUSION: The CKD-PROs scale has great reliability, validity, reactivity, acceptability and is capable of being used as one of the evaluation tools for the clinical outcomes of CKD patients.

Corrigendum: The 18-item Swedish version of Ryff's psychological wellbeing scale: psychometric properties based on classical test theory and item response theory.

[This corrects the article DOI: 10.3389/fpsyg.2023.1208300.].

Chinese cross-cultural adaptation and validation of the Well-being Numerical Rating Scales.

Introduction: Well-being is a multi-domain concept that involves measuring physical, psychological, social, and spiritual domains. However, there are currently few multi-domain and comprehensive well-being instruments available. In addition, measures that do exist customarily contain a vast number of items that may lead to boredom or fatigue in participants. The Well-being Numerical Rating Scales (WB-NRSs) offer a concise, multi-domain well-being scale. This study aimed to perform the translation, adaptation, and validation of the Chinese version of WB-NRSs (WBNRSs-CV). Methods: A total of 639 clinical participants and 542 community participants completed the WB-NRSs-CV, the Single-item Self-report Subjective Well-being Scale (SISRSWBS), the World Health Organization Five-item Well-Being Index (WHO-5), the 10-item Perceived Stress Scale (PSS-10), and the Kessler Psychological Distress Scale (K10). Results: High internal consistency and test-retest reliability were obtained for both samples. Additionally, WB-NRSs-CV was positively associated with SISRSWBS and WHO-5 and negatively associated with PSS-10 and K10. In the item response theory analysis, the model fit was adequate with the discrimination parameters ranging from 2.73 to 3.56. The diffculty parameters ranged from -3.40 to 1.71 and were evenly spaced along the trait, attesting to the appropriateness of the response categories. The invariance tests demonstrated that there was no difference in WB-NRSs-CV across groups by gender or age. Discussion: The WB-NRSs-CV was translated appropriately and cross-culturally adapted in China. It can be used as a rapid and relevant instrument to assess well-being in both clinical and non-clinical settings, with its utility for well-being measurement and management among the Chinese people.

The 18-item Swedish version of Ryff's psychological wellbeing scale: psychometric properties based on classical test theory and item response theory.

Background: Psychological wellbeing is conceptualized as the full engagement and optimal performance in existential challenges of life. Our understanding of psychological wellbeing is important for us humans to survive, adapt, and thrive during the challenges of the 21st century. Hence, the measurement of psychological wellbeing is one cornerstone for the identification and treatment of both mental illness and health promotion. In this context, Ryff operationalized psychological wellbeing as a six-dimensional model of human characteristics: self-acceptance, positive relations with others, environmental mastery, personal growth, autonomy, and purpose in life. Ryff's Psychological Wellbeing Scale has been developed and translated into different versions. Here, we examine and describe the psychometric properties of the 18-item Swedish version of Ryff's Psychological Wellbeing Scale using both Classical Test Theory (CTT) and Item Response Theory (IRT). Methods: The data used in the present study was earlier published elsewhere and consists of 768 participants (279 women and 489 men). In addition to the 18-item version of the scale, participants answered the Temporal Satisfaction with Life Scale, the Positive Affect Negative Affect Schedule, and the Background and Health Questionnaire. We examined, the 18-item version's factor structure using different models and its relationship with subjective wellbeing, sociodemographic factors (e.g., education level, gender, age), lifestyle habits (i.e., smoking, frequency of doing exercise, and exercise intensity), and health issues (i.e., pain and sleeping problems). We also analyzed measurement invariance with regard to gender. Moreover, as an addition to the existing literature, we analyzed the properties of the 18 items using Graded Response Model (GRM). Results: Although the original six-factor structure showed a good fit, both CTT and IRT indicated that a five-factor model, without the purpose in life subscale, provided a better fit. The results supported the internal consistency and concurrent validity of the 18-item Swedish version. Moreover, invariance testing showed similar measurement precision by the scale across gender. Finally, we found several items, especially the purpose in life's item "I live life one day at a time and do not really think about the future," that might need revision or modification in order to improve measurement. Conclusion: A five-factor solution is a valid and reliable measure for the assessment of psychological wellbeing in the general Swedish population. With some modifications, the scale might achieve enough accuracy to measure the more appropriate and correct six-dimensional theoretical framework as detailed by Ryff. Fortunately, Ryff's original version contains 20 items per subscale and should therefore act as a perfect pool of items in this endeavor.

Studies on Reliability and Measurement Error of Measurements in Medicine - From Design to Statistics Explained for Medical Researchers.

Reliability and measurement error are measurement properties that quantify the influence of specific sources of variation, such as raters, type of machine, or time, on the score of the individual measurement. Several designs can be chosen to assess reliability and measurement error of a measurement. Differences in design are due to specific choices about which sources of variation are varied over the repeated measurements in stable patients, which potential sources of variation are kept stable (ie, restricted), and about whether or not the entire measurement instrument (or measurement protocol) was repeated or only part of it. We explain how these choices determine how intraclass correlation coefficients and standard errors of measurement formulas are built for different designs by using Venn diagrams. Strategies for improving the measurement are explained, and recommendations for reporting the essentials of these studies are described. We hope that this paper will facilitate the understanding and improve the design, analysis, and reporting of future studies on reliability and measurement error of measurements.

Does Scoring Method Impact Estimation of Significant Individual Changes Assessed by Patient-Reported Outcome Measures? Comparing Classical Test Theory Versus Item Response Theory.

OBJECTIVES: This study aimed to examine the ability of classical test theory (CTT) and item response theory (IRT) scores assessed by Patient-Reported Outcomes Measurement Information System® (PROMIS®) measures to identify significant individual changes in the setting of clinical studies, using both simulated and empirical data. METHODS: We used simulated data to compare the estimation of significant individual changes between CTT and IRT scores across different conditions and a clinical trial data set to verify the simulation results. We calculated reliable change indexes to estimate significant individual changes. RESULTS: For small true change, IRT scores showed a slightly higher rate of classifying change groups than CTT scores and were comparable with CTT scores for a shorter test length. Additionally, IRT scores were found to have a prominent advantage in the classification rates of change groups for medium to high true change over CTT scores. Such an advantage became prominent in a longer test length. The empirical data analysis results using an anchor-based approach further supported the above findings that IRT scores can more accurately classify participants into change groups than CTT scores. CONCLUSIONS: Given that IRT scores perform better, or at least comparably, in most conditions, we recommend using IRT scores to estimate significant individual changes and identify responders to treatment. This study provides evidence-based guidance in detecting individual changes based on CTT and IRT scores under various measurement conditions and leads to recommendations for identifying responders to treatment for participants in clinical trials.

Anxiety in Brief: Assessment of the Five-Item Trait Scale of the State-Trait Anxiety Inventory in South Africa.

The current study examined the psychometric properties of a short form of the trait scale of the Spielberger State-Trait Anxiety Inventory. Participants consisted of a convenience sample of students (n = 322) who completed the five-item version of the trait scale of the State-Trait Anxiety Inventory, the Perceived Stress Scale, the nine-item version of the Beck Hopelessness Scale, the 10-item version of the Center for Epidemiological Studies Depression Scale, and the Post-Traumatic Stress Disorder Checklist. We used classical test theory and item response theory (Rasch and Mokken analyses) to examine the psychometric properties of a previously proposed five-item version of this scale. These approaches confirmed that the five-item measure of anxiety had satisfactory reliability and validity, and also confirmed that the five items comprised a unidimensional scale.

Psychometric properties of the Chinese version of the Nursing Home Adjustment Scale (C-NHAS) in Central China: Classical test theory and item response theory.

Evidence for the nursing home adjustment scale (NHAS)' s applicability in less developed regions of China is still absent. Besides, there is a need to provide further validity evidence for the NHAS using modern test theory. This study aims to investigate the psychometric properties of the Chinese version of the NHAS (C-NHAS) in a sample of nursing home residents in central China. A total of 761 older adults who lived in 21 nursing homes in Hunan Province, China, were investigated from July 2021 to December 2021. The C-NHAS yielded a four-factor structure and showed good reliability and validity. The difficulty of items matched most individuals' ability, while a small number of individuals with low ability had no items for matching. The results indicated the C-NHAS is a reliable and valid instrument while the high difficulty may restrict the performance of the C-NHAS among the less educated older adults.