Development of the cervical myelopathy severity index: a new patient reported outcome measure to quantify impairments and functional limitations.

BACKGROUND CONTEXT: Existing degenerative cervical myelopathy (DCM) severity scales have significant shortcomings, creating a strong impetus for the development of a practical measurement tool with sound psychometric properties. PURPOSE: This work reports the item generation and reduction of the Cervical Myelopathy Severity Index (CMSI), a new DCM patient-reported outcome measure of symptoms and functional limitations. DESIGN: Prospective observational study. PATIENT SAMPLE: Adult DCM patients belonging to one of three distinct treatment groups: (1) observation cohort, (2) preoperative surgical cohort, (3) 6 to 12 months postoperative cohort. OUTCOME MEASURES: Patient-reported outcome measure of symptoms and functional limitations. METHODS: Item generation was performed using semi-structured patient focus groups emphasizing symptoms experienced and functional limitations. Readability was assessed through think-aloud patient interviews. Item reduction involved surveys of DCM patients with a spectrum of disease severity and board-certified spine surgeons experienced in the treatment of DCM. A priori criteria for item removal included: patient median importance/severity <2 (of 4), 30% or more no severity (response of zero), item severity correlations ≤ 0.80 (Spearman), item severity reliability (weighted kappa <0.60) based on a 2-week interval and clinician median importance <2 with retention of items with very high clinical importance. RESULTS: There were 42 items generated from a combination of specialist input and patient focus groups. Items captured sensorimotor symptoms and limitations related to upper and lower extremities as well as sphincter dysfunction. Ninety-eight patients (43, 30, 25 observation, pre- and postsurgery respectively) and 51 surgeons completed the assessment. Twenty-three items remained after application of median importance and severity thresholds and weighted kappa cutoffs. After elimination of highly correlated (>0.80) items and combining two similar items, the final CMSI questionnaire list included 14 items. CONCLUSIONS: The CMSI is a new DCM patient-reported clinical measurement tool developed using patient and clinician input to inform item generation and reduction. Future work will evaluate the reliability, validity, and responsiveness of the CMSI in relation to existing myelopathy measurement indices.

Development of the short form Iranian women childbirth experience questionnaire: a confirmatory factor analysis approach item reduction.

INTRODUCTION: Considering that childbirth experience has short- and long-term effects on women's lives, it is necessary to examine their delivery experiences. This study aimed to prepare the short form of a 52-item Iranian women's childbirth experience questionnaire with seven factors: professional support, preparation, control, positive perception, baby, family support, and fear. METHODS: This methodological research was conducted on women aged 15 to 49 years (n = 770) with uncomplicated vaginal delivery. The short form of the Iranian women's childbirth experience questionnaire was prepared in four stages. The first stage was exploratory factor analysis, conducted on 250 samples, the second stage was confirmatory factor analysis which was performed on 260 samples, independent of the first stage, to report goodness and fit indices, and the third stage employed items from modification indices, expected parameter change, and standardized residual covariance, leading to the short form of Iranian women childbirth experience questionnaire. Finally, confirmatory factor analysis was run on 260 samples, independent of the previous two stages, to confirm the short form and compare it with the original questionnaire for psychometric analysis. RESULTS: In the exploratory factor analysis stage, nine items with a factor load of less than 0.4 were removed, and the number of domains was reduced to five. The second stage showed that the questionnaire had a goodness of fit index. However, the third stage resulted in removing 11 overlapping items and making a short questionnaire with 33 items. Finally, the confirmatory factor analysis in the last stage showed appropriate goodness of fit for the short form of the Iranian women's childbirth experiences questionnaire (𝛘2/df = 2.352, CFI = 0.881, PCFI = 0.750, RMSEA = 0.072, SRMR = 0.0862). CONCLUSION: The short form of the Iranian women's childbirth experiences questionnaire enjoyed from an appropriate psychometric evaluation. It is recommended when applying the original questionnaire is not feasible due to lack of time.

Perception of E-health Technology Scale in Chinese Brief (PETS-C Brief): Translation, item reduction, and psychometric testing.

Introduction: Perception of e-health is a broad concept involving many aspects of values and thoughts related to e-health. It is an important precursor to using e-health technologies to promote health. The purpose of this study is to validate an instrument for measuring perceptions of e-health technology among healthcare professionals. Methods: This methodological study was conducted in China. We based on an existing instrument to develop a new instrument (i.e. PETS-C Brief). In phase 1, we modified and translated the existing instrument into Chinese. Subsequently, we employed the modified and translated instrument to conduct a cross-sectional survey. In phase 2, we randomly selected data from 400 participants to run an exploratory factor analysis and item analysis to reduce the number of items and develop factors. In phase 3, we employed the data from the remaining participants to run a confirmatory factor analysis to confirm the instrument structure. Results: In phase 1, the modified and translated instrument showed good content and face validities (S-CVI = 0.96, mean comprehensibility = 93.5%). 1338 participants completed the survey. In phase 2, the number of items was reduced from 40 to 19, which demonstrated a 4-factor model. In phase 3, the goodness-of-fit of the 4-factor PETS-C Brief was shown to be acceptable (χ2/d.f. = 6.40, CFI = 0.93, RMR = 0.40, NFI = 0.92, RMSEA = 0.076, IFI = 0.93). Discussion: This study suggests using this instrument to survey perceptions of e-health technology in Chinese people. Future studies should examine its other important psychometric properties, including convergent/discriminant and predictive validity on behaviors using e-health technology.

Development and validation of the Health Education Adherence Scale for Stroke Patients: a cross-sectional study.

BACKGROUND: Due to the lack of health education adherence assessment tools for stroke patients, the assessment of health education adherence in this population is insufficient, which hinders the prevention and rehabilitation of stroke. This study aims to develop and validate a Health Education Adherence Scale for Stroke Patients (HEAS-SP). METHODS: A cross-sectional design with a purposive sampling method was used for this study. Six hundred and fifty-four eligible participants completed the demographic questionnaire and the HEAS-SP. The data collection lasted for 7 months, from March 1stto September 30th in 2019. Item analysis and exploratory and confirmatory factor analysis were employed to develop and validate the HEAS-SP. RESULTS: The item analysis, exploratory and confirmatory factor analysis resulted in a 20-item HEAS-SP with 4 domains: medication adherence, diet adherence, rehabilitation exercise adherence, and healthy lifestyle adherence. The four-domain model demonstrated acceptable model fit indexes and the 20-item HEAS-SP demonstrated acceptable reliability and validity. CONCLUSION: The 20-item HEAS-SP was shown to have acceptable reliability and validity for assessing health education adherence with respect to diet, medication, rehabilitation exercise and healthy lifestyle in stroke patients, making it a potential basis for developing targeted interventions for stroke patients.

Statistical Methods for Item Reduction in a Representative Lifestyle Questionnaire: Pilot Questionnaire Study.

BACKGROUND: Reducing the number of items in a questionnaire while maintaining relevant information is important as it is associated with advantages such as higher respondent engagement and reduced response error. However, in health care, after the original design, an a posteriori check of the included items in a questionnaire is often overlooked or considered to be of minor importance. When conducted, this is often based on a single selected method. We argue that before finalizing any lifestyle questionnaire, a posteriori validation should always be conducted using multiple approaches to ensure the robustness of the results. OBJECTIVE: The objectives of this study are to compare the results of two statistical methods for item reduction (variance inflation factor [VIF] and factor analysis [FA]) in a lifestyle questionnaire constructed by combining items from different sources and analyze the different results obtained from the 2 methods and the conclusions that can be made about the original items. METHODS: Data were collected from 79 participants (heterogeneous in age and sex) with a high risk of metabolic syndrome working in a financial company based in Tokyo. The lifestyle questionnaire was constructed by combining items (asked with daily, weekly, and monthly frequency) from multiple validated questionnaires and other selected questions. Item reduction was conducted using VIF and exploratory FA. Adequacy tests were used to check the data distribution and sampling adequacy. RESULTS: Among the daily and weekly questions, both VIF and FA identified redundancies in sleep-related items. Among the monthly questions, both approaches identified redundancies in stress-related items. However, the number of items suggested for reduction often differed: VIF suggested larger reductions than FA for daily questions but fewer reductions for weekly questions. Adequacy tests always confirmed that the structural detection was adequate for the considered items. CONCLUSIONS: As expected, our analyses showed that VIF and FA produced both similar and different findings, suggesting that questionnaire designers should consider using multiple methods for item reduction. Our findings using both methods indicate that many questions, especially those related to sleep, are redundant, indicating that the considered lifestyle questionnaire can be shortened.

Development and validation of a short version of the Sarcopenia Quality of Life questionnaire: the SF-SarQoL.

PURPOSE: To facilitate the measurement of quality of life in sarcopenia, we set out to reduce the number of items in the previously validated Sarcopenia Quality of Life (SarQoL®) questionnaire, and to evaluate the clinimetric properties of this new short form. METHODS: The item reduction process was carried out in two phases. First, information was gathered through item-impact scores from older people (n = 1950), a Delphi method with sarcopenia experts, and previously published clinimetric data. In the second phase, this information was presented to an expert panel that decided which of the items to include in the short form. The newly created SFSarQoL was then administered to older, community-dwelling participants who previously participated in the SarcoPhAge study. We examined discriminative power, internal consistency, construct validity, test-retest reliability, structural validity and examined item parameters with a graded response model (IRT). RESULTS: The questionnaire was reduced from 55 to 14 items, a 75% reduction. A total of 214 older, community-dwelling people were recruited for the validation study. The clinimetric evaluation showed that the SF-SarQoL® can discriminate on sarcopenia status [EWGSOP2 criteria; 34.52 (18.59-43.45) vs. 42.86 (26.56-63.69); p = 0.043], is internally consistent (α = 0.915, ω = 0.917) and reliable [ICC = 0.912 (0.847-0.942)]. A unidimensional model was fitted (CFI = 0.978; TLI = 0.975; RMSEA = 0.108, 90% CI 0.094-0.123; SRMR = 0.055) with no misfitting items and good response category separation. CONCLUSIONS: A new, 14-item, short form version of the Sarcopenia Quality of Life questionnaire has been developed and shows good clinimetric properties.

Measuring Senior Technology Acceptance: Development of a Brief, 14-Item Scale.

BACKGROUND AND OBJECTIVES: Technology has the potential to provide assistance and enrichment to older people; however, the desired outcomes are dependent on users' acceptance and usage. The senior technology acceptance model (STAM) was developed as a multidimensional measure assessing older people's acceptance of general technology. It contained 11 constructs measured by 38 items and had shown satisfactory psychometric properties. However, the length of the questionnaire increased respondent burden and limited its utilization. The study aimed to develop a brief, reliable, and valid version of scale to measure older people's technology acceptance by shortening the full, 38-item STAM questionnaire. RESEARCH DESIGN AND METHODS: The research method included (1) a sequential item-reduction strategy maximizing internal consistency, (2) convergent and discriminant validity analysis based on confirmative factor analysis, and (3) an expert review of resultant items. Data previously collected for developing the original STAM questionnaire were used to create the brief version. The data were collected from 1,012 community-dwelling individuals aged 55 and older in Hong Kong. Internal consistency and construct validity of the shortened questionnaire were examined. Two experts were invited for reviewing content validity. RESULTS: The final 14-item, brief version of the STAM questionnaire consisted of a 4-factor structure, representing classical technology acceptance constructs and age-related health characteristics. Theoretical relationships in the brief version showed similar patterns to the original STAM. The 14-item STAM demonstrated robustness in psychometrics by preserving the reliability and validity of the original STAM questionnaire. DISCUSSION AND IMPLICATIONS: The availability of a reliable and valid assessment tool of the short STAM can help researchers and practitioners to measure older adults' acceptance of technology and its effective usage. The short STAM could save administration time, reduce the burden on respondents, and be included in large-scale surveys.

Establishing the HLS-M-Q18 short version of the European health literacy survey questionnaire for the Malaysian context.

BACKGROUND: The European Health Literacy Survey Questionnaire (HLS-EU-Q47) is becoming a widely used tool to measure health literacy (HL), including in Malaysia. There are efforts to reduce the 47-item scale to parsimonious short item scales that still reflect the assumptions and requirements of the conceptual model. This study used confirmatory factor analysis to reduce the 47-item scale to a short scale that can offer a feasible HL screening tool with sufficient psychometric properties. METHODS: A cross-sectional survey was conducted on the Malaysian population based on ethnic distribution to ensure that the short version instrument reflects the country's varied ethnicities. The survey was administered by well-trained interviewers working for the Ministry of Health Malaysia. A total of 866 responses were obtained. Data was analysed using multi-factorial confirmatory factor analysis (CFA) with categorical variables. RESULTS: The analysis resulted in a satisfactory 18-item model. There were high correlations among the 18 items. The internal consistency reliability was robust, with no floor/ceiling effects. These results represented equivalence and consistency among the responses to items, suggesting that these items were homogenous in measuring Malaysian health literacy. The strong convergent and discriminant validity of the model makes the proposed 18 items a suitable short version of the health literacy instrument for Malaysia. CONCLUSIONS: The researchers propose the 18-item instrument to be named HLS-M-Q18. This short version instrument may be used in measuring health literacy in Malaysia as it achieved robust reliability, structural validity and construct validity that fulfilled goodness-of-fit criteria.

Item reduction of the 39-item Rotterdam Diabetic Foot Study Test Battery using decision tree modelling.

AIMS: Pedal sensory loss due to diabetes-related neuropathy can be graded by testing static two-point discrimination (S2PD), moving two-point discrimination (M2PD), static one-point discrimination (S1PD; eg, 10-g monofilament), and vibration sense and is included in the Rotterdam Diabetic Foot (RDF) Study Test Battery. The aim of this study is to investigate if decision tree modelling is able to reduce the number of tests needed in estimating pedal sensation. METHODS: The 39-item RDF Study Test Battery (RDF-39) scores were collected from the prospective RDF study and included baseline (n = 416), first follow-up (n = 364), and second follow-up (n = 135) measurements, supplemented with cross-sectional control data from a previous study (n = 196). Decision tree analysis was used to predict total RDF-39 scores using individual test item data. The tree was developed using baseline RDF study data and validated in follow-up and control data. Spearman correlation coefficients assessed the reliability between the decision tree and original RDF-39. RESULTS: The tree reduced the number of items from 39 to 3 in estimating the RDF-39 sum score. M2PD (hallux), S2PD (first dorsal web, fifth toe), vibration sense (interphalangeal joint), and S1PD (first dorsal web, fifth toe) measurements proved to be predictive. The correlation coefficients to original scores were high (0.76 to 0.91). CONCLUSIONS: The decision tree was successful at reducing the number of RDF Test Battery items to only 3, with high correlation coefficients to the scores of the full test battery. The findings of this study aids medical decision making by time efficiently estimating pedal sensory status with fewer tests needed.

Early Symptom Measurement of Post-Stroke Depression: Development and validation of a new short version.

AIMS: The aim of this study was to develop and test the psychometric properties of the Early Symptom Measurement of Post-Stroke Depression-Short Form (ESMPSD-SF). BACKGROUND: The ESMPSD is a specific measurement tool designed to detect early depressive symptoms in acute stroke patients, but it is too long for use in busy clinical settings. DESIGN: A psychometric study was conducted. METHODS: Five hundred and twenty-one post-stroke patients completed two questionnaires, the demographic and the ESMPSD questionnaire, over a period of 10 months, from July 2016-April 2017. The item reduction process was used to reduce the number of items in the ESMPSD questionnaire and consisted of item analysis, exploratory, and confirmatory factor analysis. RESULTS: The item reduction process resulted in a 12-item short version questionnaire with evidence of acceptable construct validity and internal reliability. Four factors explaining high total variance were extracted: "low," "guilt," "emotional," and "wakefulness". Estimates of all confirmatory model fit indices met the standard criteria. All standardized factor loading estimates of the 12 items met the standard criteria and the variances explained by the items were acceptable. Moreover, internal reliability estimates of the 12-item questionnaire were acceptable, and the corrected item-total correlation and item-subscale correlation also demonstrated evidence of acceptable reliability of the short form questionnaire. CONCLUSIONS: The ESMPSD-SF demonstrates evidence of acceptable reliability and validity to screen early depressive symptoms in acute stroke patients in busy clinical settings.

Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer.

Scale development and validation are critical to much of the work in the health, social, and behavioral sciences. However, the constellation of techniques required for scale development and evaluation can be onerous, jargon-filled, unfamiliar, and resource-intensive. Further, it is often not a part of graduate training. Therefore, our goal was to concisely review the process of scale development in as straightforward a manner as possible, both to facilitate the development of new, valid, and reliable scales, and to help improve existing ones. To do this, we have created a primer for best practices for scale development in measuring complex phenomena. This is not a systematic review, but rather the amalgamation of technical literature and lessons learned from our experiences spent creating or adapting a number of scales over the past several decades. We identified three phases that span nine steps. In the first phase, items are generated and the validity of their content is assessed. In the second phase, the scale is constructed. Steps in scale construction include pre-testing the questions, administering the survey, reducing the number of items, and understanding how many factors the scale captures. In the third phase, scale evaluation, the number of dimensions is tested, reliability is tested, and validity is assessed. We have also added examples of best practices to each step. In sum, this primer will equip both scientists and practitioners to understand the ontology and methodology of scale development and validation, thereby facilitating the advancement of our understanding of a range of health, social, and behavioral outcomes.

The VHI-10 and VHI Item Reduction Translations-Are we all Speaking the Same Language?

OBJECTIVES: The Vocal Handicap Index-10 (VHI-10) was designed as an item reduction of the original VHI to provide a quick, reliable, and quantifiable measure of patients' own vocal handicap perception. Many translations of the VHI-10 have been produced, but methodologies of translation vary between articles and do not always mirror that of the English VHI-10. This discrepancy leads to confusion about normative values and the applicability of published data in non-English-speaking cultures. This article examines the various item reductions of the VHI-10 from the VHI and the differing methodologies of translation of the VHI-10. STUDY DESIGN: This is an invited review article. METHODS: Published item reductions and translations of the VHI-10 were reviewed. Normative values for each translation, where available, were calculated. The World Health Organization recommendations for the translation of instruments are reviewed. RESULTS/CONCLUSIONS: There are substantial differences between the original VHI-10 (created and published in American English) and many of the translations of the VHI-10 and other proposed item reductions, both in the actual questions used and the order of the questions. We have to conclude that for a number of the non-English VHI-10/VHI reductions, the instruments are not equivalent, meaning the results from different languages are not comparable. Our recommendation for future patient-reported instrument translations is to translate and validate the instrument according to the World Health Organization protocol while maintaining item consistency and order, allowing studies to be better focused and decrease unnecessary replication of well-performed studies, as well as allowing metadata to be combined from different countries and cultures.

An abbreviated Faecal Incontinence Quality of Life Scale for Chinese-speaking population with colorectal cancer after surgery: cultural adaptation and item reduction.

No instrument is available to assess the impact of faecal incontinence (FI) of quality of life for Chinese-speaking population. The purpose of the study was to adapt the Faecal Incontinence Quality of Life Scale (FIQL) for patients with colorectal cancer, assess the factor structure and reduce the items for brevity. A sample of 120 participants were enrolled. Internal consistency, test-retest reliability, and convergent and contrasted-groups validity were assessed. Construct validity was analysed using an exploratory and confirmatory factor analyses (CFA). The internal consistency (Cronbach's α of the total scale and four subscales = 0.98 and 0.97, 0.96, 0.92, 0.82 respectively), test-retest reliability (intraclass correlation coefficients ≥.98 for all scales with p < .001) and significant correlations of all scales with selected subscales of the Medical Outcomes Study 36-Item Short-Form Health Survey and the Wexner scale suggested satisfactory reliability and validity. The severe FI group (with a Wexner score ≥9) scored significantly lower on the scale than the less severe FI group (with a Wexner score <9) did (p < .001). The CFA supported a two-factor structure and demonstrated an excellent model fit of the 15-item abbreviated version of the FIQL-Chinese. The FIQL-Chinese has satisfactory validity and reliability and the abbreviated version may be more practical and applicable.

An Adaptation of the Profile of Mood States for Use in Adults With Phenylketonuria

Abstract Adults with phenylketonuria (PKU) experience disturbances in mood. This study used qualitative and quantitative techniques to adapt the 65-item Profile of Mood States (POMS) for the assessment of key mood domains in adults with PKU. First, cognitive interviews on 58 POMS items (excluding 7 Friendliness domain items) among 15 adults and adolescents (age ≥16 years) with PKU were conducted to eliminate items poorly understood or considered irrelevant to PKU; 17 items were removed. Next, the remaining POMS items were quantitatively examined (Mokken scaling and Rasch analysis) in 115 adult patients with PKU. An additional 21 items were removed iteratively, resulting in the 20-item draft PKU-POMS. Finally, the psychometric properties of the draft PKU-POMS were examined. The instrument displayed strong psychometric properties (reliability, validity, and responsiveness) over 6 domains (Anxiety, Depression, Anger, Activity, Tiredness, and Confusion) and all items were well understood in the final cognitive interviews with 10 adults with PKU.