Treatment of Patients Presenting With Suicidal Behavior in North American Pediatric Emergency Departments.

OBJECTIVE: This study sought to identify current practices for the treatment of patients presenting with suicidal ideation or a recent suicide attempt in pediatric emergency departments (EDs) in North America. METHODS: From October 10, 2018, to January 19, 2020, the authors conducted a cross-sectional online survey on current practices of pediatric emergency medicine chiefs practicing in the United States and Canada. RESULTS: Forty-six (34%) of 136 chiefs of pediatric emergency medicine responded to the survey. The three most frequent improvements chiefs reported they would like to see in the care of young patients with suicidal ideation or suicide attempt were easier access to mental health personnel for evaluations, having mental health personnel take primary responsibility for patient evaluation and treatment, and better access to mental health personnel for dispositional planning. CONCLUSIONS: The findings highlight the need for better mental health care in pediatric EDs to serve patients at increased risk for suicide.

Lifeline Crisis Chat: Coding form development and findings on chatters' risk status and counselor behaviors.

OBJECTIVE: This study aimed to develop a reliable tool for the abstraction of data from crisis chat transcripts; to describe chatters' suicide risk status and selected counselor behaviors; and to examine the relationship of chatters' self-reported pre-chat suicidal thoughts to counselor behaviors and to chatters' disclosures of suicide risk during the chat conversation. METHODS: Coders used an instrument developed for this study to abstract data from 1034 crisis chats handled by the National Suicide Prevention Lifeline Crisis Chat network in 2015. The relationship of transcript coding data to data from an automated pre-chat survey (PCS) was examined. RESULTS: Lifeline Crisis Chat serves a young (median age = 21), high-risk population: 84.0% of chats (869/1034) came from chatters endorsing current or recent suicidal thoughts on the PCS. Counselors engaged in rapport-building on 93.3%, problem-solving on 70.1%, and suicide risk assessment on 67.7% of these 869 chats. Counselor risk assessment behavior, and the availability of information on suicide risk in the chat transcript, varied significantly by the chatter's PCS response. CONCLUSION: Crisis counselors are able to implement keystones of Lifeline's crisis intervention model over the medium of online chat. Additional efforts are needed to ensure that suicide risk is assessed on every chat.

Challenges in Measuring Applied Cognition: Measurement Properties and Equivalence of the Functional Assessment in Acute Care Multidimensional Computerized Adaptive Test (FAMCAT) Applied Cognition Item Bank.

OBJECTIVE: To present challenges in assessment of applied cognition and the results of differential item functioning (DIF) analyses used to inform the development of a computerized adaptive test (CAT). DESIGN: Measurement evaluation cohort study. DIF analyses of 107 items were conducted across educational, age, and sex groups. DIF hypotheses informed the evaluation of the results. SETTING: Hospital-based rehabilitation from a single hospital system. PARTICIPANTS: A total of 2216 hospitalized patients (N=2216). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Applied cognition item pool from multiple sources. RESULTS: Many items were hypothesized to show DIF, particularly for age. Information was moderately high in the lower (cognitive disability) tail of the distribution, but some items were not informative. Reliability estimates were high (>0.89) across all studied groups, regardless of estimation method. There were 35 items with DIF of high magnitude and 19 with accompanying supportive hypotheses. CONCLUSIONS: A key clinical tool in inpatient rehabilitation medicine is assessment of applied functional cognitive ability to inform patient-centered rehabilitation strategies to improve function. This was the first study to evaluate measurement equivalence of the applied cognition item pool across large samples of hospitalized patients. Although about one-third of the item pool evidenced DIF or low discrimination, results supported placement of most items into the bank and its use across groups differing in education, age, and sex. Six items were classified with salient DIF, defined as consistent DIF of high magnitude and or impact, with confirmatory directional DIF hypotheses, generated by content experts. These were recommended for adjustment or removal from the bank; 4 were deleted from the bank and 2 had lowered CAT exposure (administration frequency) rates. Many items hypothesized to show DIF contained content measuring constructs other than applied cognition such as physical frailty, perceptual difficulties, or skills reflective of greater educational attainment. Challenges in measurement of this construct are discussed.

Third-party callers to the national suicide prevention lifeline: Seeking assistance on behalf of people at imminent risk of suicide.

OBJECTIVE: To assist suicidal individuals, people in their social network are often directed to the National Suicide Prevention Lifeline (Lifeline). The study's objective was to provide information on third-party calls made out of concern for another person. METHOD: Reports on 172 third-party calls concerning individuals deemed to be at imminent suicide risk were completed by 30 crisis counselors at six Lifeline crisis centers. RESULTS: Third-party callers were most likely to be calling about a family member or friend and were significantly more likely than persons at risk to be female and middle-aged or older. Counselors were able to collect information about suicide risk, and counselors and third-parties were nearly always able to identify at least one intervention to aid the person at risk. Emergency services were contacted on 58.1 percent of the calls, which represents a somewhat higher rate of emergency services involvement than previously reported on imminent risk calls placed by the person at risk. Characteristics of third-parties and persons-at-risk each predicted emergency service involvement, but counselor characteristics did not. Non-emergency interventions were implemented on 68.6 percent of calls. CONCLUSIONS: Individuals calling the Lifeline when they are worried about someone are provided a range of interventions which can supplement, and at times replace, calling 911.

Examination of the Measurement Equivalence of the Functional Assessment in Acute Care MCAT (FAMCAT) Mobility Item Bank Using Differential Item Functioning Analyses.

OBJECTIVE: To assess differential item functioning (DIF) in an item pool measuring the mobility of hospitalized patients across educational, age, and sex groups. DESIGN: Measurement evaluation cohort study. Content experts generated DIF hypotheses to guide the interpretation. The graded response item response theory (IRT) model was used. Primary DIF tests were Wald statistics; sensitivity analyses were conducted using the IRT ordinal logistic regression procedure. Magnitude and impact were evaluated by examining group differences in expected item and scale score functions. SETTING: Hospital-based rehabilitation. PARTICIPANTS: Hospitalized patients (N=2216). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: A total of 111 self-reported mobility items. RESULTS: Two linking items among those used to set the metric across forms evidenced DIF for sex and age: "difficulty climbing stairs step-over-step without a handrail (alternating feet)" and "difficulty climbing 3-5 steps without a handrail." Conditional on the mobility state, the items were more difficult for women and older people (aged ≥65y). An additional 18 items were identified with DIF. Items with both high DIF magnitude and hypotheses related to age were difficulty "crossing road at a 4-lane traffic light with curbs," "jumping/landing on one leg," "strenuous activities," and "descending 3-5 steps with no handrail." Although DIF of higher magnitude was observed for several items, the scale-level effect was relatively small and the exposure rate for the most problematic items was low (0.35, 0.27, and 0.20). CONCLUSIONS: This was the first study to evaluate measurement equivalence of the hospital-based rehabilitation mobility item bank. Although 20 items evidenced high magnitude DIF, 5 of which were related to stairs, the scale-level effect was minimal; however, it is recommended that such items be avoided in the development of short-form measures. No items with salient DIF were removed from calibrations, supporting the use of the item bank across groups differing in education, age, and sex. The bank may thus be useful to assist clinical assessment and decision-making regarding risk for specific mobility restrictions at discharge as well as identifying mobility-related functions targeted for postdischarge interventions. Additionally, with the goal of avoiding long and burdensome assessments for patients and clinical staff, these results could be informative for those using the item bank to construct short forms.

Differential Item Functioning Analyses of the Patient-Reported Outcomes Measurement Information System (PROMIS®) Measures: Methods, Challenges, Advances, and Future Directions.

Several methods used to examine differential item functioning (DIF) in Patient-Reported Outcomes Measurement Information System (PROMIS®) measures are presented, including effect size estimation. A summary of factors that may affect DIF detection and challenges encountered in PROMIS DIF analyses, e.g., anchor item selection, is provided. An issue in PROMIS was the potential for inadequately modeled multidimensionality to result in false DIF detection. Section 1 is a presentation of the unidimensional models used by most PROMIS investigators for DIF detection, as well as their multidimensional expansions. Section 2 is an illustration that builds on previous unidimensional analyses of depression and anxiety short-forms to examine DIF detection using a multidimensional item response theory (MIRT) model. The Item Response Theory-Log-likelihood Ratio Test (IRT-LRT) method was used for a real data illustration with gender as the grouping variable. The IRT-LRT DIF detection method is a flexible approach to handle group differences in trait distributions, known as impact in the DIF literature, and was studied with both real data and in simulations to compare the performance of the IRT-LRT method within the unidimensional IRT (UIRT) and MIRT contexts. Additionally, different effect size measures were compared for the data presented in Section 2. A finding from the real data illustration was that using the IRT-LRT method within a MIRT context resulted in more flagged items as compared to using the IRT-LRT method within a UIRT context. The simulations provided some evidence that while unidimensional and multidimensional approaches were similar in terms of Type I error rates, power for DIF detection was greater for the multidimensional approach. Effect size measures presented in Section 1 and applied in Section 2 varied in terms of estimation methods, choice of density function, methods of equating, and anchor item selection. Despite these differences, there was considerable consistency in results, especially for the items showing the largest values. Future work is needed to examine DIF detection in the context of polytomous, multidimensional data. PROMIS standards included incorporation of effect size measures in determining salient DIF. Integrated methods for examining effect size measures in the context of IRT-based DIF detection procedures are still in early stages of development.

National Suicide Prevention Lifeline crisis chat interventions: Evaluation of chatters' perceptions of effectiveness.

OBJECTIVE: As part of the National Suicide Prevention Lifeline's crisis response system, the Lifeline Crisis Chat Network (LCC) answers chats from hundreds of thousands of at-risk individuals yearly. The study's objective was to assess the effectiveness of these online crisis interventions. METHOD: Data from 39,911 pre-chat surveys and 13,130 linked pre- and post-chat surveys completed by LCC chatters from October 2017-June 2018 were analyzed. The relationship of several effectiveness measures with chatter demographics, pre-chat distress, suicidal ideation, and chatters' perceptions of engagement with their counselors was examined using a series of logistic regression analyses. RESULTS: Chatters were significantly and substantially less distressed at the end of the chat intervention than at the beginning. By the end of the chat, two-thirds of suicidal chatters reported that the chat had been helpful, while just under half reported being less suicidal. CONCLUSIONS: Our study offers empirical evidence for the Lifeline's online crisis chat services' effectiveness, but also highlights areas for improvement. This is of critical import in light of the recent designation of 988 as the nationwide number for the Lifeline beginning in 2022, which will increase the Lifeline's prominence in providing suicide prevention and mental health crisis interventions in the United States.

Evaluation of the measurement properties of the Perceived Stress Scale (PSS) in Hispanic caregivers to patients with Alzheimer's disease and related disorders.

OBJECTIVES: The Perceived Stress Scale (PSS) is the most widely used measure of perceived stress; however, minimal psychometric evaluation has been performed among Hispanic respondents, and even less among Hispanic caregivers to persons with Alzheimer's disease and related disorders (ADRDs). DESIGN: Secondary data analysis. SETTING: New York City, NY, USA. PARTICIPANTS: A sample of 453 community dwelling Hispanic caregivers to patients with ADRD. MEASUREMENTS: Latent variable models were used to evaluate the PSS. Exploratory and confirmatory factor analyses were used to examine unidimensionality. Differential item functioning (DIF) was examined for age, education, and language using the graded item response model. RESULTS: The factor and bifactor analyses results supported essential unidimensionality of the item set; however, positively worded items were observed using response item theory to be less informative than the negatively worded items. Reliability estimates were high. Salient DIF was not observed for age, education, or language of interview using the primary DIF detection method. Sensitivity analyses using a second DIF detection method identified uniform language-DIF for the item, "In the last month, how often have you felt that you were on top of things?" However, the non-compensatory DIF value was below the threshold considered salient. CONCLUSIONS: In summary, the 10-item PSS performed well in a sample of English- and Spanish-speaking Hispanic caregivers to patients with ADRD. Very little DIF, and none of high magnitude and impact, was observed. However, the negatively worded items, perhaps because they are more directly reflective of stress, were more informative. In the context of a short-form measure or computerized adaptive test, more informative items are those that would be selected for inclusion.

Evaluation of measurement equivalence of the Family Satisfaction with the End-of-Life Care (FAMCARE): Tests of differential item functioning between Hispanic and non-Hispanic White caregivers.

OBJECTIVE: Although the psychometric properties of the Family Satisfaction with End-of-Life Care measure have been examined in diverse settings internationally; little evidence exists regarding measurement equivalence in Hispanic caregivers. The aim was to examine the psychometric properties of a short-form of the FAMCARE in Hispanics using latent variable models and place information on differential item functioning (DIF) in an existing family satisfaction item bank. METHOD: The graded form of the item response theory model was used for the analyses of DIF; sensitivity analyses were performed using a latent variable logistic regression approach. Exploratory and confirmatory factor analyses to examine dimensionality were performed within each subgroup studied. The sample included 1,834 respondents: 317 Hispanic and 1,517 non-Hispanic White caregivers of patients with Alzheimer's disease and cancer, respectively. RESULTS: There was strong support for essential unidimensionality for both Hispanic and non-Hispanic White subgroups. Modest DIF of low magnitude and impact was observed; flagged items related to information sharing. Only 1 item was flagged with significant DIF by both a primary and sensitivity method after correction for multiple comparisons: "The way the family is included in treatment and care decisions." This item was more discriminating for the non-Hispanic, White responders than for the Hispanic subsample, and was also a more severe indicator at some levels of the trait; the Hispanic respondents located at higher satisfaction levels were more likely than White non-Hispanic respondents to report satisfaction. SIGNIFICANCE OF RESULTS: The magnitude of DIF was below the salience threshold for all items. Evidence supported the measurement equivalence and use for cross-cultural comparisons of the short-form FAMCARE among Hispanic caregivers, including those interviewed in Spanish.

The Relation between Descriptive Norms, Suicide Ideation, and Suicide Attempts among Adolescents.

This study examined the relationship between adolescents' beliefs about the prevalence of youth suicide ideation (ideation descriptive norms) and suicide attempts (attempt descriptive norms) with self-reported suicide ideation and attempts. Descriptive norms, suicide ideation, and suicide attempts as well as gender, race/ethnicity, and exposure to family, peer, and others' suicide were assessed in 2,109 students at six suburban New York State high schools. After controlling for demographic variables and exposure to suicide, elevated ideation descriptive norms and attempt descriptive norms were associated with higher rates of suicide ideation and lifetime suicide attempts among adolescents. Adolescents who believed suicide ideation and attempts to be more widespread among peers (i.e., elevated ideation and attempt descriptive norms) were more likely to endorse suicide ideation and attempts. Correcting these descriptive norms may be a worthwhile goal for school-based suicide prevention programs.

Exposure to Suicide in High Schools: Impact on Serious Suicidal Ideation/Behavior, Depression, Maladaptive Coping Strategies, and Attitudes toward Help-Seeking.

Adolescents' exposure to a peer's suicide has been found to be associated with, as well as to predict, suicidal ideation and behavior. Although postvention efforts tend to be school-based, little is known about the impact of a schoolmate's suicide on the school's student population overall. The present study seeks to determine whether there is excess psychological morbidity among students in a school where a schoolmate has died by suicide, and whether students' attitudes about coping and help-seeking strategies are more or less problematic in such schools. Students in twelve high schools in Suffolk and Westchester counties in New York State-2865 students at six schools where a student had died by suicide within the past six months, and 2419 students at six schools where no suicide had occurred within the current students' tenure-completed an assessment of their suicidal ideation and behavior, depressive symptoms, coping and help-seeking attitudes, stressful life events, and friendship with suicide decedent (if applicable). No excess morbidity (i.e., serious suicidal ideation/behavior and depression) was evident among the general student population after a schoolmate's death by suicide; however, the risk of serious suicidal ideation/behavior was elevated among students at exposed schools who had concomitant negative life events. There was a significant relationship between friendship with the decedent and morbidity, in that students who were friends, but not close friends, of the decedents had the greatest odds of serious suicidal ideation/behavior. Overall, students in exposed schools had more adaptive attitudes toward help-seeking; but this was not true of the decedents' friends or students with concomitant negative life events. The implications of the findings for postvention strategies are discussed.

Follow-up with Callers to the National Suicide Prevention Lifeline: Evaluation of Callers' Perceptions of Care.

Continuity of care for suicidal individuals engaged with a variety of health and mental health care systems has become a national priority, and crisis hotlines are increasingly playing a part in the risk management and continuum of care for these individuals. The current study evaluated a national initiative to have crisis centers in the National Suicide Prevention Lifeline network provide follow-up care to suicidal callers. Data were obtained from 550 callers followed by 41 crisis counselors from 6 centers. Two main data sources provided the information for the current study: a self-report counselor questionnaire on the follow-up activities completed on each clinical follow-up call and a telephone interview with follow-up clients, providing data on their perceptions of the follow-up intervention's effectiveness. The majority of interviewed follow-up clients reported that the intervention stopped them from killing themselves (79.6%) and kept them safe (90.6%). Counselor activities, such as discussing distractors, social contacts to call for help, and reasons for dying, and individual factors, such as baseline suicide risk, were associated with callers' perceptions of the impact of the intervention on their suicide risk. Our findings provide evidence that follow-up calls to suicidal individuals can reduce the perceived risk of future suicidal behavior.

Trainer Fidelity as a Predictor of Crisis Counselors' Behaviors With Callers Who Express Suicidal Thoughts.

OBJECTIVE: The relationship between trainer fidelity during a two-day suicide prevention program for counselors at crisis centers and counselors' behaviors during calls from individuals with suicidal thoughts was examined. METHODS: The study used two data sets from a randomized control trial of a suicide prevention program delivered by counselors at 17 crisis centers who had previously received training (train-the-trainer [TTT] approach). One data set examined counselors' behaviors by silently monitoring calls (N=764) to the crisis lines, and one assessed adherence to manual content and competence in delivery among trainers (N=34) by coding training videotapes. Multilevel modeling was used to account for nested data. RESULTS: Use of recommended behaviors by counselors was primarily related to trainers' competence in delivery of the program rather than adherence to the program content. CONCLUSIONS: Trainer selection for competence may be particularly critical for group-based TTT programs involving experienced counselors and the use of experiential activities.

Suicidal Plans and Attempts Among Adolescents in Mongolia.

BACKGROUND: Although 75% of suicides occur in low- and middle-income countries, few studies have examined suicidal behaviors among young people in these countries. AIMS: This study aimed to examine what individual characteristics were associated with suicidal plans and attempts among Mongolian youth and whether suicidal risks and behaviors varied by urban and rural locations. METHOD: Logistic regression analyses were utilized to investigate suicidal plans and attempts among 5,393 adolescents using the Global Student Health Survey - 2013. RESULTS: Adolescents who lived in urban areas were at higher risk for suicidal plans and behaviors than those who lived in rural areas; however, the patterns of suicidal risks were similar. Specifically, individual characteristics, such as being female, feeling lonely and worried, smoking cigarettes, drinking alcohol, and having fights at school, were associated with suicidal plans and behaviors regardless of the residential places. LIMITATIONS: A number of important variables have not been included in the questionnaire such as depression, family and parental support, household income, family constructs etc. CONCLUSION: Given the comparable patterns of risk between urban and rural adolescents and the relatively high rates of suicidal plans and attempts, similar mental health services and interventions are necessitated for both urban and rural areas.

Methodological issues in measuring subjective well-being and quality-of-life: Applications to assessment of affect in older, chronically and cognitively impaired, ethnically diverse groups using the Feeling Tone Questionnaire.

Quality of life assessment includes measurement of positive affect. Methods artifacts associated with positively and negatively worded items can manifest as negative items loading on a second factor, despite the conceptual view that the items are measuring one underlying latent construct. Negatively worded items may elicit biased responses. Additionally, item-level response bias across ethnically diverse groups may compromise group comparisons. The aim was to illustrate methodological approaches to examining method factors and measurement equivalence in an affect measure with 9 positively and 7 negatively worded items: The Feeling Tone Questionnaire (FTQ). The sample included 4,960 non-Hispanic White, 1,144 non-Hispanic Black, and 517 Hispanic community and institutional residents receiving long-term supportive services. The mean age was 82 (s.d.=11.0); 73% were female. Two thirds were cognitively impaired. Methods effects were assessed using confirmatory factor analyses (CFA), and reliability with McDonald's omega and item response theory (IRT) generated estimates. Measurement equivalence was examined using IRT-based Wald tests. Methods effects associated with negatively worded items were observed; these provided little IRT information, and as a composite evidenced lower reliability. Both 13 and 9 item positive affect scales performed well in terms of model fit, reliability, IRT information, and evidenced little differential item functioning of high magnitude or impact. Both CFA and IRT approaches provided complementary methodological information about scale performance. The 9-item affect scale based on the FTQ can be recommended as a brief quality-of-life measure among frail and cognitively impaired individuals in palliative and long-term care settings.

Helping Callers to the National Suicide Prevention Lifeline Who Are at Imminent Risk of Suicide: Evaluation of Caller Risk Profiles and Interventions Implemented.

Crisis lines are settings where identifying individuals at imminent risk of suicidal behavior and intervening to keep them safe are critical activities. We examined clinical characteristics of crisis callers assessed by telephone crisis helpers as being at imminent risk of suicide, and the interventions implemented with these callers. Data were derived from 491 call reports completed by 132 helpers at eight crisis centers in the National Suicide Prevention Lifeline network. Helpers actively engaged the callers in collaborating to keep themselves safe on 76.4% of calls and sent emergency services without the callers' collaboration on 24.6% of calls. Four different profiles of imminent risk calls emerged. Caller profiles and some helper characteristics were associated with intervention type. Our findings provide a first step toward an empirical formulation of imminent risk warning signs and recommended interventions.

Measurement Equivalence of the Patient Reported Outcomes Measurement Information System® (PROMIS®) Pain Interference Short Form Items: Application to Ethnically Diverse Cancer and Palliative Care Populations.

Reducing the response burden of standardized pain measures is desirable, particularly for individuals who are frail or live with chronic illness, e.g., those suffering from cancer and those in palliative care. The Patient Reported Outcome Measurement Information System® (PROMIS®) project addressed this issue with the provision of computerized adaptive tests (CAT) and short form measures that can be used clinically and in research. Although there has been substantial evaluation of PROMIS item banks, little is known about the performance of PROMIS short forms, particularly in ethnically diverse groups. Reviewed in this article are findings related to the differential item functioning (DIF) and reliability of the PROMIS pain interference short forms across diverse sociodemographic groups. METHODS: DIF hypotheses were generated for the PROMIS short form pain interference items. Initial analyses tested item response theory (IRT) model assumptions of unidimensionality and local independence. Dimensionality was evaluated using factor analytic methods; local dependence (LD) was tested using IRT-based LD indices. Wald tests were used to examine group differences in IRT parameters, and to test DIF hypotheses. A second DIF-detection method used in sensitivity analyses was based on ordinal logistic regression with a latent IRT-derived conditioning variable. Magnitude and impact of DIF were investigated, and reliability and item and scale information statistics were estimated. RESULTS: The reliability of the short form item set was excellent. However, there were a few items with high local dependency, which affected the estimation of the final discrimination parameters. As a result, the item, "How much did pain interfere with enjoyment of social activities?" was excluded in the DIF analyses for all subgroup comparisons. No items were hypothesized to show DIF for race and ethnicity; however, five items showed DIF after adjustment for multiple comparisons in both primary and sensitivity analyses: ability to concentrate, enjoyment of recreational activities, tasks away from home, participation in social activities, and socializing with others. The magnitude of DIF was small and the impact negligible. Three items were consistently identified with DIF for education: enjoyment of life, ability to concentrate, and enjoyment of recreational activities. No item showed DIF above the magnitude threshold and the impact of DIF on the overall measure was minimal. No item showed gender DIF after correction for multiple comparisons in the primary analyses. Four items showed consistent age DIF: enjoyment of life, ability to concentrate, day to day activities, and enjoyment of recreational activities, none with primary magnitude values above threshold. Conditional on the pain state, Spanish speakers were hypothesized to report less pain interference on one item, enjoyment of life. The DIF findings confirmed the hypothesis; however, the magnitude was small. Using an arbitrary cutoff point of theta (θ) ≥ 1.0 to classify respondents with acute pain interference, the highest number of changes were for the education groups analyses. There were 231 respondents (4% of the total sample) who changed from the designation of no acute pain interference to acute interference after the DIF adjustment. There was no change in the designations for race/ethnic subgroups, and a small number of changes for respondents aged 65 to 84. CONCLUSIONS: Although significant DIF was observed after correction for multiple comparisons, all DIF was of low magnitude and impact. However, some individual-level impact was observed for low education groups. Reliability estimates were high. Thus, the PROMIS short form pain items examined in this ethnically diverse sample performed relatively well; although one item was problematic and removed from the analyses. It is concluded that the majority of the PROMIS pain interference short form items can be recommended for use among ethnically diverse groups, including those in palliative care and with cancer and chronic illness.

Measurement Equivalence of the Patient Reported Outcomes Measurement Information System® (PROMIS®) Anxiety Short Forms in Ethnically Diverse Groups.

This is the first study of the measurement equivalence of the Patient Reported Outcomes Measurement Information System® (PROMIS®) Anxiety short forms in a large ethnically diverse sample. The psychometric properties and differential item functioning (DIF) were examined across different racial/ethnic, educational, age, gender and language groups. METHODS: These data are from individuals selected from cancer registries in the United States. For the analyses of race/ethnicity the reference group was non-Hispanic Whites (n = 2,263), the studied groups were non-Hispanic Blacks (n = 1,117), Hispanics (n = 1,043) and Asians/Pacific Islanders (n = 907). Within the Hispanic subsample, there were 335 interviews conducted in Spanish and 703 in English. The 11 anxiety items were from the PROMIS emotional disturbance item bank. DIF hypotheses were generated by content experts who rated whether or not they expected DIF to be present, and the direction of the DIF with respect to several comparison groups. The primary method used for DIF detection was the Wald test for examination of group differences in item response theory (IRT) item parameters accompanied by magnitude measures. Expected item scores were examined as measures of magnitude. The method used for quantification of the difference in the average expected item scores was the non-compensatory DIF (NCDIF) index. DIF impact was examined using expected scale score functions. Additionally, precision and reliabilities were examined using several methods. RESULTS: Although not hypothesized to show DIF for Asians/Pacific Islanders, every item evidenced DIF by at least one method. Two items showed DIF of higher magnitude for Asians/Pacific Islanders vs. Whites: "Many situations made me worry" and "I felt anxious". However, the magnitude of DIF was small and the NCDIF statistics were not above threshold. The impact of DIF was negligible. For education, six items were identified with consistent DIF across methods: fearful, anxious, worried, hard to focus, uneasy and tense. However, the NCDIF was not above threshold and the impact of DIF on the scale was trivial. No items showed high magnitude DIF for gender. Two items showed slightly higher magnitude for age (although not above the cutoff): worried and fearful. The scale level impact was trivial. Only one item showed DIF with the Wald test after the Bonferroni correction for the language comparisons: "I felt fearful". Two additional items were flagged in sensitivity analyses after Bonferroni correction, anxious and many situations made me worry. The latter item also showed DIF of higher magnitude, with an NCDIF value (0.144) above threshold. Individual impact was relatively small. CONCLUSIONS: Although many items from the PROMIS short form anxiety measures were flagged with DIF, item level magnitude was low and scale level DIF impact was minimal; however, three items: anxious, worried and many situations made me worry might be singled out for further study. It is concluded that the PROMIS Anxiety short form evidenced good psychometric properties, was relatively invariant across the groups studied, and performed well among ethnically diverse subgroups of Blacks, Hispanic, White non-Hispanic and Asians/Pacific Islanders. In general more research with the Asians/Pacific Islanders group is needed. Further study of subgroups within these broad categories is recommended.

Measurement Equivalence of the Patient Reported Outcomes Measurement Information System® (PROMIS®) Applied Cognition - General Concerns, Short Forms in Ethnically Diverse Groups.

AIMS: The goals of these analyses were to examine the psychometric properties and measurement equivalence of a self-reported cognition measure, the Patient Reported Outcome Measurement Information System® (PROMIS®) Applied Cognition - General Concerns short form. These items are also found in the PROMIS Cognitive Function (version 2) item bank. This scale consists of eight items related to subjective cognitive concerns. Differential item functioning (DIF) analyses of gender, education, race, age, and (Spanish) language were performed using an ethnically diverse sample (n = 5,477) of individuals with cancer. This is the first analysis examining DIF in this item set across ethnic and racial groups. METHODS: DIF hypotheses were derived by asking content experts to indicate whether they posited DIF for each item and to specify the direction. The principal DIF analytic model was item response theory (IRT) using the graded response model for polytomous data, with accompanying Wald tests and measures of magnitude. Sensitivity analyses were conducted using ordinal logistic regression (OLR) with a latent conditioning variable. IRT-based reliability, precision and information indices were estimated. RESULTS: DIF was identified consistently only for the item, brain not working as well as usual. After correction for multiple comparisons, this item showed significant DIF for both the primary and sensitivity analyses. Black respondents and Hispanics in comparison to White non-Hispanic respondents evidenced a lower conditional probability of endorsing the item, brain not working as well as usual. The same pattern was observed for the education grouping variable: as compared to those with a graduate degree, conditioning on overall level of subjective cognitive concerns, those with less than high school education also had a lower probability of endorsing this item. DIF was also observed for age for two items after correction for multiple comparisons for both the IRT and OLR-based models: "I have had to work really hard to pay attention or I would make a mistake" and "I have had trouble shifting back and forth between different activities that require thinking". For both items, conditional on cognitive complaints, older respondents had a higher likelihood than younger respondents of endorsing the item in the cognitive complaints direction. The magnitude and impact of DIF was minimal. The scale showed high precision along much of the subjective cognitive concerns continuum; the overall IRT-based reliability estimate for the total sample was 0.88 and the estimates for subgroups ranged from 0.87 to 0.92. CONCLUSION: Little DIF of high magnitude or impact was observed in the PROMIS Applied Cognition - General Concerns short form item set. One item, "It has seemed like my brain was not working as well as usual" might be singled out for further study. However, in general the short form item set was highly reliable, informative, and invariant across differing race/ethnic, educational, age, gender, and language groups.

Differential item functioning magnitude and impact measures from item response theory models.

Measures of magnitude and impact of differential item functioning (DIF) at the item and scale level, respectively are presented and reviewed in this paper. Most measures are based on item response theory models. Magnitude refers to item level effect sizes, whereas impact refers to differences between groups at the scale score level. Reviewed are magnitude measures based on group differences in the expected item scores and impact measures based on differences in the expected scale scores. The similarities among these indices are demonstrated. Various software packages are described that provide magnitude and impact measures, and new software presented that computes all of the available statistics conveniently in one program with explanations of their relationships to one another.