Why Didn't You Call Me? Factors Junior Learners Consider When Deciding Whether to Call Their Supervisor.

OBJECTIVE: Over half of junior learners (JL) feel pressure to work independently and report rarely calling their supervisor. It is unclear how JL decide whether or not to call their supervisor. The study aims to identify factors that JL consider when responding to clinical scenarios and deciding whether to call senior residents (SR) and compare them to factors identified by SR. METHODS: Fifteen cognitive interviews were conducted with SR and JL. Participants were given 8 to 15 sample pages and probed regarding the factors they considered when triaging the page and deciding whether to inform a SR. De-identified interview transcripts were inductively coded using an interpretative phenomenological analysis (IPA) approach. SETTING: Department of Surgery, Faculty of medicine at the University of Ottawa in Canada. PARTICIPANT: Five general surgery SR and ten JL, which included 5 senior medical students and 5 general surgery junior residents. RESULTS: JL and SR indicated a clear need to call SR when managing high acuity pages, which included hemodynamic instability, decreased level of consciousness, or codes (ie, trauma, cardiac arrest). In the absence of high acuity findings, JL judged whether to call SR based on 10 patient and learner-related factors. Patient-related factors include: 1) time since surgery, 2) patient appearance, 3) patient requires intervention, and 4) lack of improvement after initial independent management attempt. Learner-related factors were categorized into clinical (5-8) and social factors (9-10): 5) nurse's level of concern, 6) familiarity with the patient, 7) gut feeling, 8) prior experience managing this presentation, 9) time of day, and 10) interpersonal dynamic with SR. While SR identified all patient-related and clinical factors, they did not cite the 2 social factors JL considered. CONCLUSION: When pages lack high-acuity findings, JL consider various patient and learner factors when deciding whether to inform SR. Discussing these factors may help guide new JL regarding when they should call their supervisor. Understanding social factors is important to create a culture that minimizes their influence on JL's decision-making and promotes patient safety.

Use of Cognitive Interviews in the Development of a Survey Assessing American Indian and Alaska Native Adult Perspectives on Genetics and Biological Specimens.

The cognitive interview process is a method to validate a survey instrument's face validity and enhance confidence in item interpretation, as well as a method to engage communities in the research process. Trained American Indian and Alaska Native (AIAN) interviewers conducted retrospective cognitive interviews at three AIAN communities to assess the item quality of a 131-item survey item that measures AIAN knowledge and attitudes on genetics and biological specimens. A cognitive interview process was used to assess cultural consonance, thought processes used when considering survey instructions, items and responses, and language preference of survey items in the development of a survey to assess public knowledge and attitudes on genetics. Content analysis was used to analyze interview data. Survey instructions, items and scales generated no cognitive difficulties. The participants noted being unfamiliar with terminology used to describe genetic and biological specimens. In several cases, the participants' written response in the survey and verbal response in the interview did not align. A resultant 52-item survey for use in AIAN communities was finalized. Cognitive interviewing is resource-intensive; however, ignoring community engagement during survey development results in inappropriate interpretations about culturally diverse populations such as AIAN peoples.

Development, validity, and reliability assessment of the Canadian Food Literacy Measure.

Food literacy is a growing area of interest given its potential to support healthy and sustainable diets. Most existing food literacy measures focus on nutrition and food skills but fail to address food systems and socio-environmental aspects of food literacy. Further, measures developed and tested in the Canadian context are lacking. The objective of this project was to develop and test the validity and reliability of a brief self-administered measure, in French and English, designed to assess multiple dimensions of food literacy among adults living in Canada. The 23-item Canadian Food Literacy Measure was developed through an iterative process that included assessment of face and content validity through expert review (n = 20) and cognitive interviews (n = 20) and construct validity and reliability, i.e., internal consistency through an online survey (n = 154). The results indicate that the measure is well understood by both English- and French-speaking adults. The measure's construct validity is demonstrated by the observed differences in total scores in hypothesized directions by gender (p = 0.003), age (p = 0.007), education level (p = 0.002), health literacy (p < 0.001) and smoking status (p = 0.001), and the significant positive correlation (r = 0.29; p = 0.002) between total scores and fruit and vegetable intake. The measure also has high internal consistency with a Cronbach's coefficient alpha of 0.80. This measure can be used in surveillance studies to provide insight into the food literacy of adults living in Canada and in epidemiologic research that aims to explore how food literacy is associated with a variety of health outcomes.

Development of a Vitamin B12 Deficiency Patient-Reported Outcome Measure for Clinical Practice and Research.

BACKGROUND: It is difficult to recognize vitamin B12 deficiency and to evaluate the effect of B12 treatment due to a broad range of variable clinical symptoms overlapping with other diseases and diagnostic biomarkers that quickly normalize during treatment. This poses a risk of delay in diagnosis and a challenge to uniformly monitor the effect of B12 treatment. There is a need for a new clinical outcome measure suitable for clinical practice and clinical evaluation studies. OBJECTIVE: To develop a Patient-Reported Outcome Measure (PROM) which measures the severity of vitamin B12 deficiency symptoms. METHODS: The B12 PROM was developed by (1) gathering input from experts and literature review to define a construct and develop a conceptual model, (2) processing input from health care providers, scientists, and patients to develop items and response options, and (3) improving items based on the feedback from laypersons, test interviews, semi-structured cognitive interviews with patients, and forward and backward translation (ENG-NL). RESULTS: The B12 PROM includes 62 items grouped into 8 categories of symptoms related to vitamin B12 deficiency (General, Senses, Thinking, In limbs and/or face, Movement, Emotions, Mouth & Abdomen, Urinary tract & Reproductive organs). Cognitive interviews demonstrated good comprehensibility and comprehensiveness. CONCLUSIONS: This study is the first step in the development of a disease-specific PROM for vitamin B12 deficiency to measure the burden of symptoms. Further validation and reliability testing are necessary before the PROM can be applied in clinical practice and research.

Plain language titleDevelopment of a Vitamin B12 Deficiency Questionnaire for Clinical Practice and ResearchPlain language summaryThis study is the first step in the development of a questionnaire for vitamin B12 deficiency to measure the severity of vitamin B12 deficiency symptoms. The questionnaire includes 62 items grouped into 8 categories of symptoms related to vitamin B12 deficiency (General, Senses, Thinking, In limbs and/or face, Movement, Emotions, Mouth & Abdomen, Urinary tract & Reproductive organs). Interviews with patients demonstrated good comprehensibility and comprehensiveness of the questionnaire. Further testing is necessary before the questionnaire can be applied in clinical practice and research.

Asking the "Right" Questions about Financial Hardship: Using Cognitive Interviews with Adolescents and Young Adults with Cancer and Their Caregivers to Inform Measure Development.

Purpose: Financial hardship as a result of cancer treatment can have a significant and lasting negative impact on adolescents and young adults (AYAs) and their families. To address a lack of developmentally informed and psychometrically sound measures of financial hardship for AYAs and their caregivers, we used rigorous measurement development methods recommended by the National Institutes of Health's Patient-Reported Outcomes Measurement Information System® (PROMIS®) to determine comprehensibility and relevance of measure content. Methods: Our multi-step approach involved item identification, refinement, and generation; translatability and reading level review; and cognitive interviews. A purposive sample of 25 AYAs and 10 caregivers participated, ensuring representation across age, education, gender, race/ethnicity, and cancer type. Results: Fifty patient-reported and caregiver-reported items were developed across material, psychosocial, and behavioral subdomains of financial hardship. Translatability and reading level reviews resulted in 22 patient-reported and 25 caregiver-reported items being rewritten. Eighty-eight percent of patients and all caregivers described the items as easy to answer. Younger AYAs (15 to 25 years of age) were more likely to say the items were less relevant for them. Forty-six patient-reported and 48 caregiver-reported items were recommended for further testing. Conclusion: This study is the first to use in-depth qualitative methods to center AYA patient and caregiver experiences in the creation of new measures of financial hardship. Data support the comprehensibility and content validity of these preliminary item banks. Future large-scale, quantitative testing will lead to additional refinements and support the use of short forms and computer-adaptive testing for a diverse sample of AYAs and their caregivers.

Meaning in life after cancer: Validation of the sources of meaning card method among participants in cancer rehabilitation.

Cancer survivors may be struggling to re-create meaning in life. Addressing their personal sources of meaning can support them in this process. The sources of meaning card method (SoMeCaM) aims to map and explore personal sources of meaning in a 1-h session. It includes 26 cards, each with a statement on a source of meaning. The purpose of this study was to validate the statements on the sources of meaning cards for use among participants in cancer rehabilitation by examining whether participants attribute the same meaning to the statements as intended. The three step test interview method was used to assess response processes to the sources of meaning cards among 12 participants in a 5-day cancer rehabilitation program in Denmark. The interviews were transcribed verbatim and analyzed using framework analysis. Nineteen of the 26 statements were interpreted congruently, that is, in line with the underlying theory, by all participants. Issues of incongruency, ambiguity and confusion were observed in participants' interpretations of the statements on religiosity (n = 6), spirituality (n = 10), and reason (n = 6). Minor issues were observed for the statements on practicality, achievement, knowledge, and attentiveness. In most statements, cancer survivors' interpretation aligned with the underlying theory. Problems were apparent regarding the sources of meaning religiosity, spirituality and reason, and a reconsideration of the wording of the statements is recommended. These problems may be due to cultural and linguistic interpretations rather than to being a cancer survivor. Future studies could focus on these issues in other target populations. Despite these minor issues, the SoMeCaM has proven useful in addressing the important topic of meaning in life in the cancer rehabilitation setting. Clinicians should pay attention to nuances in participants' understanding of the cards.

Translation and linguistic validation of 24 PROMIS item banks into French.

PURPOSE: The Patient-Reported Outcome Measurement Information System (PROMIS®) was developed to provide reliable, valid, and normed item banks to measure health. The item banks provide standardized scores on a common metric allowing for individualized, brief assessment (computerized adaptive tests), short forms (e.g. heart failure specific), or profile assessments (e.g. PROMIS-29). The objective of this study was to translate and linguistically validate 24 PROMIS adult item banks into French and highlight cultural nuances arising during the translation process. METHODS: We used the FACIT translation methodology. Forward translation into French by two native French-speaking translators was followed by reconciliation by a third native French-speaking translator. A native English-speaking translator fluent in French then completed a back translation of the reconciled version from French into English. Three independent reviews by bilingual translators were completed to assess the clarity and consistency of terminology and equivalency across the English source and French translations. Reconciled versions were evaluated in cognitive interviews for conceptual and linguistic equivalence. RESULTS: Twenty-four adult item banks were translated: 12 mental health, 10 physical health, and two social health. Interview data revealed that 577 items of the 590 items translated required no revisions. Conceptual and linguistic differences were evident for 11 items that required iterations to improve conceptual equivalence and two items were revised to accurately reflect the English source. CONCLUSION: French translations of 24 item banks were created for routine clinical use and research. Initial translation supported conceptual equivalence and comprehensibility. Next steps will include validation of the item banks.

Development and content validity testing of a colonoscopy-specific patient-reported experience measure: the Patient Experience Colonoscopy Scale (PECS).

BACKGROUND: In endoscopic care, favourable patient experiences before, during and after a colonoscopy are essential for the patient's willingness to repeat the procedure. To ensure that significant experiences are measured, patients should be involved in creating the measurement instruments. Thus, the aim of the present study was to develop a colonoscopy-specific PREM by (1) operationalising patient experiences before, during and after a colonoscopy procedure and (2) evaluating its content validity. METHODS: The colonoscopy-specific PREM was developed in two stages: (1) operationalisation with item generation and (2) content validity testing. A previously developed conceptual model, based on a systematic literature review that illustrates patients' (n = 245) experiences of undergoing a colonoscopy, formed the theoretical basis. To assess the degree to which the PREM reflected patients' experiences before, during and after a colonoscopy procedure, content validity was tested-through face validity with healthcare professionals (n = 4) and cognitive interviews with patients (n = 14) having experienced a colonoscopy. Content validity index (CVI) was calculated to investigate the relevance of the items. RESULTS: The Patient Experience Colonoscopy Scale (PECS) is a colonoscopy-specific PREM consisting of five different constructs: health motivation, discomfort, information, a caring relationship and understanding. Each construct was defined and generated into a pool of items (n = 77). After face-validity assessment with healthcare professionals, a draft 52-item version of the PECS was ready for content validity testing by the patients. During cognitive interviews the patients contributed valuable insights that led to rewording and removal of items. Results from the CVI suggest that the PECS and its content are relevant (I-CVI range 0.5-1, S-CVI/Ave = 0.86). The final PECS consists of 30 items representing a colonoscopy-specific PREM. CONCLUSION: The PECS is a new 30-item PREM instrument designed for adult elective colonoscopy patients after they have undergone the procedure. Each item in the PECS derives from a conceptual model based on a systematic literature review. Patients and healthcare professionals were involved in developing the PECS, which measures colonoscopy-specific patient experiences before, during and after the procedure. The content validity testing positively contributed to the development of the PECS. Psychometric properties need to be evaluated further.

Comparison of evaluation methods for improving the usability of a Spanish mHealth tool.

OBJECTIVE: Mobile health (mHealth) technology is now widely used across health conditions and populations. The rigorous development of these tools has yielded improved health outcomes, yet the ideal approach for developing mHealth tools continues to evolve, indicating the need for rigorous usability evaluation methods. This study compares two usability evaluation methods - cognitive interviews and usability assessments employing a think-aloud approach - for adapting an evidence-based mHealth tool from English into Spanish. METHODS: We conducted cognitive interviews and usability assessments using a think-aloud protocol to evaluate the usability of an HIV mHealth application among 40 Spanish-speaking adults with HIV in New York City, NY, and La Romana, Dominican Republic. The Health IT Usability Evaluation Model (Health-ITUEM) was used to guide the analysis of qualitative data collected from each method. RESULTS: Participants (N = 40) averaged 43 years old (SD = 12.26; range 20-79), identified primarily Hispanic/Latino (92.5 %), and resided in La Romana (50 %) or New York City (50 %). Both usability evaluation methods yielded similar findings, highlighting learnability and information needs as crucial components of participant feedback for the mHealth application. Cognitive interviews captured participants' perspectives on the app's interface and design. On the other hand, results from usability assessments offered insights into participants' competency while interacting with the mHealth tool. CONCLUSION: Findings from this study highlight the contributions and limitations of including cognitive interviews and task-based usability assessments using a think-aloud approach in mHealth usability testing. Future research should employ a multi-method approach, incorporating complementary usability evaluation methods and engaging participants in multiple assessments. Using complementary usability evaluation methods may provide a more comprehensive understanding of the usability and participant experience aspects of a mHealth tool compared to using a single usability evaluation method.

Exploring women's interpretations of survey questions on pregnancy and pregnancy outcomes: cognitive interviews in Iganga Mayuge, Uganda.

BACKGROUND: In 2021, Uganda's neonatal mortality rate was approximately 19 deaths per 1000 live births, with an estimated stillbirth rate of 15.1 per 1000 total births. Data are critical for indicating areas where deaths occur and why, hence driving improvements. Many countries rely on surveys like Demographic and Health Surveys (DHS), which face challenges with respondents' misinterpretation of questions. However, little is documented about this in Uganda. Cognitive interviews aim to improve questionnaires and assess participants' comprehension of items. Through cognitive interviews we explored women's interpretations of questions on pregnancy and pregnancy outcomes. METHODS: In November 2021, we conducted cognitive interviews with 20 women in Iganga Mayuge health and demographic surveillance system site in eastern Uganda. We adapted the reproductive section of the DHS VIII women's questionnaire, purposively selected questions and used concurrent verbal probing. Participants had secondary school education and were English speaking. Cognition was measured through comparing instructions in the DHS interviewers' manual to participants' responses and researcher's knowledge. A qualitative descriptive approach to analysis was undertaken. RESULTS: We report findings under the cognitive aspect of comprehension. Some questions were correctly understood, especially those with less technical terms or without multiple sections. Most participants struggled with questions asking whether the woman has her living biological children residing with her or not. Indeed, some thought it referred to how many living children they had. There were comprehension difficulties with long questions like 210 that asks about miscarriages, newborn deaths, and stillbirths together. Participants had varying meanings for miscarriages, while many misinterpreted stillbirth, not linking it to gestational age. Furthermore, even amongst educated women some survey questions were misunderstood. CONCLUSIONS: Population surveys may misclassify, over or under report events around pregnancy and pregnancy outcomes. Interviewers should begin with a standard definition of key terms and ensure respondents understand these. Questions can be simplified through breaking up long sentences, while interviewer training should be modified to ensure they thoroughly understand key terms. We recommend cognitive interviews while developing survey tools, beyond basic pre-testing. Improving respondents' comprehension and thus response accuracy will increase reporting and data quality.

Development and pilot testing of a patient-reported outcome measure to assess symptoms of parastomal hernia.

AIM: The aim was to develop and pilot a patient-reported outcome measure (PROM) to assess symptoms of parastomal hernia (PSH). METHODS: Standard questionnaire development was undertaken (phases 1-3). An initial list of questionnaire domains was identified from validated colorectal cancer PROMs and from semi-structured interviews with patients with a PSH and health professionals (phase 1). Domains were operationalized into items in a provisional questionnaire, and 'think-aloud' patient interviews explored face validity and acceptability (phase 2). The updated questionnaire was piloted in patients with a stoma who had undergone colorectal surgery and had a computed tomography scan available for review. Patient-reported symptoms were examined in relation to PSH (phase 3). Three sources determined PSH presence: (i) data about PSH presence recorded in hospital notes, (ii) independent expert review of the computed tomography scan and (iii) patient report of being informed of a PSH by a health professional. RESULTS: For phase 1, 169 and 127 domains were identified from 70 PROMs and 29 interviews respectively. In phase 2, 14 domains specific to PSH were identified and operationalized into questionnaire items. Think-aloud interviews led to three minor modifications. In phase 3, 44 completed questionnaires were obtained. Missing data were few: 5/660 items. PSH symptom scores associated with PSH presence varied between different data sources. The scale with the most consistent differences between PSH presence and absence and all data sources was the stoma appearance scale. CONCLUSION: A PROM to examine the symptoms of PSH has been developed from the literature and views of key informants. Although preliminary testing shows it to be understandable and acceptable it is uncertain if it is sensitive to PSH-specific symptoms and further psychometric testing is needed.

Using Cognitive Interviews to Adapt Interpersonal Violence Measures for Use With Middle School Youth.

Experiences of interpersonal violence are common among youth. Starting prevention programming early (e.g., middle school) may be beneficial for primary prevention. Evaluating whether such programs are effective often requires collecting self-report data from youth, but many existing measures have been developed for high school and college-aged youth. This study aimed to assess adolescents' comprehension of self-report survey items on interpersonal violence with middle school youth. We conducted virtual cognitive interviews with 15 youth in grades 6 to 8. A content analysis was used to identify patterns and to classify the nature and type of comprehension issues youth experienced. Nearly all students found most questions clear and understandable. We identified the following comprehension issues: (1) uncertainty with how the intent of a perpetrator factored into a victim's experience (e.g., distinguishing the difference between joking and bullying, or intentional versus unintentional behavior); (2) lack of familiarity with certain expressions of sexualized violence (e.g., "sexual looks") or sex-related terminology (e.g., intercourse); and (3) narrow interpretations of question prompts (e.g., interpreting "forced" as physically forced, not psychologically coerced). Students suggested including language describing dating relationships, types of social media platforms where cyber abuse takes place, and additional examples alongside items to enhance relevance and clarity. Survey questions to measure interpersonal violence may need to be adapted for use among middle school youth. Our findings highlight potential considerations for improving the measurement of interpersonal violence in this age group.

Electronic Patient-Reported Outcomes in Hidradenitis Suppurativa: Content Validity and Usability of the Electronic Hidradenitis Suppurativa Symptom Daily Diary, Hidradenitis Suppurativa Symptom Questionnaire, and Hidradenitis Suppurativa Quality of Life Questionnaire.

BACKGROUND: Hidradenitis suppurativa (HS), a chronic skin condition that causes pain and physical dysfunction, can impact significantly on quality of life. Disease-specific tools have been designed to assess the impact of HS on patients, including the HS Symptom Daily Diary (HSSDD), the HS Symptom Questionnaire (HSSQ), and the HS Quality of Life (HiSQOL©) questionnaire, which have been developed into electronic instruments (eHSSDD, eHSSQ, and eHiSQOL©). OBJECTIVES: The objective of this study was to establish the content validity of the electronic version of the HSSDD and HSSQ, and the acceptability and usability of the HSSDD, HSSQ, and HiSQOL©, using concept elicitation and cognitive debriefing interviews. METHODS: This was a non-interventional qualitative video interview study involving participants aged ≥18 years with moderate to severe HS recruited from a single clinical site in the USA. Interviews gathered feedback on participants' symptom experience, followed by training and completion of the eHSSDD, eHSSQ, and eHiSQOL© questionnaires on electronic handheld devices. Participants were then interviewed on the content of the eHSSDD and eHSSQ and the acceptability and usability of all three instruments. Interviews were transcribed and qualitatively analysed. RESULTS: Twenty participants with moderate to severe HS (median age: 41.5 [range: 20.0-64.0]; n = 16/20 female) were included. All participants found the eHSSDD, eHSSQ, and eHiSQOL© instructions clear and described the instruments as "easy", "simple" and "self-explanatory". Overall understanding of individual items within the eHSSDD and eHSSQ was high; however, 6/20 participants had difficulty in understanding the average skin pain item in the eHSSDD. All participants were able to accurately recall their symptoms within the recall periods of the eHSSDD and eHSSQ, although 4/20 participants found the 24-h recall period of the eHSSDD limiting. Completion time was quick across all instruments, and usability was high, with the majority of participants reporting no difficulty in completing questionnaires on electronic devices. CONCLUSION: The concepts covered in the eHSSDD and eHSSQ are relevant and important to patients, supporting their content validity. The findings also provide evidence of acceptability and usability of the eHSSDD, eHSSQ, and eHiSQOL©. A limitation was that all participants were recruited from a single site, which may have introduced selection bias and thus limited the generalisability of results.

A collaborative approach to designing an online nutrition education program for people with multiple sclerosis.

PURPOSE: People with multiple sclerosis (pwMS) want disease-specific dietary advice to reduce the confusion around diet. This study used co-design principles to develop an online nutrition education program for pwMS. METHODS: Mixed-methods (multiphase sequential design). Phase 1: online survey (n = 114 pwMS) to explore preferred content and characteristics of a nutrition program and develop a draft program. Phase 2: feedback on the draft program from stakeholders (two meetings; n = 10 pwMS and multiple sclerosis (MS) health professionals) and pwMS (two workshops; n = 6) to produce a full program prototype. Phase 3: cognitive interviews (n = 8 pwMS plus 1 spouse) to explore acceptability and ease of comprehension of one module of the program, analysed using deductive content analysis. RESULTS: Preferred topics were included in the program, which were further developed with consumer feedback. Cognitive interviews produced four themes: (1) positive and targeted messaging to motivate behaviour change; (2) "not enough evidence" is not good enough; (3) expert advice builds in credibility; and (4) engaging and appropriate online design elements are crucial. CONCLUSIONS: Positive language appears to improve motivation to make healthy dietary changes and engagement with evidence-based nutrition resources. To ensure acceptability, health professionals can use co-design to engage consumers when developing resources for pwMS.IMPLICATIONS FOR REHABILITATIONCo-designed nutrition education programs can help people achieve high-quality diets in line with recommendations, but very few programs exist for people with multiple sclerosis (MS), and none were co-designedThe participatory research in this study was instrumental in ensuring that important information regarding program acceptability was identifiedCo-design can ensure that the language is appropriate for the target audience, and positive language appeared to improve motivation in people with MS to engage with the online nutrition education programWhere practical and feasible, health professionals should collaborate with MS consumers when developing resources, and use positive, empowering language.

Investigating the PHQ-9 With Mokken Scale Analysis and Cognitive Interviews.

Scores on the Patient Health Questionnaire-9 (PHQ-9) are frequently used to assess depression both in research and in clinical practice. The aim was to examine the validity of the PHQ-9 sum score by using Mokken scale analysis (Study I) and cognitive interviews (Study II) on the Icelandic version of PHQ-9. A primary care sample of 618 individuals was used in Study I. The results indicate that the PHQ-9 items are not close enough to perfectly unidimensional for their sum score to accurately order people on the depression severity dimension. In Study II, the sample consisted of 53 individuals, with 28 having a history of depression and 25 not. The findings reveal a number of issues concerning respondents' use of the PHQ-9. No systematic differences were found in the results of the two groups. The PHQ-9 sum score should thus be interpreted and used with great care. We provide scale revision recommendations to improve the quality of PHQ-9.

Translation, cultural adaptation and validation of a patient-reported experience measure for children.

BACKGROUND: There is no national, validated, generic patient-reported experience measure (PREM) for children under 15 years of age in Sweden. A recent cross-sectional study found no consensus in how children's voices are heard in paediatric health care, as well as a lack of validated questionnaires. AIM: The aim of this study is to translate, adapt and validate the six versions of the Children's and Young People's PREM for use in a Swedish health care context. DESIGN: An exploratory sequential mixed-method design including cognitive interviews and content validity index (CVI) was used. The interviews focused on evaluating children's understanding of the questionnaire, and the CVI was used to further adjust the relevance of the questionnaire. PARTICIPANTS: A convenience sample of 62 children participated in the cognitive interviews and an additional convenience sample of 42 children was included in the CVI testing. The children, aged 8-16 years, were attending routine visits at paediatric departments in a county hospital and a children's hospital in the mid-Sweden region between October 2020 and June 2022. RESULTS: The translation, adaptation and validation process identified several issues regarding the understanding of the questionnaire in a Swedish context. Adaptations were made based on issues related to context, wording and the structure of the questions. CVI testing resulted in the removal of 3-10 questions in each of the different versions of the questionnaire. CONCLUSION: The study has resulted in six face- and content-validated Swedish versions of the questionnaire ready for pilot testing. Although the versions of the original questionnaire were developed in collaboration with children in the United Kingdom, this did not mean that they could automatically be used in a Swedish health care context. This study confirms the importance of a rigorous process of adaptation and validation to ensure quality and applicability to children accessing health care in different countries. PATIENT OR PUBLIC CONTRIBUTION: Children's views have guided the development of the original instrument and its adaptation to the Swedish health care context. Due to the strong patient involvement in the process of developing the Swedish versions of the questionnaire, the research group made a pragmatic decision to have no other patient contribution in the study.

Translation and cultural adaptation of the Greek integrated palliative care outcome scale (IPOS): challenges in a six-phase process.

AIM: To translate and culturally adapt IPOS to the Greek population. METHODS: A four phases- sequential study, which included verification of conceptual equivalence, double forward- backward translations and conceptual cognitive debriefing. Focus group interviews used 'think aloud' and 'verbal probing' techniques. Interviews were audio-recorded, transcribed verbatim and thematically analyzed using predefined categories. Purposely sampled from two oncology and palliative care units in Athens. RESULTS: The Integrated Palliative Care Outcome Scale was well accepted by both patients and health professionals. Overall comprehension and acceptability of the scale were good. The comprehension and judgement challenges identified in the pre-final version were successfully resolved in the cognitive interviewing phase. Five out of the seventeen translated items of the scale were modified after cognitive debriefing. Comprehension difficulties were identified with specific terms (e.g., energy/feeling depressed) and with some answer options. Severity of symptoms and not their impact was a common difficulty. A judgement challenge was reported in relation to 7-days recall and fluctuation of symptoms. Layout concerns in relation to length of questions were also stated. All questions were considered important and none as inappropriate. CONCLUSION: This study demonstrated face and content validity and acceptability of the Integrated Palliative Care Outcome Scale in the Greek context. Cognitive Interviewing proved valuable in refining concepts within the specific cultural context. CLINICAL IMPLICATIONS: The IPOS outcome measure tool is now being used routinely in a palliative care service in Athens and is currently used to evaluate service outcomes.

Cognitive Interviewing to Develop a New Health-Related Quality of Life Measure for Parkinson's Disease: The Preference-Based Parkinson's Disease Index (PB-PDI).

Preference-based measures (PBM) for health-related quality of life (HRQoL) are essential in assessing the cost-utility of different treatment options. The preference-based Parkinson's disease Index (PB-PDI) is being developed for people with Parkinson's disease (PD). The aim of this study was to refine the PB-PDI through cognitive interviews with people with PD. Cognitive debriefing was conducted to assess patients' interpretation of items, both in English and French. Participants' feedback guided the iterative modification of the PB-PDI and items were accepted for final inclusion if they were endorsed by three consecutive participants. A total of 16 participants provided feedback on the items, refined the response options, and discussed how to clarify questions. They selected a 2-week timeframe for the PB-PDI recall period. At the end of the cognitive interviews, all seven items and their response options were endorsed in both languages. The cognitive interview process allowed us to refine items and ensure that they were clear in terms of instructions and response options from the perspective of people with PD. The next step will be to elicit preference weights to develop a scoring algorithm and assess its measurement properties.

Development and usability testing of an electronic patient-reported outcome (ePRO) solution for patients with inflammatory diseases in an Advanced Therapy Medicinal Product (ATMP) basket trial.

BACKGROUND: Electronic patient-reported outcome (ePRO) systems are increasingly used in clinical trials to provide evidence of efficacy and tolerability of treatment from the patient perspective. The aim of this study is twofold: (1) to describe how we developed an electronic platform for patients to report their symptoms, and (2) to develop and undertake usability testing of an ePRO solution for use in a study of cell therapy seeking to provide early evidence of efficacy and tolerability of treatment and test the feasibility of the system for use in later phase studies. METHODS: An ePRO system was designed to be used in a single arm, multi-centre, phase II basket trial investigating the safety and activity of the use of ORBCEL-C™ in the treatment of patients with inflammatory conditions. ORBCEL-C™ is an enriched Mesenchymal Stromal Cells product isolated from human umbilical cord tissue using CD362+ cell selection. Usability testing sessions were conducted using cognitive interviews and the 'Think Aloud' method with patient advisory group members and Research Nurses to assess the usability of the system. RESULTS: Nine patient partners and seven research nurses took part in one usability testing session. Measures of fatigue and health-related quality of life, the PRO-CTCAE™ and FACT-GP5 global tolerability question were included in the ePRO system. Alert notifications to the clinical team were triggered by PRO-CTCAE™ and FACT-GP5 scores. Patient participants liked the simplicity and responsiveness of the patient-facing app. Two patients were unable to complete the testing session, due to technical issues. Research Nurses suggested minor modifications to improve functionality and the layout of the clinician dashboard and the training materials. CONCLUSION: By testing the effectiveness, efficiency, and satisfaction of our novel ePRO system (PROmicsR), we learnt that most people with an inflammatory condition found it easy to report their symptoms using an app on their own device. Their experiences using the PROmicsR ePRO system within a trial environment will be further explored in our upcoming feasibility testing. Research nurses were also positive and found the clinical dashboard easy-to-use. Using ePROs in early phase trials is important in order to provide evidence of therapeutic responses and tolerability, increase the evidence based, and inform methodology development. TRIAL REGISTRATION: ISRCTN, ISRCTN80103507. Registered 01 April 2022, https://www.isrctn.com/ISRCTN80103507.

More and more patients tell clinicians how they feel by completing questionnaires electronically. Therefore, it is important to assess how easy it is for patients to do this. In this study, we describe how we developed an electronic platform for patients to report their symptoms and how we tested the usability of this platform with patient partners and research nurses. Once the electronic platform was developed, quality of life and symptoms questionnaires were programmed onto it. Alerts were sent to the clinical team if specific scores were obtained on the symptoms questionnaires. Although two patient partners were not able to finish the testing session because of technical issues, the ones who completed the session liked its simplicity and responsiveness. The research nurses also liked the system and only suggested minor modifications. Following this testing, we refined the electronic platform to test it further in a larger study which investigates the safety and use of a drug. We hope that thanks to this electronic platform, we will obtain useful information on the safety and efficacy of treatment.

Translation, cultural adaptation, and psychometric testing of the Supportive care needs survey for partners and caregivers for Swedish family members of persons diagnosed with colorectal cancer.

BACKGROUND: Colorectal cancer is the third most common cancer diagnosis globally and is increasing in both incidence and prevalence. Despite evidence showing that family members of persons diagnosed with cancer have supportive care needs, no validated questionnaire measuring the needs of family members of persons diagnosed with CRC exists in Swedish. Thus, the objective of the present study was to translate, culturally adapt, and evaluate the psychometric properties the Supportive Care Needs Survey - Partners and Caregivers 45. METHODS: The translation and cultural adaptation followed a systematic yet iterative process. Firstly, the questionnaire was translated using a forward-backward approach. Secondly, face and content validity and comprehensibility were evaluated by two expert panels of colorectal cancer specialist nurses and family members, respectively. Lastly, the psychometric properties, validity, and reliability of the translated questionnaire were evaluated among 45 Swedish family members of persons diagnosed with colorectal cancer. RESULTS: The face, content, and construct validity of the translated questionnaire were evaluated as satisfying. Moreover, psychometric evaluations showed high data quality and satisfactory internal consistency. However, the results also revealed unsolved issues regarding relevance, targeting, and internal consistency, as well as a probable scaling failure. CONCLUSION: The translated and adapted questionnaire can be used to identify family members unmet needs of support throughout the colorectal cancer trajectory. The questionnaire showed promising validity and reliability in the target population. However, it needs to be further evaluated in a larger sample, preferably involving factor analysis and stability over time.

Colorectal cancer is the third most common cancer diagnose globally. At times of cancer, also the health and wellbeing of the surrounding family members is negatively affected. As a result, family members of persons diagnosed with cancer report that they too need support. Still, no validated questionnaire that enable measurement of family members needs of support throughout the colorectal cancer trajectory existed in Swedish. Thus, the present study undertook the process of translation of a questionnaire from English to Swedish. Thereto, evaluated it among Swedish family members of persons diagnosed with colorectal cancer. The evaluation showed a successful translation and the translated questionnaire appeared reliable and useful for measuring the family members´ needs of support throughout the colorectal cancer trajectory. However, it requires further evaluation.