Metacognitive analysis of the practicum subject of the Master's in Secondary Teaching through a reflexive portfolio.

This study delves into the efficacy of the reflective portfolio in the metacognitive domain within the context of the Master's in Secondary Teaching. It places particular emphasis on the impact of prior academic training in different specialties (scientific vs. humanities) on metacognitive skills development. The research employs a mixed-methods approach, analyzing portfolios from various academic specialties, developed in practicum subject, to ascertain differences in metacognitive competencies of teaching competencies. The main findings reveal that while students generally demonstrate a basic level of success in describing learning situations, there is a notable deficiency in deeper analytical skills and self-improvement strategies, especially among science students compared to their humanities counterparts. This suggests that initial training and educational background significantly influence the development of these competencies. The study concludes that there is a pressing need for more focused and robust training in metacognitive skills across different educational disciplines. Furthermore, it highlights the necessity for educational strategies that effectively address these variations, aligning teaching and learning processes with the principles of quality and sustainable education as envisioned in Agenda 2030. The insights gained are crucial for the development of more effective and comprehensive teacher education programs.

A formative evaluation to inform integration of psychiatric care with other gender-affirming care.

BACKGROUND: Transgender, non-binary, and/or gender expansive (TNG) individuals experience disproportionately high rates of mental illness and unique barriers to accessing psychiatric care. Integrating TNG-specific psychiatric care with other physical health services may improve engagement, but little published literature describes patient and clinician perspectives on such models of care. Here we present a formative evaluation aiming to inform future projects integrating psychiatric care with physical health care for TNG individuals. METHODS: In this qualitative pre-implementation study, semi-structured interview guides were developed informed by the Consolidated Framework for Implementation Research to ensure uniform inclusion and sequencing of topics and allow for valid comparison across interviews. We elicited TNG patient (n = 11) and gender-affirming care clinician (n = 10) needs and preferences regarding integrating psychiatric care with other gender-affirming clinical services. We conducted a rapid analysis procedure, yielding a descriptive analysis for each participant group, identifying challenges of and opportunities in offering integrated gender-affirming psychiatric care. RESULTS: Participants unanimously preferred integrating psychiatry within primary care instead of siloed service models. All participants preferred that patients have access to direct psychiatry appointments (rather than psychiatrist consultation with care team only) and all gender-affirming care clinicians wanted increased access to psychiatric consultations. The need for flexible, tailored care was emphasized. Facilitators identified included taking insurance, telehealth, clinician TNG-competence, and protecting time for clinicians to collaborate and obtain consultation. CONCLUSIONS: This health equity pre-implementation project engaged TNG patients and gender-affirming care clinicians to inform future research exploring integration of mental health care with primary care for the TNG community and suggests utility of such a model of care.

Measuring digital intervention user experience with a novel ecological momentary assessment (EMA) method, CORTO.

Digital interventions often suffer from low usage, which may reflect insufficient attention to user experience. Moreover, the existing evaluation methods have limited applicability in the remote study of user experience of complex interventions that have expansive content and that are used over an extensive period of time. To alleviate these challenges, we describe here a novel qualitative Ecological Momentary Assessment (EMA) method: the CORTO method (Contextual, One-item, Repeated, Timely, Open-ended). We used it to gather digital intervention user experience data from Finnish adults (n = 184) who lived with interview-confirmed major depressive disorder (MDD) and took part in a randomized controlled trial (RCT) that studied the efficacy of a novel 12-week game-based digital intervention for depression. A second dataset on user experience was gathered with retrospective interviews (n = 22). We inductively coded the CORTO method and retrospective interview data, which led to four user experience categories: (1) contextual use, (2) interaction-elicited emotional experience, (3) usability, and (4) technical issues. Then, we used the created user experience categories and Template Analysis to analyze both datasets together, and reported the results qualitatively. Finally, we compared the two datasets with each other. We found that the data generated with the CORTO method offered more insights into usability and technical categories than the interview data that particularly illustrated the contextual use. The emotional valence of the interview data was more positive compared with the CORTO data. Both the CORTO and interview data detected 55 % of the micro-level categories; 20 % of micro-level categories were only detected by the CORTO data and 25 % only by the interview data. We found that the during-intervention user experience measurement with the CORTO method can provide intervention-specific insights, and thereby further the iterative user-centered intervention development. Overall, these findings highlight the impact of evaluation methods on the categories and qualities of insights acquired in intervention research.

SWOT Analysis and Recommendations for Community Health Workers and Stakeholders Responding to COVID-19 Health Inequities.

Background. By 2023, 1,080,000 cases of COVID-19 have been reported in Harris County. Systemic inequity and vaccine hesitancy have contributed to COVID-19 disparities. Community Health Workers provide health education and instrumental support to alleviate health disparities among vulnerable communities. We conducted an analysis of Strengths, Weaknesses, Opportunities, and Threats (SWOT) analysis in June 2022 among a broad coalition of Community Health Work stakeholders to better understand the local landscape in the context of the COVID-19 pandemic. Methods. We recruited 33 community health workers and industry stakeholders in Harris County, Texas, to participate in the SWOT analysis. Participants were asked to describe their opinions on the SWOT facing the Community Health Work landscape and then rank the outcomes of the analysis to prioritize action. Results. A total of 19 themes were identified. Weaknesses included lack of respect and resources for Community Health Workers and poor coordination and capacity among the workforce infrastructure. Limited funding and lack of appreciation for Community Health Workers were deemed important threats. Diversity and community connection were critical strengths, and strong education, training, and raising awareness for community health work were considered opportunities to overcome identified weaknesses and threats. Discussion. Increased funding, greater coordination, greater respect, and amplified training can improve capacity for Community Health Workers and, therefore, improve public health outcomes for respiratory illness and viral infections such as COVID-19. This analysis helps fill an important research gap on the topic Community Health Workers responding to public health crises with racially disparate outcomes.

Internet-Delivered Cognitive Behavioral Therapy Tailored to Spouses and Significant Others of Public Safety Personnel: Formative Evaluation Study.

BACKGROUND: Spouses and significant others (SSOs) of public safety personnel (PSP) are affected by the risks and requirements of these occupations. Internet-delivered cognitive behavioral therapy (ICBT) provides a convenient and accessible treatment format that can be tailored to the needs of SSOs of PSP. OBJECTIVE: This study aimed to assess the initial use and client perceptions (eg, likes, helpfulness, and areas for improvement) of a self-guided, transdiagnostic ICBT course designed for Canadian SSOs of PSP and identify opportunities to further tailor ICBT for this group. METHODS: SSOs were invited to complete a 5-lesson, self-guided, transdiagnostic ICBT course. Descriptive statistics were used to analyze the demographic and clinical characteristics of participants. Content analysis was used to analyze the data from open-ended survey responses and interviews to understand their experiences with ICBT. RESULTS: Clients (N=118) endorsed various mental health concerns (eg, depression, anxiety, posttraumatic stress symptoms, and relationship concerns) with a range of severity levels. Most clients identified as White (110/116, 94.8%) and women (108/116, 91.5%), with a mean age of 42.03 (SD 9.36) years. Of the 26 clients who were interviewed, 89% (23/26) reported believing that ICBT is helpful and 92% (24/26) reported finding at least 1 skill helpful. Clients provided suggestions for course improvements. On the basis of this feedback and quantitative data, changes were made to areas such as the delivery of materials, content, case stories, and timelines. Overall, the results indicated that many SSOs of PSP had positive perceptions of ICBT tailored to their needs and found several aspects of the course helpful, supporting the continued delivery of tailored ICBT to this population. However, there remains a need for continued promotion of the course and outreach to diverse groups of SSOs of PSP. CONCLUSIONS: Findings from this formative evaluation provide insight into the unique experiences and needs of SSOs of PSP and provide preliminary evidence for the use of tailored ICBT to support the mental health of this group in Canada.

A developmental formative evaluation of a pilot participatory music program for veterans with housing insecurity.

BACKGROUND: Interventions are needed to improve well-being and promote community reintegration among Veterans with housing insecurity. The objective was to conduct a developmental formative evaluation of a participatory music program. METHODS: This single-site, pilot study implemented a participatory music program at a U.S. Department of Veterans Affairs (VA) Homeless Domiciliary that included one-hour sessions (group music instruction and ensemble playing), 3 times per week for 3 months. Intervention development was guided by the Model of Human Occupation (MOHO). Evaluation was guided by the MOHO and the Consolidated Framework for Implementation Evaluation (CFIR). Qualitative data were collected via semi-structured interviews from participants and non-participants, and were analyzed using an interdisciplinary, constant comparison qualitative analysis technique. RESULTS: Sixteen program participants and 8 non-participants were enrolled, age range 26-59 (mean 41; standard deviation, 11) years; 75% were White. The sample for this study (N = 12) included five participants and seven non-participants. Semi-structured interview responses produced three salient themes illuminating Veterans' perspectives: (1) key characteristics of the intervention (the relative advantage of the participatory program over other problem-focused programs; the importance of a supportive, encouraging teaching; the group setting; the role of music); (2) the therapeutic power of the program (based on it being enjoyable; and serving as an escape from preoccupations); and (3) the context and culture (which included Veterans supporting each other and the Domiciliary setting). CONCLUSIONS: Veterans described the benefits of a participatory music intervention compared to problem-based groups, which included enjoyment, skill acquisition facilitating pride, escape, reconnecting with their identity prior to current problems, and experiencing positive aspects of Veteran culture such as mutual support and discipline. These data support ongoing research about participatory music programs to support Veterans with housing insecurity.

A Digital Coach (E-Supporter 1.0) to Support Physical Activity and a Healthy Diet in People With Type 2 Diabetes: Acceptability and Limited Efficacy Testing.

BACKGROUND: A healthy lifestyle, including regular physical activity and a healthy diet, is increasingly part of type 2 diabetes (T2D) management. As many people with T2D have difficulty living and maintaining a healthy lifestyle, there is a need for effective interventions. eHealth interventions that incorporate behavior change theories and tailoring are considered effective tools for supporting a healthy lifestyle. The E-Supporter 1.0 digital coach contains eHealth content for app-based eHealth interventions and offers tailored coaching regarding physical activity and a healthy diet for people with T2D. OBJECTIVE: This study aimed to assess the acceptability of E-Supporter 1.0 and explore its limited efficacy on physical activity, dietary behavior, the phase of behavior change, and self-efficacy levels. METHODS: Over a span of 9 weeks, 20 individuals with T2D received daily motivational messages and weekly feedback derived from behavioral change theories and determinants through E-Supporter 1.0. The acceptability of the intervention was assessed using telephone-conducted, semistructured interviews. The interview transcripts were coded using inductive thematic analysis. The limited efficacy of E-Supporter 1.0 was explored using the Fitbit Charge 2 to monitor step count to assess physical activity and questionnaires to assess dietary behavior (using the Dutch Healthy Diet index), phase of behavior change (using the single-question Self-Assessment Scale Stages of Change), and self-efficacy levels (using the Exercise Self-Efficacy Scale). RESULTS: In total, 5 main themes emerged from the interviews: perceptions regarding remote coaching, perceptions regarding the content, intervention intensity and duration, perceived effectiveness, and overall appreciation. The participants were predominantly positive about E-Supporter 1.0. Overall, they experienced E-Supporter 1.0 as a useful and easy-to-use intervention to support a better lifestyle. Participants expressed a preference for combining E-Supporter with face-to-face guidance from a health care professional. Many participants found the intensity and duration of the intervention to be acceptable, despite the coaching period appearing relatively short to facilitate long-term behavior maintenance. As expected, the degree of tailoring concerning the individual and external factors that influence a healthy lifestyle was perceived as limited. The limited efficacy testing showed a significant improvement in the daily step count (z=-2.040; P=.04) and self-efficacy levels (z=-1.997; P=.046) between baseline and postintervention. Diet was improved through better adherence to Dutch dietary guidelines. No significant improvement was found in the phase of behavior change (P=.17), as most participants were already in the maintenance phase at baseline. CONCLUSIONS: On the basis of this explorative feasibility study, we expect E-Supporter 1.0 to be an acceptable and potentially useful intervention to promote physical activity and a healthy diet in people with T2D. Additional work needs to be done to further tailor the E-Supporter content and evaluate its effects more extensively on lifestyle behaviors.

Physiology education and teaching in Chinese mainland medical schools: the status quo and the changes over the past two decades.

Physiology is a critical subject that bridges basic and clinical medicine. The reform of physiology education is crucial to improving the quality of teaching and supporting student learning; however, there is a lack of comprehensive data documenting the current state of physiology education in medical programs in China. This study conducted an online survey among experienced teachers from the top 100 medical schools in the Chinese mainland in 2022. A total of 89 valid questionnaires were included in this study. In 57.3% of the surveyed medical schools, 70% of the physiology teachers have a Ph.D. degree, while the number of faculty members with a medical background has tended to decrease in 53.9% of the surveyed medical schools. Of the 89 medical schools, 62 have implemented physiology course integration, with 69.4% of the respondents believing that curriculum integration could enhance students' knowledge acquisition and application. The lecture hours per term are 50-70 and 71-90 in 49.4% and 42.7% of the 89 medical schools, respectively. The ratio of course duration of lecture to laboratory was 2:1 in 47.2% of the surveyed medical schools, while the ratio was between 1:1 and 2:1 in 47.2% of the surveyed medical schools, and only 5.6% of medical schools opted for a 1:1 course arrangement. For teaching methods, about 60% of medical schools used problem-based learning, case-based learning, and task-based learning (PBL/CBL/TBL) for clinical medicine students only, and 25.4% of medical schools applied PBL/CBL/TBL to all students. This study is conducive to promoting dialogue and communication among physiology teachers, administrators, and researchers.NEW & NOTEWORTHY This study conducted a nationwide survey of the top 100 medical schools in the Chinese mainland in 2022 to provide first-hand data on the current situation and changes in physiology education and teaching in the Chinese mainland with focuses on the faculty composition, curriculum integration, teaching methods, and assessment modes, which is a microcosm of the reform and development of the medical education in the Chinese mainland, hoping to improve the quality of preclinical medical education.

Team-Based Qualitative Rapid Analysis: Approach and Considerations for Conducting Developmental Formative Evaluation for Intervention Design.

Qualitative rapid analysis is one of many rapid research approaches that offer a solution to the problem of time constrained health services evaluations and avoids sacrificing the richness of qualitative data that is needed for intervention design. We describe modifications to an established team-based, rapid analysis approach that we used to rapidly collect and analyze semi-structured interview data for a developmental formative evaluation of a cardiovascular disease prevention intervention. Over 18 weeks, we conducted and analyzed 35 semi-structured interviews that were conducted with patients and health care providers in the Veterans Health Administration to identify targets for adapting the intervention in preparation for a clinical trial. We identified 12 key themes describing actionable targets for intervention modification. We highlight important methodological decisions that allowed us to maintain rigor when using qualitative rapid analysis for intervention adaptation and we provide practical guidance on the resources needed to execute similar qualitative studies. We additionally reflect on the benefits and challenges of the described approach when working within a remote research team environment.ClinicalTrials.gov: NCT04545489.

Implementing a cirrhosis order set in a tertiary healthcare system: a theory-informed formative evaluation.

BACKGROUND: Standardized order sets are a means of increasing adherence to clinical practice guidelines and improving the quality of patient care. Implementation of novel quality improvement initiatives like order sets can be challenging. Before the COVID-19 pandemic, we conducted a formative evaluation to understand healthcare providers' perspectives on implementing clinical changes and the individual, collective and organizational contextual factors that might impact implementation at eight hospital sites in Alberta, Canada. METHODS: We utilized concepts from the Consolidated Framework for Implementation Research (CFIR) and Normalisation Process Theory (NPT) to understand the context, past implementation experiences, and perceptions of the cirrhosis order set. Eight focus groups were held with healthcare professionals caring for patients with cirrhosis. Data were coded deductively using relevant constructs of NPT and CFIR. A total of 54 healthcare professionals, including physicians, nurses, nurse practitioners, social workers and pharmacists and a physiotherapist, participated in the focus groups. RESULTS: Key findings revealed that participants recognized the value of the cirrhosis order set and its potential to improve the quality of care. Participants highlighted potential implementation challenges, including multiple competing quality improvement initiatives, feelings of burnout, lack of communication between healthcare provider groups, and a lack of dedicated resources to support implementation. CONCLUSIONS: Implementing a complex improvement initiative across clinician groups and acute care sites presents challenges. This work yielded insights into the significant influence of past implementation of similar interventions and highlighted the importance of communication between clinician groups and resources to support implementation. However, by using multiple theoretical lenses to illuminate what and how contextual and social processes will influence uptake, we can better anticipate challenges during the implementation process.

Instruments to Assess Evidence-Based Practice Among Health Care Professionals: A Systematic Review.

BACKGROUND: The use of measurement instruments to assess the use of Evidence-Based Practice by health professionals has been frequently reported in studies. AIMS: This systematic review aimed to summarize, describe, and evaluate the measurement properties of the instruments that evaluate the use of Evidence-Based Practice in health professionals. METHODS: The search was carried out in four databases considering three groups of search terms: evidence-based practice, evaluation, and measurement proprieties. Studies were included that described the use of instruments to assess Evidence-Based Practice in health professionals, with the full-text publication, which analyzed the measurement properties, in English. The methodological quality of the studies was evaluated using COnsensus-based Standards for the selection of health Measurement INstruments. RESULTS: In total, 6,429 were found and only 92 were eligible for data analysis. Forty new instruments were identified most were developed for nursing and physical therapist. The investigators performed at least 1 type of validity test on 73% of the instruments. Reliability was tested at 90%, through internal consistency. Responsiveness was tested on less than half of the instruments (30%). Most of the instruments identified are reliable and valid to measure evidence-based practice in health professionals. CONCLUSION: Although the Fresno Test remains the most complete instrument, and adequate for use. The COnsensus-based Standards for the selection of health Measurement INstruments checklist classified 7 (seven) instruments as suitable for the target audience.

Formative evaluation prior to implementation of a brief treatment for posttraumatic stress disorder in primary care.

BACKGROUND: Successful implementation of evidence-based treatments (EBT) for posttraumatic stress disorder (PTSD) in primary care may address treatment access and quality gaps by providing care in novel and less stigmatized settings. Yet, PTSD treatments are largely unavailable in safety net primary care. We aimed to collect clinician stakeholder data on organizational, attitudinal, and contextual factors relevant to EBT implementation. METHODS: Our developmental formative evaluation was guided by the Consolidated Framework for Implementation Research (CFIR), including (a) surveys assessing implementation climate and attitudes towards EBTs and behavioral health integration and (b) semi-structured interviews to identify barriers and facilitators to implementation and need for augmentation. Participants were hospital employees (N = 22), including primary care physicians (n = 6), integrated behavioral health clinicians (n = 8), community wellness advocates (n = 3), and clinic leadership (n = 5). We report frequency and descriptives of survey data and findings from directed content analysis of interviews. We used a concurrent mixed-methods approach, integrating survey and interview data collected simultaneously using a joint display approach. A primary care community advisory board (CAB) helped to refine interview guides and interpret findings. RESULTS: Stakeholders described implementation determinants of the EBT related to the CFIR domains of intervention characteristics (relative advantage, adaptability), outer setting (patient needs and resources), inner setting (networks and communication, relative priority, leadership engagement, available resources), and individuals involved (knowledge and beliefs, cultural considerations). Stakeholders described strong attitudinal support (relative advantage), yet therapist time and capacity restraints are major PTSD treatment implementation barriers (available resources). Changes in hospital management were perceived as potentially allowing for greater access to behavioral health services, including EBTs. Patient engagement barriers such as stigma, mistrust, and care preferences were also noted (patient needs and resources). Recommendations included tailoring the intervention to meet existing workflows (adaptability), system alignment efforts focused on improving detection, referral, and care coordination processes (networks and communication), protecting clinician time for training and consultation (leadership engagement), and embedding a researcher in the practice (available resources). CONCLUSIONS: Our evaluation identified key CFIR determinants of implementation of PTSD treatments in safety net integrated primary care settings. Our project also demonstrates that successful implementation necessitates strong stakeholder engagement.

Formative Evaluation of a Student Symptom Decision Tree for COVID-19.

Objectives: In support of schools restarting during the COVID-19 pandemic, some schools partnered with local experts in academia, education, community, and public health to provide decision-support tools for determining what actions to take when presented with students at risk for spreading infection at school. Methods: The Student Symptom Decision Tree, developed in Orange County, California, is a flow chart consisting of branching logic and definitions to assist school personnel in making decisions regarding possible COVID-19 cases in schools which was repeatedly updated to reflect evolving evidence-based guidelines. A survey of 56 school personnel evaluated the frequency of use, acceptability, feasibility, appropriateness, usability, and helpfulness of the Decision Tree. Results: The tool was used at least 6 times a week by 66% of respondents. The Decision Tree was generally perceived as acceptable (91%), feasible (70%), appropriate (89%), usable (71%) and helpful (95%). Suggestions for improvement included reducing the complexity in content and formatting of the tool. Conclusions: The data suggest that school personnel found value in the Decision Tree, which was intended to assist them with making decisions in a challenging and rapidly evolving pandemic.

Using formative evaluation of a community-based opioid overdose prevention program to inform strategic communication for adoption, implementation, and sustainability.

BACKGROUND: Opioid addiction and overdose is a public health problem in the United States and is expected to remain with substance use increasing due to the COVID-19 pandemic. Communities that approach this issue through multi-sector partnerships experience more positive health outcomes. Understanding motivation for stakeholder engagement in these efforts is essential to successful adoption, implementation, and sustainability particularly in the shifting landscape of needs and resources. METHODS: A formative evaluation was conducted on the C.L.E.A.R. Program in Massachusetts, a state heavily impacted by the opioid epidemic. A stakeholder power analysis identified appropriate stakeholders for the study (n = 9). The Consolidated Framework for Implementation Research (CFIR) guided data collection and analysis. Surveys (n = 8) examined perception and attitudes on the program; motivations and communication for engagement; and, benefits and barriers to collaboration. Stakeholder interviews (n = 6) explored the quantitative findings in more detail. Surveys were analyzed using descriptive statistics and a content analysis with deductive approach was conducted for stakeholder interviews. The Diffusion of Innovation (DOI) Theory guided recommendations for communications to engage stakeholders. RESULTS: Agencies represented a range of sectors and the majority (n = 5) were familiar with the C.L.E.A.R. PROGRAM: Despite the many strengths of the program and existing collaboration, based on the coding densities of each CFIR construct stakeholders identified crucial gaps in the services the program provided and noted that the overall infrastructure of the program could be enhanced. Opportunities for strategic communication to address the stages of DOI align with the gaps identified in the CFIR domains to result in increased agency collaboration and expansion of services into the surrounding communities to ensure sustainability of the C.L.E.A.R. CONCLUSIONS: This study explored factors necessary for ongoing multi-sector collaboration and sustainability of an existing community-based program especially given the changing context from COVID-19. Findings informed both program revisions and communication strategies to promote the program to new and existing collaborating agencies and the community served, and identify effective communication approaches across sectors. This is essential for successful implementation and sustainability of the program, especially as it is adapted and expanded to address post-pandemic times. TRIAL REGISTRATION: This study does not report results of a health care intervention on human participants, however it was reviewed and determined an exempt study with the Boston University Institutional Review Board (IRB #H-42107).

Making Connections that Count - a Case Study of the Family Referral Service in Schools Program on the Central Coast, New South Wales, Australia.

Introduction: Adverse childhood experiences (ACEs) are associated with health and social problems in later life, with an early intervention highly desirable for better outcomes. Description: The Family-Referral-Services-In-Schools (FRSIS) is an early-intervention case management program for children and families with complex unmet needs, providing access to family support, housing, mental health care, and/or drug and alcohol services. The in-school trial setting was aimed at improving service uptake which was low in its community counterpart. Discussion: FRSIS was a well-regarded intervention that reduced barriers to access for vulnerable families. The school setting and non-government agency service provision led to increased acceptability and trust. The program reached 5% of the student population. Support was tailored to family need, which was often complex and involved both children and caregivers. Initially, the multi-agency partnership and governance oversight group championed the service and enabled the pilot to be established, however funding uncertainty and competing priorities saw leadership support ebb away despite operational success. Conclusion: The FRSIS model breaks down numerous barriers to accessing care for vulnerable families by its generalist nature and tailored approach and represents a high-trust approach to brokering appropriate care. Consistency in leadership support was a missed opportunity for program sustainability.

A framework for using real-time evaluative interview feedback for health promotion program and evaluation improvement: The Check It case study.

Formative evaluation is a crucial strategy for health promotion program improvement. Early and ongoing formative evaluation can make a major impact on program outcomes; however, there are few frameworks that provide actual guidance on how programmatic or research teams can systematically perform this kind of important work. In this article we describe the use of an iterative real-time interview feedback framework we developed for Check It, a community-wide chlamydia screening and treatment program for young African American men in New Orleans, Louisiana. The framework considers the diverse and needed perspectives of multiple stakeholders, including participants, interviewers, transcribers, program staff, and lead researchers and/or administrators. Interviews were conducted with N = 15 Check It participants utilizing this approach. Employing the framework led to critical insights that resulted in several vital programmatic and evaluation improvements. Lessons learned, including strengths and challenges of utilizing the framework, are also shared so that this model can be replicated or adapted by program planning and evaluation professionals for other kinds of programs.

Money Matters: A Three-Step Process for Using Budget Data in Program Evaluation to Assess the Design and Management of a Novel Public Health Program.

We applied a three-step process, abstracting and analyzing program budgets to examine how Colorectal Cancer Control Program (CRCCP) awardees are structuring their programs and to assess the fidelity of program design to the CRCCP public health model. We reviewed 23 state, one tribal organization, and six university awardee budgets. We assessed resource allocations, staffing structures, and contracted partners and their activities. Awardees allocated 83% of all funds to contracts and personnel. Program managers were the most budgeted personnel type across three measures: number of people, full-time equivalency, and personnel costs. Awardees not only contracted with health care systems and clinics (39% of all contracts) but also contracted other partner types. Contractors were mainly funded to implement evidence-based interventions (25%) and conduct evaluation (24%). Program design varied among awardees in the number of staff (0-22), number of full-time equivalencies (0-5.4), and the number of contracts (1-11) budgeted. State awardees budgeted more resources to contracts, compared with university awardees (57% vs. 31%), while universities budgeted more for total personnel costs (41% vs. 30%). We learned that awardees designed their programs with fidelity to the CRCCP model. Although implementation approaches varied, overall results suggest implementation requires a combination of internal capacities and contracted partners. Budgets provide opportunities to use already existing program data to evaluate program design, partnerships, and planned activities.

How Older Drivers Perceive Warning Alerts? Insights for the Design of Driver-Car Interaction.

The automotive industry is working toward driving automation and driver-assistance technology is becoming a norm in modern cars. Warning alert systems support the driver-car interaction and inform drivers about automation system status, upcoming obstacles, or dangers ahead. However, older drivers' needs are not always addressed in research studies, although they make up a large segment of drivers. Therefore, we conducted a qualitative three-round formative evaluation of a warning alert system using video prototypes in lab and remote settings. The goal was to evaluate visual-, sound-, and speech-based alerts based on: (a) their efficiency in informing drivers about the road situation ahead, and (b) participants' subjective opinions. We evaluated the system's efficiency using self-reported data measuring participants' cognitive load, usability, UX, and ease of use. Also, we conducted interviews to collect subjective feedback about proposed prototypes. In this article, we describe the design of warning alerts and report on their evaluation results. Our results show that speech-based warnings, especially when coupled with visual warnings, are efficient and accepted well by the participants. This article illustrates older drivers' attitude toward the use of different warning modalities in the driving context.

Men Who Suffered Intimate Partner Violence: Impressions About Existing Public Campaigns and Recommendations for New Ones.

Over the last decades, the negative effects of intimate partner violence (IPV) directed at men in abusive different-sex and same-sex relationships have been increasingly investigated. Men who are the targets of IPV face many barriers to help-seeking, and to overcome them, public awareness campaigns have been developed. Women who experienced IPV have found campaigns targeting them to be harmful and misleading, and previous research suggests that following the principles of formative evaluation research may improve campaigns' effectiveness and reduce unwanted negative effects. This article documents the theory-based formative evaluation research conducted with 14 men abused in different-sex and same-sex relationships for the creation of targeted campaigns. Through semi-structured interviews, men were asked about their overall knowledge of campaigns, their thoughts about specific pictorial IPV campaigns, and their suggestions for the development of new campaigns. Thematic analysis and a theoretically grounded coding scheme were used to analyze the content of the interviews with high interrater reliability. Overall, our results indicate that most men were not aware of campaigns in Portugal, and their impressions about the ones they recalled were mixed. Most men praised clear messages informing forms of violence, while some responded negatively to the inclusion of words such as "shame" and "victim" and the depiction of bruises. They also considered that future campaigns targeting men should portray "real people" like them and provide information on self-efficacy, the efficacy of recommended responses, and threat susceptibility. Our findings are consistent with previous evidence with women who experienced IPV but also provide theoretically grounded novel contributions and highlight the importance of considering the population of interest's insights when developing and testing new campaigns.

Orientation and digital innovation construction of Medical Physics curriculum / 中华医学教育探索杂志

Medical Physics is an interdiscipline which is formed by applying the basic principles, methods, and techniques of physics to clinical medical research such as prevention, diagnosis, and treatment of human diseases, and it is a compulsory professional basic course for medical students. However, there are many medical students reflect that the content of this course is obscure and difficult to understand. Teaching effect is not ideal. The main reasons are that the teaching method is single and the reference materials are few. Based on the actual situation of the course, Hebei Medical University, China promotes formative evaluation from the content of teaching materials, teaching means, and other aspects. At the same time, by combining with the Internet, the digital construction has been realized, deepening the reform of the Medical Physics curriculum, and remarkable results have been achieved.