Using financial incentives to improve health service engagement and outcomes of adults experiencing homelessness: A scoping review of the literature.

People experiencing homelessness (PEH) have high rates of acute and chronic health conditions, complex support needs and often face multiple barriers to accessing health services. Financial incentive (FI) interventions have been found effective in improving service engagement and health outcomes for a range of health conditions, populations and settings, but little is known about their impact on PEH. We conducted a scoping review to explore the impact of FI interventions on treatment retention, adherence and other health outcomes of PEH. We searched seven electronic databases from inception to September 2021 to identify peer-reviewed published English language studies that used FI interventions with adult PEH. A scoping review methodology was used to chart relevant data uniformly. Descriptive statistics and narrative syntheses were used to describe outcomes. Thirty-three quantitative articles related to 29 primary studies were published between 1990 and 2021 and met inclusion criteria. Studies targeted three areas of health behaviour change: decreasing substance use or increasing abstinence rates, preventing or treating infectious diseases or promoting lifestyle/general health goal attainment. A variety of FIs were used (cash/non-cash, escalating/fixed schedule, larger/smaller amounts, some/all behaviours rewarded, certain/uncertain reward) across studies. Twenty-six of the primary studies reported significantly better outcomes for the participants receiving FI compared to controls. There were mixed findings about the efficacy of cash versus non-cash FIs, non-cash FIs versus other interventions and higher versus lower value of incentives. Furthermore, there was limited research about long-term outcomes and impacts. FIs have promise in increasing abstinence from substances, engagement in infectious disease treatment, retention in health services and general lifestyle modifications for PEH. Future research should examine long-term impacts and the contribution of co-interventions and intermediary lifestyle behaviour changes.

Assessing the usability and user engagement of Thought Spot - A digital mental health help-seeking solution for transition-aged youth.

OBJECTIVE: To evaluate the perceived usability of and user engagement with a digital platform (Thought Spot) designed to enhance mental health and wellness help-seeking among transition-aged youth (TAY; 17-29-years old). MATERIALS AND METHODS: Survey responses and usage patterns were collected as part of a randomized controlled trial evaluating the efficacy of Thought Spot. Participants given Thought Spot completed an adapted Usefulness, Satisfaction, and Ease of Use (USE) Questionnaire to measure perceived usability of the platform. User engagement patterns on Thought Spot were examined using analytics data collected throughout the study (March 2018-June 2019). RESULTS: A total of 131 transition-aged participants completed the USE questionnaire and logged on to Thought Spot at least once. Ease of learning scored higher than ease of use, usefulness and satisfaction. Participants identified numerous strengths and challenges related to usability, visual appeal, functionality and usefulness of the content. In terms of user engagement, most participants stopped using the platform after 3 weeks. Participants searched and were interested in a variety of resources, including mental health, counselling and social services. DISCUSSION: Participants reported mixed experiences while using Thought Spot and exhibited low levels of long-term user engagement. User satisfaction, the willingness to recommend Thought Spot to others, and the willingness for future use appeared to be influenced by content relevance, ease of learning, available features, and other contextual factors. Analysis of the types of resources viewed and searches conducted by TAY end-users provided insight into their behaviour and needs. CONCLUSION: Users had mixed perceptions about the usability of Thought Spot, which may have contributed to the high attrition rate. User satisfaction and engagement appears to be influenced by content relevance, ease of learning, and the types of features available. Further investigation to understand the contextual factors that affect TAYs' adoption and engagement with digital mental health tools is required.

Postsecondary Student Engagement With a Mental Health App and Online Platform (Thought Spot): Qualitative Study of User Experience.

BACKGROUND: There is growing interest in using mobile apps and online tools to support postsecondary student mental health, but most of these solutions have suboptimal user engagement in real-world settings. Poor engagement can limit long-term effectiveness and usefulness of these tools. Previous literature has proposed several theories that link factors such as low usability and poor user-centered design to app disengagement. However, few studies provide direct evidence showing what factors contribute to suboptimal user engagement in the context of mobile mental health apps for postsecondary students. OBJECTIVE: This study focuses on understanding postsecondary students' attitudes and behaviors when using Thought Spot, a co-designed mental health app and online platform, to understand factors related to engagement and user experience. METHODS: Students who were given access to Thought Spot for 6 months during a randomized trial of the intervention were invited to participate in one-on-one semistructured interviews. The interviews explored participants' overall experiences and perceptions of the app, along with factors that affected their usage of various features. All interviews were recorded, and template analysis was used to analyze transcripts. RESULTS: User satisfaction was mixed among users of Thought Spot. The degree of engagement with the app appeared to be affected by factors that can be grouped into 5 themes: (1) Students valued detailed, inclusive, and relevant content; (2) Technical glitches and a lack of integration with other apps affected the overall user experience and satisfaction with the app; (3) Using the app to support peers or family can increase engagement; (4) Crowdsourced information from peers about mental health resources drove user engagement, but was difficult to obtain; and (5) Users often turned to the app when they had an immediate need for mental health information, rather than using it to track mental health information over time. CONCLUSIONS: Content, user experience, user-centeredness, and peer support are important determinants of user engagement with mobile mental health apps among postsecondary students. In this study, participants disengaged when the app did not meet their expectations on these determinants. Future studies on user engagement should further explore the effectiveness of different features and the relative importance of various criteria for high-quality apps. Further focus on these issues may inform the creation of interventions that increase student engagement and align with their mental health needs. TRIAL REGISTRATION: ClinicalTrials.gov NCT03412461; https://clinicaltrials.gov/ct2/show/NCT03412461. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/resprot.6446.

Core components and strategies for suicide and risk management protocols in mental health research: a scoping review.

BACKGROUND: Suicide and risk management protocols in mental health research aim to ensure patient safety, provide vital information on how to assess suicidal ideation, manage risk, and respond to unexpected and expected situations. However, there is a lack of literature that identifies specific components and strategies to include in suicide and risk management protocols (SRMPs) for mental health research. The goal of this scoping review was to review academic and grey literature to determine core components and associated strategies, which can be used to inform SRMPs in mental health research. METHODS AND ANALYSIS: The methodological framework outlined by Arksey and O'Malley was used for this scoping review. The search strategy, conducted by a medical librarian, was multidisciplinary and included seven databases. Two reviewers independently assessed eligibility criteria in each document and used a standardized charting form to extract relevant data. The extracted data were then examined using qualitative content analysis. Specifically, summative content analysis was used to identify the core components and strategies used in SRMPs. The data synthesis process was iterative. RESULTS: This review included 36 documents, specifically 22 peer-reviewed articles and 14 documents from the grey literature. Five core components of SRMPs emerged from the reviewed literature including: training; educational resources for research staff; educational resources for research participants; risk assessment and management strategies; and clinical and research oversight. Potentials strategies for risk mitigation within each of the core components are outlined. CONCLUSIONS: The five core components and associated strategies for inclusion in SRMPs will assist mental health researchers in conducting research safely and rigorously. Findings can inform the development of SRMPs and how to tailor them across various research contexts.

Help-Seeking Behaviors of Transition-Aged Youth for Mental Health Concerns: Qualitative Study.

BACKGROUND: Transition-aged youth are particularly vulnerable to mental health problems, yet they are one of the least likely demographic groups to seek help. OBJECTIVE: The aim of this study is to explore the influences on and patterns in help-seeking for mental health concerns among transition-aged youth who attend postsecondary schools in Canada. METHODS: A qualitative research design was used, involving 12 semistructured focus groups with transition-aged youth (17-29 years) who attended postsecondary schools in Canada. A thematic analysis was conducted to code the transcripts and develop themes. RESULTS: Four main themes and subthemes regarding the process and experience of help-seeking were generated: (1) the influence of formal service providers (accessibility and experiences), (2) the influence of social factors (system navigation and stigma), (3) the influence of health literacy (symptom recognition, acting on symptoms, digital tools and the internet, and mental health awareness campaigns), and (4) the influence of low-intensity sources of support, namely, self-help. CONCLUSIONS: Transition-aged youth seek help for mental health problems in different ways. Despite efforts to improve access to mental health services, transition-aged youth continue to face barriers to accessing these services, especially formal sources of support. The factors identified in this study that either hinder or facilitate help-seeking have pragmatic implications for developing help-seeking interventions and delivering mental health services for this population. In addition to other facilitators, family physicians are an important resource in the help-seeking process. Furthermore, digital help-seeking tools have unique characteristics that may make them an important source of support for transition-aged youth.

Effects of a Mobile and Web App (Thought Spot) on Mental Health Help-Seeking Among College and University Students: Randomized Controlled Trial.

BACKGROUND: Mental health disorders are the most prevalent health issues among postsecondary students, yet few solutions to this emerging crisis exist. While mobile health technologies are touted as promising solutions for the unmet mental health needs of these students, the efficacy of these tools remains unclear. In response to these gaps, this study evaluates Thought Spot, a mobile and web app created through participatory design research. OBJECTIVE: The goal of the research is to examine the impact of Thought Spot on mental health and wellness help-seeking intentions, behaviors, attitudes, self-stigma, and self-efficacy among postsecondary students in Canada. METHODS: A 2-armed randomized controlled trial involving students from three postsecondary institutions was conducted. Students were eligible if they were aged 17 to 29 years, enrolled in full-time or part-time studies, functionally competent in English, and had access to a compatible digital device. The usual care group received a mental health services information pamphlet. The intervention group received the Thought Spot app on their digital device. Thought Spot is a standalone app that allows users to add, review, and search crowdsourced information about nearby mental health and wellness services. Users can also track their mood on the app. Outcomes were self-assessed through questionnaires collected at baseline and 3 and 6 months. The primary outcome was change in formal help-seeking intentions from baseline to 6 months, measured by the General Help-Seeking Questionnaire. A mixed-effects model was used to compare the impact of usual care and intervention on the primary outcome (formal help-seeking intentions). Secondary outcomes included changes in informal help-seeking intentions and help-seeking behaviors, help-seeking attitudes, self-stigma, and self-efficacy. RESULTS: A total of 481 students were randomized into two groups: 240 to usual care, and 241 to the intervention group. There were no significant differences in help-seeking intentions between the usual care and intervention groups over 6 months (F2,877=0.85; P=.43, f=0.04). Both groups demonstrated similar increases in formal help-seeking intentions at 3 and 6 months (F2,877=23.52; P<.001, f=0.21). Compared with males, females sought more help from formal resources (OR 1.86; 95% CI 1.22 to 2.83, P=.001). Females were less likely to seek help from informal sources than males (OR 0.80; 95% CI 0.22 to 0.73, P<.001). CONCLUSIONS: Prompting postsecondary students about mental health and help-seeking appears to increase help-seeking intentions. mHealth interventions may be as effective as information pamphlets in increasing formal help-seeking but may confer a small advantage in driving help-seeking from informal sources. Although there is enthusiasm, developers and health policy experts should exercise caution and thoroughly evaluate these types of digital tools. Future studies should explore the cost-effectiveness of digital interventions and develop strategies for improving their efficacy. TRIAL REGISTRATION: ClinicalTrials.gov NCT03412461; https://clinicaltrials.gov/ct2/show/NCT03412461. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/resprot.6446.

Surveying the Role of Analytics in Evaluating Digital Mental Health Interventions for Transition-Aged Youth: Scoping Review.

BACKGROUND: Consumer-facing digital health interventions provide a promising avenue to bridge gaps in mental health care delivery. To evaluate these interventions, understanding how the target population uses a solution is critical to the overall validity and reliability of the evaluation. As a result, usage data (analytics) can provide a proxy for evaluating the engagement of a solution. However, there is paucity of guidance on how usage data or analytics should be used to assess and evaluate digital mental health interventions. OBJECTIVE: This review aimed to examine how usage data are collected and analyzed in evaluations of mental health mobile apps for transition-aged youth (15-29 years). METHODS: A scoping review was conducted using the Arksey and O'Malley framework. A systematic search was conducted on 5 journal databases using keywords related to usage and engagement, mental health apps, and evaluation. A total of 1784 papers from 2008 to 2019 were identified and screened to ensure that they included analytics and evaluated a mental health app for transition-aged youth. After full-text screening, 49 papers were included in the analysis. RESULTS: Of the 49 papers included in the analysis, 40 unique digital mental health innovations were evaluated, and about 80% (39/49) of the papers were published over the past 6 years. About 80% involved a randomized controlled trial and evaluated apps with information delivery features. There were heterogeneous findings in the concept that analytics was ascribed to, with the top 3 being engagement, adherence, and acceptability. There was also a significant spread in the number of metrics collected by each study, with 35% (17/49) of the papers collecting only 1 metric and 29% (14/49) collecting 4 or more analytic metrics. The number of modules completed, the session duration, and the number of log ins were the most common usage metrics collected. CONCLUSIONS: This review of current literature identified significant variability and heterogeneity in using analytics to evaluate digital mental health interventions for transition-aged youth. The large proportion of publications from the last 6 years suggests that user analytics is increasingly being integrated into the evaluation of these apps. Numerous gaps related to selecting appropriate and relevant metrics and defining successful or high levels of engagement have been identified for future exploration. Although long-term use or adoption is an important precursor to realizing the expected benefits of an app, few studies have examined this issue. Researchers would benefit from clarification and guidance on how to measure and analyze app usage in terms of evaluating digital mental health interventions for transition-aged youth. Given the established role of adoption in the success of health information technologies, understanding how to abstract and analyze user adoption for consumer digital mental health apps is also an emerging priority.

Thought Spot: Embedding Usability Testing into the Development Cycle.

Usability testing is a vital component in the development of any digital innovation. Thought Spot, a mental health and wellness mobile application designed for and by transition-aged youth, underwent three distinct phases of usability testing (lab testing, field testing and heuristic evaluations). Testing highlighted that participants generally had a positive experience with the platform. Although some app functions were initially difficult for users, positive trends in learnability were observed. The key lesson learned from this process is the need for iterative testing timelines, concurrent with app development.

Moving beyond orientations: a multiple case study of the residency experiences of Canadian-born and immigrant international medical graduates.

Many international medical graduates (IMGs) enter North American residency programs every year. The Canadian IMG physician pool increasingly includes Canadian-born IMGs (C-IMGs) along with Immigrant-IMGs (I-IMGs). Similar trends exist in the United States. Our objective was to understand the similarities and differences in the challenges faced by both I-IMGs and C-IMGs during residency to identify actionable recommendations to support them during this critical time. We performed a multiple case study of IMGs' experiences at a large Canadian university. Within our two descriptive cases (I-IMGs, C-IMGs) we iteratively conducted twenty-two semi-structured interviews; we thematically analyzed our data within, between, and across both cases to understand challenges to IMGs' integration and opportunities for curricular innovations to facilitate their adaptation process. Research team members with different perspectives contributed reflexively to the thematic analysis. Participants identified key differences between medical culture and knowledge expected in Canada and the health systems and curricula in which they originally trained. I-IMG and C-IMG participants perceived two major challenges: discrimination because of negative labelling as IMGs and difficulties navigating their initial residency months. C-IMGs described a third challenge: frustration around the focus on the needs of I-IMGs. Participants from both groups identified two major opportunities: their desire to help other IMGs and a need for mentorship. I-IMGs and C-IMGs face diverse challenges during their training, including disorientation and discrimination. We identified specific objectives to inform the design of curriculum and support services that residency programs can offer trainees as well as important targets for resident education and faculty development.

The Optimization of an eHealth Solution (Thought Spot) with Transition-Aged Youth in Postsecondary Settings: Participatory Design Research.

BACKGROUND: Seventy percent of lifetime cases of mental illness emerge before the age of 24 years, but many youth are unable to access the support and services they require in a timely and appropriate way. With most youth using the internet, electronic health (eHealth) interventions are promising tools for reaching this population. Through participatory design research (PDR) engagement methods, Thought Spot, a Web- and mobile-based platform, was redeveloped to facilitate access to mental health services by transition-aged youth (aged 16-29 years) in postsecondary settings. OBJECTIVE: The aim of this study was to describe the process of engaging with postsecondary students through the PDR approaches, with the ultimate goal of optimizing the Thought Spot platform. METHODS: Consistent with the PDR approaches, five student-led workshops, attended by 41 individuals, were facilitated to obtain feedback regarding the platform's usability and functionality and its potential value in a postsecondary setting. Various creative engagement activities were delivered to gather experiences and opinions, including semistructured focus groups, questionnaires, personas, journey mapping, and a world café. Innovative technological features and refinements were also brainstormed during the workshops. RESULTS: By using PDR methods of engagement, participants knew that their ideas and recommendations would be applied. There was also an overall sense of respect and care integrated into each group, which facilitated an exchange of ideas and suggestions. CONCLUSIONS: The process of engaging with students to redesign the Thought Spot platform through PDR has been effective. Findings from these workshops will significantly inform new technological features within the app to enable positive help-seeking behaviors among students. These behaviors will be further explored in the second phase that involves a randomized controlled trial.

A Web- and Mobile-Based Map of Mental Health Resources for Postsecondary Students (Thought Spot): Protocol for an Economic Evaluation.

BACKGROUND: Youth demonstrate a low propensity to seek help for mental health issues and exhibit low use of health services despite the high prevalence of mental health challenges in this population. Research has found that delivering interventions via the internet and mobile devices is an effective way to reach youth. Thought Spot, a Web- and mobile-based map, was developed to help transition-aged youth in postsecondary settings overcome barriers to help-seeking, thereby reducing the economic burden associated with untreated mental health issues. OBJECTIVE: This paper presents the protocol for an economic evaluation that will be conducted in conjunction with a randomized controlled trial (RCT) to evaluate the effectiveness and cost of Thought Spot compared with usual care in terms of self-efficacy for mental health help-seeking among postsecondary students. METHODS: A partially blinded RCT will be conducted to assess the impact of Thought Spot on the self-efficacy of students for mental health help-seeking. Students from 3 postsecondary institutions in Ontario, Canada will be randomly allocated to 1 of 2 intervention groups (resource pamphlet or Thought Spot) for 6 months. The economic evaluation will focus on the perspective of postsecondary institutions or other organizations interested in using Thought Spot. Costs and resources for operating and maintaining the platform will be reported and compared with the costs and resource needs associated with usual care. The primary outcome will be change in help-seeking intentions, measured using the General Help-Seeking Questionnaire. The cost-effectiveness of the intervention will be determined by calculating the incremental cost-effectiveness ratio, which will then be compared with willingness to pay. RESULTS: The RCT is scheduled to begin in February 2018 and will run for 6 months, after which the economic evaluation will be completed. CONCLUSIONS: We expect to demonstrate that Thought Spot is a cost-effective way to improve help-seeking intentions and encourage help-seeking behavior among postsecondary students. The findings of this study will help inform postsecondary institutions when they are allocating resources for mental health initiatives. TRIAL REGISTRATION: ClinicalTrials.gov NCT03412461; https://clinicaltrials.gov/ct2/show/NCT03412461 (Archived at WebCite at http://www.webcitation.org/6xy5lWpnZ).

Scoping review protocol: education initiatives for medical psychiatry collaborative care.

INTRODUCTION: The collaborative care model is an approach providing care to those with mental health and addictions disorders in the primary care setting. There is a robust evidence base demonstrating its clinical and cost-effectiveness in comparison with usual care; however, the transitioning to this new paradigm of care has been difficult. While there are efforts to train and prepare healthcare professionals, not much is known about the current state of collaborative care training programmes. The objective of this scoping review is to understand how widespread these collaborative care education initiatives are, how they are implemented and their impacts. METHODS AND ANALYSIS: The scoping review methodology uses the established review methodology by Arksey and O'Malley. The search strategy was developed by a medical librarian and will be applied in eight different databases spanning multiple disciplines. A two-stage screening process consisting of a title and abstract scan and a full-text review will be used to determine the eligibility of articles. To be included, articles must report on an existing collaborative care education initiative for healthcare providers. All articles will be independently assessed for eligibility by pairs of reviewers, and all eligible articles will be abstracted and charted in duplicate using a standardised form. The extracted data will undergo a 'narrative review' or a descriptive analysis of the contextual or process-oriented data and simple quantitative analysis using descriptive statistics. ETHICS AND DISSEMINATION: Research ethics approval is not required for this scoping review. The results of this scoping review will inform the development of a collaborative care training initiative emerging from the Medical Psychiatry Alliance, a four-institution philanthropic partnership in Ontario, Canada. The results will also be presented at relevant national and international conferences and published in a peer-reviewed journal.

Thought Spot: Co-Creating Mental Health Solutions with Post-Secondary Students.

It is difficult for the nearly 20% of Canadian 15- to 24-year olds reporting symptoms to seek the help they need within the current mental health system. Web-based and mobile health interventions are promising tools for reaching this group; having the capacity to reduce access-to-service barriers and engage youth in promoting their mental well-being. A three-phased, iterative, co-creation developmental approach was used to develop Thought Spot, a platform to better enable post-secondary students to seek mental health support. Co-creation activities included student development teams, hosting a hackathon, conducting focus groups and evidence-based workshops and student advisory groups. Evaluation results highlighted the need for greater role clarity and strategies for sustainable engagement in the co-creation process. Lessons learned are informing the project optimization phase and will be utilized to inform the design and implementation of an RCT, assessing impact on help seeking behaviour.

Philanthropy in health professions education research: determinants of success.

CONTEXT: Fund-raising is a new practice in medical education research. OBJECTIVES: This qualitative study explores a cross-sectional analysis of philanthropy in medical education in Canada and Europe and identifies some common characteristics in the fund-raising system, key roles and characteristics of research sites that have had success. METHODS: Medical education research sites that had received donations greater than Can$100 000 were identified by searching publicly available sources. Interviews were conducted with 25 individuals from these and other sites, in four categories: medical education leaders (n = 9); philanthropy-supported chairholders and researchers (n = 5); donors of over Can$100 000 (n = 7), and advancement professionals (n = 4). Interview transcripts were inductively coded to identify themes. RESULTS: Five factors associated with success in accessing philanthropic sources were identified in the sample: support of the organisation's senior leadership; a charismatic champion who motivates donors; access to an advancement office or foundation; impetus to find funds beyond traditional operating budgets, and understanding of the conceptual and practical dimensions of fund-raising. Three types of donor (medical education insider, donor collective and general philanthropist), four faculty roles (trailblazers, rock stars, 'Who? Me?' people and future fund-raisers) and six stages in the fund-raising cycle were also identified. CONCLUSIONS: Philanthropy is a source of funding with the potential to significantly advance education research. Yet competence in fund-raising is not widely developed among medical education research leaders. Successful accessing of philanthropic sources of funding requires the ability to articulate the impact of philanthropy in medical education research in a way that will interest donors. This appears to be challenging for medical education leaders, who tend to frame their work in academic terms and have trouble competing against other fund-raising domains. Medical education research institutes and centres will benefit from developing greater understanding of the conception and practices of fund-raising.

Enhancing Self-Efficacy for Help-Seeking Among Transition-Aged Youth in Postsecondary Settings With Mental Health and/or Substance Use Concerns, Using Crowd-Sourced Online and Mobile Technologies: The Thought Spot Protocol.

BACKGROUND: Seventy percent of lifetime cases of mental illness emerge prior to age 24. While early detection and intervention can address approximately 70% of child and youth cases of mental health concerns, the majority of youth with mental health concerns do not receive the services they need. OBJECTIVE: The objective of this paper is to describe the protocol for optimizing and evaluating Thought Spot, a Web- and mobile-based platform cocreated with end users that is designed to improve the ability of students to access mental health and substance use services. METHODS: This project will be conducted in 2 distinct phases, which will aim to (1) optimize the existing Thought Spot electronic health/mobile health intervention through youth engagement, and (2) evaluate the impact of Thought Spot on self-efficacy for mental health help-seeking and health literacy among university and college students. Phase 1 will utilize participatory action research and participatory design research to cocreate and coproduce solutions with members of our target audience. Phase 2 will consist of a randomized controlled trial to test the hypothesis that the Thought Spot intervention will show improvements in intentions for, and self-efficacy in, help-seeking for mental health concerns. RESULTS: We anticipate that enhancements will include (1) user analytics and feedback mechanisms, (2) peer mentorship and/or coaching functionality, (3) crowd-sourcing and data hygiene, and (4) integration of evidence-based consumer health and research information. CONCLUSIONS: This protocol outlines the important next steps in understanding the impact of the Thought Spot platform on the behavior of postsecondary, transition-aged youth students when they seek information and services related to mental health and substance use.

The Psychiatry OSCE: a 20-year retrospective.

OBJECTIVE: Twenty years ago researchers at the University of Toronto launched the Psychiatry Skills Assessment Project (PSAP), a research program exploring Objective Structured Clinical Examinations (OSCEs) in psychiatry. Between 1994 and 2005 PSAP produced publications on the feasibility, reliability, validity, ethics, and practical concerns of OSCEs in psychiatry. The current review has two parts: a review of the state of the art of OSCEs in psychiatry 20 years after they were introduced and documentation of the impact of the PSAP research program. METHODS: A literature search identified all publications on OSCEs and psychiatry. Articles were coded thematically, and locations of agreement and controversies were identified. Bibliometric analysis identified citations of PSAP research papers, which were analyzed thematically. RESULTS: As of May 2013, there were 250 publications related to OSCEs in psychiatry (not including 10 PSAP papers), published in 29 different countries and ten languages. Prominent topics were the validity and acceptability of OSCEs and SPs, systems issues in adopting OSCEs in psychiatry, and the effects on learning. Eighty-eight percent of all publications cited PSAP work (300 citations). Citations were employed for four purposes: as evidence/justification (54 %); to frame replication research (14 %); to support adaptation of OSCEs in other countries and professions (15 %); and for debate (18 %). CONCLUSIONS: Over the past 20 years, use of OSCEs has grown steadily in psychiatry, and several national certification organizations have adopted OSCEs. PSAP work, introduced two decades ago, continues to provide a scholarly foundation for psychometric, practical, and ethical issues of interest to this field.

Sustaining quality improvement and patient safety training in graduate medical education: lessons from social theory.

PURPOSE: Despite an official mandate to incorporate formal quality improvement (QI) and patient safety (PS) training into graduate medical education, many QI/PS curricular efforts face implementation challenges and are not sustained. Educators are increasingly turning to sociocultural theories to address issues such as curricular uptake in medical education. The authors conducted a case study using Bourdieu's concepts of "field" and "habitus" to identify theoretically derived strategies that can promote sustained implementation of QI/PS curricula. METHOD: From October 2010 through May 2011, the authors conducted semistructured interviews with principal authors of studies included in a systematic review of QI/PS curricula and with key informants (identified by study participants) who did not publish on their QI/PS curricular efforts. The authors purposively sampled to theoretical saturation and analyzed data concurrently with iterative data gathering within Bourdieu's theoretical framework. RESULTS: The study included 16 participants representing six specialties in the United States and Canada. Data analysis revealed that academic physicians belong to, and compete for legitimate forms of capital within, two separate but related fields associated with QI/PScurricular implementation: the "academic field" and the "health care delivery field." Respondents used specific strategies toexploit and/or redefine the prevailingforms of legitimate capital in each field to encourage changes inacademic physicians' habitus that would legitimizeQI/PS. CONCLUSIONS: Situating study findings in a sociocultural theory enables articulation of concrete strategies that can legitimize QI/PS in the academic and health care delivery fields. These strategies can promote sustained QI/PS curricula in graduate medical education.

Teaching medical error disclosure to physicians-in-training: a scoping review.

PURPOSE: This scoping review identified published studies of error disclosure curricula targeting physicians-in-training (residents or medical students). METHOD: In 2011, the authors searched electronic databases (e.g., MEDLINE, EMBASE, ERIC) for eligible studies published between 1960 and July 2011. From the studies that met their inclusion criteria, they extracted and summarized key aspects of each curriculum (e.g., level of learner, program discipline) and educational features (e.g., curriculum design, teaching and assessment methods, and learner outcomes). RESULTS: The authors identified 21 studies that met their inclusion criteria. These studies described 19 error disclosure curricula, which were either a stand-alone educational activity, part of a larger curriculum in patient safety or communication skills, or part of simulation training. Most curricula consisted of a brief, single encounter, combining didactic lectures or small-group discussions with role-play. Fourteen studies described learners' self-reported improvements in knowledge, skills, and attitudes. Five studies used a structured assessment and reported that learners' error disclosure skills improved after completing the curriculum; however, these studies were limited by their small to medium sample size and lack of assessment of skills retention. Attempts to assess the change in learners' error disclosure behavior in the clinical context were limited. CONCLUSIONS: Studies of existing error disclosure curricula demonstrate improvements in learners' knowledge, skills, and attitudes. A greater emphasis is needed on the more rigorous assessment of skills acquisition and behavior change to determine whether formal training leads to long-term effects on learner outcomes that translate into real-world clinical practice.

Neophyte facilitator experiences of interprofessional education: implications for faculty development.

The facilitation of learners from different professional groups requires a range of interprofessional knowledge and skills (e.g. an understanding of possible sources of tension between professions) in addition to those that are more generic, such as how to manage a small group of learners. The development and delivery of interprofessional education (IPE) programs tends to rely on a small cohort of facilitators who have typically gained expertise through 'hands-on' involvement in facilitating IPE and through mentorship from more experienced colleagues. To avoid burn-out and to meet a growing demand for IPE, a larger number of facilitators are needed. However, empirical evidence regarding effective approaches to prepare for this type of work is limited. This article draws on data from a multiple case study of four IPE programs based in an urban setting in North America with a sample of neophyte facilitators and provides insight into their perceptions and experiences in preparing for and delivering IPE. Forty-one semi-structured interviews were conducted before (n = 20) and after (n = 21) program delivery with 21 facilitators. Findings indicated that despite participating in a three-fold faculty development strategy designed to support them in their IPE facilitation work, many felt unprepared and continued to have a poor conceptual understanding of core IPE and interprofessional collaboration principles, resulting in problematic implications (e.g. 'missed teachable moments') within their IPE programs. Findings from this study are discussed in relation to the IPE, faculty development and wider educational literature before implications are offered for the future delivery of interprofessional faculty development activities.