Language-Specific Challenges and Solutions for Equitable Telemedicine Implementation in the Primary Care Safety Net During COVID-19.

PURPOSE: Telemedicine care dramatically expanded during the COVID-19 pandemic. We characterized facilitators and barriers to telemedicine implementation among safety-net primary care clinics serving patients with limited English proficiency (LEP). METHODS: We collected data on telemedicine volume and patient demographics among safety-net clinics participating in a telemedicine learning collaborative. Data on various metrics were reported to the collaborative from February 2019 through August 2021. We conducted semi-structured interviews with clinical and quality leaders, purposively sampling clinics serving high proportions of patients with LEP. We analyzed interviews with a mixed inductive-deductive approach applying the Consolidated Framework for Implementation Research. RESULTS: By September 2020, the 23 sites served 121,589 unique patients with in-person and 120,338 with telephone visits; 47% of these patients had LEP. Of 10,897 unique patients served by video visits, 38% had LEP. As a proportion of total visits, telemedicine (telephone and video) visits increased from 0-17% in October 2019-March 2020 to 10-98% in March-August 2020. We conducted 14 interviews at 11 sites. Themes included (1) existing telemedicine platforms and interpreter services were not optimized to support patients with LEP; (2) clinics invested significant labor iterating workflows; (3) sites with technological infrastructure and language-concordant staff were best suited to serve patients; (4) patients speaking less-represented languages or experiencing intersecting literacy barriers were underserved with telemedicine. Interviewees recommended innovations in telemedicine platforms and community-based access. CONCLUSIONS: Safety-net sites relied on existing resources to accommodate patients with LEP, but struggled providing access for the most marginalized. Proactive, data-driven strategies to address patient and community barriers as well as optimize clinical workflows with high-quality, certified medical interpreters are needed to ensure equitable access.

Usability and acceptability of virtual reality for chronic pain management among diverse patients in a safety-net setting: a qualitative analysis.

Objective: The aim of this study was to understand the usability and acceptability of virtual reality (VR) among a racially and ethnically diverse group of patients who experience chronic pain. Materials and Methods: Using the Technology Acceptance Model theory, we conducted semistructured interviews and direct observation of VR use with English-speaking patients who experience chronic pain treated in a public healthcare system (n = 15), using a commercially available VR technology platform. Interviews included questions about current pain management strategies, technology use, experiences and opinions with VR, and motivators for future use. Results: Before the study, none of the 15 participants had heard about or used VR for pain management. Common motivators for VR use included a previous history of substance use and having exhausted many other options to manage their pain and curiosity. Most participants had a positive experience with VR and 47% found that the VR modules distracted them from their pain. When attempting the navigation-based usability tasks, most participants (73%-92%) were able to complete them independently. Discussion: VR is a usable tool for diverse patients with chronic pain. Our findings suggest that the usability of VR is not a barrier and perhaps a focus on improving the accessibility of VR in safety-net settings is needed to reduce disparities in health technology use. Conclusions: The usability and acceptability of VR are rarely studied in diverse patient populations. We found that participants had a positive experience using VR, showed interest in future use, and would recommend VR to family and friends.

Virtual Reality for Chronic Pain Management Among Historically Marginalized Populations: Systematic Review of Usability Studies.

BACKGROUND: Virtual reality (VR) has potential to improve chronic pain management outcomes. However, the majority of studies assessing VR are conducted in predominantly White populations in well-resourced settings, thus leaving a gap in knowledge of VR use among diverse populations who experience a significant chronic pain burden. OBJECTIVE: This review aims to examine the extent to which usability of VR for chronic pain management has been studied within historically marginalized patient groups. METHODS: We conducted a systematic search to identify studies with usability outcomes located in high-income countries that included a historically marginalized population, defined by a mean age greater than or equal to 65 years, lower educational attainment (greater than or equal to 60% having attained high school education or less), and being a racial or ethnic minority (less than or equal to 50% non-Hispanic White people for studies based in the United States). RESULTS: Our analysis included 5 papers, which we used to conduct a narrative analysis. Three studies examined VR usability as a primary outcome. All studies assessed VR usability using different measures, of which 4 found VR to be usable by their respective study population. Only 1 study found a significant improvement in pain levels post-VR intervention. CONCLUSIONS: The use of VR shows promise for chronic pain management, but few studies include populations that are older, have limited educational attainment, or have racial or ethnic diversity. Additional studies with these populations are needed to further develop VR systems that work best for diverse patients with chronic pain.

Acceptability and Usability of a Wearable Device for Sleep Health Among English- and Spanish-Speaking Patients in a Safety Net Clinic: Qualitative Analysis.

BACKGROUND: Sleep disorders are common and disproportionately affect marginalized populations. Technology, such as wearable devices, holds the potential to improve sleep quality and reduce sleep disparities, but most devices have not been designed or tested with racially, ethnically, and socioeconomically diverse patients. Inclusion and engagement of diverse patients throughout digital health development and implementation are critical to achieving health equity. OBJECTIVE: This study aims to evaluate the usability and acceptability of a wearable sleep monitoring device-SomnoRing-and its accompanying mobile app among patients treated in a safety net clinic. METHODS: The study team recruited English- and Spanish-speaking patients from a mid-sized pulmonary and sleep medicine practice serving publicly insured patients. Eligibility criteria included initial evaluation of obstructed sleep apnea, which is most appropriate for limited cardiopulmonary testing. Patients with primary insomnia or other suspected sleep disorders were not included. Patients tested the SomnoRing over a 7-night period and participated in a 1-hour semistructured web-based qualitative interview covering perceptions of the device, motivators and barriers to use, and general experiences with digital health tools. The study team used inductive or deductive processes to code interview transcripts, guided by the Technology Acceptance Model. RESULTS: A total of 21 individuals participated in the study. All participants owned a smartphone, almost all (19/21) felt comfortable using their phone, and few already owned a wearable (6/21). Almost all participants wore the SomnoRing for 7 nights and found it comfortable. The following four themes emerged from qualitative data: (1) the SomnoRing was easy to use compared to other wearable devices or traditional home sleep testing alternatives, such as the standard polysomnogram technology for sleep studies; (2) the patient's context and environment, such as family and peer influence, housing status, access to insurance, and device cost affected the overall acceptance of the SomnoRing; (3) clinical champions motivated use in supporting effective onboarding, interpretation of data, and, ongoing technical support; and (4) participants desired more assistance and information to best interpret their own sleep data summarized in the companion app. CONCLUSIONS: Racially, ethnically, and socioeconomically diverse patients with sleep disorders perceived a wearable as useful and acceptable for sleep health. Participants also uncovered external barriers related to the perceived usefulness of the technology, such as housing status, insurance coverage, and clinical support. Future studies should further examine how to best address these barriers so that wearables, such as the SomnoRing, can be successfully implemented in the safety net health setting.

Operationalizing Academic-Industry Partnerships to Advance Digital Health Equity: Lessons Learned.

Technological innovation can improve health care and population health. However, it is not often designed with public health systems and diverse patients in mind. In 2016, university faculty digital health experts established an innovation incubator in an academic setting based in a public health care system. The incubator conducted projects with a cohort of private technology companies and sparked cross-sector dialogue about digital health equity. The incubator completed rapid-cycle research and evaluation projects with industry and in partnership with publicly insured patients and public health care workers to improve the fit of technology with diverse user needs and preferences. Lessons learned include the importance of an explicit focus on equity, early alignment of expectations, broader investment and communications, and inclusive stakeholder relationships. Partnerships between the digital health industry and public health researchers can bridge the gap between technology offerings and the needs and preferences of publicly insured patients.

Multispecialty Physician Online Survey Reveals That Burnout Related to Adverse Event Involvement May Be Mitigated by Peer Support.

OBJECTIVES: Involvement in adverse events can negatively impact physician well-being. Because burnout is increasingly recognized as a threat to patient safety, we examined the relationship between physician adverse event involvement and burnout as well as facilitators and barriers to support among physicians experiencing burnout. METHODS: We surveyed physicians in the United States who are members of the networking platform, Doximity. We conducted quantitative and qualitative analyses investigating experiences with adverse events, the impact of adverse events, the type of support the physician sought and received after the event, and burnout. RESULTS: Across specialties, involvement in an adverse event and burnout was common. Most respondents involved in an adverse event experienced emotional impact, but only a minority received support. Those reporting that the error resulted in emotional impact were more likely to experience burnout (adjusted odds ratio, 1.90; 95% confidence interval, 1.18-3.07); this association was mitigated by the most common form of support sought, peer support (adjusted odds ratio for burnout among those who received peer support versus those who did not, 0.65; 95% confidence interval, 0.52-0.82). Barriers to support after an adverse event include punitive culture and systems factors such as administrative bureaucracy. Facilitators that emerged include peer, professional, and spiritual support, mentorship, helping others, the learning environment, and improved/flexible working hours. CONCLUSIONS: Physicians who experienced emotional repercussions from adverse events were more likely to report burnout compared with those who did not. Respondents proposed barriers and facilitators to support that have not been widely implemented. Peer support may help mitigate physician burnout related to adverse events.

Do patient-reported outcome measures measure up? A qualitative study to examine perceptions and experiences with heart failure proms among diverse, low-income patients.

BACKGROUND: The Kansas City Cardiomyopathy Questionnaire (KCCQ) is a Patient-Reported Outcome Measure (PROM) used to evaluate the health status of patients with heart failure (HF) but has predominantly been tested in settings serving predominately white, male, and economically well-resourced populations. We sought to examine the acceptability of the shorter version of the KCCQ (KCCQ-12) among racially and ethnically diverse patients receiving care in an urban, safety-net setting. METHODS: We conducted cognitive interviews with a diverse population of patients with heart failure in a safety net system to assess their perceptions of the KCCQ-12. We conducted a thematic analysis of the qualitative data then mapped themes to the Capability, Opportunity, Motivation Model of Behavior framework. RESULTS: We interviewed 18 patients with heart failure and found that patients broadly endorsed the concepts of the KCCQ-12 with minor suggestions to improve the instrument's content and appearance. Although patients accepted the KCCQ-12, we found that the instrument did not adequately measure aspects of health care and quality of life that patients identified as being important components of managing their heart failure. Patient-important factors of heart failure management coalesced into three main themes: social support, health care environment, and mental health. CONCLUSIONS: Patients from this diverse, low-income, majority non-white population experience unique challenges and circumstances that impact their ability to manage disease. In this study, patients were receptive to the KCCQ-12 as a tool but perceived that it did not adequately capture key health components such as mental health and social relationships that deeply impact their ability to manage HF. Further study on the incorporation of social determinants of health into PROMs could make them more useful tools in evaluating and managing HF in diverse, underserved populations.

Barriers and Facilitators to the Implementation of Virtual Reality as a Pain Management Modality in Academic, Community, and Safety-Net Settings: Qualitative Analysis.

BACKGROUND: Prior studies have shown that virtual reality (VR) is an efficacious treatment modality for opioid-sparing pain management. However, the majority of these studies were conducted among primarily White, relatively advantaged populations and in well-resourced settings. OBJECTIVE: We conducted a qualitative, theory-informed implementation science study to assess the readiness for VR in safety-net settings. METHODS: Using the theoretical lens of the Consolidated Framework for Implementation Research (CFIR) framework, we conducted semistructured interviews with current VR users and nonusers based in safety-net health systems (n=15). We investigated barriers and facilitators to a commercially available, previously validated VR technology platform AppliedVR (Los Angeles, CA, USA). We used deductive qualitative analysis using the overarching domains of the CFIR framework and performed open, inductive coding to identify specific themes within each domain. RESULTS: Interviewees deemed the VR intervention to be useful, scalable, and an appealing alternative to existing pain management approaches. Both users and nonusers identified a lack of reimbursement for VR as a significant challenge for adoption. Current users cited positive patient feedback, but safety-net stakeholders voiced concern that existing VR content may not be relevant or appealing to diverse patients. All respondents acknowledged the challenge of integrating and maintaining VR in current pain management workflows across a range of clinical settings, and this adoption challenge was particularly acute, given resource and staffing constraints in safety-net settings. CONCLUSIONS: VR for pain management holds interest for frontline pain management clinicians and leadership in safety-net health settings but will require significant tailoring and adaption to address the needs of diverse populations. Integration into complex workflows for pain management is a significant barrier to adoption, and participants cited structural cost and reimbursement concerns as impediments to initial implementation and scaling of VR use.

Alignment of Key Stakeholders' Priorities for Patient-Facing Tools in Digital Health: Mixed Methods Study.

BACKGROUND: There is widespread agreement on the promise of patient-facing digital health tools to transform health care. Yet, few tools are in widespread use or have documented clinical effectiveness. OBJECTIVE: The aim of this study was to gain insight into the gap between the potential of patient-facing digital health tools and real-world uptake. METHODS: We interviewed and surveyed experts (in total, n=24) across key digital health stakeholder groups-venture capitalists, digital health companies, payers, and health care system providers or leaders-guided by the Consolidated Framework for Implementation Research. RESULTS: Our findings revealed that external policy, regulatory demands, internal organizational workflow, and integration needs often take priority over patient needs and patient preferences for digital health tools, which lowers patient acceptance rates. We discovered alignment, across all 4 stakeholder groups, in the desire to engage both patients and frontline health care providers in broader dissemination and evaluation of digital health tools. However, major areas of misalignment between stakeholder groups have stymied the progress of digital health tool uptake-venture capitalists and companies focused on external policy and regulatory demands, while payers and providers focused on internal organizational workflow and integration needs. CONCLUSIONS: Misalignment of the priorities of digital health companies and their funders with those of providers and payers requires direct attention to improve uptake of patient-facing digital health tools and platforms.

Usability, inclusivity, and content evaluation of COVID-19 contact tracing apps in the United States.

We evaluated the usability of mobile COVID-19 contact tracing apps, especially for individuals with barriers to communication and limited digital literacy skills. We searched the Apple App Store, Google Play, peer-reviewed literature, and lay press to find contact tracing apps in the United States. We evaluated apps with a framework focused on user characteristics and user interface. Of the final 26 apps, 77% were on both iPhone and Android. 69% exceeded 9th grade readability, and 65% were available only in English. Only 12% had inclusive illustrations (different genders, skin tones, physical abilities). 92% alerted users of an exposure, 42% linked to a testing site, and 62% linked to a public health website within 3 clicks. Most apps alert users of COVID-19 exposure but require high English reading levels and are not fully inclusive of the U.S. population, which may limit their reach as public health tools.

Defining and Measuring Adherence in Observational Studies Assessing Outcomes of Real-world Active Surveillance for Prostate Cancer: A Systematic Review.

CONTEXT: Evidence-based guidelines for active surveillance (AS), a treatment option for men with low-risk prostate cancer, recommend regular follow-up at periodic intervals to monitor disease progression. However, gaps in monitoring can lead to delayed detection of cancer progression, leading to a missed window of curability. OBJECTIVE: We aimed to identify the extent to which real-world observational studies reported adherence to monitoring protocols among prostate cancer patients on AS. When reported, we sought to characterize definitions of adherence. EVIDENCE ACQUISITION: We systematically reviewed observational studies assessing outcomes of prostate cancer patients on AS, published before March 22, 2019 in PubMed, Embase, and CENTRAL. Adherence definitions were considered time bound if they included prespecified time and binary if adherence was assessed but did not specify a time interval. We assessed study quality using the Strengthening the Reporting of Observational Studies in Epidemiology checklist. EVIDENCE SYNTHESIS: Forty-five studies met our inclusion criteria. Eleven studies did not report any data on adherence to AS protocols. Twenty-five studies did not explicitly measure adherence, but provided relevant data (eg, number of patients who received a repeat biopsy). Six studies reported adherence using a time-bound definition, while three studies used a binary definition. Twenty-three studies provided information on patients lost to follow-up. CONCLUSIONS: Most studies reporting outcomes of patients on AS did not measure or report adherence. When reported, adherence was often not time specific. As some AS patients will benefit from maintaining a window of curability, clinical practices and future studies should track and report adherence and associated factors. PATIENT SUMMARY: We reviewed real-world observational studies examining outcomes of prostate cancer patients on active surveillance. Most studies did not clearly define or report adherence to monitoring protocols, which is important to consider for appropriate disease management.

Real-world insights from launching remote peer-to-peer mentoring in a safety net healthcare delivery setting.

Peer mentors have been proven to improve diabetes outcomes, especially among diverse patients. Delivering peer mentoring via remote strategies (phone, text, mobile applications) is critical, especially in light of the recent pandemic. We conducted a real-world evaluation of a remote diabetes intervention in a safety-net delivery system in New York. We summarized the uptake, content, and pre-post clinical effectiveness for English- and Spanish-speaking participants. Of patients who could be reached, 71% (n = 690/974) were enrolled, and 90% of those (n = 618/690) participated in coaching. Patients and mentors had a mean of 32 check-ins, and each patient set an average of 10 goals. 29% of the participants accessed the program via the smartphone application. Among participants with complete hemoglobin A1c data (n = 179), there was an absolute 1.71% reduction (P < .01). There are multiple lessons for successful implementation of remote peer coaching into settings serving diverse patients, including meaningful patient-mentor matching and addressing social determinants.

Gaps in Treatment and Surveillance: Head and Neck Cancer Care in a Safety-Net Hospital.

OBJECTIVE: Treatment delays and suboptimal adherence to posttreatment surveillance may adversely affect head and neck cancer (HNC) outcomes. Such challenges can be exacerbated in safety-net settings that struggle with limited resources and serve a disproportionate number of patients vulnerable to gaps in care. This study aims to characterize treatment delays and adherence with posttreatment surveillance in HNC care at an urban tertiary care public hospital in San Francisco. STUDY DESIGN: Retrospective chart review. SETTING: Urban tertiary care public hospital in San Francisco. SUBJECTS AND METHODS: We identified all cases of HNC diagnosed from 2008 to 2010 through the electronic medical record. We abstracted data, including patient characteristics, disease characteristics, pathology and radiology findings, treatment details, posttreatment follow-up, and clinical outcomes. RESULTS: We included 64 patients. Median time from diagnosis to treatment initiation (DTI) was 57 days for all patients, 54 days for patients undergoing surgery only, 49 days for patients undergoing surgery followed by adjuvant radiation ± chemotherapy, 65 days for patients undergoing definitive radiation ± chemotherapy, and 29 days for patients undergoing neoadjuvant chemotherapy followed by radiation or chemoradiation. Overall, 69% of patients completed recommended treatment. Forty-two of 61 (69%) patients demonstrated adherence to posttreatment visits in year 1; this fell to 14 out of 30 patients (47%) by year 5. CONCLUSION: DTI was persistently prolonged in this study compared with prior studies in other public hospital settings. Adherence to posttreatment surveillance was suboptimal and continued to decline as the surveillance period progressed.

Customized registry tool for tracking adherence to clinical guidelines for head and neck cancers: protocol for a pilot study.

BACKGROUND: Despite recommendations for monitoring patients with chronic and high-risk conditions, gaps still remain. These gaps are exacerbated in outpatient care, where patients and clinicians face challenges related to care coordination, multiple electronic health records, and extensive follow-up. In addition, low-income and racial/ethnic minority populations that are disproportionately cared for in safety net settings are particularly at risk to lapses in monitoring. METHODS: We aim to implement and evaluate a health information technology platform developed using systems engineering methodologies. The implementation is situated in a clinic that monitors patients with head and neck cancer within a large, urban, publicly funded hospital. Our study will evaluate the time it takes for patients to progress through key treatment milestones prior to and after implementation of the tool. We will use models controlling for secular trend to estimate the effect of the tool on improving timely and successful completion of guideline-based care processes. DISCUSSION: This protocol details the evaluation of the effectiveness of a human-centered health information technology intervention on improving timely delivery of care for high-risk populations. Other settings, including those that face challenges related to limited resources to devote to safety programs and fragmented health information technology, may benefit from this approach. TRIAL REGISTRATION: ClinicalTrials.gov, NCT03546322. "Customized Registry Tool for Tracking Adherence to Clinical Guidelines for Head and Neck Cancers." Registered 1 June 2018.

Follow-up of incidental pulmonary nodules and association with mortality in a safety-net cohort.

Background Though incidental pulmonary nodules are common, rates of guideline-recommended surveillance and associations between surveillance and mortality are unclear. In this study, we describe adherence (categorized as complete, partial, late and none) to guideline-recommended surveillance among patients with incidental 5-8 mm pulmonary nodules and assess associations between adherence and mortality. Methods This was a retrospective cohort study of 551 patients (≥35 years) with incidental pulmonary nodules conducted from September 1, 2008 to December 31, 2016, in an integrated safety-net health network. Results Of the 551 patients, 156 (28%) had complete, 87 (16%) had partial, 93 (17%) had late and 215 (39%) had no documented surveillance. Patients were followed for a median of 5.2 years [interquartile range (IQR), 3.6-6.7 years] and 82 (15%) died during follow-up. Adjusted all-cause mortality rates ranged from 2.24 [95% confidence interval (CI), 1.24-3.25] deaths per 100 person-years for complete follow-up to 3.30 (95% CI, 2.36-4.23) for no follow-up. In multivariable models, there were no statistically significant associations between the levels of surveillance and mortality (p > 0.16 for each comparison with complete surveillance). Compared with complete surveillance, adjusted mortality rates were non-significantly increased by 0.45 deaths per 100 person-years (95% CI, -1.10 to 2.01) for partial, 0.55 (95% CI, -1.08 to 2.17) for late and 1.05 (95% CI, -0.35 to 2.45) for no surveillance. Conclusions Although guideline-recommended surveillance of small incidental pulmonary nodules was incomplete or absent in most patients, gaps in surveillance were not associated with statistically significant increases in mortality in a safety-net population.

An electronic registry to improve adherence to active surveillance monitoring among men with prostate cancer at a safety-net hospital: protocol for a pilot study.

BACKGROUND: The evidence-based practice of active surveillance to monitor men with favorable-risk prostate cancer in lieu of initial definitive treatment is becoming more common. However, there are barriers to effective implementation, particularly in low-resource settings. Our goal is to assess the efficacy and feasibility of a health information technology registry for men on active surveillance at a safety-net hospital to ensure patients receive guideline-recommended care. METHODS: We developed an electronic registry for urology clinic staff to monitor men on active surveillance. The health information technology tool was developed using the Systems Engineering Initiative for Patient Safety model and iteratively tailored to the needs of the clinic by engaging providers in a co-design process. We will enroll all men at Zuckerberg San Francisco General Hospital and Trauma Center who choose active surveillance as a treatment strategy. The primary outcomes to be assessed during this non-randomized, pragmatic evaluation are number of days delayed beyond recommended date of follow-up testing, the proportion of men who are lost to follow-up, the cancer stage at active treatment, and the feasibility and acceptability of the clinic-wide intervention with clinic staff. Secondary outcomes include appointment adherence within 30 days of the scheduled date. DISCUSSION: Use of a customized electronic approach for monitoring men on active surveillance could improve patient outcomes. It may help reduce the number of men lost to follow-up and improve adherence to timely follow-up testing. Evaluating the adoption and efficacy of a customized registry in a safety-net setting may also demonstrate feasibility for implementation in diverse clinical contexts. TRIAL REGISTRATION: ClinicalTrials.gov identifier NCT03553732, An Electronic Registry to Improve Adherence to Active Surveillance Monitoring at a Safety-net Hospital. Registered 11 June 2018.

Differences in Narrative Language in Evaluations of Medical Students by Gender and Under-represented Minority Status.

BACKGROUND: In varied educational settings, narrative evaluations have revealed systematic and deleterious differences in language describing women and those underrepresented in their fields. In medicine, limited qualitative studies show differences in narrative language by gender and under-represented minority (URM) status. OBJECTIVE: To identify and enumerate text descriptors in a database of medical student evaluations using natural language processing, and identify differences by gender and URM status in descriptions. DESIGN: An observational study of core clerkship evaluations of third-year medical students, including data on student gender, URM status, clerkship grade, and specialty. PARTICIPANTS: A total of 87,922 clerkship evaluations from core clinical rotations at two medical schools in different geographic areas. MAIN MEASURES: We employed natural language processing to identify differences in the text of evaluations for women compared to men and for URM compared to non-URM students. KEY RESULTS: We found that of the ten most common words, such as "energetic" and "dependable," none differed by gender or URM status. Of the 37 words that differed by gender, 62% represented personal attributes, such as "lovely" appearing more frequently in evaluations of women (p < 0.001), while 19% represented competency-related behaviors, such as "scientific" appearing more frequently in evaluations of men (p < 0.001). Of the 53 words that differed by URM status, 30% represented personal attributes, such as "pleasant" appearing more frequently in evaluations of URM students (p < 0.001), and 28% represented competency-related behaviors, such as "knowledgeable" appearing more frequently in evaluations of non-URM students (p < 0.001). CONCLUSIONS: Many words and phrases reflected students' personal attributes rather than competency-related behaviors, suggesting a gap in implementing competency-based evaluation of students. We observed a significant difference in narrative evaluations associated with gender and URM status, even among students receiving the same grade. This finding raises concern for implicit bias in narrative evaluation, consistent with prior studies, and suggests opportunities for improvement.

Decisions and repercussions of second victim experiences for mothers in medicine (SAVE DR MoM).

BACKGROUND: The second victim effect is defined as emotional distress experienced by providers involved in mistakes. This study characterises events contributing to the second victim effect among a diverse sample of physician mothers, describes the impact on both provider and patient and seeks to determine the association between experiencing a mistake and burnout. METHODS: In this mixed-methods study, an anonymous, cross-sectional survey was posted to an online network of over 65 000 physician mothers on 17 June 2016. Self-reported involvement in a mistake provided opportunity to describe the error and impact on both provider and patient. Free-text responses were qualitatively coded to identify error types. Hypothesising that making a mistake contributes to burnout, self-reported burnout was examined using a single question. We used logistic regression to estimate the association between involvement in a mistake and burnout, adjusting for practice years, setting and specialty. RESULTS: 5782 members completed the survey for an estimated response rate of 16.5% based on 34956 active users during the survey period. 2859 respondents reported involvement in a mistake (49%), which was associated with higher reported burnout (p<0.0001). 56% of those reporting a mistake provided descriptions. Qualitative analysis revealed that self-reported treatment errors were more common and diagnostic errors were most often reported to result in greater patient harm. Of those involved in a mistake, 82% reported feelings of guilt; 2.2% reported reducing clinical workload, taking leave or leaving the profession. CONCLUSIONS: Physician mothers involved in errors experience negative outcomes and may be at increased risk for burnout. Additional research should focus on strategies to mitigate burnout associated with the second victim effect, particularly among women physicians and those with family responsibilities.

Implementation science for ambulatory care safety: a novel method to develop context-sensitive interventions to reduce quality gaps in monitoring high-risk patients.

BACKGROUND: Missed evidence-based monitoring in high-risk conditions (e.g., cancer) leads to delayed diagnosis. Current technological solutions fail to close this safety gap. In response, we aim to demonstrate a novel method to identify common vulnerabilities across clinics and generate attributes for context-flexible population-level monitoring solutions for widespread implementation to improve quality. METHODS: Based on interviews with staff in otolaryngology, pulmonary, urology, breast, and gastroenterology clinics at a large urban publicly funded health system, we applied journey mapping to co-develop a visual representation of how patients are monitored for high-risk conditions. Using a National Academies framework and context-sensitivity theory, we identified common systems vulnerabilities and developed preliminary concepts for improving the robustness for monitoring patients with high-risk conditions ("design seeds" for potential solutions). Finally, we conducted a face validity and prioritization assessment of the design seeds with the original interviewees. RESULTS: We identified five high-risk situations for potentially consequential diagnostic delays arising from suboptimal patient monitoring. All situations related to detection of cancer (head and neck, lung, prostate, breast, and colorectal). With clinic participants we created 5 journey maps, each representing specialty clinic workflow directed at evidence-based monitoring. System vulnerabilities common to the different clinics included challenges with: data systems, communications handoffs, population-level tracking, and patient activities. Clinic staff ranked 13 design seeds (e.g., keep patient list up to date, use triggered notifications) addressing these vulnerabilities. Each design seed has unique evaluation criteria for the usefulness of potential solutions developed from the seed. CONCLUSIONS: We identified and ranked 13 design seeds that characterize situations that clinicians described 'wake them up at night', and thus could reduce their anxiety, save time, and improve monitoring of high-risk patients. We anticipate that the design seed approach promotes robust and context-sensitive solutions to safety and quality problems because it provides a human-centered link between the experienced problem and various solutions that can be tested for viability. The study also demonstrates a novel integration of industrial and human factors methods (journey mapping, process tracing and design seeds) linked to implementation theory for use in designing interventions that anticipate and reduce implementation challenges.