Developing a Framework and Electronic Tool for Communicating Diagnostic Uncertainty in Primary Care: A Qualitative Study.

Importance: Communication of information has emerged as a critical component of diagnostic quality. Communication of diagnostic uncertainty represents a key but inadequately examined element of diagnosis. Objective: To identify key elements facilitating understanding and managing diagnostic uncertainty, examine optimal ways to convey uncertainty to patients, and develop and test a novel tool to communicate diagnostic uncertainty in actual clinical encounters. Design, Setting, and Participants: A 5-stage qualitative study was performed between July 2018 and April 2020, at an academic primary care clinic in Boston, Massachusetts, with a convenience sample of 24 primary care physicians (PCPs), 40 patients, and 5 informatics and quality/safety experts. First, a literature review and panel discussion with PCPs were conducted and 4 clinical vignettes of typical diagnostic uncertainty scenarios were developed. Second, these scenarios were tested during think-aloud simulated encounters with expert PCPs to iteratively draft a patient leaflet and a clinician guide. Third, the leaflet content was evaluated with 3 patient focus groups. Fourth, additional feedback was obtained from PCPs and informatics experts to iteratively redesign the leaflet content and workflow. Fifth, the refined leaflet was integrated into an electronic health record voice-enabled dictation template that was tested by 2 PCPs during 15 patient encounters for new diagnostic problems. Data were thematically analyzed using qualitative analysis software. Main Outcomes and Measures: Perceptions and testing of content, feasibility, usability, and satisfaction with a prototype tool for communicating diagnostic uncertainty to patients. Results: Overall, 69 participants were interviewed. A clinician guide and a diagnostic uncertainty communication tool were developed based on the PCP interviews and patient feedback. The optimal tool requirements included 6 key domains: most likely diagnosis, follow-up plan, test limitations, expected improvement, contact information, and space for patient input. Patient feedback on the leaflet was iteratively incorporated into 4 successive versions, culminating in a successfully piloted prototype tool as an end-of-visit voice recognition dictation template with high levels of patient satisfaction for 15 patients with whom the tool was tested. Conclusions and Relevance: In this qualitative study, a diagnostic uncertainty communication tool was successfully designed and implemented during clinical encounters. The tool demonstrated good workflow integration and patient satisfaction.

Terminations in Primary Care: a Retrospective Observational Study of 16 Primary Care Clinics.

BACKGROUND: The relationship between clinician and patient is the cornerstone of primary care. Breakdown and termination of this relationship are understudied yet important, undesirable outcomes. OBJECTIVE: To better understand the nature and extent of provider and clinic termination of the primary care relationship. DESIGN: Retrospective observational case-control study. SUBJECTS: Adult patients in Eastern Massachusetts who received primary care at hospital- and community-based clinics and health centers participating in a practice-based research network between January 2013 and June 2017. MAIN MEASURES: Formal termination by primary care physician (PCP), reasons for termination, independent predictors of termination based on mixed-effects logistic regression, and documentation of a new PCP after termination. KEY RESULTS: We identified 158,192 patients who received primary care from 182 PCPs across 16 clinics. We found 536 cases of formal termination. Clinics ranged from 4 to 119 terminations per 10,000 patients (intraclass correlation coefficient [ICC]=0.21; 95% CI: 0.18-0.24). Patient age, race/ethnicity, educational attainment, relationship status, employment status, and insurance type were independent predictors of termination (e.g., compared to patients employed full-time, patients unemployed due to disability were more likely to be terminated [adjusted OR:9.26; 95% CI: 6.74-12.74]). The most common cause for termination (38%) was appointment "no-shows" with some PCPs/clinics found to enforce a policy of dismissal following three no-shows. At the time of chart review, 201 patients (38%) had no documentation of a new PCP. Among patients who re-established care within the network, 134 (25%) had a primary care visit within 6 months of termination. CONCLUSIONS: Detailed chart review found that, unlike previous survey-based studies, dismissal was often for missed appointments based on enforcement of no-show policies. Many sociodemographic factors were associated with termination. Variability among clinics highlights the need for further research to better understand circumstances surrounding terminations, with the principal goals of improving patient-provider relationships and providing equitable care.

Design and testing of a mobile health application rating tool.

Mobile health applications ("apps") have rapidly proliferated, yet their ability to improve outcomes for patients remains unclear. A validated tool that addresses apps' potentially important dimensions has not been available to patients and clinicians. The objective of this study was to develop and preliminarily assess a usable, valid, and open-source rating tool to objectively measure the risks and benefits of health apps. We accomplished this by using a Delphi process, where we constructed an app rating tool called THESIS that could promote informed app selection. We used a systematic process to select chronic disease apps with ≥4 stars and <4-stars and then rated them with THESIS to examine the tool's interrater reliability and internal consistency. We rated 211 apps, finding they performed fair overall (3.02 out of 5 [95% CI, 2.96-3.09]), but especially poorly for privacy/security (2.21 out of 5 [95% CI, 2.11-2.32]), interoperability (1.75 [95% CI, 1.59-1.91]), and availability in multiple languages (1.43 out of 5 [95% CI, 1.30-1.56]). Ratings using THESIS had fair interrater reliability (κ = 0.3-0.6) and excellent scale reliability (ɑ = 0.85). Correlation with traditional star ratings was low (r = 0.24), suggesting THESIS captures issues beyond general user acceptance. Preliminary testing of THESIS suggests apps that serve patients with chronic disease could perform much better, particularly in privacy/security and interoperability. THESIS warrants further testing and may guide software and policymakers to further improve app performance, so apps can more consistently improve patient outcomes.

Effectiveness of a school-based intervention in Guatemala to increase knowledge of sexual and reproductive health.

OBJECTIVES: Adolescent pregnancy in Guatemala is a multifactorial issue contributing to maternal and child mortality as well as negative social and economic outcomes. While multiple organizations have identified this as an important area for improvement, little has been published on methods for reducing rates of adolescent pregnancy in resource-limited settings. We characterized the effects of a brief intervention on the knowledge and attitudes towards sexual health of high schoolers in a rural Guatemalan community. METHODS: We created a condensed, 2-h sexual education course, which was taught to over 500 high school students in San Juan Sacatepequez, Guatemala. Students completed pre- and post-intervention surveys assessing their knowledge about pregnancy prevention and attitudes toward contraception use. Chi-square tests were used to assess the difference between the pre- and post-intervention responses as well as the responses between male and female participants. RESULTS: Analysis of the survey results revealed significant improvements in all questions assessing knowledge regarding pregnancy prevention (p<0.01). Our pre-intervention survey revealed that male participants possessed greater knowledge regarding pregnancy prevention (p<0.01). Following the intervention, several areas of initial difference between male and female students' knowledge disappeared, including knowledge of what a contraceptive is, awareness that one sexual relation is sufficient for pregnancy, and recognition that condoms can prevent sexually transmitted infections. CONCLUSIONS: This study demonstrates that brief, school-based sexual health courses are low-resource, feasible interventions to significantly increase knowledge about contraception and sexual health in resource-limited settings and improve the disparities in knowledge between male and female participants.