Teaching prudent antibiotic use on the go: a descriptive report on development, utilization and listener satisfaction of an educational podcast format for medical students and young professionals.

BACKGROUND: An important component in fostering the responsible use of antibiotics is training of new and future prescribers in this interdisciplinary topic. Because podcasts are playing an increasing role in medical education, we aimed to develop and evaluate a podcast format with practice and guideline-oriented learning content on antibiotic therapy for medical students and young medical professionals. METHODS: We developed the concept for the podcast with the direct involvement of medical students and medical experts with teaching experience. We used video conferencing when recording the episodes in order to have quick, easy, and nationwide access to the experts involved. We released an episode every 2 to 4 weeks on the popular podcast platforms. The podcast was promoted through mailing lists, social and print media, and at conferences. The evaluation of episodes was based on user data provided by the platforms and an anonymous feedback questionnaire linked to each episode in the podcast notes. RESULTS: Between December 2021 and December 2022 19 episodes of InfectEd: der Antibiotika-Podcast were released. The mean duration of an episode was 91 min. By March 9, 2023, a total of 38,829 downloads and streams had been recorded. The majority of users listened to the podcast on a mobile device. The average playing time per episode was 65%. The feedback questionnaire was completed 135 times. 60.7% of respondents were female, 38.5% male. The majority of respondents were in their twenties and thirties (66.7%). 31.1% were medical students, 25.9% were residents, and 25.2% were specialists. Listeners were asked to rate episodes on a scale from 1 to 6, where 1 was "very good" and 6 was "insufficient." Ratings did not differ significantly between female and male respondents or between medical students and others. 118 respondents (87.4%) reported an increase in knowledge. Free-text feedback frequently emphasized clinical and also exam relevance. CONCLUSION: Our podcast format, developed with a user-centered approach, was broadly distributed and has been well accepted by both medical students and physicians alike. It provides a large number of learners with low-threshold access to current, guideline-orientated content and could be a useful supplement to conventional teaching formats.

Influence of Disease-Related Stigma on Patients' Decisions to Upload Medical Reports to the German Electronic Health Record: Randomized Controlled Trial.

BACKGROUND: The rollout of the electronic health record (EHR) represents a central component of the digital transformation of the German health care system. Although the EHR promises more effective, safer, and faster treatment of patients from a systems perspective, the successful implementation of the EHR largely depends on the patient. In a recent survey, 3 out of 4 Germans stated that they intend to use the EHR, whereas other studies show that the intention to use a technology is not a reliable and sufficient predictor of actual use. OBJECTIVE: Controlling for patients' intention to use the EHR, we investigated whether disease-specific risk perceptions related to the time course of the disease and disease-related stigma explain the additional variance in patients' decisions to upload medical reports to the EHR. METHODS: In an online user study, 241 German participants were asked to interact with a randomly assigned medical report that varied systematically in terms of disease-related stigma (high vs low) and disease time course (acute vs chronic) and to decide whether to upload it to the EHR. RESULTS: Disease-related stigma (odds ratio 0.154, P<.001) offset the generally positive relationship between intention to use and the upload decision (odds ratio 2.628, P<.001), whereas the disease time course showed no effect. CONCLUSIONS: Even if patients generally intend to use the EHR, risk perceptions such as those related to diseases associated with social stigma may deter people from uploading related medical reports to the EHR. To ensure the reliable use of this key technology in a digitalized health care system, transparent and easy-to-comprehend information about the safety standards of the EHR are warranted across the board, even for populations that are generally in favor of using the EHR.

Talking about Familial Breast and Ovarian Cancer Risk-Evaluation of a Psychosocial Training Module for Gynecologists in Germany.

Primary care gynecologists are increasingly integrated into the care of patients with hereditary breast and ovarian cancer (HBOC) risks. These physicians should not only have basic genetic knowledge; they should also feel able to sensitively address an increased HBOC risk and deal with emotional, stressful situations in this context. Our project aimed at developing a training module, 'iKNOWgynetics', addressing psychosocial challenges in the context of HBOC care for primary care gynecologists. We developed the psychosocial training module in three phases: first, we conducted an online survey with n = 35 women with a family history of breast or ovarian cancer to assess patients' experiences and needs. Second, based on the results of the needs assessment, we developed the training module. Third, we evaluated the training by assessing physicians' (n = 109) self-efficacy with regard to communication skills in the context of HBOC before and after the training. In the needs assessment, seven psychosocial themes emerged. These themes, complementing a review of the literature, informed the training curriculum. The training was divided into two parts: (1) communicating with women before genetic testing and (2) care co-management for women with HBOC after genetic testing. After the training, participants reported a significant increase in self-efficacy in three domains: communicating empathetically, educating patients in a comprehensible way and dealing with emotionally challenging situations. Our results highlight the relevance of psychosocial issues for patients with HBOC. A genetic literacy training module that integrates aspects of psychosocial care increases physicians' confidence in dealing with emotionally challenging situations before and after their patients' genetic testing. Thus, such trainings may improve the care of women with hereditary cancer risks.

iKNOWgynetics - A web-based learning concept to empower primary care gynecologists to participate in the care of patients with a family history of breast and ovarian cancer.

Familial cancer burden and genetics play an increasingly important role in the early detection and prevention of gynecological cancers. However, people with hereditary cancer risks are often identified late when they already have cancer. We aimed at developing and evaluating a training concept for primary care gynecologists-iKNOWgynetics-to improve their knowledge and awareness of genetic cancer syndromes and their ability to identify patients with increased familial cancer risks based on up-to-date evidence and current guidelines (in Germany, primary care includes all doctors treating patients on an outpatient basis without a clear separation of the expertise of the doctor or of their specialty). Starting off with a needs assessment among primary care gynecologists, we developed and evaluated an online training concept-using a web-based learning platform in combination with a live virtual seminar-to convey practice-relevant knowledge about familial cancer. After registration, participants get access to the web-based learning platform (www.iknowgynetics.de) to prepare for the virtual seminars and to use it as online reference to re-access the contents after the training. Evaluation included multiple-choice (MC) questions on knowledge and participants' self-efficacy to implement the acquired knowledge, which were administered in a pre-post design. Of 109 participants, 103 (94.5%) filled out pre- and post-questionnaires. Eighty-five participants were gynecologists in primary care from Berlin (81.2%) and Brandenburg (18.8%) and had an average of 24.1 years (SD = 8.5 years) of professional experience. After the training, participants answered significantly more knowledge questions correctly (M = 15.2 of 17, SD = 1.3) than before (M = 13.8 of 17, SD = 1.7) (p < 0.01) and felt more confident to be able to apply referral criteria for specialized counseling in practice (p < 0.001). The online-based training iKNOWgynetics considers the busy schedule of primary care gynecologists and supports them in acquiring practice-relevant information on familial cancer risks and on how to identify healthy persons at risk, which may ultimately help to improve the prevention of gynecological cancers. In future studies, the reported concept could be transferred to other entities.

How suitable are clinical vignettes for the evaluation of symptom checker apps? A test theoretical perspective.

Objective: To evaluate the ability of case vignettes to assess the performance of symptom checker applications and to suggest refinements to the methodology used in case vignette-based audit studies. Methods: We re-analyzed the publicly available data of two prominent case vignette-based symptom checker audit studies by calculating common metrics of test theory. Furthermore, we developed a new metric, the Capability Comparison Score (CCS), which compares symptom checker capability while controlling for the difficulty of the set of cases each symptom checker evaluated. We then scrutinized whether applying test theory and the CCS altered the performance ranking of the investigated symptom checkers. Results: In both studies, most symptom checkers changed their rank order when adjusting the triage capability for item difficulty (ID) with the CCS. The previously reported triage accuracies commonly overestimated the capability of symptom checkers because they did not account for the fact that symptom checkers tend to selectively appraise easier cases (i.e., with high ID values). Also, many case vignettes in both studies showed insufficient (very low and even negative) values of item-total correlation (ITC), suggesting that individual items or the composition of item sets are of low quality. Conclusions: A test-theoretic perspective helps identify previously undetected threats to the validity of case vignette-based symptom checker assessments and provides guidance and specific metrics to improve the quality of case vignettes, in particular by controlling for the difficulty of the vignettes an app was (not) able to evaluate correctly. Such measures might prove more meaningful than accuracy alone for the competitive assessment of symptom checkers. Our approach helps elaborate and standardize the methodology used for appraising symptom checker capability, which, ultimately, may yield more reliable results.

Extending the Privacy Calculus to the mHealth Domain: Survey Study on the Intention to Use mHealth Apps in Germany.

BACKGROUND: With the increasing digitalization of the health sector, more and more mobile health (mHealth) apps are coming to the market to continuously collect and process sensitive health data for the benefit of patients and providers. These technologies open up new opportunities to make the health care system more efficient and save costs but also pose potential threats such as loss of data or finances. OBJECTIVE: This study aims to present an empirical review and adaptation of the extended privacy calculus model to the mHealth domain and to understand what factors influence the intended usage of mHealth technologies. METHODS: A survey study was conducted to empirically validate our model, using a case vignette as cover story. Data were collected from 250 German participants and analyzed using a covariance-based structural equation model. RESULTS: The model explains R2=79.3% of the variance in intention to use. The 3 main factors (social norms, attitude to privacy, and perceived control over personal data) influenced the intention to use mHealth apps, albeit partially indirectly. The intention to use mHealth apps is driven by the perceived benefits of the technology, trust in the provider, and social norms. Privacy concerns have no bearing on the intention to use. The attitude to privacy has a large inhibiting effect on perceived benefits, as well as on trust in the provider. Perceived control over personal data clearly dispels privacy concerns and supports the relationship of trust between the user and the provider. CONCLUSIONS: Based on the privacy calculus, our domain-specific model explains the intention to use mHealth apps better than previous, more general models. The findings allow health care providers to improve their products and to increase usage by targeting specific user groups.

Characteristics of Users and Nonusers of Symptom Checkers in Germany: Cross-Sectional Survey Study.

BACKGROUND: Previous studies have revealed that users of symptom checkers (SCs, apps that support self-diagnosis and self-triage) are predominantly female, are younger than average, and have higher levels of formal education. Little data are available for Germany, and no study has so far compared usage patterns with people's awareness of SCs and the perception of usefulness. OBJECTIVE: We explored the sociodemographic and individual characteristics that are associated with the awareness, usage, and perceived usefulness of SCs in the German population. METHODS: We conducted a cross-sectional online survey among 1084 German residents in July 2022 regarding personal characteristics and people's awareness and usage of SCs. Using random sampling from a commercial panel, we collected participant responses stratified by gender, state of residence, income, and age to reflect the German population. We analyzed the collected data exploratively. RESULTS: Of all respondents, 16.3% (177/1084) were aware of SCs and 6.5% (71/1084) had used them before. Those aware of SCs were younger (mean 38.8, SD 14.6 years, vs mean 48.3, SD 15.7 years), were more often female (107/177, 60.5%, vs 453/907, 49.9%), and had higher formal education levels (eg, 72/177, 40.7%, vs 238/907, 26.2%, with a university/college degree) than those unaware. The same observation applied to users compared to nonusers. It disappeared, however, when comparing users to nonusers who were aware of SCs. Among users, 40.8% (29/71) considered these tools useful. Those considering them useful reported higher self-efficacy (mean 4.21, SD 0.66, vs mean 3.63, SD 0.81, on a scale of 1-5) and a higher net household income (mean EUR 2591.63, SD EUR 1103.96 [mean US $2798.96, SD US $1192.28], vs mean EUR 1626.60, SD EUR 649.05 [mean US $1756.73, SD US $700.97]) than those who considered them not useful. More women considered SCs unhelpful (13/44, 29.5%) compared to men (4/26, 15.4%). CONCLUSIONS: Concurring with studies from other countries, our findings show associations between sociodemographic characteristics and SC usage in a German sample: users were on average younger, of higher socioeconomic status, and more commonly female compared to nonusers. However, usage cannot be explained by sociodemographic differences alone. It rather seems that sociodemographics explain who is or is not aware of the technology, but those who are aware of SCs are equally likely to use them, independently of sociodemographic differences. Although in some groups (eg, people with anxiety disorder), more participants reported to know and use SCs, they tended to perceive them as less useful. In other groups (eg, male participants), fewer respondents were aware of SCs, but those who used them perceived them to be more useful. Thus, SCs should be designed to fit specific user needs, and strategies should be developed to help reach individuals who could benefit but are not aware of SCs yet.

[Virtual hallway chats and status updates: collaboration in avatar-based work environments]. / Virtuelle Flurgespräche und Status-Updates: Zusammenarbeit in avatar-basierten Arbeitsumgebungen.

This article focuses on the collaboration of hybrid teams in avatar-based virtual office environments. Based on the three dimensions of virtuality, we pursue the following research questions: (1) How is everyday work and collaboration coordinated in these environments? and (2) Which advantages and challenges do users perceive in relation to this form of work? Based on a multi-method study consisting of qualitative interviews with experienced users and a participatory focus group discussion with new users, we illustrate that collaboration in avatar-based work environments is marked by a diverse array of work practices-ranging from co-present to mobile work-and that promising implementation methods exist to coordinate these practices. However, our results also suggest that to exploit this potential, not only the virtual environments but also teams' work practices and digital infrastructure must be further developed.Practical relevance: The study discusses virtuality based on a currently used avatar-based work environment and illustrates the perspectives of experienced and new users on collaboration in these socio-technical work systems. Specifically, we present concrete implementations and challenges of collaborative work practices in these virtual environments, which offer orientation for practitioners interested in applying these solutions to their own work contexts.

Appropriate antibiotic use and antimicrobial resistance: knowledge, attitudes and behaviour of medical students and their needs and preferences for learning.

BACKGROUND: The impact of an appropriate use of antibiotics on the prevention of antimicrobial resistance (AMR) has been demonstrated. Surveys have shown, however, that medical students do not feel sufficiently trained to use antibiotics wisely. The aims of our study were (1) to describe what medical students currently know about appropriate antibiotic use, and (2) to identify students' learning preferences as a basis for developing student-centred teaching modules to convey the basics of AMR prevention. METHODS: We performed an online survey at Charité Universitätsmedizin Berlin and the Julius-Maximilians-University Würzburg on the knowledge, attitudes, and behaviour (KAB) of medical students concerning AMR, antibiotic treatment options, and their perceptions of AMR topics addressed in the medical curriculum. Participants were able to fill out an online questionnaire between December 2019 and February 2020. In addition, we conducted focus group discussions with lecturers and medical students in winter 2019/2020 to identify AMR-related learning needs and preferences. Data were analysed descriptively. RESULTS: Overall, 356 students (response rate 5.1%) participated in the KAB survey. Of these, 192 (54%) strongly agreed that the topic of AMR is relevant to students' clinical practice and 48% (171/355) stated that their future antibiotic prescription behaviour will have an influence on AMR development in their region. Participating students seemed to be interested in the topic of AMR and antibiotic therapy. But even of them, only 46% answered the question about the length of antibiotic use for community-acquired pneumonia correctly and 57% the question about the appropriate use of antibiotics in Staphylococcus aureus infections. Focus group discussions with students (n = 7) and lecturers (n = 9) identified a lack of competence in the responsible use of antibiotics and the prevention of AMR. Respondents stated that the teaching formats and AMR-related content should emphasize clinical applications, interaction with peers/clinicians, and repeated formative feedback from instructors. CONCLUSIONS: Our results show that even medical students who were interested in the AMR problem were not able to use antibiotics appropriately due to gaps in knowledge and a lack of clinical skills. Based on the insights gained in the learning preferences of students and their content priorities, improved student-centred teaching materials should be developed.

Paradigmatic Approach to Support Personalized Counseling With Digital Health (iKNOW).

iKNOW is the first evidence-based digital tool to support personalized counseling for women in Germany with a hereditary cancer risk. The counseling tool is designed for carriers of pathogenic gBRCA (germline breast cancer gene) variants that increase the lifetime risk of breast and ovarian cancer. Carriers of pathogenic variants are confronted with complex, individualized risk information, and physicians must be able to convey this information in a comprehensible way to enable preference-sensitive health decisions. In this paper, we elaborate on the clinical, regulatory, and practical premises of personalized counseling in Germany. By operationalizing these premises, we formulate 5 design principles that, we suggest, are specific enough to develop a digital tool (eg, iKNOW), yet wide-ranging enough to inform the development of counseling tools for personalized medicine more generally: (1) digital counseling tools should implement the current standard of care (eg, based on guidelines); (2) digital counseling tools should help to both standardize and personalize the counseling process (eg, by enabling the preference-sensitive selection of counseling contents from a common information base); (3) digital counseling tools should make complex information easy to access both cognitively (eg, by using evidenced-based risk communication formats) and technically (eg, by means of responsive design for various devices); (4) digital counseling tools should respect the counselee's data privacy rights (eg, through strict pseudonymization and opt-in consent); and (5) digital counseling tools should be systematically and iteratively evaluated with the users in mind (eg, using formative prototype testing to ensure a user-centric design and a summative multicenter, randomized controlled trial). On the basis of these paradigmatic design principles, we hope that iKNOW can serve as a blueprint for the development of more digital innovations to support personalized counseling approaches in cancer medicine.

Boosting for insight and/or boosting for agency? How to maximize accurate test interpretation with natural frequencies.

BACKGROUND: Many physicians do not know how to accurately interpret test results using Bayes' rule. As a remedy, two kinds of interventions have been shown effective: boosting insight and boosting agency with natural frequencies. To boost insight, test statistics are provided in natural frequencies (rather than conditional probabilities), without instructions on how to use them. To boost agency, a training is provided on how to translate probabilities into natural frequencies and apply them in Bayes' rule. What has not been shown is whether boosting agency is sufficient or if representing test statistics in natural frequencies may additionally boost insight to maximize accurate test interpretation. METHODS: We used a pre/posttest design to assess test interpretation accuracy of 577 medical students before and after a training on two Bayesian reasoning tasks, one providing conditional probabilities, the other natural frequencies. The pretest assessed baseline abilities versus the effect of natural frequencies to boost insight. After participants received a training on how to translate conditional probabilities into natural frequencies and how to apply them in Bayes' rule, test interpretation skills were assessed using the same tasks again, comparing the effects of training-induced agency with versus without additionally boosting insight (i.e., test statistics in natural frequencies versus conditional probabilities). RESULTS: Compared to the test question formatted in conditional probabilities (34% correct answers), natural frequencies facilitated Bayesian reasoning without training (68%), that is, they increased insight. The training on how to use natural frequencies improved performance for tasks formatted in conditional probabilities (64%). Performance was maximal after training and with test statistics formatted in natural frequencies, that is, with a combination of boosting insight and agency (89%). CONCLUSIONS: Natural frequencies should be used to boost insight and agency to maximize effective use of teaching resources. Thus, mandating that test statistics are provided in natural frequencies and adopting short trainings on how to translate conditional probabilities into natural frequencies and how to apply them in Bayes' rule will help to maximize accurate test interpretation. TRIAL REGISTRATION: The study was a registered with the German Clinical Trial Registry ( DRKS00008723 ; 06/03/2015).

The Triage Capability of Laypersons: Retrospective Exploratory Analysis.

BACKGROUND: Although medical decision-making may be thought of as a task involving health professionals, many decisions, including critical health-related decisions are made by laypersons alone. Specifically, as the first step to most care episodes, it is the patient who determines whether and where to seek health care (triage). Overcautious self-assessments (ie, overtriaging) may lead to overutilization of health care facilities and overcrowded emergency departments, whereas imprudent decisions (ie, undertriaging) constitute a risk to the patient's health. Recently, patient-facing decision support systems, commonly known as symptom checkers, have been developed to assist laypersons in these decisions. OBJECTIVE: The purpose of this study is to identify factors influencing laypersons' ability to self-triage and their risk averseness in self-triage decisions. METHODS: We analyzed publicly available data on 91 laypersons appraising 45 short fictitious patient descriptions (case vignettes; N=4095 appraisals). Using signal detection theory and descriptive and inferential statistics, we explored whether the type of medical decision laypersons face, their confidence in their decision, and sociodemographic factors influence their triage accuracy and the type of errors they make. We distinguished between 2 decisions: whether emergency care was required (decision 1) and whether self-care was sufficient (decision 2). RESULTS: The accuracy of detecting emergencies (decision 1) was higher (mean 82.2%, SD 5.9%) than that of deciding whether any type of medical care is required (decision 2, mean 75.9%, SD 5.25%; t>90=8.4; P<.001; Cohen d=0.9). Sensitivity for decision 1 was lower (mean 67.5%, SD 16.4%) than its specificity (mean 89.6%, SD 8.6%) whereas sensitivity for decision 2 was higher (mean 90.5%, SD 8.3%) than its specificity (mean 46.7%, SD 15.95%). Female participants were more risk averse and overtriaged more often than male participants, but age and level of education showed no association with participants' risk averseness. Participants' triage accuracy was higher when they were certain about their appraisal (2114/3381, 62.5%) than when being uncertain (378/714, 52.9%). However, most errors occurred when participants were certain of their decision (1267/1603, 79%). Participants were more commonly certain of their overtriage errors (mean 80.9%, SD 23.8%) than their undertriage errors (mean 72.5%, SD 30.9%; t>89=3.7; P<.001; d=0.39). CONCLUSIONS: Our study suggests that laypersons are overcautious in deciding whether they require medical care at all, but they miss identifying a considerable portion of emergencies. Our results further indicate that women are more risk averse than men in both types of decisions. Layperson participants made most triage errors when they were certain of their own appraisal. Thus, they might not follow or even seek advice (eg, from symptom checkers) in most instances where advice would be useful.

What Causes Cancer in Women with a gBRCA Pathogenic Variant? Counselees' Causal Attributions and Associations with Perceived Control.

Laypersons have a strong need to explain critical life events, such as the development of an illness. Expert explanations do not always match the beliefs of patients. We therefore assessed causal attributions made by women with a pathogenic germline variant in BRCA1/2 (gBRCA1/2-PV), both with and without a cancer diagnosis. We assumed that attributions would be associated with the control experience. We conducted a cross-sectional study of N = 101 women with a gBRCA1/2-PV (mean age 43.3 ± 10.9). Women answered self-report questionnaires on perceived causes and control. Most women (97%) named genes as a causal factor for the development of cancer. Surprisingly, the majority of women also named stress and health behavior (both 81%), environment (80%), and personality (61%). Women with a cancer diagnosis tended to endorse more causes. The attributions to personality (ρ = 0.39, p < 0.01) health behavior (ρ = 0.44, p < 0.01), and environment (ρ = 0.22, p < 0.05) were significantly associated with personal control, whereas attribution to genes showed a small, albeit significant association with treatment control (ρ = 0.20, p < 0.05). Discussing causal beliefs in clinical counseling may provide a "window of opportunity" in which risk factors and health behaviors could be better addressed and individually targeted.

Determinants of Laypersons' Trust in Medical Decision Aids: Randomized Controlled Trial.

BACKGROUND: Symptom checker apps are patient-facing decision support systems aimed at providing advice to laypersons on whether, where, and how to seek health care (disposition advice). Such advice can improve laypersons' self-assessment and ultimately improve medical outcomes. Past research has mainly focused on the accuracy of symptom checker apps' suggestions. To support decision-making, such apps need to provide not only accurate but also trustworthy advice. To date, only few studies have addressed the question of the extent to which laypersons trust symptom checker app advice or the factors that moderate their trust. Studies on general decision support systems have shown that framing automated systems (anthropomorphic or emphasizing expertise), for example, by using icons symbolizing artificial intelligence (AI), affects users' trust. OBJECTIVE: This study aims to identify the factors influencing laypersons' trust in the advice provided by symptom checker apps. Primarily, we investigated whether designs using anthropomorphic framing or framing the app as an AI increases users' trust compared with no such framing. METHODS: Through a web-based survey, we recruited 494 US residents with no professional medical training. The participants had to first appraise the urgency of a fictitious patient description (case vignette). Subsequently, a decision aid (mock symptom checker app) provided disposition advice contradicting the participants' appraisal, and they had to subsequently reappraise the vignette. Participants were randomized into 3 groups: 2 experimental groups using visual framing (anthropomorphic, 160/494, 32.4%, vs AI, 161/494, 32.6%) and a neutral group without such framing (173/494, 35%). RESULTS: Most participants (384/494, 77.7%) followed the decision aid's advice, regardless of its urgency level. Neither anthropomorphic framing (odds ratio 1.120, 95% CI 0.664-1.897) nor framing as AI (odds ratio 0.942, 95% CI 0.565-1.570) increased behavioral or subjective trust (P=.99) compared with the no-frame condition. Even participants who were extremely certain in their own decisions (ie, 100% certain) commonly changed it in favor of the symptom checker's advice (19/34, 56%). Propensity to trust and eHealth literacy were associated with increased subjective trust in the symptom checker (propensity to trust b=0.25; eHealth literacy b=0.2), whereas sociodemographic variables showed no such link with either subjective or behavioral trust. CONCLUSIONS: Contrary to our expectation, neither the anthropomorphic framing nor the emphasis on AI increased trust in symptom checker advice compared with that of a neutral control condition. However, independent of the interface, most participants trusted the mock app's advice, even when they were very certain of their own assessment. Thus, the question arises as to whether laypersons use such symptom checkers as substitutes rather than as aids in their own decision-making. With trust in symptom checkers already high at baseline, the benefit of symptom checkers depends on interface designs that enable users to adequately calibrate their trust levels during usage. TRIAL REGISTRATION: Deutsches Register Klinischer Studien DRKS00028561; https://tinyurl.com/rv4utcfb (retrospectively registered).

Triage Accuracy of Symptom Checker Apps: 5-Year Follow-up Evaluation.

BACKGROUND: Symptom checkers are digital tools assisting laypersons in self-assessing the urgency and potential causes of their medical complaints. They are widely used but face concerns from both patients and health care professionals, especially regarding their accuracy. A 2015 landmark study substantiated these concerns using case vignettes to demonstrate that symptom checkers commonly err in their triage assessment. OBJECTIVE: This study aims to revisit the landmark index study to investigate whether and how symptom checkers' capabilities have evolved since 2015 and how they currently compare with laypersons' stand-alone triage appraisal. METHODS: In early 2020, we searched for smartphone and web-based applications providing triage advice. We evaluated these apps on the same 45 case vignettes as the index study. Using descriptive statistics, we compared our findings with those of the index study and with publicly available data on laypersons' triage capability. RESULTS: We retrieved 22 symptom checkers providing triage advice. The median triage accuracy in 2020 (55.8%, IQR 15.1%) was close to that in 2015 (59.1%, IQR 15.5%). The apps in 2020 were less risk averse (odds 1.11:1, the ratio of overtriage errors to undertriage errors) than those in 2015 (odds 2.82:1), missing >40% of emergencies. Few apps outperformed laypersons in either deciding whether emergency care was required or whether self-care was sufficient. No apps outperformed the laypersons on both decisions. CONCLUSIONS: Triage performance of symptom checkers has, on average, not improved over the course of 5 years. It decreased in 2 use cases (advice on when emergency care is required and when no health care is needed for the moment). However, triage capability varies widely within the sample of symptom checkers. Whether it is beneficial to seek advice from symptom checkers depends on the app chosen and on the specific question to be answered. Future research should develop resources (eg, case vignette repositories) to audit the capabilities of symptom checkers continuously and independently and provide guidance on when and to whom they should be recommended.

Workarounds in the Shadow System: An Ethnographic Study of Requirements for Documentation and Cooperation in a Clinical Advisory Center.

OBJECTIVE: Hospital information systems (HIS) are meant to manage complex work processes across healthcare organizations. We describe limitations of HIS to address local information requirements and how they are circumvented at different organizational levels. Results can be used to better support collaboration in socio-technical systems. BACKGROUND: Workarounds describe a mismatch between a technology's purpose and its actual use, whereas shadow systems are unofficial IT systems circumventing limitations of official systems to support workflows. Boundary infrastructures are conceptualized as the entirety of all (in)formal digital and analog systems connecting different communities of practice in a socio-technical system. METHODS: An ethnographic study with observations and semi-structured interviews was conducted and analyzed through categorization and iterative coding. RESULTS: Several digital-analog workarounds are employed for documentation and a shared server functions as a shadow system to support workflows in ways the HIS cannot. For collaborative documentation, all (official and informal) information sources were used simultaneously as part of an interconnected boundary infrastructure. CONCLUSION: Formal and informal IT systems are interconnected across different organizational levels and provide insights into unmet information requirements, effective and problematic work practices, and how to address them to improve system functioning. An integrated perspective on boundary infrastructures, workarounds, and shadow systems may advance system analysis, providing a more comprehensive picture of IT requirements than any concept alone. APPLICATION: Workarounds and shadow systems highlight that HIS should support systemic and local needs. Customized interfaces in HIS to support search, access, and exchange of relevant data might help to mitigate current shortcomings.

"You Never Get a Second Chance": First Impressions of Physicians Depend on Their Body Posture and Gender.

A first impression matters, in particular when encounters are brief as in most doctor-patient interactions. In this study, we investigate how physicians' body postures impact patients' first impressions of them and extend previous research by exploring posture effects on the perception of all roles of a physician - not just single aspects such as scholarly expertise or empathy. In an online survey, 167 participants ranked photographs of 4 physicians (2 female, 2 male) in 4 postures (2 open, 2 closed). The results show that male physicians were rated more positively when assuming open rather than closed postures with respect to all professional physician roles. Female physicians in open postures were rated similarly positive for items related to medical competence, but they tended to be rated less favorably with respect to social skills (such as the ability to communicate with and relate to the patient). These findings extend what is known about the effects of physicians' body postures on the first impressions patients form to judge physicians' medical versus social competencies. We discuss practical implications and the need for more research on interaction effects of body postures and physician gender on first impressions.

A Remote Patient-Monitoring System for Intensive Care Medicine: Mixed Methods Human-Centered Design and Usability Evaluation.

BACKGROUND: Continuous monitoring of vital signs is critical for ensuring patient safety in intensive care units (ICUs) and is becoming increasingly relevant in general wards. The effectiveness of health information technologies such as patient-monitoring systems is highly determined by usability, the lack of which can ultimately compromise patient safety. Usability problems can be identified and prevented by involving users (ie, clinicians). OBJECTIVE: In this study, we aim to apply a human-centered design approach to evaluate the usability of a remote patient-monitoring system user interface (UI) in the ICU context and conceptualize and evaluate design changes. METHODS: Following institutional review board approval (EA1/031/18), a formative evaluation of the monitoring UI was performed. Simulated use tests with think-aloud protocols were conducted with ICU staff (n=5), and the resulting qualitative data were analyzed using a deductive analytic approach. On the basis of the identified usability problems, we conceptualized informed design changes and applied them to develop an improved prototype of the monitoring UI. Comparing the UIs, we evaluated perceived usability using the System Usability Scale, performance efficiency with the normative path deviation, and effectiveness by measuring the task completion rate (n=5). Measures were tested for statistical significance using a 2-sample t test, Poisson regression with a generalized linear mixed-effects model, and the N-1 chi-square test. P<.05 were considered significant. RESULTS: We found 37 individual usability problems specific to monitoring UI, which could be assigned to six subcodes: usefulness of the system, response time, responsiveness, meaning of labels, function of UI elements, and navigation. Among user ideas and requirements for the UI were high usability, customizability, and the provision of audible alarm notifications. Changes in graphics and design were proposed to allow for better navigation, information retrieval, and spatial orientation. The UI was revised by creating a prototype with a more responsive design and changes regarding labeling and UI elements. Statistical analysis showed that perceived usability improved significantly (System Usability Scale design A: mean 68.5, SD 11.26, n=5; design B: mean 89, SD 4.87, n=5; P=.003), as did performance efficiency (normative path deviation design A: mean 8.8, SD 5.26, n=5; design B: mean 3.2, SD 3.03, n=5; P=.001), and effectiveness (design A: 18 trials, failed 7, 39% times, passed 11, 61% times; design B: 20 trials, failed 0 times, passed 20 times; P=.002). CONCLUSIONS: Usability testing with think-aloud protocols led to a patient-monitoring UI with significantly improved usability, performance, and effectiveness. In the ICU work environment, difficult-to-use technology may result in detrimental outcomes for staff and patients. Technical devices should be designed to support efficient and effective work processes. Our results suggest that this can be achieved by applying basic human-centered design methods and principles. TRIAL REGISTRATION: ClinicalTrials.gov NCT03514173; https://clinicaltrials.gov/ct2/show/NCT03514173.

Interactive Versus Static Decision Support Tools for COVID-19: Randomized Controlled Trial.

BACKGROUND: During the COVID-19 pandemic, medical laypersons with symptoms indicative of a COVID-19 infection commonly sought guidance on whether and where to find medical care. Numerous web-based decision support tools (DSTs) have been developed, both by public and commercial stakeholders, to assist their decision making. Though most of the DSTs' underlying algorithms are similar and simple decision trees, their mode of presentation differs: some DSTs present a static flowchart, while others are designed as a conversational agent, guiding the user through the decision tree's nodes step-by-step in an interactive manner. OBJECTIVE: This study aims to investigate whether interactive DSTs provide greater decision support than noninteractive (ie, static) flowcharts. METHODS: We developed mock interfaces for 2 DSTs (1 static, 1 interactive), mimicking patient-facing, freely available DSTs for COVID-19-related self-assessment. Their underlying algorithm was identical and based on the Centers for Disease Control and Prevention's guidelines. We recruited adult US residents online in November 2020. Participants appraised the appropriate social and care-seeking behavior for 7 fictitious descriptions of patients (case vignettes). Participants in the experimental groups received either the static or the interactive mock DST as support, while the control group appraised the case vignettes unsupported. We determined participants' accuracy, decision certainty (after deciding), and mental effort to measure the quality of decision support. Participants' ratings of the DSTs' usefulness, ease of use, trust, and future intention to use the tools served as measures to analyze differences in participants' perception of the tools. We used ANOVAs and t tests to assess statistical significance. RESULTS: Our survey yielded 196 responses. The mean number of correct assessments was higher in the intervention groups (interactive DST group: mean 11.71, SD 2.37; static DST group: mean 11.45, SD 2.48) than in the control group (mean 10.17, SD 2.00). Decisional certainty was significantly higher in the experimental groups (interactive DST group: mean 80.7%, SD 14.1%; static DST group: mean 80.5%, SD 15.8%) compared to the control group (mean 65.8%, SD 20.8%). The differences in these measures proved statistically significant in t tests comparing each intervention group with the control group (P<.001 for all 4 t tests). ANOVA detected no significant differences regarding mental effort between the 3 study groups. Differences between the 2 intervention groups were of small effect sizes and nonsignificant for all 3 measures of the quality of decision support and most measures of participants' perception of the DSTs. CONCLUSIONS: When the decision space is limited, as is the case in common COVID-19 self-assessment DSTs, static flowcharts might prove as beneficial in enhancing decision quality as interactive tools. Given that static flowcharts reveal the underlying decision algorithm more transparently and require less effort to develop, they might prove more efficient in providing guidance to the public. Further research should validate our findings on different use cases, elaborate on the trade-off between transparency and convenience in DSTs, and investigate whether subgroups of users benefit more with 1 type of user interface than the other. TRIAL REGISTRATION: Deutsches Register Klinischer Studien DRKS00028136; https://tinyurl.com/4bcfausx (retrospectively registered).