Leveraging an Informatics Approach to Identify an Unmet Clinical Need for BRCA1/2 Testing Among Patients With Ovarian Cancer.

PURPOSE: Although BRCA1/2 testing in ovarian cancer improves outcomes, it is vastly underutilized. Scalable approaches are urgently needed to improve genomically guided care. METHODS: We developed a Natural Language Processing (NLP) pipeline to extract electronic medical record information to identify recipients of BRCA testing. We applied the NLP pipeline to assess testing status in 308 patients with ovarian cancer receiving care at a National Cancer Institute Comprehensive Cancer Center (main campus [MC] and five affiliated clinical network sites [CNS]) from 2017 to 2019. We compared characteristics between (1) patients who had/had not received testing and (2) testing utilization by site. RESULTS: We found high uptake of BRCA testing (approximately 78%) from 2017 to 2019 with no significant differences between the MC and CNS. We observed an increase in testing over time (67%-85%), higher uptake of testing among younger patients (mean age tested = 61 years v untested = 65 years, P = .01), and higher testing among Hispanic (84%) compared with White, Non-Hispanic (78%), and Asian (75%) patients (P = .006). Documentation of referral for an internal genetics consultation for BRCA pathogenic variant carriers was higher at the MC compared with the CNS (94% v 31%). CONCLUSION: We were able to successfully use a novel NLP pipeline to assess use of BRCA testing among patients with ovarian cancer. Despite relatively high levels of BRCA testing at our institution, 22% of patients had no documentation of genetic testing and documentation of referral to genetics among BRCA carriers in the CNS was low. Given success of the NLP pipeline, such an informatics-based approach holds promise as a scalable solution to identify gaps in genetic testing to ensure optimal treatment interventions in a timely manner.

Usability of a Consumer Health Informatics Tool Following Completion of a Clinical Trial: Focus Group Study.

BACKGROUND: Mobile health (mHealth) apps have the potential to be effective tools for encouraging patients with chronic diseases to self-manage their health. The success of mHealth apps is related to technology acceptance and its subsequent use by intended consumers. Therefore, it is essential to gain insights from consumers' perspectives about their use of mHealth apps in daily life. OBJECTIVE: The purpose of this work was to understand consumers' perspectives on use of a self-management app following completion of a clinical trial that tested the efficacy of the app for improving health outcomes. METHODS: We conducted five focus groups with paricipants of a clinical trial (NCT03182738) who were randomized to use the video information provider (VIP) for HIV-associated nonAIDS (HANA) conditions app (VIP-HANA) or an attention control app. Thematic analysis was conducted, and the themes were organized according to the two key constructs of the technology acceptance model framework: perceived usefulness and perceived ease of use. RESULTS: Thirty-nine people living with HIV (20 from the intervention group and 19 from the control group) participated in the focus group sessions. Of the eight themes identified from focus group data, the five themes related to perceived usefulness were: (1) self-monitoring HIV-related symptoms of HANA conditions, (2) enhanced relationship with clinical providers, (3) improvement in physical and emotional health, (4) long-term impact of self-care strategies on improvement in symptoms of HANA conditions, and (5) inspired lifestyle changes to manage symptoms. The three themes related to perceived ease of use were: (1) easy to navigate, (2) avatar personalization, and (3) privacy/confidentiality maintained even when changing the location of app use. CONCLUSIONS: Perceived ease of use was similar in both study groups but perceived usefulness differed between study groups. Participants in both study groups found the VIP-HANA app to be useful in monitoring their symptoms and enhancing communication with their clinical care providers. However, only intervention group participants perceived the app to be useful in improving overall health and long-term symptom management. Findings from this study highlight factors that are essential to ensure the usefulness of self-management apps and facilitate sustained use of mHealth apps for people living with chronic illnesses.

Effect of Speech Recognition on Problem Solving and Recall in Consumer Digital Health Tasks: Controlled Laboratory Experiment.

BACKGROUND: Recent advances in natural language processing and artificial intelligence have led to widespread adoption of speech recognition technologies. In consumer health applications, speech recognition is usually applied to support interactions with conversational agents for data collection, decision support, and patient monitoring. However, little is known about the use of speech recognition in consumer health applications and few studies have evaluated the efficacy of conversational agents in the hands of consumers. In other consumer-facing tools, cognitive load has been observed to be an important factor affecting the use of speech recognition technologies in tasks involving problem solving and recall. Users find it more difficult to think and speak at the same time when compared to typing, pointing, and clicking. However, the effects of speech recognition on cognitive load when performing health tasks has not yet been explored. OBJECTIVE: The aim of this study was to evaluate the use of speech recognition for documentation in consumer digital health tasks involving problem solving and recall. METHODS: Fifty university staff and students were recruited to undertake four documentation tasks with a simulated conversational agent in a computer laboratory. The tasks varied in complexity determined by the amount of problem solving and recall required (simple and complex) and the input modality (speech recognition vs keyboard and mouse). Cognitive load, task completion time, error rate, and usability were measured. RESULTS: Compared to using a keyboard and mouse, speech recognition significantly increased the cognitive load for complex tasks (Z=-4.08, P<.001) and simple tasks (Z=-2.24, P=.03). Complex tasks took significantly longer to complete (Z=-2.52, P=.01) and speech recognition was found to be overall less usable than a keyboard and mouse (Z=-3.30, P=.001). However, there was no effect on errors. CONCLUSIONS: Use of a keyboard and mouse was preferable to speech recognition for complex tasks involving problem solving and recall. Further studies using a broader variety of consumer digital health tasks of varying complexity are needed to investigate the contexts in which use of speech recognition is most appropriate. The effects of cognitive load on task performance and its significance also need to be investigated.

Access to assistive technology (AT) information in Spanish on state and territory program websites: United States, 2018.

BACKGROUND: Compared to non-Hispanic white individuals, assistive technology (AT) utilization is lower among Hispanic individuals.1-7 In the US, Spanish is the 2nd most frequently spoken language. Greater than one-fifth of Spanish-speaking households are limited English proficiencty (LEP) households (i.e., all individuals over age 14 in the household speak English less than "very well").8 Availability of AT materials in Spanish is one factor influencing knowledge about and utilization of AT among Spanish-speakers. OBJECTIVE: To examine the availability of Spanish-language AT information on state AT program websites and to assess the relationship between availability and state demographic and linguistic characteristics. METHODS: In 2018, we evaluated 56 state and territory AT program websites for the availability of AT information in Spanish. We calculated 4 measures (US Hispanic population in the state/territory; Hispanic individuals as a proportion of state population; overall Spanish-speaking households, and Spanish-speaking, limited English proficient households) from the 2016 American Community Survey and created ranked lists for each measure. Point biserial (rpb) correlations were calculated to test associations between each measure and availability of AT information in Spanish on each program's website. RESULTS: Sixteen program websites (15 states, 1 territory) provided access to Spanish-language AT information. None of the 4 measures were strongly associated with this outcome (rpb ranged from 0.30 to 0.42). For any of the 4 measures, no more than half of states in the top 10 ranks offered online access to AT information in Spanish. CONCLUSIONS: Improving the online availability of AT information in Spanish is necessary to increase equity in AT utilization among Spanish-speaking people with disabilities.

Visualizations Integrated Into Consumer Health Technologies Support Self-management of Chronic Diseases: A Systematic Review.

While chronic diseases remain a global problem, visualizations of data and information are a potential solution to assist patients with chronic disease in communication, self-management, and decision making. The purpose of this systematic review is to synthesize evidence regarding data and information visualizations integrated into consumer health informatics solutions for chronic disease management in the community. A search was conducted in CINAHL, EMBASE, Engineering Village, PsycINFO, PubMed, and Web of Science between January 1, 2007, and May 1, 2019. Studies were evaluated using the Mixed Methods Appraisal Tool. Of the 2549 published studies, six studies met inclusion criteria. Of these six studies, two used information visualizations, two used data visualizations, and two used both information and data visualizations. Graphs were the main type of visualization used. Visualizations were mainly delivered in mobile applications and were interactive. The goals of the visualizations varied across studies including to (1) improve understanding of health data, (2) improve patient-provider communication, (3) monitor chronic disease, and/or (4) improve chronic disease management. Five studies reported subjective outcomes of the visualizations (eg, perceived usability, acceptability). One study reported both subjective and objective outcomes (eg, recall) of the visualizations. Findings highlight the need for more research on data and information visualizations integrated into consumer health technologies that support chronic disease management in daily life.

Designing a Patient Portal for Patient-Centered Care: Cross-Sectional Survey.

BACKGROUND: In recent literature, patient portals are considered as important tools for the delivery of patient-centered care. To date, it is not clear how patients would conceptualize a patient portal and which health information needs they have when doing so. OBJECTIVE: This study aimed (1) to investigate health information needs, expectations, and attitudes toward a patient portal and (2) to assess whether determinants, such as patient characteristics, health literacy, and empowerment status, can predict two different variables, namely the importance people attribute to obtaining health information when using a patient portal and the expectations concerning personal health care when using a patient portal. METHODS: We conducted a cross-sectional survey of the Flemish population on what patients prefer to know about their digital health data and their expectations and attitudes toward using a patient portal to access their electronic health record. People were invited to participate in the survey through newsletters, social media, and magazines. We used a questionnaire including demographics, health characteristics, health literacy, patient empowerment, and patient portal characteristics. RESULTS: We received 433 completed surveys. The health information needs included features such as being notified when one's health changes (371/396, 93.7%), being notified when physical parameters increase to dangerous levels (370/395, 93.7%), observing connections between one's symptoms or diseases or biological parameters (339/398, 85.2%), viewing the evolution of one's health in function of time (333/394, 84.5%), and viewing information about the expected effect of treatment (349/395, 88.4%). Almost 90% (369/412) of respondents were interested in using a patient portal. Determinants of patients' attachment for obtaining health information on a patient portal were (1) age between 45 and 54 years (P=.05); (2) neutral (P=.03) or interested attitude (P=.008) toward shared decision making; and (3) commitment to question physicians' decisions (P=.03, R2=0.122). Determinants of patients' expectations on improved health care by accessing a patient portal were (1) lower education level (P=.04); (2) neutral (P=.03) or interested attitude (P=.008) toward shared decision making; and (3) problems in understanding health information (P=.04; R2=0.106). CONCLUSIONS: The interest in using a patient portal is considerable in Flanders. People would like to receive alerts or some form of communication from a patient portal in case they need to act to manage their health. Determinants such as education, attached importance to shared decision making, difficulties in finding relevant health information, and the attached importance in questioning the decisions of physicians need to be considered in the design of a patient portal.

Choosing Channels, Sources, and Content for Communicating Prostate Cancer Information to Black Men: A Systematic Review of the Literature.

The purpose of this study was to identify effective channels, sources, and content approaches for communicating prostate cancer prevention information to Black men. The Web of Science, PubMed and GoogleScholar databases, as well as reviews of reference lists for selected publications, were searched to select articles relevant to cancer communication channels, sources or content for Black men, focused on male-prevalent cancers and published in English. Articles were excluded if they examined only patient-provider communication, dealt exclusively with prostate cancer patients or did not separate findings by race. The selection procedures identified 41 relevant articles, which were systematically and independently reviewed by two team members to extract data on preferred channels, sources, and content for prostate cancer information. This review revealed that Black men prefer interpersonal communication for prostate cancer information; however, video can be effective. Trusted sources included personal physicians, clergy, and other community leaders, family (especially spouses) and prostate cancer survivors. Men want comprehensive information about screening, symptoms, treatment, and outcomes. Messages should be culturally tailored, encouraging empowerment and "ownership" of disease. Black men are open to prostate cancer prevention information through mediated channels when contextualized within spiritual/cultural beliefs and delivered by trusted sources.

[Information and communication technologies in the integrated care of people with dementia]. / Információs és kommunikációs technológiák alkalmazása dementiában szenvedok komplex ellátásában.

Modern information and communication tools have increasingly become an indispensable part of our everyday life. Research data demonstrate that it can be used effectively to preserve and restore health, not just among young people but also among the elderly, as for nowadays the use of the internet is widespread among the elderly, but healthcare applications are less well-known. This supports the significance of our project since it is important to develop and introduce disease-specific healthcare applications. Our preliminary results also indicated that men are less open to these new technologies, so in their case, specific methods are needed to facilitate the use of electronic devices. The high level of internet activity and the interest in information and communication technologies provide a reliable basis for applying these new technologies to the elderly. Thus, based on our research, we can develop a complex model of care based on the bio-psycho-social principles, which can be a significant advance in the prevention and early detection of age-related mental disorders and in alleviating the physical and psychological burdens of people with dementia and their families. Orv Hetil. 2018; 159(24): 965-973.

Assessing Competencies Needed to Engage With Digital Health Services: Development of the eHealth Literacy Assessment Toolkit.

BACKGROUND: To achieve full potential in user-oriented eHealth projects, we need to ensure a match between the eHealth technology and the user's eHealth literacy, described as knowledge and skills. However, there is a lack of multifaceted eHealth literacy assessment tools suitable for screening purposes. OBJECTIVE: The objective of our study was to develop and validate an eHealth literacy assessment toolkit (eHLA) that assesses individuals' health literacy and digital literacy using a mix of existing and newly developed scales. METHODS: From 2011 to 2015, scales were continuously tested and developed in an iterative process, which led to 7 tools being included in the validation study. The eHLA validation version consisted of 4 health-related tools (tool 1: "functional health literacy," tool 2: "health literacy self-assessment," tool 3: "familiarity with health and health care," and tool 4: "knowledge of health and disease") and 3 digitally-related tools (tool 5: "technology familiarity," tool 6: "technology confidence," and tool 7: "incentives for engaging with technology") that were tested in 475 respondents from a general population sample and an outpatient clinic. Statistical analyses examined floor and ceiling effects, interitem correlations, item-total correlations, and Cronbach coefficient alpha (CCA). Rasch models (RM) examined the fit of data. Tools were reduced in items to secure robust tools fit for screening purposes. Reductions were made based on psychometrics, face validity, and content validity. RESULTS: Tool 1 was not reduced in items; it consequently consists of 10 items. The overall fit to the RM was acceptable (Anderson conditional likelihood ratio, CLR=10.8; df=9; P=.29), and CCA was .67. Tool 2 was reduced from 20 to 9 items. The overall fit to a log-linear RM was acceptable (Anderson CLR=78.4, df=45, P=.002), and CCA was .85. Tool 3 was reduced from 23 to 5 items. The final version showed excellent fit to a log-linear RM (Anderson CLR=47.7, df=40, P=.19), and CCA was .90. Tool 4 was reduced from 12 to 6 items. The fit to a log-linear RM was acceptable (Anderson CLR=42.1, df=18, P=.001), and CCA was .59. Tool 5 was reduced from 20 to 6 items. The fit to the RM was acceptable (Anderson CLR=30.3, df=17, P=.02), and CCA was .94. Tool 6 was reduced from 5 to 4 items. The fit to a log-linear RM taking local dependency (LD) into account was acceptable (Anderson CLR=26.1, df=21, P=.20), and CCA was .91. Tool 7 was reduced from 6 to 4 items. The fit to a log-linear RM taking LD and differential item functioning into account was acceptable (Anderson CLR=23.0, df=29, P=.78), and CCA was .90. CONCLUSIONS: The eHLA consists of 7 short, robust scales that assess individual's knowledge and skills related to digital literacy and health literacy.

Dermatology on Instagram: An Analysis of Hashtags.

Forty-two percent of Americans search for health-related information on social media platforms, and forty-five percent of consumers report that social media health information influences their decision to seek care.

The internet as a source of support for youth with chronic conditions: A qualitative study.

BACKGROUND: Adolescents living with chronic conditions often portray themselves as "healthy" online, yet use the Internet as one of their top sources of health information and social communication. There is a need to develop online support programs specific to adolescents with chronic conditions in order to provide a private space to discuss concerns. This paper endeavors to increase our understanding of the online support needs and wants of these adolescents and their interest in and preferences for an online support program. METHODS: A qualitative descriptive study using semistructured interviews was completed. Stratified purposive sampling was utilized to ensure a representative sample based on age and diagnosis. English speaking adolescents (aged 12-18 years) diagnosed with a chronic condition were recruited from clinic and inpatient areas across 3 paediatric hospitals in Canada. RESULTS: Thirty-three participants aged 15.3 ± 1.8 years (64% female) completed the study. The main topics identified were (a) the purpose of current online activity, (b) the benefits and challenges of existing online supports, and (c) a description of ideal online resources. The purpose of online activity was social networking, information, online gaming, and social support. When accessing health information online, participants prioritized websites that were easy to access and understand despite the trustworthiness of the site. The reported benefits and challenges varied across participants with many areas perceived as both a benefit and a challenge. The majority of participants were interested in participating in an online support program that included both accurate disease-related information and a community of other adolescents to provide social support. CONCLUSIONS: Adolescents with chronic conditions are interested in online support that encompasses health information and social support that is flexible and easy to navigate. Findings can be used to develop or adapt existing online support programs for adolescents with chronic conditions to help increase engagement and utilization.

Quantitative Information on Oncology Prescription Drug Websites.

Our objective was to determine whether and how quantitative information about drug benefits and risks is presented to consumers and healthcare professionals on cancer-related prescription drug websites. We analyzed the content of 65 active cancer-related prescription drug websites. We assessed the inclusion and presentation of quantitative information for two audiences (consumers and healthcare professionals) and two types of information (drug benefits and risks). Websites were equally likely to present quantitative information for benefits (96.9 %) and risks (95.4 %). However, the amount of the information differed significantly: Both consumer-directed and healthcare-professional-directed webpages were more likely to have quantitative information for every benefit (consumer 38.5 %; healthcare professional 86.1 %) compared with every risk (consumer 3.1 %; healthcare professional 6.2 %). The numeric and graphic presentations also differed by audience and information type. Consumers have access to quantitative information about oncology drugs and, in particular, about the benefits of these drugs. Research has shown that using quantitative information to communicate treatment benefits and risks can increase patients' and physicians' understanding and can aid in treatment decision-making, although some numeric and graphic formats are more useful than others.

Resource and Response Type Classification for Consumer Health Question Answering.

Health question answering systems often depend on the initial step of question type classification. Practitioners face several modeling choices for this component alone. We evaluate the effectiveness of different modeling choices in both the embeddings and architectural hyper-parameters of the classifier. In the process, we achieve improved performance over previous methods, achieving a new best 5-fold accuracy of 85.3% on the GARD dataset. The contribution of this work is to evaluate the performance of sentence classification methods on the task of consumer health question type classification and to contribute a dataset of 2,882 medical questions annotated for question type.

Consumer Health-Related Activities on Social Media: Exploratory Study.

BACKGROUND: Although a number of studies have investigated how consumers use social media for health-related purposes, there is a paucity of studies in the Australian context. OBJECTIVE: This study aimed to explore how Australian consumers used social media for health-related purposes, specifically how they identified social media platforms, which were used, and which health-related activities commonly took place. METHODS: A total of 5 focus groups (n=36 participants), each lasting 60 to 90 minutes, were conducted in the Sydney metropolitan area. The group discussions were audiorecorded and transcribed verbatim. The transcripts were coded line-by-line and thematically analyzed. RESULTS: Participants used general search engines to locate health-related social media platforms. They accessed a wide range of social media on a daily basis, using several electronic devices (in particular, mobile phones). Although privacy was a concern, it did not prevent consumers from fully engaging in social media for health-related purposes. Blogs were used to learn from other people's experiences with the same condition. Facebook allowed consumers to follow health-related pages and to participate in disease-specific group discussions. Wikipedia was used for factual information about diseases and treatments. YouTube was accessed to learn about medical procedures such as surgery. No participant reported editing or contributing to Wikipedia or posting YouTube videos related to health topics. Twitter was rarely used for health-related purposes. Social media allowed consumers to obtain and provide disease and treatment-related information and social and emotional support for those living with the same condition. Most considered their participation as observational, but some also contributed (eg, responded to people's questions). CONCLUSIONS: Participants used a wide range of social media for health-related purposes. Medical information exchange (eg, disease and treatment) and social and emotional support were the cornerstones of their online activities. Social media appears to be used as a key tool to support disease self-management.

Photo-sharing social media for eHealth: analysing perceived message effectiveness of sexual health information on Instagram.

Health professionals increasingly use social media to communicate health information, but it is unknown how visual message presentation on these platforms affects message reception. This study used an experiment to analyse how young adults (n = 839) perceive sexual health messages on Instagram. Participants were exposed to one of four conditions based on visual message presentation. Messages with embedded health content had the highest perceived message effectiveness ratings. Additionally, message sensation value, attitudes and systematic information processing were significant predictors of perceived message effectiveness. Implications for visual message design for electronic health are discussed.

Direct-to-Consumer Promotion of Prescription Drugs on Mobile Devices: Content Analysis.

BACKGROUND: US Food and Drug Administration (FDA) regulations state that any prescription drug promotion that presents drug benefits to consumers must also disclose certain information about the drug's risks in a similar manner. Nearly three-quarters of all US mobile phone subscribers use a smartphone, and over half report receiving mobile advertisements on their device. OBJECTIVE: The objective of this project was to investigate how prescription drugs are being promoted to consumers using mobile technologies. We were particularly interested in the presentation of drug benefits and risks, with regard to presence, placement, and prominence. METHODS: We analyzed a sample of 51 mobile promotional communications and their associated linked landing pages. We assessed the content and format of the mobile communications and landing pages with regard to presentation of drug benefits and risks. RESULTS: Of the 51 mobile communications we coded, 41% (21/51) were product claim communications (includes the drug name, benefits, and risks), 22% (11/51) were reminder communications (includes drug name only), and 37% (19/51) were help-seeking communications (includes information about the medical condition but not the drug name). Some of the product claim communications (5/21, 24%) required scrolling to see all the benefit information; in contrast, 95% (20/21) required scrolling to see all the risk information. Of the 19 product claim communications that presented both benefits and risks, 95% (18/19) presented benefits before risks and 47% (9/19) used a bigger font for benefits than for risks. Most mobile communications (35/51, 69%) linked to branded drug websites with both benefits and risks, 25% (13/51) linked to a landing page with benefits but no visible risks, and 6% (3/51) linked to a landing page with risks but no visible benefits. Few landing pages (4/51, 8%) required scrolling to see all the benefit information; in contrast, 51% (26/51) required scrolling to see all the risk information. Of the 35 landing pages with both benefit and risk information, 71% (25/35) presented benefits before risks and 51% (18/35) used a bigger font for benefits than for risks. CONCLUSIONS: These results indicate that, while risks and benefits are both represented in mobile communications and their associated landing pages, they are not equally prominent and accessible. This has implications for compliance with FDA fair balance regulations.

"It Feels Good to Know That Someone Cares".

INTRODUCTION: Diabetes is the leading cause of death in Hispanic communities. Self-management is an important part of diabetes care, and diabetes self-management education (DSME) aims to teach the skills necessary for preventing and delaying complication. However, DSME is underutilized. The purpose of this study was to explore Hispanic adults' motivations for attending a DSME class to identify effective strategies for promoting class participation and retention. METHOD: Nineteen adults participated in seven focus groups conducted in Spanish. Discussions were audio-recorded, transcribed, and translated. Transcripts were content coded by two coders to create a thematic coding scheme. RESULTS: Five main themes emerged as motivations for attendance: (1) frustration with physiological changes, (2) desire to "do better" because of family experience with death/complications from diabetes, (3) free access to information that is unattainable elsewhere, (3) a way to take control, and (4) group setting offered valued emotional and informational support as well as peer support for those who were uncomfortable discussing diabetes with family or lived with family who do not support lifestyle changes. CONCLUSIONS: Gaining diabetes self-management knowledge only partly explains the perceived value of classes. Culturally relevant content and appealing to the social supportive aspects of groups may encourage participation.

Implementation and evaluation of a prototype consumer reporting system for patient safety events.

OBJECTIVE: No methodologically robust system exists for capturing consumer-generated patient safety reports. To address this challenge, we developed and pilot-tested a prototype consumer reporting system for patient safety, the Health Care Safety Hotline. DESIGN: Mixed methods evaluation. SETTING: The Hotline was implemented in two US healthcare systems from 1 February 2014 through 30 June 2015. PARTICIPANTS: Patients, family members and caregivers associated with two US healthcare systems. INTERVENTION: A consumer-oriented incident reporting system for telephone or web-based administration was developed to elicit medical mistakes and care-related injuries. MAIN OUTCOMES MEASURES: Key informant interviews, measurement of website traffic and analysis of completed reports. RESULTS: Key informants indicated that Hotline participation was motivated by senior leaders' support and alignment with existing quality and safety initiatives. During the measurement period from 1 October 2014 through 30 June 2015, the home page had 1530 visitors with a unique IP address. During its 17 months of operation, the Hotline received 37 completed reports including 20 mistakes without harm and 15 mistakes with injury. The largest category of mistake concerned problems with diagnosis or advice from a health practitioner. Hotline reports prompted quality reviews, an education intervention, and patient follow-ups. CONCLUSION: While generating fewer reports than its capacity to manage, the Health Care Safety Hotline demonstrated the feasibility of consumer-oriented patient safety reporting. Further research is needed to understand how to increase consumers' use of these systems.