Design of patient-facing immunization visualizations affects task performance: an experimental comparison of 4 electronic visualizations.

OBJECTIVE: This study experimentally evaluated how well lay individuals could interpret and use 4 types of electronic health record (EHR) patient-facing immunization visualizations. MATERIALS AND METHODS: Participants (n = 69) completed the study using a secure online survey platform. Participants viewed the same immunization information in 1 of 4 EHR-based immunization visualizations: 2 different patient portals (Epic MyChart and eClinicWorks), a downloadable EHR record, and a clinic-generated electronic letter (eLetter). Participants completed a common task, created a standard vaccine schedule form, and answered questions about their perceived workload, subjective numeracy and health literacy, demographic variables, and familiarity with the task. RESULTS: The design of the immunization visualization significantly affected both task performance measures (time taken to complete the task and number of correct dates). In particular, those using Epic MyChart took significantly longer to complete the task than those using eLetter or eClinicWorks. Those using Epic MyChart entered fewer correct dates than those using the eLetter or eClinicWorks. There were no systematic statistically significant differences in task performance measures based on the numeracy, health literacy, demographic, and experience-related questions we asked. DISCUSSION: The 4 immunization visualizations had unique design elements that likely contributed to these performance differences. CONCLUSION: Based on our findings, we provide practical guidance for the design of immunization visualizations, and future studies. Future research should focus on understanding the contexts of use and design elements that make tables an effective type of health data visualization.

Evolving Interoperability Across a State Public Health Immunization Registry and Electronic Health Records.

The critical need for system interoperability and robust information infrastructure in public health was highlighted during the COVID-19 pandemic. An assessment of the evolving interoperability between immunization information system (IIS) in a state-based public health agency and electronic health records (EHRs) including pandemic-driven evolution/use was conducted. The Minnesota Immunization Information Connection (MIIC), the IIS for Minnesota (US) supports interoperability with EHRs using HL7v2.5.1 standards-based queries. Structured interviews were conducted with 28 experts across 12 healthcare systems and public health clinics (n=286 sites) between April - July 2022. Though all reported use of MIIC, most (83%) had MIIC integration within their EHRs, and high EHR queries to MIIC (∼6 million/month), numerous organizational/technical barriers were identified including standard vaccine-naming need in EHRs, app access issues, limited resources and informatics-staff shortage in public health. Results underscore vital role of IIS, on-going interoperability evaluation to address issues and promote standards-based bi-directional EHR-IIS data exchanges.

User Perceptions and Use of Decision Support Medical Apps Among Medical Students: Cross-Sectional Study.

We aimed to assess medical students' use of decision-support medical apps and evaluate their perception of app use. A cross-sectional multi-center observational study was conducted among medical students with and without a medical informatics course as part of their undergraduate medical curriculum. We assessed trust, perceptions, patient impression, reliability, and comfort using an online survey. A total of 439 responses were received. There were significant differences between the two groups when indicating which apps, they trust. Students agreed that using apps enhanced knowledge (91%), saved time (88%), improved patient care (85%), and increased diagnostic accuracy (82%). Students indicated that patients would think that students didn't know what they were doing (63%) or students were fresh out of training (53%) when using apps in the presence of patients. Incorporating medical app usage as part of learning may increase trust and comfort with using medical apps in medical practice.

Development and implementation of an interoperability tool across state public health agency's disease surveillance and immunization information systems.

Public health information systems have historically been siloed with limited interoperability. The State of Minnesota's disease surveillance system (Minnesota Electronic Disease Surveillance System: MEDSS, ∼12 million total reportable events) and immunization information system (Minnesota Immunization Information Connection: MIIC, ∼130 million total immunizations) lacked interoperability between them and data exchange was fully manual. An interoperability tool based on national standards (HL7 and SOAP/web services) for query and response was developed for electronic vaccination data exchange from MIIC into MEDSS by soliciting stakeholder requirements (n = 39) and mapping MIIC vaccine codes (n = 294) to corresponding MEDSS product codes (n = 48). The tool was implemented in March 2022 and incorporates MIIC data into a new vaccination form in MEDSS with mapping of 30 data elements including MIIC demographics, vaccination history, and vaccine forecast. The tool was evaluated using mixed methods (quantitative analysis of user time, clicks, queries; qualitative review with users). Comparison of key tasks demonstrated efficiencies including vaccination data access (before: 50 clicks, >2 min; after: 4 clicks, 8 s) which translated directly to staff effort (before: 5 h/week; after: ∼17 min/week). This case study demonstrates the contribution of improving public health systems interoperability, ultimately with the goal of enhanced data-driven decision-making and public health surveillance.

Examining standardized consumer-generated social determinants of health and resilience data supported by Omaha System terminology.

Nursing terminologies like the Omaha System are foundational in realizing the vision of formal representation of social determinants of health (SDOH) data and whole-person health across biological, behavioral, social, and environmental domains. This study objective was to examine standardized consumer-generated SDOH data and resilience (strengths) using the MyStrengths+MyHealth (MSMH) app built using Omaha System. Overall, 19 SDOH concepts were analyzed including 19 Strengths, 175 Challenges, and 76 Needs with additional analysis around Income Challenges. Data from 919 participants presented an average of 11(SD = 6.1) Strengths, 21(SD = 15.8) Challenges, and 15(SD = 14.9) Needs. Participants with at least one Income Challenge (n = 573) had significantly (P < .001) less Strengths [9.4(6.4)], more Challenges [27.4(15.5)], and more Needs [15.1(14.9)] compared to without an Income Challenge (n = 337) Strengths [13.4(4.5)], Challenges [10.5(8.9)], and Needs [5.1(10.0)]. This standards-based approach to examining consumer-generated SDOH and resilience data presents a great opportunity in understanding 360-degree whole-person health as a step towards addressing health inequities.

Electronic case reporting (eCR) of COVID-19 to public health: implementation perspectives from the Minnesota Department of Health.

Electronic case reporting (eCR) is the automated generation and transmission of case reports from electronic health records to public health for review and action. These reports (electronic initial case reports: eICRs) adhere to recommended exchange and terminology standards. eCR is a partnership of the Centers for Disease Control and Prevention (CDC), Association of Public Health Laboratories (APHL) and Council of State and Territorial Epidemiologists (CSTE). The Minnesota Department of Health (MDH) received eICRs for COVID-19 from April 2020 (3 sites, manual process), automated eCR implementation in August 2020 (7 sites), and on-boarded ∼1780 clinical units in 460 sites across 6 integrated healthcare systems (through March 2022). Approximately 20 000 eICRs/month were reported to MDH during high-volume timeframes. With increasing provider/health system implementation, the proportion of COVID-19 cases with an eICR increased to 30% (March 2022). Evaluation of data quality for select demographic variables (gender, race, ethnicity, email, phone, language) across the 6 reporting health systems revealed a high proportion of completeness (>80%) for half of variables and less complete data for rest (ethnicity, email, language) along with low ethnicity data (<50%) for one health system. Presently eCR implementation at MDH includes only one EHR vendor. Next steps will focus on onboarding other EHRs, additional eICR data extraction/utilization, detailed analysis, outreach to address data quality issues, and expanding to other reportable conditions.

The role of organizational culture in health information technology implementations: A scoping review.

Introduction: The exponential growth in health information technology (HIT) presents an immense opportunity for facilitating the data-to-knowledge-to-performance loop which supports learning health systems. This scoping review addresses the gap in knowledge around HIT implementation contextual factors such as organizational culture and provides a current state assessment. Methods: A search of 13 databases guided by Arskey and O'Malley's framework identified content on HIT implementations and organizational culture. The Consolidated Framework for Implementation Research (CFIR) was used to assess culture and to develop review criteria. Culture stress, culture effort, implementation climate, learning climate, readiness for implementation, leadership engagement, and available resources were the constructs examined. Rayyan and Qualtrics were used for screening and data extraction. Results: Fifty two studies included were mainly conducted in Academic Health Centers (n = 18, 35%) and at urban locations (n = 50, 96%). Interviews frequently used for data collection (n = 26, 50%) and guided by multiple frameworks (n = 34). Studies mostly focused on EHR implementations (n = 23, 44%) followed by clinical decision support (n = 9, 17%). About two-thirds (n = 34, 65%) reflected culture stress theme and 62% (21 of 34) acknowledged it as a barrier. Culture effort identified in 27 studies and was a facilitator in most (78%, 21 of 27). Leadership engagement theme in majority studies (71%, n = 37), with 35% (n = 13) noting it as a facilitator. Eighty percent (42 studies) noted available resources, 12 of which identified this as barrier to successful implementation. Conclusions: It is vital to determine the culture and other CFIR inner setting constructs that are significant to HIT implementation as facilitators or barriers. This scoping review presents a limited number of empirical studies in this topic highlighting the need for additional research to quantify the effects of culture. This will help build evidence and best practices that facilitate HIT implementations and hence serve as a platform to support robust learning health systems.

A Community-Based Participatory Intervention in the United States Using Data to Shift the Community Narrative From Deficits to Strengths.

With Minneapolis, Minnesota, partners, we developed a community-based participatory intervention using a mobile health application to provide actionable data to communities. More than 550 participants completed the survey. Key messages included strengths in our homes, neighborhoods, and faith communities. Key challenges were related to substance use and sleeping. We jointly conducted virtual community meetings such as webinars, Facebook Live shows, and online newsletters to begin to shift the community narrative from deficits to whole-person health, including strengths. (Am J Public Health. 2022;112(S3):S275-S278. https://doi.org/10.2105/AJPH.2022.306852).

Understanding Whole-Person Health and Resilience During the COVID-19 Pandemic and Beyond: A Cross-sectional and Descriptive Correlation Study.

BACKGROUND: The COVID-19 pandemic has prompted an interest in whole-person health and emotional well-being. Informatics solutions through user-friendly tools such as mobile health apps offer immense value. Prior research developed a consumer-facing app MyStrengths + MyHealth using Simplified Omaha System Terms (SOST) to assess whole-person health. The MyStrengths + MyHealth app assesses strengths, challenges, and needs (SCN) for 42 concepts across four domains (My Living, My Mind and Networks, My Body, My Self-care; eg, Income, Emotions, Pain, and Nutrition, respectively). Given that emotional well-being was a predominant concern during the COVID-19 pandemic, we sought to understand whole-person health for participants with/without Emotions challenges. OBJECTIVE: This study aims to use visualization techniques and data from attendees at a Midwest state fair to examine SCN overall and by groups with/without Emotions challenges, and to explore the resilience of participants. METHODS: This cross-sectional and descriptive correlational study surveyed adult attendees at a 2021 Midwest state fair. Data were visualized using Excel and analyzed using descriptive and inferential statistics using SPSS. RESULTS: The study participants (N=182) were primarily female (n=123, 67.6%), aged ≥45 years (n=112, 61.5%), White (n=154, 84.6%), and non-Hispanic (n=177, 97.3%). Compared to those without Emotions challenges, those with Emotions challenges were aged 18-44 (P<.001) years, more often female (P=.02), and not married (P=.01). Overall, participants had more strengths (mean 28.6, SD 10.5) than challenges (mean 12, SD 7.5) and needs (mean 4.2, SD 7.5). The most frequent needs were in Emotions, Nutrition, Income, Sleeping, and Exercising. Compared to those without Emotions challenges, those with Emotions challenges had fewer strengths (P<.001), more challenges (P<.001), and more needs (P<.001), along with fewer strengths for Emotions (P<.001) and for the cluster of health-related behaviors domain concepts, Sleeping (P=.002), Nutrition (P<.001), and Exercising (P<.001). Resilience was operationalized as correlations among strengths for SOST concepts and visualized for participants with/without an Emotions challenge. Those without Emotions challenges had more positive strengths correlations across multiple concepts/domains. CONCLUSIONS: This survey study explored a large community-generated data set to understand whole-person health and showed between-group differences in SCN and resilience for participants with/without Emotions challenges. It contributes to the literature regarding an app-aided and data-driven approach to whole-person health and resilience. This research demonstrates the power of health informatics and provides researchers with a data-driven methodology for additional studies to build evidence on whole-person health and resilience.

Making the case for workforce diversity in biomedical informatics to help achieve equity-centered care: a look at the AMIA First Look Program.

Developing a diverse informatics workforce broadens the research agenda and ensures the growth of innovative solutions that enable equity-centered care. The American Medical Informatics Association (AMIA) established the AMIA First Look Program in 2017 to address workforce disparities among women, including those from marginalized communities. The program exposes women to informatics, furnishes mentors, and provides career resources. In 4 years, the program has introduced 87 undergraduate women, 41% members of marginalized communities, to informatics. Participants from the 2019 and 2020 cohorts reported interest in pursuing a career in informatics increased from 57% to 86% after participation, and 86% of both years' attendees responded that they would recommend the program to others. A June 2021 LinkedIn profile review found 50% of participants working in computer science or informatics, 4% pursuing informatics graduate degrees, and 32% having completed informatics internships, suggesting AMIA First Look has the potential to increase informatics diversity.

A Public Health Informatics Solution to Improving Food Safety in Restaurants: Putting the Missing Piece in the Puzzle.

Foodborne illnesses remain an important public health challenge in the United States causing an estimated 48 million illnesses, 128,000 hospitalizations, and 3,000 deaths per year. Restaurants are frequent settings for foodborne illness transmission. Public health surveillance - the continual, systematic collection, analysis, and interpretation of reports of health data to prevent and control illness - is a prerequisite for an effective food control system. While restaurant inspection data are routinely collected, these data are not regularly aggregated like traditional surveillance data. However, there is evidence that these data are a valuable tool for understanding foodborne illness outbreaks and threats to food safety. This article discusses the challenges and opportunities for incorporating routine restaurant inspection data as a surveillance tool for monitoring and improving foodborne illness prevention activities. The three main challenges are: 1) lack of a national framework; 2) lack of data standards and interoperability; and 3) limited access to restaurant inspection data. Tapping into the power of public health informatics represents an opportunity to address these challenges. Advancing the food safety system by improving restaurant inspection information systems and making restaurant inspection data available to support decision-making represents an opportunity to practice smarter food safety.

Expert Perspectives on Definitions, Drivers and Informatics Contributions to Learning Health Systems.

Learning Health System (LHS) proposes a new paradigm in scientific enterprise to facilitate the rapid movement of data to knowledge (D2K) and knowledge to practice (K2P). Informatics can play a pivotal role in facilitating feedback loops and rapid cycles of learning across D2K and K2P. Though informatics has been acknowledged as a critical component of LHS, it remains unclear how leaders in informatics are conceptualizing its role in promoting LHS. This study sought to gain insights from informatics leaders and experts on their perspectives around role of informatics in LHS. We conducted semi-structured interviews with fourteen informatics leaders across different informatics domains and leadership positions. Our results revealed areas of agreement around key concepts related to LHS as well as opportunities to improve messaging and add clarity to the role of informatics in promoting LHS.

Evaluation of Data Exchange Process for Interoperability and Impact on Electronic Laboratory Reporting Quality to a State Public Health Agency.

BACKGROUND: Past and present national initiatives advocate for electronic exchange of health data and emphasize interoperability. The critical role of public health in the context of disease surveillance was recognized with recommendations for electronic laboratory reporting (ELR). Many public health agencies have seen a trend towards centralization of information technology services which adds another layer of complexity to interoperability efforts. OBJECTIVES: The study objective was to understand the process of data exchange and its impact on the quality of data being transmitted in the context of electronic laboratory reporting to public health. This was conducted in context of Minnesota Electronic Disease Surveillance System (MEDSS), the public health information system for supporting infectious disease surveillance in Minnesota. Data Quality (DQ) dimensions by Strong et al., was chosen as the guiding framework for evaluation. METHODS: The process of assessing data exchange for electronic lab reporting and its impact was a mixed methods approach with qualitative data obtained through expert discussions and quantitative data obtained from queries of the MEDSS system. Interviews were conducted in an open-ended format from November 2017 through February 2018. Based on these discussions, two high level categories of data exchange process which could impact data quality were identified: onboarding for electronic lab reporting and internal data exchange routing. This in turn comprised of ten critical steps and its impact on quality of data was identified through expert input. This was followed by analysis of data in MEDSS by various criteria identified by the informatics team. RESULTS: All DQ metrics (Intrinsic DQ, Contextual DQ, Representational DQ, and Accessibility DQ) were impacted in the data exchange process with varying influence on DQ dimensions. Some errors such as improper mapping in electronic health records (EHRs) and laboratory information systems had a cascading effect and can pass through technical filters and go undetected till use of data by epidemiologists. Some DQ dimensions such as accuracy, relevancy, value-added data and interpretability are more dependent on users at either end of the data exchange spectrum, the relevant clinical groups and the public health program professionals. The study revealed that data quality is dynamic and on-going oversight is a combined effort by MEDSS Informatics team and review by technical and public health program professionals. CONCLUSION: With increasing electronic reporting to public health, there is a need to understand the current processes for electronic exchange and their impact on quality of data. This study focused on electronic laboratory reporting to public health and analyzed both onboarding and internal data exchange processes. Insights gathered from this research can be applied to other public health reporting currently (e.g. immunizations) and will be valuable in planning for electronic case reporting in near future.

Developing Workforce Capacity in Public Health Informatics: Core Competencies and Curriculum Design.

We describe a master's level public health informatics (PHI) curriculum to support workforce development. Public health decision-making requires intensive information management to organize responses to health threats and develop effective health education and promotion. PHI competencies prepare the public health workforce to design and implement these information systems. The objective for a Master's and Certificate in PHI is to prepare public health informaticians with the competencies to work collaboratively with colleagues in public health and other health professions to design and develop information systems that support population health improvement. The PHI competencies are drawn from computer, information, and organizational sciences. A curriculum is proposed to deliver the competencies and result of a pilot PHI program is presented. Since the public health workforce needs to use information technology effectively to improve population health, it is essential for public health academic institutions to develop and implement PHI workforce training programs.

Representation of occupational information across resources and validation of the occupational data for health model.

Reports by the National Academy of Medicine and leading public health organizations advocate including occupational information as part of an individual's social context. Given recent National Academy of Medicine recommendations on occupation-related data in the electronic health record, there is a critical need for improved representation. The National Institute for Occupational Safety and Health has developed an Occupational Data for Health (ODH) model, currently in draft format. This study aimed to validate the ODH model by mapping occupation-related elements from resources representing recommendations, standards, public health reports and surveys, and research measures, along with preliminary evaluation of associated value sets. All 247 occupation-related items across 20 resources mapped to the ODH model. Recommended value sets had high variability across the evaluated resources. This study demonstrates the ODH model's value, the multifaceted nature of occupation information, and the critical need for occupation value sets to support clinical care, population health, and research.

Immunization Information System and Informatics to Promote Immunizations: Perspective From Minnesota Immunization Information Connection.

The vision for management of immunization information is availability of real-time consolidated data and services for all ages, to clinical, public health, and other stakeholders. This is being executed through Immunization Information Systems (IISs), which are population-based and confidential computerized systems present in most US states and territories. Immunization Information Systems offer many functionalities, such as immunization assessment reports, client follow-up, reminder/recall feature, vaccine management tools, state-supplied vaccine ordering, comprehensive immunization history, clinical decision support/vaccine forecasting and recommendations, data processing, and data exchange. This perspective article will present various informatics tools in an IIS, in the context of the Minnesota Immunization Information Connection.

Assessing the Representation of Occupation Information in Free-Text Clinical Documents Across Multiple Sources.

There has been increasing recognition of the key role of social determinants like occupation on health. Given the relatively poor understanding of occupation information in electronic health records (EHRs), we sought to characterize occupation information within free-text clinical document sources. From six distinct clinical sources, 868 total occupation-related sentences were identified for the study corpus. Building off approaches from previous studies, refined annotation guidelines were created using the National Institute for Occupational Safety and Health Occupational Data for Health data model with elements added to increase granularity. Our corpus generated 2,005 total annotations representing 39 of 41 entity types from the enhanced data model. Highest frequency entities were: Occupation Description (17.7%); Employment Status - Not Specified (12.5%); Employer Name (11.0%); Subject (9.8%); Industry Description (6.2%). Our findings support the value of standardizing entry of EHR occupation information to improve data quality for improved patient care and secondary uses of this information.