The Associations of Electronic Health Record Usability and User Age With Stress and Cognitive Failures Among Finnish Registered Nurses: Cross-Sectional Study.

BACKGROUND: Electronic health records (EHRs) are expected to provide many clinical and organizational benefits. Simultaneously, the end users may face unintended consequences, such as stress and increased cognitive workload, due to poor EHR usability. However, whether the effects of usability depend on end user characteristics, such as career stage or age, remains poorly understood. OBJECTIVE: The objective of this study was to examine the associations of EHR usability and user age with stress related to information systems and cognitive failures among registered nurses. METHODS: A cross-sectional survey design was employed in Finland in 2017. A total of 3383 registered nurses responded to the nationwide electronic survey. Multiple linear regression was used to examine the associations of EHR usability (eg, how easily information can be found and a patient's care can be documented) and user age with stress related to information systems and cognitive failures. Interaction effects of EHR usability and age were also tested. Models were adjusted for gender and employment sector. RESULTS: Poor EHR usability was associated with higher levels of stress related to information systems (ß=.38; P<.001). The strength of the association did not depend on user age. Poor EHR usability was also associated with higher levels of cognitive failures (ß=.28; P<.001). There was a significant interaction effect between age and EHR usability for cognitive failures (ß=.04; P<.001). Young nurses who found the EHR difficult to use reported the most cognitive failures. CONCLUSIONS: Information system stress due to poor EHR usability afflicts younger and older nurses alike. However, younger nurses starting their careers may be more cognitively burdened if they find EHR systems difficult to use compared to older nurses. Adequate support in using the EHRs may be particularly important to young registered nurses, who have a lot to learn and adopt in their early years of practice.

Tailoring EHRs for Specific Working Environments Improves Work Well-Being of Physicians.

Electronic health records (EHRs) have an impact on physicians' well-being and stress levels. We studied physicians' experiences with EHRs and their experienced time pressure and self-rated stress by an electronic questionnaire sent to Finnish physicians aged under 65 in 2017. Our sample was 2980 physicians working in the public sector, health care centers (35.5%) or hospitals (64.5%). Experienced technical problems were positively associated with experienced time pressure, whereas user-friendliness of the EHRs was negatively associated with experienced time pressure. Low perceived support for internal cooperation was associated with high levels of time pressure in hospitals. Those experiencing high levels of technical problems were 1.3 times more likely to experience stress compared to those experiencing low levels of technical problems. Better user-friendliness of the EHRs was associated with lower levels of self-rated stress. In both working environments but more strongly in primary health care, technical problems were associated with self-rated stress. Technical problems and user-friendliness of EHRs are the main factors associated with time pressure and self-rated stress. Health care environments differ in the nature of workflow having different demands on the EHRs. Developing EHR systems should consider the special needs of different environments and workflows, enabling better work well-being amongst physicians.

Digital Divide in Perceived Benefits of Online Health Care and Social Welfare Services: National Cross-Sectional Survey Study.

BACKGROUND: The number of online services in health care is increasing rapidly in developed countries. Users are expected to take a more skilled and active role in taking care of their health and prevention of ill health. This induces risks that users (especially those who need the services the most) will drop out of digital services, resulting in a digital divide or exclusion. To ensure wide and equal use of online services, all users must experience them as beneficial. OBJECTIVE: This study aimed to examine associations of (1) demographics (age, gender, and degree of urbanization), (2) self-rated health, (3) socioeconomic position (education, experienced financial hardship, labor market position, and living alone), (4) social participation (voting, satisfaction with relationships, and keeping in touch with friends and family members), and (5) access, skills, and extent of use of information and communication technologies (ICT) with perceived benefits of online health care and social welfare services. Associations were examined separately for perceived health, economic, and collaboration benefits. METHODS: We used a large random sample representative of the Finnish population including 4495 (56.77% women) respondents aged between 20 and 97 years. Analyses of covariance were used to examine the associations of independent variables with perceived benefits. RESULTS: Access to online services, ICT skills, and extent of use were associated with all examined benefits of online services. ICT skills seemed to be the most important factor. Poor self-rated health was also consistently associated with lower levels of perceived benefits. Similarly, those who were keeping in touch with their friends and relatives at least once a week perceived online services more often beneficial in all the examined dimensions. Those who had experienced financial hardship perceived fewer health and economic benefits than others. Those who were satisfied with their relationships reported higher levels of health and collaboration benefits compared with their counterparts. Also age, education, and degree of urbanization had some statistically significant associations with benefits but they seemed to be at least partly explained by differences in access, skills, and extent of use of online services. CONCLUSIONS: According to our results, providing health care services online has the potential to reinforce existing social and health inequalities. Our findings suggest that access to online services, skills to use them, and extent of use play crucial roles in perceiving them as beneficial. Moreover, there is a risk of digital exclusion among those who are socioeconomically disadvantaged, in poor health, or socially isolated. In times when health and social services are increasingly offered online, this digital divide may predispose people with high needs for services to exclusion from them.

Physicians' and nurses' experiences on EHR usability: Comparison between the professional groups by employment sector and system brand.

BACKGROUND: Usability associates with patient safety and quality of care. This article reports results from nation-wide usability-focused survey studies for physicians and nurses in Finland. Earlier research has shown dissatisfaction and serious deficiencies, which hamper the efficient use of health information systems (HIS); however, evaluation studies covering the viewpoints of both user groups are practically lacking. Our study aimed at comparing end-users' experiences on the usability of electronic health record (EHR) systems by employment sector and EHR brand. METHODS: To measure usability, we used the validated National Usability-focused HIS Scale (NuHISS). For this study, we selected 11 usability statements that relate to technical quality (n = 3), ease of use (n = 6), benefits (n = 1) and collaboration (n = 1), and were identical in both surveys. We report the responses from 3013 physicians and 2560 nurses working in public sector hospitals or primary care health centers in 2017. RESULTS: Results in total and by healthcare sector showed notable differences between nurses' and physicians' experiences on usability of their EHR systems. Physicians were more satisfied than nurses on technical quality and learnability of the EHR-systems, while nurses experienced the ease of use better and were more satisfied with collaboration aspects than physicians. Two EHR brands used in hospitals appeared to have succeeded in supporting physician workflows, while two others used in health centers were more suitable for nurses' needs. CONCLUSIONS: Nurses' and physicians' experiences on EHR usability appear to vary more by EHR brand and employment sector rather than either professional group being generally more satisfied. Development of EHR systems should consider the perspectives of these two main user groups and their working contexts.

Usability Factors Associated With Physicians' Distress and Information System-Related Stress: Cross-Sectional Survey.

BACKGROUND: Constantly changing and difficult-to-use information systems have arisen as a significant source of stress in physicians' work. Physicians have reported several usability problems, system failures, and a lack of integration between the systems and have experienced that systems poorly support the documentation and retrieval of patient data. This stress has kept rising in the 21st century, and it seems that it may also affect physicians' well-being. OBJECTIVE: This study aimed to examine the associations of (1) usability variables (perceived benefits, technical problems, support for feedback, and user-friendliness), (2) the number of systems in daily use, (3) experience of using information systems, and (4) participation in information systems development work with physicians' distress and levels of stress related to information systems (SRIS) levels. METHODS: A cross-sectional survey was conducted among 4018 Finnish physicians (64.82%, 2572 out of 3968 women) aged between 24 and 64 years (mean 46.8 years) in 2017. The analyses of covariance were used to examine the association of independent variables with SRIS and distress (using the General Health Questionnaire) adjusted for age, gender, employment sector, specialization status, and the electronic health record system in use. RESULTS: High levels of technical problems and a high number of systems in daily use were associated with high levels of SRIS, whereas high levels of user-friendliness, perceived benefits, and support for feedback were associated with low levels of SRIS. Moreover, high levels of technical problems were associated with high levels of psychological distress, whereas high levels of user-friendliness were associated with low distress levels. Those who considered themselves experienced users of information systems had low levels of both SRIS and distress. CONCLUSIONS: It seems that by investing in user-friendly systems with better technical quality and good support for feedback that professionals perceive as being beneficial would improve the work-related well-being and overall well-being of physicians. Moreover, improving physicians' skills related to information systems by giving them training could help to lessen the stress that results from poorly functioning information systems and improve physicians' well-being.

Experienced time pressure and stress: electronic health records usability and information technology competence play a role.

BACKGROUND: Electronic health records (EHRs) are an elementary part of the work of registered nurses (RNs) in healthcare. RNs are the largest group of healthcare workers, and their experiences with EHRs and their informatics competence play a crucial role in a fluent workflow. The present study examined EHR usability factors and nurses' informatics competence factors related to self-reported time pressure and psychological distress. METHODS: A nationwide survey was conducted for working-age registered nurses in 2017. The study sample included 3607 nurses (5% men) in Finland. The association of age, sex, employment sector, EHR usability factors, and nurses' informatics competence factors with time pressure and psychological distress were examined with analyses of covariance. RESULTS: The EHR usability factors that were associated with high time pressure were low EHR reliability and poor user-friendliness. Regarding the nurses' informatics competence factors, only low e-Care competence was associated with time pressure. Of the EHR usability factors, low EHR reliability and low support for cooperation were associated with high psychological distress. Of the nurses' informatics competence factors, low e-Care competence was associated with high psychological distress. CONCLUSIONS: Unreliability and poor user-friendliness of EHRs seem to be prominent sources of time pressure and psychological distress among registered nurses. User-friendly EHR systems and digital tools in healthcare are needed. Nurses' competence to use eHealth tools to tailor patient care should be strengthened through organizational and regional actions. For example, house rules about how to use eHealth tools and instructions on common practices in cooperation with other organizations could be useful.

Developing the National Usability-Focused Health Information System Scale for Physicians: Validation Study.

BACKGROUND: Problems in the usability of health information systems (HISs) are well acknowledged, but research still lacks a validated questionnaire for measuring and monitoring different dimensions of usability of HISs. Such questionnaires are needed not only for research but also for developing usability of HISs from the viewpoint of end-user experiences. OBJECTIVE: This study aimed to develop and test the validity of the questionnaire measuring the National Usability-Focused HIS-Scale (NuHISS) among a nationally representative sample of Finnish physicians. METHODS: We utilized 2 cross-sectional data collected from a random sample of Finnish physicians in 2014 (N=3781; of which 2340 [61.9%] were women) and 2017 (N=4018; of which 2604 [64.8%] were women). Exploratory and confirmatory factor analyses (structural equation modeling [SEM]) were applied to test the structural validity of the NuHISS. As the concurrent validity measure, we used the self-reported overall quality of the electronic health record system (school grade) provided by the participants using marginal structural models. RESULTS: The exploratory factor analyses with Varimax rotation suggested that the 7-factor solution did offer a good fit to the data in both samples (C2=2136.14 in 2014 and C2=2109.83 in 2017, both P<.001). Moreover, structural equation modelling analyses, using comparative fit index (CFI), Tucker-Lewis Index (TLI), Normed Fit Index (NFI), root mean squared error of approximation (RMSEA), and Standardized Root Mean square Residual (SRMR), showed that the 7-factor solution provided an acceptable fit in both samples (CFI=0.92/0.91, TLI=0.92/0.91, NFI=0.92/0.91, RMSEA=0.048/0.049, and SRMR=0.040/0.039). In addition, concurrent validity of this solution was shown to be acceptable. Ease of use, but also all other dimensions, was especially associated with overall quality reports independent of measured confounders. The 7-factor solution included dimensions of technical quality, information quality, feedback, ease of use, benefits, internal collaboration, and cross-organizational collaboration. CONCLUSIONS: NuHISS provides a useful tool for measuring usability of HISs among physicians and offers a valid measure for monitoring the long-term development of HISs on a large scale. The relative importance of items needs to be assessed against national electronic health policy goals and complemented with items that have remained outside the NuHISS from the questionnaire when appropriate.

Artificial Intelligence in Clinical Decision Support: Challenges for Evaluating AI and Practical Implications.

OBJECTIVES: This paper draws attention to: i) key considerations for evaluating artificial intelligence (AI) enabled clinical decision support; and ii) challenges and practical implications of AI design, development, selection, use, and ongoing surveillance. METHOD: A narrative review of existing research and evaluation approaches along with expert perspectives drawn from the International Medical Informatics Association (IMIA) Working Group on Technology Assessment and Quality Development in Health Informatics and the European Federation for Medical Informatics (EFMI) Working Group for Assessment of Health Information Systems. RESULTS: There is a rich history and tradition of evaluating AI in healthcare. While evaluators can learn from past efforts, and build on best practice evaluation frameworks and methodologies, questions remain about how to evaluate the safety and effectiveness of AI that dynamically harness vast amounts of genomic, biomarker, phenotype, electronic record, and care delivery data from across health systems. This paper first provides a historical perspective about the evaluation of AI in healthcare. It then examines key challenges of evaluating AI-enabled clinical decision support during design, development, selection, use, and ongoing surveillance. Practical aspects of evaluating AI in healthcare, including approaches to evaluation and indicators to monitor AI are also discussed. CONCLUSION: Commitment to rigorous initial and ongoing evaluation will be critical to ensuring the safe and effective integration of AI in complex sociotechnical settings. Specific enhancements that are required for the new generation of AI-enabled clinical decision support will emerge through practical application.

Physicians' Experiences on EHR Usability: A Time Series from 2010, 2014 and 2017.

The interest towards monitoring and guiding the development of healthcare information systems on a national level is increasing. In this paper, we report results from the three cross-sectional surveys on physicians' experiences on usability of their electronic health record (EHR) systems in Finland. The research question was: How have physicians' experiences on usability of their EHR systems evolved between 2010 and 2017? The data consists of responses to six usability statements from Finnish physicians working in public healthcare centres and hospitals. Among physicians working in healthcare centres, results between 2010 and 2017 show change for the worse. Among their colleagues in hospitals, results indicate slight improvement only in the domain of ease of use of the systems. In general, contrary to general expectations, the results do not show improvements between the years 2010, 2014 and 2017. In the future, we will continue the monitoring work in Finland on a national level from the viewpoint of physicians and other professional groups.

Factors Related to Health Informatics Competencies for Nurses-Results of a National Electronic Health Record Survey.

In 2015, the Finnish Ministry of Social Affairs and Health published an eHealth and eSocial strategy with key objectives that by 2020 health information systems will be smart and providers will be able to maximize their use. Measures include improving system usability and decision support, involving professionals in system and service development, and increasing professionals' training in information management, electronic documentation, data protection, and data security. The aim of this study was to explore the level of nurses' informatics competencies and sufficiency of in-house training regarding technology-induced changes in work practices. An electronic questionnaire produced by the National Institute of Health and Welfare was sent in February to April 2017 to 29 283 Finnish working-age nurses, community nurses, and midwives; 3607 replies were received. Respondents rated their overall informatics competency relatively high, with the lowest competency scores on terminology-based documentation (Finnish Care Classification) and patient-related digital work. Education, electronic health record system used, experience using electronic health record systems, sufficiency of training, higher levels of technical functionality, ease of use, and usefulness were all associated with competency and remained significant after all adjustments. One-third of the respondents felt that they had not received sufficient training. Age and participation in system development were associated with experiences of sufficiency of training.

Health information exchange in Finland: Usage of different access types and predictors of paper use.

INTRODUCTION: Timely, complete and accurate patient data is needed in care decisions along the continuum of care. To access patient data from other organizations, there are three types of regional health information exchange systems (RHIS) in use In Finland. Some regions use multiple RHISs while others do not have a RHIS available. The recently introduced National Patient Data Repository (Kanta) is increasingly used for health information exchange (HIE). OBJECTIVES: The purpose of this study was to assess usage of paper, RHISs and Kanta by context in 2017; evolution of paper use over the years; and predictors of paper use in 2017 among Finnish physicians for HIE system development. METHODS: Data from national electronic health record (EHR) usage and user experience surveys were taken from 2010 (prior to ePrescription system implementation), 2014 (prior to implementation of Kanta) and 2017 (Kanta was in full use in the public sector and in large private organizations). The web-based surveys were targeted to all physicians engaged in clinical work in Finland. RESULTS: Kanta was the most frequently used means of HIE in 2017. Paper use had reduced significantly from 2010 to 2014. The trend continued in 2017. Still, up to half of the physicians reported using paper daily or weekly in 2017. There were great variations in paper use by healthcare sector, available RHIS type and EHR system used. In multivariable analysis (with all other variables constant), predictors of more frequent use of paper than electronic means for HIE were: private sector or hospital, access to Master Patient Index RHIS (type 1), multiple RHIS (type 4) or no RHIS (type 5), two particular EHR systems, older age, less experience, operative, psychiatric or diagnostic specialties, and male gender. CONCLUSIONS: Usability of HIE systems including EHRs as access points to HIE need to be improved to facilitate usage of electronic HIE. Usage ensures more timely and complete patient data for safe, coordinated care. Specialty-specific needs and requirements call for more user participation in HIE design. Especially older professionals need training to better exploit HIS for HIE.

Monitoring and Benchmarking eHealth in the Nordic Countries.

The Nordic eHealth Research Network, a subgroup of the Nordic Council of Ministers eHealth group, is working on developing indicators to monitor progress in availability, use and outcome of eHealth applications in the Nordic countries. This paper reports on the consecutive analysis of National eHealth policies in the Nordic countries from 2012 to 2016. Furthermore, it discusses the consequences for the development of indicators that can measure changes in the eHealth environment arising from the policies. The main change in policies is reflected in a shift towards more stakeholder involvement and intensified focus on clinical infrastructure. This change suggests developing indicators that can monitor understandability and usability of eHealth systems, and the use and utility of shared information infrastructure from the perspective of the end-users - citizens/patients and clinicians in particular.

Predictors of physicians' stress related to information systems: a nine-year follow-up survey study.

BACKGROUND: Among the important stress factors for physicians nowadays are poorly functioning, time consuming and inadequate information systems. The present study examined the predictors of physicians' stress related to information systems (SRIS) among Finnish physicians. The examined predictors were cognitive workload, staffing problems, time pressure, problems in teamwork and job satisfaction, adjusted for baseline levels of SRIS, age, gender and employment sector. METHODS: The study has a follow-up design with two survey data collection waves, one in 2006 and one in 2015, based on a random sample of Finnish physicians was used. The present study used a sample that included 1109 physicians (61.9% women; mean age in 2015 was 54.5; range 34-72) who provided data on the SRIS in both waves. The effects of a) predictor variable levels in 2006 on SRIS in 2015 and b) the change in the predictor variables from 2006 to 2015 on SRIS in 2015 were analysed with linear regression analyses. RESULTS: Regression analyses showed that the higher level of cognitive workload in 2006 significantly predicted higher level of SRIS in 2015 (ß = 0.08). The reciprocity of this association was tested with cross-lagged structural equation model analyses which showed that the direction of the association was from cognitive workload to SRIS, not from SRIS to cognitive workload. Moreover, increases in time pressure (ß = 0.16) and problems in teamwork (ß = 0.10) were associated with higher levels of SRIS in 2015, whereas job satisfaction increase was associated with lower SRIS (ß = - 0.06). CONCLUSIONS: According to our results, physicians' cognitive workload may have long-lasting negative ramifications in regard to how stressful physicians experience their health information systems to be. Thus, organisations should pay attention to physicians workload if they wish physicians to master all the systems they need to use. It is also important to provide physicians with enough time and collegial support in their system-related problems, and in learning new systems and system updates.

The Safe and Effective Use of Shared Data Underpinned by Stakeholder Engagement and Evaluation Practice.

OBJECTIVES: The paper draws attention to: i) key considerations involving the confidentiality, privacy, and security of shared data; and ii) the requirements needed to build collaborative arrangements encompassing all stakeholders with the goal of ensuring safe, secure, and quality use of shared data. METHOD: A narrative review of existing research and policy approaches along with expert perspectives drawn from the International Medical Informatics Association (IMIA) Working Group on Technology Assessment and Quality Development in Health Care and the European Federation for Medical Informatics (EFMI) Working Group for Assessment of Health Information Systems. RESULTS: The technological ability to merge, link, re-use, and exchange data has outpaced the establishment of policies, procedures, and processes to monitor the ethics and legality of shared use of data. Questions remain about how to guarantee the security of shared data, and how to establish and maintain public trust across large-scale shared data enterprises. This paper identifies the importance of data governance frameworks (incorporating engagement with all stakeholders) to underpin the management of the ethics and legality of shared data use. The paper also provides some key considerations for the establishment of national approaches and measures to monitor compliance with best practice. CONCLUSION: Data sharing endeavours can help to underpin new collaborative models of health care which provide shared information, engagement, and accountability amongst all stakeholders. We believe that commitment to rigorous evaluation and stakeholder engagement will be critical to delivering health data benefits and the establishment of collaborative models of health care into the future.

Better Usability and Technical Stability Could Lead to Better Work-Related Well-Being among Physicians.

Background and Objective Finnish physicians have been increasingly dissatisfied with poor usability of the electronic patient record (EPR) systems, which they have identified as an overload factor in their work. Our aim is to specify which factors in EPRs are associated with work-related well-being of physicians. Methods A web-based questionnaire was sent to Finnish physicians younger than 65 years; the responses (n = 3,781) represent one-fourth of these. This was a repetition of a survey in 2010, where this questionnaire was used for the first time. In addition to statements assessing usability, there were questions measuring time pressure and job control. The relation between usability and work well-being was investigated with hierarchical multivariate regression analyses: With time pressure and job control as dependent variables, EPR usability assessments and physicians' background information were used as independent variables. Results In the multivariate analyses, technical problems that are often experienced in the EPR were related to higher time pressure and lower job control. Active participation in the development of the EPR system was related to stronger time pressure and stronger job control. In addition, use of several systems daily and the experience of time-consuming documentation of patient information for statistical purposes (billing, national registries, and reporting) were related to higher time pressure, while those with longer experience with the EPR system and those experiencing easy-to-read nursing records reported higher job control. Conclusion To relieve time pressure and increase sense of job control experienced by physicians, usability, integrations, and stability of the EPR systems should be improved: fewer login procedures, easier readability of nursing records, and decreased need for separate documentation for statistical purposes. Physician participation in the EPR development would increase the feeling of job control, but would add the time pressure. Hence, time for developmental work should be arranged.

Finnish physicians' stress related to information systems keeps increasing: a longitudinal three-wave survey study.

BACKGROUND: Poorly functioning, time-consuming, and inadequate information systems are among the most important work-related psychosocial factors causing stress in physicians. The present study examined the trend in the perceived stress that was related to information systems (SRIS) among Finnish physicians during a nine-year follow-up. In addition, we examined the associations of gender, age, employment sector, specialization status, leadership position, on-call burden, and time pressure with SRIS change and levels. METHODS: A longitudinal design with three survey data collection waves (2006, 2010 and 2015) based on a random sample of Finnish physicians in 2006 was used. The study sample included 1095 physicians (62.3% women, mean age 54.4 years) who provided data on SRIS in every wave. GLM repeated measures analyses were used to examine the associations between independent variables and the SRIS trend during the years 2006, 2010, and 2015. RESULTS: SRIS increased during the study period. The estimated marginal mean of SRIS in 2006 was 2.80 (95% CI = 2.68-2.92) and the mean increase was 0.46 (95% CI = 0.30-0.61) points from 2006 to 2010 and 0.25 (95% CI = 0.11-0.39) points from 2010 to 2015. Moreover, our results show that the increase was most pronounced in primary care, whereas in hospitals SRIS did not increase between 2010 and 2015. SRIS increased more among those in a leadership position. On-call duties and high time-pressures were associated with higher SRIS levels during all waves. CONCLUSIONS: Changing, difficult, and poorly functioning information systems (IS) are a prominent source of stress among Finnish physicians and this perceived stress continues to increase. Organizations should implement arrangements to ease stress stemming from IS especially for those with a high workload and on-call or leadership duties. To decrease IS-related stress, it would be important to study in more detail the main IS factors that contribute to SRIS. Earlier studies indicate that the usability and stability of information systems as well as end-user involvement in system development and work-procedure planning may be significant factors.

Literature Review of Patient Record Structures from the Physician's Perspective.

The Finnish Patient Data Repository is a nationwide electronic health record (EHR) system collecting patient data from all healthcare providers. The usefulness of the large amount of data stored in the system depends on the underlying data structures, and thus a solid understanding of these structures is in focus in further development of the data repository. This study seeks to improve that understanding by a systematic literature review. The review takes the physician's perspective to the use and usefulness of the data structures. The articles included in this review study data structures intended to be used in the actual care process. Secondary use and nursing aspects have been covered in separate reviews. After applying the predefined inclusion and exclusion criteria only 40 articles were included in the review. The research on widespread systems in everyday use was especially scarce, most studies concentrated on narrow fields. Majority of these studies were primarily developed for specialist use in secondary care units. Most structures or applications studied were at an early stage of development. In many applications the use of structured data was found to improve the completeness of the documented data and facilitate its automated use. However, there seem to be some applications where narrative text cannot be easily replaced by structured data. Usability results regarding structured representation were conflicting. The scattered nature and paucity of research hinders the generalizability of the findings, and from the system design or implementation point of view the practical value of the scientific literature reviewed is limited.

Usability problems do not heal by themselves: National survey on physicians' experiences with EHRs in Finland.

PURPOSE: Survey studies of health information systems use tend to focus on availability of functionalities, adoption and intensity of use. Usability surveys have not been systematically conducted by any healthcare professional groups on a national scale on a repeated basis. This paper presents results from two cross-sectional surveys of physicians' experiences with the usability of currently used EHR systems in Finland. The research questions were: To what extent has the overall situation improved between 2010 and 2014? What differences are there between healthcare sectors? METHODS: In the spring of 2014, a survey was conducted in Finland using a questionnaire that measures usability and respondents' user experiences with electronic health record (EHR) systems. The survey was targeted to physicians who were actively doing clinical work. Twenty-four usability-related statements, that were identical in 2010 and 2014, were analysed from the survey. The respondents were also asked to give an overall rating of the EHR system they used. The study data comprised responses from 3081 physicians from the year 2014 and from 3223 physicians in the year 2010, who were using the nine most commonly used EHR system brands in Finland. RESULTS: Physicians' assessments of the usability of their EHR system remain as critical as they were in 2010. On a scale from 1 ('fail') to 7 ('excellent') the average of overall ratings of their principally used EHR systems varied from 3.2 to 4.4 in 2014 (and in 2010 from 2.5 to 4.3). The results show some improvements in the following EHR functionalities and characteristics: summary view of patient's health status, prevention of errors associated with medication ordering, patient's medication list as well as support for collaboration and information exchange between the physician and the nurses. Even so, support for cross-organizational collaboration between physicians and for physician-patient collaboration were still considered inadequate. Satisfaction with technical features had not improved in four years. The results show marked differences between the EHR system brands as well as between healthcare sectors (private sector, public hospitals, primary healthcare). Compared to responses from the public sector, physicians working in the private sector were more satisfied with their EHR systems with regards to statements about user interface characteristics and support for routine tasks. Overall, the study findings are similar to our previous study conducted in 2010. CONCLUSIONS: Surveys about the usability of EHR systems are needed to monitor their development at regional and national levels. To our knowledge, this study is the first national eHealth observatory questionnaire that focuses on usability and is used to monitor the long-term development of EHRs. The results do not show notable improvements in physician's ratings for their EHRs between the years 2010 and 2014 in Finland. Instead, the results indicate the existence of serious problems and deficiencies which considerably hinder the efficiency of EHR use and physician's routine work. The survey results call for considerable amount of development work in order to achieve the expected benefits of EHR systems and to avoid technology-induced errors which may endanger patient safety. The findings of repeated surveys can be used to inform healthcare providers, decision makers and politicians about the current state of EHR usability and differences between brands as well as for improvements of EHR usability. This survey will be repeated in 2017 and there is a plan to include other healthcare professional groups in future surveys.

Impacts of structuring the electronic health record: Results of a systematic literature review from the perspective of secondary use of patient data.

PURPOSE: To explore the impacts that structuring of electronic health records (EHRs) has had from the perspective of secondary use of patient data as reflected in currently published literature. This paper presents the results of a systematic literature review aimed at answering the following questions; (1) what are the common methods of structuring patient data to serve secondary use purposes; (2) what are the common methods of evaluating patient data structuring in the secondary use context, and (3) what impacts or outcomes of EHR structuring have been reported from the secondary use perspective. METHODS: The reported study forms part of a wider systematic literature review on the impacts of EHR structuring methods and evaluations of their impact. The review was based on a 12-step systematic review protocol adapted from the Cochrane methodology. Original articles included in the study were divided into three groups for analysis and reporting based on their use focus: nursing documentation, medical use and secondary use (presented in this paper). The analysis from the perspective of secondary use of data includes 85 original articles from 1975 to 2010 retrieved from 15 bibliographic databases. RESULTS: The implementation of structured EHRs can be roughly divided into applications for documenting patient data at the point of care and application for retrieval of patient data (post hoc structuring). Two thirds of the secondary use articles concern EHR structuring methods which were still under development or in the testing phase. METHODS: of structuring patient data such as codes, terminologies, reference information models, forms or templates and documentation standards were usually applied in combination. Most of the identified benefits of utilizing structured EHR data for secondary use purposes concentrated on information content and quality or on technical quality and reliability, particularly in the case of Natural Language Processing (NLP) studies. A few individual articles evaluated impacts on care processes, productivity and costs, patient safety, care quality or other health impacts. In most articles these endpoints were usually discussed as goals of secondary use and less as evidence-supported impacts, resulting from the use of structured EHR data for secondary purposes. CONCLUSIONS: Further studies and more sound evaluation methods are needed for evidence on how EHRs are utilized for secondary purposes, and how structured documentation methods can serve different users' needs, e.g. administration, statistics and research and development, in parallel to medical use purposes.

International health IT benchmarking: learning from cross-country comparisons.

OBJECTIVE: To pilot benchmark measures of health information and communication technology (ICT) availability and use to facilitate cross-country learning. MATERIALS AND METHODS: A prior Organization for Economic Cooperation and Development-led effort involving 30 countries selected and defined functionality-based measures for availability and use of electronic health records, health information exchange, personal health records, and telehealth. In this pilot, an Organization for Economic Cooperation and Development Working Group compiled results for 38 countries for a subset of measures with broad coverage using new and/or adapted country-specific or multinational surveys and other sources from 2012 to 2015. We also synthesized country learnings to inform future benchmarking. RESULTS: While electronic records are widely used to store and manage patient information at the point of care-all but 2 pilot countries reported use by at least half of primary care physicians; many had rates above 75%-patient information exchange across organizations/settings is less common. Large variations in the availability and use of telehealth and personal health records also exist. DISCUSSION: Pilot participation demonstrated interest in cross-national benchmarking. Using the most comparable measures available to date, it showed substantial diversity in health ICT availability and use in all domains. The project also identified methodological considerations (e.g., structural and health systems issues that can affect measurement) important for future comparisons. CONCLUSION: While health policies and priorities differ, many nations aim to increase access, quality, and/or efficiency of care through effective ICT use. By identifying variations and describing key contextual factors, benchmarking offers the potential to facilitate cross-national learning and accelerate the progress of individual countries.