Understanding Unintended Consequences and Health Information Technology:. Contribution from the IMIA Organizational and Social Issues Working Group.

OBJECTIVE: No framework exists to identify and study unintended consequences (UICs) with a focus on organizational and social issues (OSIs). To address this shortcoming, we conducted a literature review to develop a framework for considering UICs and health information technology (HIT) from the perspective of OSIs. METHODS: A literature review was conducted for the period 2000- 2015 using the search terms "unintended consequences" and "health information technology". 67 papers were screened, of which 18 met inclusion criteria. Data extraction was focused on the types of technologies studied, types of UICs identified, and methods of data collection and analysis used. A thematic analysis was used to identify themes related to UICs. RESULTS: We identified two overarching themes. One was the definition and terminology of how people classify and discuss UICs. Second was OSIs and UICs. For the OSI theme, we also identified four sub-themes: process change and evolution, individual-collaborative interchange, context of use, and approaches to model, study, and understand UICs. CONCLUSIONS: While there is a wide body of research on UICs, there is a lack of overall consensus on how they should be classified and reported, limiting our ability to understand the implications of UICs and how to manage them. More mixed-methods research and better proactive identification of UICs remain priorities. Our findings and framework of OSI considerations for studying UICs and HIT extend existing work on HIT and UICs by focusing on organizational and social issues.

Big Data in Healthcare - Defining the Digital Persona through User Contexts from the Micro to the Macro. Contribution of the IMIA Organizational and Social Issues WG.

OBJECTIVES: While big data offers enormous potential for improving healthcare delivery, many of the existing claims concerning big data in healthcare are based on anecdotal reports and theoretical vision papers, rather than scientific evidence based on empirical research. Historically, the implementation of health information technology has resulted in unintended consequences at the individual, organizational and social levels, but these unintended consequences of collecting data have remained unaddressed in the literature on big data. The objective of this paper is to provide insights into big data from the perspective of people, social and organizational considerations. METHOD: We draw upon the concept of persona to define the digital persona as the intersection of data, tasks and context for different user groups. We then describe how the digital persona can serve as a framework to understanding sociotechnical considerations of big data implementation. We then discuss the digital persona in the context of micro, meso and macro user groups across the 3 Vs of big data. RESULTS: We provide insights into the potential benefits and challenges of applying big data approaches to healthcare as well as how to position these approaches to achieve health system objectives such as patient safety or patient-engaged care delivery. We also provide a framework for defining the digital persona at a micro, meso and macro level to help understand the user contexts of big data solutions. CONCLUSION: While big data provides great potential for improving healthcare delivery, it is essential that we consider the individual, social and organizational contexts of data use when implementing big data solutions.

From Usability Testing to Clinical Simulations: Bringing Context into the Design and Evaluation of Usable and Safe Health Information Technologies. Contribution of the IMIA Human Factors Engineering for Healthcare Informatics Working Group.

OBJECTIVES: The objective of this paper is to explore human factors approaches to understanding the use of health information technology (HIT) by extending usability engineering approaches to include analysis of the impact of clinical context through use of clinical simulations. METHODS: Methods discussed are considered on a continuum from traditional laboratory-based usability testing to clinical simulations. Clinical simulations can be conducted in a simulation laboratory and they can also be conducted in real-world settings. The clinical simulation approach attempts to bring the dimension of clinical context into stronger focus. This involves testing of systems with representative users doing representative tasks, in representative settings/environments. RESULTS: Application of methods where realistic clinical scenarios are used to drive the study of users interacting with systems under realistic conditions and settings can lead to identification of problems and issues with systems that may not be detected using traditional usability engineering methods. In conducting such studies, careful consideration is needed in creating ecologically valid test scenarios. The evidence obtained from such evaluation can be used to improve both the usability and safety of HIT. In addition, recent work has shown that clinical simulations, in particular those conducted in-situ, can lead to considerable benefits when compared to the costs of running such studies. CONCLUSION: In order to bring context of use into the testing of HIT, clinical simulation, involving observing representative users carrying out tasks in representative settings, holds considerable promise.

eHealth in North America.

OBJECTIVE: The overall objective of this paper is to provide an overview of the current status of electronic health record (EHR) adoption and implementation in Canada and the United States. METHODS: A review and synthesis of the empirical and grey literature about adoption of electronic health records in Canada and the United States was undertaken. RESULTS: Both Canada and the United States have experienced increases in their adoption rates. More specifically, 2012 adoption statistics reveal that the electronic medical record adoption rate in the United States is 69% and in Canada it is 57%. Significant investment by both governments has increased adoption of electronic records across North America. CONCLUSIONS: In the United States and Canada there has been a significant rise in the adoption of electronic records by health professionals with the aid of national government incentive programs.

Empowering Patients: Making Health Information and Systems Safer for Patients and the Public. Contribution of the IMIA Health Informatics for Patient Safety Working Group.

OBJECTIVES: The objectives of this paper are to explore issues and perspectives from four regions of the world where health information systems are contributing to patient empowerment and influencing patient safety. METHODS: Members of the IMIA Working Group for Health Information Systems Safety came together to explore global issues at the intersection of health information systems safety, patient empowerment and patient safety. The group carried out a review and synthesis of the empirical and grey literature in four different regions/countries of the world that have differing health information system safety priorities. RESULTS: Regions/countries from differing parts of the world are developing: (1) high quality, safe information for individuals to use in their health related decision making, (2) patient portals and testing them for their safety, (3) methods for identifying unsafe health information system features and functions, and (4) ways of engaging citizens in identifying unsafe features and functions of health information systems. CONCLUSIONS: Internationally, there has been a rise in the number of health information systems and technologies that are being developed to support patient care. The amount of health information available on the World Wide Web (WWW), and the use of mobile phone software to support consumer health behaviours and self-management of chronic illnesses has also grown. The use of some of these health information systems and technologies has helped citizens to improve their health status (e.g. patient portals, mobile phones). However, the safety of these systems and technologies has come into question. As a result, there is a need to refine these systems and ensure their safety when they are used by patients and their families.

Technology-induced errors. The current use of frameworks and models from the biomedical and life sciences literatures.

OBJECTIVE: The objective of this paper is to examine the extent, range and scope to which frameworks, models and theories dealing with technology-induced error have arisen in the biomedical and life sciences literature as indexed by Medline®. METHODS: To better understand the state of work in the area of technology-induced error involving frameworks, models and theories, the authors conducted a search of Medline® using selected key words identified from seminal articles in this research area. Articles were reviewed and those pertaining to frameworks, models or theories dealing with technology-induced error were further reviewed by two researchers. RESULTS: All articles from Medline® from its inception to April of 2011 were searched using the above outlined strategy. 239 citations were returned. Each of the abstracts for the 239 citations were reviewed by two researchers. Eleven articles met the criteria based on abstract review. These 11 articles were downloaded for further in-depth review. The majority of the articles obtained describe frameworks and models with reference to theories developed in other literatures outside of healthcare. The papers were grouped into several areas. It was found that articles drew mainly from three literatures: 1) the human factors literature (including human-computer interaction and cognition), 2) the organizational behavior/sociotechnical literature, and 3) the software engineering literature. CONCLUSIONS: A variety of frameworks and models were found in the biomedical and life sciences literatures. These frameworks and models drew upon and extended frameworks, models and theoretical perspectives that have emerged in other literatures. These frameworks and models are informing an emerging line of research in health and biomedical informatics involving technology-induced errors in healthcare.

Towards an integrative cognitive-socio-technical approach in health informatics: analyzing technology-induced error involving health information systems to improve patient safety.

The purpose of this paper is to argue for an integration of cognitive and socio-technical approaches to assessing the impact of health information systems. Historically, health informatics research has examined the cognitive and socio-technical aspects of health information systems separately. In this paper we argue that evaluations of health information systems should consider aspects related to cognition as well as socio-technical aspects including impact on workflow (i.e. an integrated view). Using examples from the study of technology-induced error in healthcare, we argue for the use of simulations to evaluate the cognitive-socio-technical impacts of health information technology [36]. Implications of clinical simulations and analysis of cognitive-social-technical impacts are discussed within the context of the system development life cycle to improve health information system design, implementation and evaluation.

Application of the Apriori algorithm for adverse drug reaction detection.

The objective of this research is to assess the suitability of the Apriori association analysis algorithm for the detection of adverse drug reactions (ADR) in health care data. The Apriori algorithm is used to perform association analysis on the characteristics of patients, the drugs they are taking, their primary diagnosis, co-morbid conditions, and the ADRs or adverse events (AE) they experience. This analysis produces association rules that indicate what combinations of medications and patient characteristics lead to ADRs. A simple data set is used to demonstrate the feasibility and effectiveness of the algorithm.

A framework for diagnosing and identifying where technology-induced errors come from.

Health information systems have the ability to reduce medical errors but they can also introduce new types of errors. In the cognitive and human factors literature there is a recognition that many of the high profile accidents that have occurred in other industries outside of healthcare have had their origins in the complexities of organizational work and how work is structured. The authors propose that in order to have a fully robust framework for diagnosing technology-induced errors one must understand the development and implementation of a technology and the influences of policy using a multi-organizational model. The authors propose that technology-induced errors may have their origins in up to four or more organizational structures that make up complex health care systems in addition to the health care provider: governments, model organizations, software development organizations, and local healthcare organizations. In this paper a framework for considering the origins of technology-induced error in healthcare is presented, along with our experiences to date in the application of the framework.

Does a hybrid electronic-paper environment impact on health professional information seeking?

UNLABELLED: The purpose of this study was to investigate the effects of a hybrid electronic-paper patient record environment upon health professional information seeking (i.e. amount of information accessed, choice of key sources of information, type of information and use of information seeking tactics). A within group, laboratory, experimental study was conducted using two simulation environments (i.e. a paper patient record and a hybrid or electronic-paper environment). Thirty-five novice nurses participated in this within group, laboratory based study. Findings revealed significant differences between the paper and hybrid environments in terms of their effects upon information seeking. SUBJECTS: (1) accessed less data in the hybrid than the paper environment, (2) accessed more non-electronic sources than electronic sources of information in the hybrid environment, and (3) used more passive information seeking tactics in the hybrid than the paper environment. Findings from the cued recall data revealed subjects experienced increased cognitive load in the hybrid environment. Implications for the design of hybrid environments are discussed.

Using a low-cost simulation approach for assessing the impact of a medication administration system on workflow.

This paper describes the analysis of the impact of a medication administration system on clinical workflow. The methodological framework employed was based on in-depth analysis of simulated user interactions with a medication administration system. The approach involved the collection of rich data consisting of audio and video recordings of interactions between 16 subjects (5 nurses and 11 physicians) as they interacted with a medication administration system. Methodological considerations and issues in conducting such studies are discussed. The study indicated that use of the system would have a significant impact on nurse and physician workflow and that this impact could be accurately identified using simulation approaches prior to widespread release of such systems in real clinical environments.