Are We There Yet? Human Factors Knowledge and Health Information Technology - the Challenges of Implementation and Impact.

Objective: To review the developments in human factors (HF) research on the challenges of health information technology (HIT) implementation and impact given the continuing incidence of usability problems and unintended consequences from HIT development and use. Methods: A search of PubMed/Medline and Web of Science® identified HF research published in 2015 and 2016. Electronic health records (EHRs) and patient-centred HIT emerged as significant foci of recent HF research. The authors selected prominent papers highlighting ongoing HF and usability challenges in these areas. This selective rather than systematic review of recent HF research highlights these key challenges and reflects on their implications on the future impact of HF research on HIT. Results: Research provides evidence of continued poor design, implementation, and usability of HIT, as well as technology-induced errors and unintended consequences. The paper highlights support for: (i) strengthening the evidence base on the benefits of HF approaches; (ii) improving knowledge translation in the implementation of HF approaches during HIT design, implementation, and evaluation; (iii) increasing transparency, governance, and enforcement of HF best practices at all stages of the HIT system development life cycle. Discussion and Conclusion: HF and usability approaches are yet to become embedded as integral components of HIT development, implementation, and impact assessment. As HIT becomes ever-more pervasive including with patients as end-users, there is a need to expand our conceptualisation of the problems to be addressed and the suite of tactics and strategies to be used to calibrate our pro-active involvement in its improvement.

Human Factors for More Usable and Safer Health Information Technology: Where Are We Now and Where do We Go from Here?

A wide range of human factors approaches have been developed and adapted to healthcare for detecting and mitigating negative unexpected consequences associated with technology in healthcare (i.e. technology-induced errors). However, greater knowledge and wider dissemination of human factors methods is needed to ensure more usable and safer health information technology (IT) systems. OBJECTIVE: This paper reports on work done by the IMIA Human Factors Working Group and discusses some successful approaches that have been applied in using human factors to mitigate negative unintended consequences of health IT. The paper addresses challenges in bringing human factors approaches into mainstream health IT development. RESULTS: A framework for bringing human factors into the improvement of health IT is described that involves a multi-layered systematic approach to detecting technology-induced errors at all stages of a IT system development life cycle (SDLC). Such an approach has been shown to be needed and can lead to reduced risks associated with the release of health IT systems into live use with mitigation of risks of negative unintended consequences. CONCLUSION: Negative unintended consequences of the introduction of IT into healthcare (i.e. potential for technology-induced errors) continue to be reported. It is concluded that methods and approaches from the human factors and usability engineering literatures need to be more widely applied, both in the vendor community and in local and regional hospital and healthcare settings. This will require greater efforts at dissemination and knowledge translation, as well as greater interaction between the academic and vendor communities.

Human Factors in the Large: Experiences from Denmark, Finland and Canada in Moving Towards Regional and National Evaluations of Health Information System Usability. Contribution of the IMIA Human Factors Working Group.

OBJECTIVES: The objective of this paper is to explore approaches to understanding the usability of health information systems at regional and national levels. METHODS: Several different methods are discussed in case studies from Denmark, Finland and Canada. They range from small scale qualitative studies involving usability testing of systems to larger scale national level questionnaire studies aimed at assessing the use and usability of health information systems by entire groups of health professionals. RESULTS: It was found that regional and national usability studies can complement smaller scale usability studies, and that they are needed in order to understand larger trends regarding system usability. Despite adoption of EHRs, many health professionals rate the usability of the systems as low. A range of usability issues have been noted when data is collected on a large scale through use of widely distributed questionnaires and websites designed to monitor user perceptions of usability. CONCLUSION: As health information systems are deployed on a widespread basis, studies that examine systems used regionally or nationally are required. In addition, collection of large scale data on the usability of specific IT products is needed in order to complement smaller scale studies of specific systems.

A Review and Framework for Categorizing Current Research and Development in Health Related Geographical Information Systems (GIS) Studies.

OBJECTIVES: The application of GIS in health science has increased over the last decade and new innovative application areas have emerged. This study reviews the literature and builds a framework to provide a conceptual overview of the domain, and to promote strategic planning for further research of GIS in health. METHOD: The framework is based on literature from the library databases Scopus and Web of Science. The articles were identified based on keywords and initially selected for further study based on titles and abstracts. A grounded theory-inspired method was applied to categorize the selected articles in main focus areas. Subsequent frequency analysis was performed on the identified articles in areas of infectious and non-infectious diseases and continent of origin. RESULTS: A total of 865 articles were included. Four conceptual domains within GIS in health sciences comprise the framework: spatial analysis of disease, spatial analysis of health service planning, public health, health technologies and tools. Frequency analysis by disease status and location show that malaria and schistosomiasis are the most commonly analyzed infectious diseases where cancer and asthma are the most frequently analyzed non-infectious diseases. Across categories, articles from North America predominate, and in the category of spatial analysis of diseases an equal number of studies concern Asia. CONCLUSION: Spatial analysis of diseases and health service planning are well-established research areas. The development of future technologies and new application areas for GIS and data-gathering technologies such as GPS, smartphones, remote sensing etc. will be nudging the research in GIS and health.

Usability Methods for Ensuring Health Information Technology Safety: Evidence-Based Approaches. Contribution of the IMIA Working Group Health Informatics for Patient Safety.

OBJECTIVES: Issues related to lack of system usability and potential safety hazards continue to be reported in the health information technology (HIT) literature. Usability engineering methods are increasingly used to ensure improved system usability and they are also beginning to be applied more widely for ensuring the safety of HIT applications. These methods are being used in the design and implementation of many HIT systems. In this paper we describe evidence-based approaches to applying usability engineering methods. METHODS: A multi-phased approach to ensuring system usability and safety in healthcare is described. Usability inspection methods are first described including the development of evidence-based safety heuristics for HIT. Laboratory-based usability testing is then conducted under artificial conditions to test if a system has any base level usability problems that need to be corrected. Usability problems that are detected are corrected and then a new phase is initiated where the system is tested under more realistic conditions using clinical simulations. This phase may involve testing the system with simulated patients. Finally, an additional phase may be conducted, involving a naturalistic study of system use under real-world clinical conditions. RESULTS: The methods described have been employed in the analysis of the usability and safety of a wide range of HIT applications, including electronic health record systems, decision support systems and consumer health applications. It has been found that at least usability inspection and usability testing should be applied prior to the widespread release of HIT. However, wherever possible, additional layers of testing involving clinical simulations and a naturalistic evaluation will likely detect usability and safety issues that may not otherwise be detected prior to widespread system release. CONCLUSION: The framework presented in the paper can be applied in order to develop more usable and safer HIT, based on multiple layers of evidence.

From Usability Testing to Clinical Simulations: Bringing Context into the Design and Evaluation of Usable and Safe Health Information Technologies. Contribution of the IMIA Human Factors Engineering for Healthcare Informatics Working Group.

OBJECTIVES: The objective of this paper is to explore human factors approaches to understanding the use of health information technology (HIT) by extending usability engineering approaches to include analysis of the impact of clinical context through use of clinical simulations. METHODS: Methods discussed are considered on a continuum from traditional laboratory-based usability testing to clinical simulations. Clinical simulations can be conducted in a simulation laboratory and they can also be conducted in real-world settings. The clinical simulation approach attempts to bring the dimension of clinical context into stronger focus. This involves testing of systems with representative users doing representative tasks, in representative settings/environments. RESULTS: Application of methods where realistic clinical scenarios are used to drive the study of users interacting with systems under realistic conditions and settings can lead to identification of problems and issues with systems that may not be detected using traditional usability engineering methods. In conducting such studies, careful consideration is needed in creating ecologically valid test scenarios. The evidence obtained from such evaluation can be used to improve both the usability and safety of HIT. In addition, recent work has shown that clinical simulations, in particular those conducted in-situ, can lead to considerable benefits when compared to the costs of running such studies. CONCLUSION: In order to bring context of use into the testing of HIT, clinical simulation, involving observing representative users carrying out tasks in representative settings, holds considerable promise.

Discussion of "Attitude of physicians towards automatic alerting in computerized physician order entry systems".

With these comments on the paper "Attitude of Physicians Towards Automatic Alerting in Computerized Physician Order Entry Systems", written by Martin Jung and co-authors, with Dr. Elske Ammenwerth as senior author [1], the journal wants to stimulate a broad discussion on computerized physician order entry systems. An international group of experts have been invited by the editor of Methods to comment on this paper. Each of the invited commentaries forms one section of this paper.

Empowering Patients: Making Health Information and Systems Safer for Patients and the Public. Contribution of the IMIA Health Informatics for Patient Safety Working Group.

OBJECTIVES: The objectives of this paper are to explore issues and perspectives from four regions of the world where health information systems are contributing to patient empowerment and influencing patient safety. METHODS: Members of the IMIA Working Group for Health Information Systems Safety came together to explore global issues at the intersection of health information systems safety, patient empowerment and patient safety. The group carried out a review and synthesis of the empirical and grey literature in four different regions/countries of the world that have differing health information system safety priorities. RESULTS: Regions/countries from differing parts of the world are developing: (1) high quality, safe information for individuals to use in their health related decision making, (2) patient portals and testing them for their safety, (3) methods for identifying unsafe health information system features and functions, and (4) ways of engaging citizens in identifying unsafe features and functions of health information systems. CONCLUSIONS: Internationally, there has been a rise in the number of health information systems and technologies that are being developed to support patient care. The amount of health information available on the World Wide Web (WWW), and the use of mobile phone software to support consumer health behaviours and self-management of chronic illnesses has also grown. The use of some of these health information systems and technologies has helped citizens to improve their health status (e.g. patient portals, mobile phones). However, the safety of these systems and technologies has come into question. As a result, there is a need to refine these systems and ensure their safety when they are used by patients and their families.

Evaluation of electronic health record systems.

OBJECTIVES: The objective of this article is to present an overview of the various considerations to be made prior to evaluating electronic health record (EHR) systems. METHODS: From the methodological literature, a number of themes for decisions are presented and related to the contemporary EHR situation. Special attention is paid to a number of important methodological themes. RESULTS: Definitive checklists for evaluation of EHR systems can not be recommended, but seven key steps are listed to guide the design of evaluation projects. CONCLUSION: It is concluded that the issues presented are not completely exhausted and the seven key steps might have to include iterative loops because of interdependencies between some of the steps.

Shared experience in 13 local Danish EPR projects: the Danish EPR Observatory.

In 1996 a national strategy for the development of electronic patient records (EPR) for the Danish hospitals and primary care was launched. An element in the strategy was to support a number of regional EPR development projects. The EPR-Observatory has in the two recent years collected data from the regional projects, dealing with the expectations in four areas: 1) Impact on organisational issues, 2) Benefits of EPR, 3) Integration of EPR with other information systems and 4) security aspects of EPR. Among the observations an increasing teamwork and im-proved knowledge about the patient was found. What was expected, but not found, was resistance to EPR, as a result of changes in skills and power. The most obvious benefits are increased data accessibility and improved decision ma-king. The most considerable disadvantage is an enormous growth in discontent with the systems performance and the fact, that all the projects are delayed. Many different types of integration solutions are chosen, because of a lack of a common model for integration. Generally the projects find, that EPJ yields increased security, but logistical problems arise in having the systems running 24 hours 7 days a week. Economical benefits cannot be documented. This relates to the fact, that the regional projects are stand-alone projects. The ongoing growth in discontent with the EPR-systems and the fact, that all the projects are delayed must be subject to further exploration.

Long- or short-limb gastric bypass?

The aim of this study was to determine whether longer limb length improved results of gastric bypass in patients who were morbidly obese (body mass index <50 kg/m(2)) or superobese (body mass index >50 kg/m(2). A total of 242 patients were followed for a mean of 5.5 years. The standard operation was a Roux-en-Y gastric bypass with a 40 cm Roux limb and a 10 cm afferent limb. The long-limb operation had a 100 cm Roux limb and a 100 cm afferent limb. Morbidly obese patients did not benefit from a long-limb bypass. The final body mass index was 28.6 +/- 4.7 kg/m(2) in the short-limb group and 28.5 +/- 3.8 kg/m(2) in the long-limb group. The superobese patients did benefit from a long-limb bypass. Final body mass index was 35.8 +/- 6.7 kg/m(2) in the short-limb patients and 32.7 +/- 5.1 in the long-limb patients (P = 0.049). A subgroup of 20 patients, all of whom had a body mass index greater than 60 kg/m(2), benefited the most from long-limb bypass. No macronutritional side effects unique to the long-limb bypass were encountered.

Research needs and priorities in health informatics.

A Delphi study was accomplished on the topic "what is needed to implement the information society within healthcare? and which research topics should be given higher priority than other topics to achieve the desired evolution?", involving 29 international experts. The study comprised of four phases, (I) a brainstorming phase based on a open question; (II) an evaluation phase for mutual commenting; (III) a feedback phase allowing corrections/extensions; and (IV) a phase collecting the ratings of individual issues within a questionnaire synthesised from the previous phases. A total of 110 research items and 58 supplementary barriers were raised, divided into 14 topics grouped according to homogeneity. The emphasised research topics are business process re-engineering, the electronic patient record and connected inter-operating systems, (support for) evidence-based medicine and clinical guidelines, and education. Issues inherent to the healthcare domain often are the kernel of the research recommended. Similarly, methods and 'people'-issues are strongly emphasised among the research issues in general and among those for which the experts' joint opinion was rated as statistically significant. In contrast, only a minority of the research issues emphasised was related to technical issues.

Globalization and the cultural impact on distance education.

With the delivery of distance (or flexible) learning in today's society, the changing roles of both the teacher and the learner need to be seriously considered. This is particularly relevant with the use of new technologies to deliver courses in locations with entirely different cultural and academic traditions. International education of this kind currently faces difficulties in facilitating cross-cultural learning. While problems of limited communications technologies, lack of teacher training, inadequate competence of university administration and general cultural differences may be known, global changes call for the development of new pedagogies with new communication technologies in ways, which are sensitive to issues of cultural diversity.

Late outcome of isolated gastric bypass.

OBJECTIVE: To complete a long-term (>5 years) follow-up of patients undergoing isolated gastric bypass for severe obesity. SUMMARY BACKGROUND DATA: Previous experience as well as randomized trials suggested that the ideal operation for obesity should rely on manipulation of satiety rather than the production of malabsorption. Such an operation should incorporate a small gastric pouch of less than 30 mL placed in a dependent position on the lesser curvature of the stomach, not dependent on staples, and separated from the remaining stomach with a retrocolic, retrogastric Roux-en-Y gastrojejunostomy without external support. METHODS: The authors established an obesity clinic where patients were seen six times during the first year and semiannually thereafter. Emphasis was placed on defining success in terms of approximation to normal body-mass index. RESULTS: Of 274 patients, 243 (89%) were followed up for 5.5 +/- 1.5 years. Before surgery, the patients were obese (n = 13), morbidly obese (n = 134), or super-obese (n = 96). The obese and morbidly obese group achieved an excellent result, and the super-obese a good result. Individual results showed considerable variation from the mean. CONCLUSIONS: This study of isolated gastric bypass with a 5.5-year follow-up rate of 88.6% revealed a success rate of 93% in obese or morbidly obese patients and 57% in super-obese patients. Isolated gastric bypass compares favorably with biliopancreatic diversion in terms of weight loss, maximum weight loss, weight regain, current body-mass index, and percentage of patients with a body-mass index less than 35 kg/m2.

The Danish EPR Observatory. Assessing organisational impact from EPR implementation.

The EPR Observatory has studied 13 local Danish electronic patient record (EPR) projects through 2 years. The focus has been on expectations and experiences in relation to organisational changes. The main conclusions are that the healthcare professionals, working with the development, implementation and/or use of EPR, are in a very important and difficult process settling up with old traditions and cultures tied to the healthcare professions. Especially the healthcare professionals, working with EPR, shows interest and readiness to participate in new ways of collaboration and to work with highly structured data in structured frameworks. EPR is at this point of time only diffused in few relatively small and isolated healthcare organisations, and the preliminary assessment in the study only outlines the perspectives for what will happen on a wider scale when EPR systems get more diffused.

Technological changes in the healthcare sector. A method to assess change readiness.

This paper describes the theory, method and recent results of a study developing methods for assessment of change readiness. The empirical focus is on development and implementation of clinical IT systems in the Danish healthcare sector. To assess change readiness, a questionnaire has been developed. The questionnaire has been tested in a hospital department as a part of a pre analysis related to development and implementation of an IT quality assurance system. The study shows a general positive attitude to the IT system and the organisational changes, related to the implementation and use of the system. It also supplies the project organisation with specific information, useful to the project organisation to continue the essential dialogue with the healthcare professionals during the change process. Furthermore it provides a useful tool for planning the ongoing developing processes. Several other healthcare organisations are at the moment entering the study.

An architecture for bridging between research and practical use in health informatics.

Health informatics is a true interdisciplinary research discipline combining computer engineering, health science and fields dealing with organisation and communication issues. Much of the research published within the area has a common goal: to develop optimal information systems for better access to relevant data, information, and knowledge in the health care sector. As a respond to existing discontinuity between research and practical use, we present an architecture for an interdisciplinary virtual organisation promoting synergy across health informatics environments including research, industry, clinical, and educational settings. A set of key lessons learned from a practical implementation of the architecture are reported.

Research needs and priorities in health informatics--early results of a Delphi study.

A four-phased Delphi study has been performed on the topic of "research needs and priorities to implement the Information Society within Healthcare". This contribution presents the outcome of the first three phases. The biggest surprises are that 'Telemedicine' is relatively lower ranked than expected, and that 'Business Process Re-engineering' is the highest ranking topic, as judged from the number of issues and barriers raised by the expert panel.

Strategic planning of the master programme in health informatics at Aalborg University: targeting and updating the programme, to meet explicit customer needs.

Education is essentially giving people new skills and qualifications to fulfil certain tasks. In planning and managing educational programmes it is crucial to know what skills and what qualifications are needed to carry out the tasks in question, not to mention the importance of knowing what tasks are relevant to carry out. The programme in health informatics at Aalborg University produces health informatics professionals. The students are developing skills in solving informatics problems in health care organisations. The programme has been running for 3 years now and to maintain the perception of the aim for the programme a number of activities have been launched. In the following, the programme will be presented, the activities to obtain information on how to keep the programme targeted and updated will be described and the changes that are going to be introduced will be outlined.