Process evaluation of physical activity counselling with and without the use of mobile technology: A mixed methods study.

BACKGROUND: A monitoring-and-feedback tool was developed to stimulate physical activity by giving feedback on physical activity performance to patients and practice nurses. The tool consists of an activity monitor (accelerometer), wirelessly connected to a Smartphone and a web application. Use of this tool is combined with a behaviour change counselling protocol (the Self-management Support Programme) based on the Five A's model (Assess-Advise-Agree-Assist-Arrange). OBJECTIVES: To examine the reach, implementation and satisfaction with the counselling protocol and the tool. DESIGN: A process evaluation was conducted in two intervention groups of a three-armed cluster randomised controlled trial, in which the counselling protocol was evaluated with (group 1, n=65) and without (group 2, n=66) the use of the tool using a mixed methods design. SETTINGS: Sixteen family practices in the South of the Netherlands. PARTICIPANTS: Practice nurses (n=20) and their associated physically inactive patients (n=131), diagnosed with Chronic Obstructive Pulmonary Disease or Type 2 Diabetes, aged between 40 and 70 years old, and having access to a computer with an Internet connection. METHODS: Semi structured interviews about the receipt of the intervention were conducted with the nurses and log files were kept regarding the consultations. After the intervention, questionnaires were presented to patients and nurses regarding compliance to and satisfaction with the interventions. Functioning and use of the tool were also evaluated by system and helpdesk logging. RESULTS: Eighty-six percent of patients (group 1: n=57 and group 2: n=56) and 90% of nurses (group 1: n=10 and group 2: n=9) responded to the questionnaires. The execution of the Self-management Support Programme was adequate; in 83% (group 1: n=52, group 2: n=57) of the patients, the number and planning of the consultations were carried out as intended. Eighty-eight percent (n=50) of the patients in group 1 used the tool until the end of the intervention period. Technical problems occurred in 58% (n=33). Participants from group 1 were significantly more positive: patients: χ(2)(2, N=113)=11.17, p=0.004, and nurses: χ(2)(2, N=19)=6.37, p=0.040. Use of the tool led to greater awareness of the importance of physical activity, more discipline in carrying it out and more enjoyment. CONCLUSIONS: The interventions were adequately executed and received as planned. Patients from both groups appreciated the focus on physical activity and personal attention given by the nurse. The most appreciated aspect of the combined intervention was the tool, although technical problems frequently occurred. Patients with the tool estimated more improvement of physical activity than patients without the tool.

Technology combined with a counseling protocol to stimulate physical activity of chronically ill patients in primary care.

An iterative user-centered design method was used to develop and test mobile technology (the It's LiFe! tool/monitor) embedded in primary care, followed by a three months feasibility study with 20 patients and three nurses. The tool consists of an accelerometer that transfers data to an app on a Smartphone, which is subsequently connected to a server. Physical activity levels are measured in minutes per day compared to pre-set activity goals, which are set by patients in dialogue with nurses. Nurses can monitor patients' physical activity via a secured website. The counseling protocol is based on the Five A's model and consists of a limited number of behavior change consultations intertwined with interaction with and responses from the tool. The technology supports nurses when performing physical activity counseling. Provided that no connectivity problems occur, the It's LiFe! intervention is feasible, and its longitudinal effects will be tested in a cluster RCT.

The role of social media for patients and consumer health. Contribution of the IMIA Consumer Health Informatics Working Group.

OBJECTIVES: : To provide an overview on social media for consumers and patients in areas of health behaviours and outcomes. METHODS: A directed review of recent literature. RESULTS: : We discuss the limitations and challenges of social media, ranging from social network sites (SNSs), computer games, mobile applications, to online videos. An overview of current users of social media (Generation Y), and potential users (such as low socioeconomic status and the chronically ill populations) is also presented. Future directions in social media research are also discussed. CONCLUSIONS: : We encourage the health informatics community to consider the socioeconomic class, age, culture, and literacy level of their populations, and select an appropriate medium and platform when designing social networked interventions for health. Little is known about the impact of second-hand experiences faciliated by social media, nor the quality and safety of social networks on health. Methodologies and theories from human computer interaction, human factors engineering and psychology may help guide the challenges in designing and evaluating social networked interventions for health. Further, by analysing how people search and navigate social media for health purposes, infodemiology and infoveillance are promising areas of research that should provide valuable insights on present and emergening health behaviours on a population scale.

From clinical practice guidelines to computer-interpretable guidelines. A literature overview.

BACKGROUND: Guidelines are among us for over 30 years. Initially they were used as algorithmic protocols by nurses and other ancillary personnel. Many physicians regarded the use of guidelines as cookbook medicine. However, quality and patient safety issues have changed the attitude towards guidelines. Implementing formalized guidelines in a decision support system with an interface to an electronic patient record (EPR) makes the application of guidelines more personal and therefore acceptable at the moment of care. OBJECTIVE: To obtain, via a literature review, an insight into factors that influence the design and implementation of guidelines. METHODS: An extensive search of the scientific literature in PubMed was carried out with a focus on guideline characteristics, guideline development and implementation, and guideline dissemination. RESULTS: We present studies that enable us to explain the characteristics of high-quality guidelines, and new advanced methods for guideline formalization, computerization, and implementation. We show how the guidelines affect processes of care and the patient outcome. We discuss the reasons of low guideline adherence as presented in the literature and comment upon them. CONCLUSIONS: Developing high-quality guidelines requires a skilled team of people and sufficient budget. The guidelines should give personalized advice. Computer-interpretable guidelines (CIGs) that have access to the patient's EPR are able to give personal advice. Because of the costs, sharing of CIGs is a critical requirement for guideline development, dissemination, and implementation. Until now this is hardly possible, because of the many models in use. However, some solutions have been proposed. For instance, a standardized terminology should be imposed so that the terms in guidelines can be matched with terms in an EPR. Also, a dissemination model for easy updating of guidelines should be established. The recommendations should be based on evidence instead of on consensus. To test the quality of the guideline, appraisal instruments should be used to assess the guideline as a whole, as well as checking the quality of the recommendations individually. Only in this way optimal guideline advice can be given on an individual basis at a reasonable cost.

Three-Layer Model for the design of a Protocol Support System.

OBJECTIVE: The aim of the PropeR project is to investigate the impact of Active Computerized Protocol Support (ACPS) on daily care processes in different settings (home care and hospital care). ACPS consists of an active Protocol Support System (PSS) that is linked to an Electronic Patient Record system. The aim of this paper is to describe how we have taken the organizational and social aspects into account in the hospital setting and the consequences of this approach for the design of the PSS. METHODS: Socio-technical approaches have been applied. Observations and interviews with various health care providers were performed at the hematology and oncology department of the University Hospital Maastricht. Ten extensive sessions with a specialist physician and research nurse took place to further elaborate a study protocol and to discuss how it is integrated in daily practice. The knowledge editor component of Gaston was used to build a computer interpretable version of the selected protocol. RESULTS AND CONCLUSIONS: To support the representation of a study protocol integrated in routine clinical care, a Three-Layer Model was developed. This model distinguishes the protocol description, local adaptations to the protocol and communication as three separate layers. These layers have been incorporated into the knowledge acquisition tool Gaston. The Three-Layer Model makes easy updating possible, and also supports transferability of computerized (study) protocols to other organizations.

Two patient care information systems in the same hospital: beyond technical aspects.

OBJECTIVES: To compare two clinical workstations in one hospital with respect to technical, organizational, cultural and human factors. One clinical workstation was a GUI to the HIS. The other was an electronic patient record for stroke. METHODS: Data were collected by means of in-depth interviews with end-users of both clinical workstations. The interviews were audio taped and transcribed for analysis. RESULTS: End users assessed both clinical workstations as user friendly. Coordination between health care workers was perceived to be enhanced. However, in both situations poor communication between management, implementers and users resulted in uncertainty and skepticism about future perspectives. Further-more, it appeared that inpatient and outpatient settings needed clinical workstations with different requirements for an optimal fit between work practices and information system. CONCLUSIONS: Regardless of the domain and content of a workstation, it can support coordination between disciplines. The communication concerning the information technology strategy deserves much attention. Finally, the requirements for inpatient and outpatient workstations differ.

A generic model of clinical practice.

OBJECTIVES: Many shared-care projects feel the need for electronic patient-record (EPR) systems. In absence of practical experiences from paper record keeping, a theoretical model is the only reference for the design of these systems. In this article, we review existing models of individual clinical practice and integrate their useful elements. We then present a generic model of clinical practice that is applicable to both individual and collaborative clinical practice. METHODS: We followed the principles of the conversation-for-action theory and the DEMO method. According to these principles, information can only be generated by a conversation between two actors. An actor is a role that can be played by one or more human subjects, so the model does not distinguish between inter-individual and intra-individual conversations. RESULTS: Clinical practice has been divided into four actors: service provider, problem solver, coordinator, and worker. Each actor represents a level of clinical responsibility. Any information in the patient record is the result of a conversation between two of these actors. Connecting different conversations to one another can create a process view with meta-information about the rationale of clinical practice. Such process view can be implemented as an extension to the EPR. CONCLUSIONS: The model has the potential to cover all professional activities, but needs to be further validated. The model can serve as a theoretical basis for the design of EPR-systems for shared care, but a successful EPR-system needs more than just a theoretical model.

Determinants of success of inpatient clinical information systems: a literature review.

We reviewed the English and Dutch literature on evaluations of patient care information systems that require data entry by health care professionals published from 1991 to 2001. Our objectives were to identify attributes that were used to assess the success of such systems and to test the ability of a framework developed by Delone and McLean for management information systems(1) to categorize these attributes correctly. The framework includes six dimensions or success factors: system quality, information quality, usage, user satisfaction, individual impact, and organizational impact. Thirty-three papers were selected for complete review. Types of study design included descriptive, correlational, comparative, and case studies. A variety of relevant attributes could be assigned to the six dimensions in the Delone and McLean framework, but some attributes, predominantly in cases of failure, did not fit any of the categories. They related to contingent factors, such as organizational culture. Our review points out the need for more thorough evaluations of patient care information systems that look at a wide range of factors that can affect the relative success or failure of these systems.

An architecture for a virtual electronic health record.

The Healthcare Domain Taskforce of the Object Management Group has specified standards for secure access and retrieval of demographic and medical data. This paper discusses the strengths and weaknesses of an electronic healthcare record that implements these specifications.

Development and implementation of an EPR: how to encourage the user.

This paper reports on the role users played in the design and development of an electronic patient record. Two key users participated in the project team. All future users received questionnaires and a selection of them was interviewed. Before starting the development of the EPR, the attitude of users towards electronic record keeping, their satisfaction with the paper clinical records, their knowledge of computers, and their needs and expectations of computer applications in health care were measured by means of a questionnaire. The results of the questionnaire were supplemented with in-depth interviews. Users had a neutral attitude towards electronic record keeping. They were more positive about data entry of the paper records than data retrieval. During the development phase, but prior to the implementation of the EPR, a second questionnaire measured satisfaction with the paper records. Satisfaction appeared to be related to self-rated computer experience. Inexperienced computer users tended to be more positive about the paper records. In general, respondents did not have many expectations about electronic record keeping. A second series of interviews zoomed in on the expectations users had. Except for more concise reporting no beneficial effects of electronic record keeping were expected.

An experimental electronic patient record for stroke patients. Part 1: situation analysis.

In this article the paper record and its position in work practices is discussed, and is related to the situation at an inpatient clinic for which an electronic patient record (EPR) is in development. In addition reported research on innovations is discussed. An analysis of 42 clinical paper records gave insight into existing problems with paper records. The current work practices were analysed based on two periods of observations in the ward and eight in-depth interviews with questions about their daily work, communication in the ward and the role of the paper record in communication. The results indicate that several problems described in the literature were recognised only for a part of the medical and nursing records. One probable cause of insufficient communication between health care workers appeared to be the internal organisation of the paper records. The fact that the experimental EPR system will be small-scaled, introduces specific problems regarding communication with other departments that still work with paper records. Nevertheless, we conclude that also an electronic patient record designed for a specific setting has the potential to improve record keeping and communication between health care workers.

An experimental electronic patient record for stroke patients. Part 2: system description.

This article presents an electronic patient record (EPR) for stroke patients. At the neurology department of the Maastricht University Hospital, coordination and communication of the multidisciplinary team for stroke patients is intended to be supported by an EPR. Existing, structured, paper nursing and medical records served as a starting point for the development of the EPR. In close cooperation with future users, the database structure, and data entry and data retrieval aspects of the user interface were adapted to the domain of stroke. The result is a combined electronic medical and nursing record that has potential to improve record keeping and to truly support daily routines. The challenges encountered in the development process were maintaining continuous user involvement and conflicting points of view regarding the relevance of clinical data. Conclusively, we state that intensive user participation improved the EPR, coupling with the existing hospital information system and other systems will be advantageous and the fact that the paper records were structured in advance will smooth the unavoidable changes in work patterns.

The user in the design process of an EPR.

To optimise the development and implementation process of an electronic patient record, attitudes toward computers in health care and satisfaction with paper records of nurses and physicians of a department in an academic hospital were determined. For this purpose participants received two questionnaires. These results were supplemented with eight semi-structured in-depth interviews. Users who considered themselves as experienced computer users had more positive attitudes. Inexperienced users were more satisfied with the nursing paper record, while no significant differences existed for the paper medical record.

Consultation of medical narratives in the electronic medical record.

This article presents an overview of a research project concerning the consultation of medical narratives in the electronic medical record (EMR). It describes an analysis of user needs, the design and implementation of a prototype EMR system, and the evaluation of the ease of consultation of medical narratives when using this system. In a questionnaire survey, 85 hospital physicians judged the quality of their paper-based medical record with respect to data entry, information retrieval and some other aspects. Participants were more positive about the paper medical record than the literature suggests. They wished to maintain the flexibility of data entry but indicated the need to improve the retrieval of information. A prototype EMR system was developed to facilitate the consultation of medical narratives. These parts were divided into labeled segments that could be arranged source-oriented and problem-oriented. This system was used to evaluate the ease of information retrieval of 24 internists and 12 residents at a teaching hospital when using free-text medical narratives divided at different levels of detail. They solved, without time pressure, some predefined problems concerning three voluminous, inpatient case records. The participants were randomly allocated to a sequence that was balanced by patient case and learning effect. The division of medical narratives affected speed, but not completeness of information retrieval. Progress notes divided into problem-related segments could be consulted 22% faster than when undivided. Medical history and physical examination divided into segments at organ-system level could be consulted 13% faster than when divided into separate questions and observations. These differences were statistically significant. The fastest divisions were also appreciated as the best combination of easy searching and best insight in the patient case. The results of our evaluation study suggest a trade-off between searching and reading: too much detailed segments will delay the consultation of medical narratives. Validation of the results in daily practice is recommended.

An experimental electronic patient record for stroke patients.

This contribution describes an electronic patient record for stroke patients at the neurology ward of the Maastricht University Hospital. Daily practice at the ward will be supported with the developed electronic patient record that integrates both the medical and the nursing record, that will provide decision support and it will be connected to the hospital information system. In an evaluation project we will study the effects of the usage of the electronic patient record and additional effects of providing decision support.

The granularity of medical narratives and its effect on the speed and completeness of information retrieval.

OBJECTIVE: Using electronic rather than paper-based record systems improves clinicians' information retrieval from patient narratives. However, few studies address how data should be organized for this purpose. Information retrieval from clinical narratives containing free text involves two steps: searching for a labeled segment and reading its content. The authors hypothesized that physicians can retrieve information better when clinical narratives are divided into many small, labeled segments ("high granularity"). DESIGN: The study tested the ability of 24 internists and 12 residents at a teaching hospital to retrieve information from an electronic medical record--in terms of speed and completeness--when using different granularities of clinical narratives. Participants solved, without time pressure, predefined problems concerning three voluminous, inpatient case records. To mitigate confounding factors, participants were randomly allocated to a sequence that was balanced by patient case and learning effect. RESULTS: Compared with retrieval from undivided notes, information retrieval from problem-partitioned notes was 22 percent faster (statistically significant), whereas retrieval from notes divided into organ systems was only 11 percent faster (not statistically significant). Subdividing segments beyond organ systems was 13 percent slower (statistically significant) than not subdividing. Granularity of medical narratives affected the speed but not the completeness of information retrieval. CONCLUSION: Dividing voluminous free-text clinical narratives into labeled segments makes patient-related information retrieval easier. However, too much subdivision slows retrieval. Study results suggest that a coarser granularity is required for optimal information retrieval than for structured data entry. Validation of these conclusions in real-life clinical practice is recommended.

Combining a scientific approach and prototyping in the design of EHCR systems.

In this paper, it is emphasized that electronic medical record systems cannot totally be developed in the traditional way. The underlying process of how physicians or nurses are searching for information is not fully understood. Therefore, a method that combines a scientific approach and prototyping is advocated. With the help of this advocated approach, these questions could be answered in a way that was also scientifically sound. In this contribution, two examples of the use of this method are presented. One concerns the determination of the optimum granularity of the narrative parts of the electronic healthcare record (EHCR) and the other concerns the use and impact of stand-alone protocol systems.

User needs and demands of a computer-based patient record.

Prior to the implementation of a computer-based patient record, it is necessary to outline the requirements of the medical personnel. The paper is an account of a survey on information needs and demands on computer-based patient records. The study was conducted among physicians, nursing staff and therapists in two Dutch hospitals. In order to conduct the study, a measuring-instrument in form of a questionnaire was developed. Based on the results, it may be concluded, that health service staff does not only require improved input- and consultation uses with regard to the hard copy, but is also in need of additional functions. The developed measuring instrument appeared to be a proficient aid in outlining the information needs and demands of the health service staff. Through the developed questionnaire, the staff was able to obtain an idea of the possibilities of the computer-based patient record and state their own interest in same.

Medical narratives in electronic medical records.

In this article, we describe the state of the art and directions of current development and research with respect to the inclusion of medical narratives in electronic medical-record systems. We used information about 20 electronic medical-record systems as presented in the literature. We divided these systems into 'classical' systems that matured before 1990 and are now used in a broad range of medical domains, and 'experimental' systems, more recently developed and, in general, more innovative. In the literature, three major challenges were addressed: facilitation of direct data entry, achieving unambiguous understandability of data, and improvement of data presentation. Promising approaches to tackle the first and second challenge are the use of dynamic data-entry forms that anticipate sensible input, and free-text data entry followed by natural-language interpretation. Both these approaches require a highly expressive medical terminology. How to facilitate the access to medical narratives has not been studied much. We found facilitating examples of presenting this information as fluent prose, of optimising the screen design with fixed position cues, and of imposing medical narratives with a structure of indexable paragraphs that can be used in flowsheets. We conclude that further study is needed to develop an optimal searching structure for medical narratives.

An experimental electronic medical-record system with multiple views on medical narratives.

In this article we describe a prototype electronic medical-record system that has been developed specifically to facilitate searching through medical narratives, as part of a preparatory study to the development of a medical workstation. This system contains a searching structure in which several views on the medical data are combined. We describe the structure of the database and the user-interface. A second design goal was to prepare the system for conducting research with respect to the use of the medical record. We address the kind of test designs the system can support and describe the research module that was implemented. We also describe a study we conducted with the system and report part of its results. We discuss the significance of this medical-record system compared to systems in the literature, some technical and functional problems encountered, and our future plans with the system.