Usage of digital, social and goal-setting functionalities to support health behavior change: A mixed methods study among disadvantaged women during or after pregnancy and their healthcare professionals.

OBJECTIVE: We aimed to gain insight into how and to what extent social (i.e. private/group chat) and goal-setting (e.g. rewards) functionalities in digital interventions for health behavior change were used by clients and nurses in a preventive care program for disadvantaged women during or after pregnancy, and which factors influenced usage. METHODS: We collected quantitative and qualitative data on usage of these functionalities in 'Kindle', a mHealth intervention to prepare for health behavior change. RESULTS: We found that nurses (n = 5) and clients (n = 20) scarcely used both functionalities. They sent 862 messages in the social functionality whose security they appreciated, but habitually used WhatsApp likewise. Moreover, nurses were hesitant to let their clients interact in the group chat. Clients formulated 59 personal goals, which they found difficult to do. Nurses rewarded 846 points for clients' progress on goal attainment, but found it hard to determine how many points to reward. Clients and nurses indicated that the functionality made it more fun and easy to discuss clients' personal goals. CONCLUSIONS: To conclude, digital, social and goal-setting functionalities were used to a limited extent by nurses and clients, and need optimization before implementation to support disadvantaged groups to change their health behavior.

Serious games for smoking prevention and cessation: A systematic review of game elements and game effects.

OBJECTIVE: Serious health games might have the potential to prevent tobacco smoking and its health consequences, depending on the inclusion of specific game elements. This review aimed to assess the composition of serious games and their effects on smoking initiation prevention and cessation and behavioral determinants. MATERIALS AND METHODS: We systematically searched MEDLINE, Embase, PsycINFO, and Web of Science for publications that evaluated serious games aimed at changing smoking behavior or behavioral determinants. A taxonomy by King et al was used to classify game elements. RESULTS: We identified 15 studies, evaluating 14 unique serious games. All games combined multiple game elements (mean 5.5; range, 3-10). Most frequently used were general and intermittent rewards, theme and genre features, and punishments. Six studies on smoking prevention together assessed 20 determinants and found statistically significant positive effects for 8 determinants (eg, attitude, knowledge, intention). Of 7 studies on smoking cessation, 5 found positive, statistically significant effects on smoking cessation or status. These studies found statistically significant positive effects for 6 of 12 determinants (eg, self-efficacy, attitude, intention). The majority of included studies had poor or fair methodological quality, lacked follow-up measures, and had fixed (as opposed to free, on-demand) play sessions. CONCLUSIONS: Serious games included multiple types of game elements. The evidence from a number of studies suggests that games may have positive effects on smoking-related outcomes, particularly smoking cessation. However, as most studies had important methodological limitations, stronger designs are needed to demonstrate, quantify, and understand the effects of serious games.

A usability study to improve a clinical decision support system for the prescription of antibiotic drugs.

OBJECTIVE: A clinical decision support system (CDSS) for empirical antibiotic treatment has the potential to increase appropriate antibiotic use. Before using such a system on a broad scale, it needs to be tailored to the users preferred way of working. We have developed a CDSS for empirical antibiotic treatment in hospitalized adult patients. Here we determined in a usability study if the developed CDSS needed changes. METHODS: Four prespecified patient cases, based on real life clinical scenarios, were evaluated by 8 medical residents in the study. The "think-aloud" method was used, and sessions were recorded and analyzed afterwards. Usability was assessed by 3 evaluators using an augmented classification scheme, which combines the User Action Framework with severity rating of the usability problems and the assessment of the potential impact of these problems on the final task outcomes. RESULTS: In total 51 usability problems were identified, which could be grouped into 29 different categories. Most (n = 17/29) of the usability problems were cosmetic problems or minor problems. Eighteen (out of 29) of the usability categories could have an ordering error as a result. Classification of the problems showed that some of the problems would get a low priority based on their severity rating, but got a high priority for their impact on the task outcome. This effectively provided information to prioritize system redesign efforts. CONCLUSION: Usability studies improve lay-out and functionality of a CDSS for empirical antibiotic treatment, even after development by a multidisciplinary system.

Mobile health for older adult patients: Using an aging barriers framework to classify usability problems.

BACKGROUND: With populations aging, digital health tools and mobile health applications (mHealth) are becoming more common to assist older people in independent living and self-management of (chronic) illnesses. These mHealth services can be beneficial to older patients, provided that they are adjusted to their needs and characteristics, as the current mHealth landscape lacks user-friendly services for this target group. Understanding of intrinsic aging barriers, which cause and impact usability problems older patients encounter, is needed to achieve this. OBJECTIVES: This study set out to assess usability problems older patients encounter in two mHealth apps and aims to show the value of MOLD-US, a recent aging barriers framework, as a classification tool to identify the intrinsic cause of these problems. METHOD: A case-study design, with in-depth analysis of usability issues older adult patients' experience. Data on usability issues were collected using the Think Aloud Protocol for two mHealth apps. The MOLD-US framework and Nielsen's severity rating were used to classify identified issues and their potential impact. RESULTS: In total 28 high severe usability issues of the mHealth apps were identified. Core natures of most issues were related to motivational and cognitive barriers of older adults. Participants had difficulties in understanding the navigation structure of the apps. Important text, buttons and icon elements were overseen. CONCLUSION: Current knowledge on creating interfaces for older target groups is not well applied within the assessed mHealth designs. Specifically, design guidelines should address older adults' diminishing cognition skills, physical ability and motivational barriers. By classifying usability problems with MOLD-US, insights on these barriers can be enhanced to adequately address these issues in new designs. In addition, we propose that future research focuses on investigating suitable usability evaluation methods adapted to older patients' characteristics to ultimately be able to gain unbiased sight on usability issues older patients may experience while interacting with technology.

IMIA Accreditation of Biomedical and Health Informatics Education: Current State and Future Directions.

Objectives: The educational activities initiated by the International Medical Informatics Association (IMIA) have had global impacts and influenced national societies and local academic programs in the field of Biomedical and Health Informatics (BMHI). After the successful publication and dissemination of its educational recommendations, IMIA launched an accreditation procedure for educational programs in BMHI. The accreditation procedure was pilot tested by several BMHI academic programs in different countries and continents to obtain a global perspective. Methods: This paper presents an overview of IMIA quality assurance and accreditation procedures along with feedback on issues and problems which emerged during the pilot. Results: It appears that IMIA quality assurance and procedures worked quite well in different countries of Europe, the Middle East, South America, and Asia. These first experiences provided adequate information for adapting, modifying, and optimizing the procedures and finally for the planning of future activities. Conclusions: IMIA accreditation framework comprises a single set of standards that apply at various levels to both academic and professional BMHI programs. The pilot phase confirmed the robustness and generalizability of quality assurance standards and associated procedures on which IMIA accreditation is based at an international level.

Participation rates of childhood cancer survivors to self-administered questionnaires: a systematic review.

This review aimed to assess participation rates of childhood cancer survivors (CCS) invited to fill out a health-related questionnaire. Additionally, effects of study and CCS characteristics on participation rates were examined. PubMed, Web of Science, Ovid (EMBASE) and CINAHL databases were searched. Publications included were questionnaire-based studies among CCS diagnosed with cancer before the age of 21, alive at least 5 years past diagnosis and aged 16 years or older at the time of study. Thirty-five studies were included; the median participation rate was 65%. Sixteen studies reported information about CCS actively declining participation (median rate 5%). Five study characteristics seemed to influence participation rates: the use of reminders and incentives, the option to answer a shortened questionnaire, the recruitment of participants through their general practitioner and a pre-notification before sending out the questionnaire. Furthermore, CCS characteristics related to improved participation were female gender, Caucasian ethnicity and a higher educational level. The results of this study will help to improve the (methodological) quality of future questionnaire-based studies among CCS, thereby increasing our knowledge about late effects among this group of survivors.

Factors influencing implementation success of guideline-based clinical decision support systems: A systematic review and gaps analysis.

OBJECTIVE: To provide an integrated and differentiated understanding of factors influencing guideline-based CDSS implementation and illustrate the gaps in the current literature. MATERIALS AND METHODS: A systematic literature review and in-depth exploration of factors impeding or facilitating successful implementation of guideline-based CDSS supporting physicians in clinical decision-making was performed. Factors were identified thematically by textual analysis of the included publications and were individually mapped to the human, organization and technology-fit (HOT-fit) framework for evaluating implementations of health information systems. RESULTS: A total of 421 factors were found in 35 included publications from a total of 3676 publications. The mapping of factors concerning CDSS implementation on the HOT-fit framework revealed gaps in each domain of the framework and showed that research has mainly focused on human and technology factors and less on organizational factors. CONCLUSIONS: Future research within the field of guideline-based CDSS should focus on evaluating implementations through the use of socio-technical models to study guideline-based CDSS system implementations from a multidimensional view. Furthermore, research is needed to explore whether use of these models during the planning phases of a CDSS project is useful in anticipating and preventing implementation barriers from occurring and exploiting facilitators to a successful implementation of the system.

Impact of Patient-centered eHealth Applications on Patient Outcomes: A Review on the Mediating Influence of Human Factor Issues.

OBJECTIVES: To examine the evidence of the impact of patient- centered eHealth applications on patient care and to analyze if and how reported human factor issues mediated the outcomes. METHODS: We searched PubMed (2014-2015) for studies evaluating the impact of patient-centered eHealth applications on patient care (behavior change, self-efficacy, and patient health-related outcomes). The Systems Engineering Initiative for Patient Safety (SEIPS 2.0) model was used as a guidance framework to identify the reported human factors possibly impacting the effectiveness of an eHealth intervention. RESULTS: Of the 348 potentially relevant papers, 10 papers were included for data analysis. None of the 10 papers reported a negative impact of the eHealth intervention. Seven papers involved a randomized controlled trial (RCT) study. Six of these RCTs reported a positive impact of the eHealth intervention on patient care. All 10 papers reported on human factor issues possibly mediating effects of patient-centered eHealth. Human factors involved patient characteristics, perceived social support, and (type of) interaction between patient and provider. CONCLUSION: While the amount of patient-centered eHealth interventions increases, many questions remain as to whether and to what extent human factors mediate their use and impact. Future research should adopt a formal theory-driven approach towards human factors when investigating those factors' influence on the effectiveness of these interventions. Insights could then be used to better tailor the content and design of eHealth solutions according to patient user profiles, so as to enhance eHealth interventions impact on patient behavior, self-efficacy, and health-related outcomes.

Influence of Human Factor Issues on Patient-Centered mHealth Apps' Impact; Where Do We Stand?

This paper discusses the preliminary results of a literature review on studies published in 2014-2015 concerning patient-centered mHealth applications' (apps) impact. Abstracts were included when they described a mHealth app targeted at patients and reported on the effects of this app on patient care. From a total of 559 potentially relevant articles, 17 papers were finally included. Nine studies reported a positive impact of the patient-centered mHealth app on patient care; 4 of these studies were randomized controlled trials. Measured impacts in the 17 studies focused on improving patients' physical activity, self-efficacy and medication adherence. Human factors issues potentially mediating these effects were discussed in all studies. Transitions in the interaction between healthcare providers and their patients were most often discussed as influencing the impact of the mHealth app. More research is needed, focussing on human issues mediating the effect of patient-centered mHealth apps to precipitate knowledge on the effectiveness of mHealth. This research should preferably be guided by socio-technical models.

Two Decades of Teledermatology: Current Status and Integration in National Healthcare Systems.

Teledermatology, originating in 1995, has been one of the first telemedicine services to see the light of day. Two decades of teledermatology research is summarized in this review. A literature search was conducted in PubMed. Search terms included "teledermatology," "teledermoscopy," "tele wound care," "telederm*," "(dermatology OR dermoscopy OR wound care OR skin) AND (telemedicine OR ehealth or mhealth OR telecare OR teledermatology OR teledermoscopy)." Inclusion criteria were (i) Dutch or English written papers and (ii) publication year from 2011 to present or (iii) (systematic) reviews with publication year before 2011. One hundred fourteen publications and 14 (systematic) reviews were included for full text reading. Focus of this review is on the following outcomes: (i) actors (primary, secondary, tertiary), (ii) purposes (consultation, triage, follow-up, education) and subspecialties (tele-wound care, burn care, teledermoscopy (teledermatoscopy), teledermatopathology, and mobile teledermatology), (iii) delivery modalities and technologies (store and forward, real-time interactive, and hybrid modalities using web-based systems, email, mobile phones, tablets, or videoconferencing equipment), (iv) business models, (v) integration of teledermatology into national healthcare systems, (vi) preconditions and requirements for implementation (security, ethical issues, responsibility, reimbursement, user satisfaction, technique, and technology standards), and (vii) added value. To conclude, teledermatology is an efficient and effective healthcare service compared to in-person care. Teledermatology reduces patients' travel time and waiting time, avoids (unnecessary) dermatologic visits, and improves access of care to underserved patients.

Uncovering healthcare practitioners' information processing using the think-aloud method: From paper-based guideline to clinical decision support system.

OBJECTIVE: To investigate whether the use of the think-aloud method with propositional analysis could be helpful in the design of a Clinical Decision Support System (CDSS) providing guideline recommendations about long-term follow-up of childhood cancer survivors. MATERIALS AND METHODS: The think-aloud method was used to gain insight into healthcare professionals' information processing while reviewing a paper-based guideline. A total of 13 healthcare professionals (6 physicians and 7 physician assistants) prepared 2 fictitious patient consults using the paper-based guideline. Propositional analysis was used to analyze verbal protocols of the think-aloud sessions. A prototype CDSS was developed and a usability study was performed, again with the think-aloud method. RESULTS: The analysis revealed that the paper-based guideline did not support healthcare practitioners in finding patient-specific recommendations. An information processing model for retrieving recommendations was developed and used as input for the design of a CDSS prototype user interface. Usability analysis of the prototype CDSS showed that the navigational structure of the system fitted well with healthcare practitioners' daily practices. CONCLUSIONS: The think-aloud method combined with propositional analysis of healthcare practitioners' verbal utterances while they processed a paper-based guideline was useful in the design of a usable CDSS providing patient-specific guideline recommendations.

A Concise and Practical Framework for the Development and Usability Evaluation of Patient Information Websites.

BACKGROUND: The Website Developmental Model for the Healthcare Consumer (WDMHC) is an extensive and successfully evaluated framework that incorporates user-centered design principles. However, due to its extensiveness its application is limited. In the current study we apply a subset of the WDMHC framework in a case study concerning the development and evaluation of a website aimed at childhood cancer survivors (CCS). OBJECTIVE: To assess whether the implementation of a limited subset of the WDMHC-framework is sufficient to deliver a high-quality website with few usability problems, aimed at a specific patient population. METHODS: The website was developed using a six-step approach divided into three phases derived from the WDMHC: 1) information needs analysis, mock-up creation and focus group discussion; 2) website prototype development; and 3) heuristic evaluation (HE) and think aloud analysis (TA). The HE was performed by three double experts (knowledgeable both in usability engineering and childhood cancer survivorship), who assessed the site using the Nielsen heuristics. Eight end-users were invited to complete three scenarios covering all functionality of the website by TA. RESULTS: The HE and TA were performed concurrently on the website prototype. The HE resulted in 29 unique usability issues; the end-users performing the TA encountered eleven unique problems. Four issues specifically revealed by HE concerned cosmetic design flaws, whereas two problems revealed by TA were related to website content. CONCLUSION: Based on the subset of the WDMHC framework we were able to deliver a website that closely matched the expectancy of the end-users and resulted in relatively few usability problems during end-user testing. With the successful application of this subset of the WDMHC, we provide developers with a clear and easily applicable framework for the development of healthcare websites with high usability aimed at specific medical populations.

A framework for evaluating mHealth tools for Older Patients on Usability.

Mobile health (mHealth) apps can play a significant role in supporting older patients. The aging process is yet related to progressive degradation of sensory, physical and cognitive abilities. mHealth apps with touch screen based interfaces thus need to be adapted to the, often impaired, skills and special needs of older patients. However, existing design guidelines for mHealth apps do not address the aging barriers that older users face in working with touch screen based applications. By means of a constructed conceptual framework on cognitive, motivational, physical and visual impairments of older adults, this study revealed possible aging barriers concerning identified usability issues of an mHealth app for older patients. Insights into the aging process barriers that underlie usability issues supports developers in (re)designing mHealth apps that are better attuned to the needs of the older patient population.

Using personas to tailor educational messages to the preferences of coronary heart disease patients.

PURPOSE: Although tailoring health education messages to individual characteristics of patients has shown promising results, most patient education materials still take a one-size-fits-all approach. The aim of this study was to develop a method for tailoring health education messages to patients' preferences for various message features, using the concept of personas. This is a preliminary study focused on education for coronary heart disease (CHD) patients. METHODS: This study used a three-step approach. First, we created personas by (i) performing k-means cluster analysis on data from an online survey that assessed the preferences of 213 CHD patients for various message features and, (ii) creating a vivid description of the preferences per patient cluster in an iterative process with the research team. Second, we developed adaptation rules to tailor existing educational messages to the resulting personas. Third, we conducted a pilot validation by adapting nine existing educational messages to each of the personas. These messages and the resulting personas were then presented to a separate group of 38 CHD patients who visited the cardiology outpatient clinic. They were first asked to choose their most preferred, second most preferred, and least preferred persona. Subsequently, they were asked to rate three of the adapted messages; one for every of the persona choices. RESULTS: We created five personas that pertained to five patient clusters. Personas varied mainly on preferences for medical or lay language, current or future temporal perspective, and including or excluding explicit health risks. Fifty-five different adaptation rules were developed, primarily describing adaptations to the message's perspective, level of detail, sentence structure, and terminology. Most participants in the validation study could identify with one of the five personas, although some of them found it hard to choose. On average, 68.5% of all participants rated the messages that matched their most preferred persona more positively than, or in the same way as, the messages that matched their least preferred persona. CONCLUSIONS: The persona-based method developed in this study can be used to create a manageable set of patient-centered tailored messages, while additionally using the developed personas to assess patients' preferences.

Evolution of human factors research and studies of health information technologies: the role of patient safety.

OBJECTIVES: The objective of this survey paper is to present and explain the impact of recent regulations and patient safety initiatives (EU, US and Canada) on Human Factors (HF)/Usability studies and research focusing on Health Information Technology (HIT). METHODS: The authors have selected the most prominent of these recent regulations and initiatives, which rely on validated HF and usability methods and concepts and aim at enhancing the specific process of identification and prevention of technology-induced errors throughout the lifecycle of HIT. RESULTS: The analysis highlights several points of consensus: 1) safety initiatives or regulations applicable to Medical Devices (MD) tend to extend to HIT, 2) Usability is considered a fundamental dimension of HIT safety, 3) HF/Usability methods and the overall Human Centred Design (HCD) approach are considered efficient solutions to ensure the design of safe and usable HIT. However, it appears that MD manufacturers, and a fortiori HIT designers and developers are still far from being able to routinely apply HCD to their products. DISCUSSION AND CONCLUSION: On the research side, we need to analyze manufacturers' difficulties with the application of the HCD process and imposed standards. For each given category of HIT, we need to identify the fundamental usability dimensions and design principles likely to impact patient safety independently of workplace settings or organizations. These should be described in terms of usability flaws, corresponding usage problems experienced by users and related outcomes. This approach requires good quality and well structured reporting of Human Factors / Usability research studies on HIT.

Final height in survivors of childhood cancer compared with Height Standard Deviation Scores at diagnosis.

BACKGROUND: Our study aimed to evaluate final height in a cohort of Dutch childhood cancer survivors (CCS) and assess possible determinants of final height, including height at diagnosis. PATIENTS AND METHODS: We calculated standard deviation scores (SDS) for height at initial cancer diagnosis and height in adulthood in a cohort of 573 CCS. Multivariable regression analyses were carried out to estimate the influence of different determinants on height SDS at follow-up. RESULTS: Overall, survivors had a normal height SDS at cancer diagnosis. However, at follow-up in adulthood, 8.9% had a height ≤-2 SDS. Height SDS at diagnosis was an important determinant for adult height SDS. Children treated with (higher doses of) radiotherapy showed significantly reduced final height SDS. Survivors treated with total body irradiation (TBI) and craniospinal radiation had the greatest loss in height (-1.56 and -1.37 SDS, respectively). Younger age at diagnosis contributed negatively to final height. CONCLUSION: Height at diagnosis was an important determinant for height SDS at follow-up. Survivors treated with TBI, cranial and craniospinal irradiation should be monitored periodically for adequate linear growth, to enable treatment on time if necessary. For correct interpretation of treatment-related late effects studies in CCS, pre-treatment data should always be included.

Attitude of physicians towards automatic alerting in computerized physician order entry systems. A comparative international survey.

OBJECTIVES: To analyze the attitude of physicians towards alerting in CPOE systems in different hospitals in different countries, addressing various organizational and technical settings and the view of physicians not currently using a CPOE. METHODS: A cross-sectional quantitative and qualitative questionnaire survey. We invited 2,600 physicians in eleven hospitals from nine countries to participate. Eight of the hospitals had different CPOE systems in use, and three of the participating hospitals were not using a CPOE system. RESULTS: 1,018 physicians participated. The general attitude of the physicians towards CPOE alerting is positive and is found to be mostly independent of the country, the specific organizational settings in the hospitals and their personal experience with CPOE systems. Both quantitative and qualitative results show that the majority of the physicians, both CPOE-users and non-users, appreciate the benefits of alerting in CPOE systems on medication safety. However, alerting should be better adapted to the clinical context and make use of more sophisticated ways to present alert information. The vast majority of physicians agree that additional information regarding interactions is useful on demand. Around half of the respondents see possible alert overload as a major problem; in this regard, physicians in hospitals with sophisticated alerting strategies show partly better attitude scores. CONCLUSIONS: Our results indicate that the way alerting information is presented to the physicians may play a role in their general attitude towards alerting, and that hospitals with a sophisticated alerting strategy with less interruptive alerts tend towards more positive attitudes. This aspect needs to be further investigated in future studies.

A usability evaluation of a SNOMED CT based compositional interface terminology for intensive care.

OBJECTIVE: To evaluate the usability of a large compositional interface terminology based on SNOMED CT and the terminology application for registration of the reasons for intensive care admission in a Patient Data Management System. DESIGN: Observational study with user-based usability evaluations before and 3 months after the system was implemented and routinely used. MEASUREMENTS: Usability was defined by five aspects: effectiveness, efficiency, learnability, overall user satisfaction, and experienced usability problems. Qualitative (the Think-Aloud user testing method) and quantitative (the System Usability Scale questionnaire and Time-on-Task analyses) methods were used to examine these usability aspects. RESULTS: The results of the evaluation study revealed that the usability of the interface terminology fell short (SUS scores before and after implementation of 47.2 out of 100 and 37.5 respectively out of 100). The qualitative measurements revealed a high number (n=35) of distinct usability problems, leading to ineffective and inefficient registration of reasons for admission. The effectiveness and efficiency of the system did not change over time. About 14% (n=5) of the revealed usability problems were related to the terminology content based on SNOMED CT, while the remaining 86% (n=30) was related to the terminology application. The problems related to the terminology content were more severe than the problems related to the terminology application. CONCLUSIONS: This study provides a detailed insight into how clinicians interact with a controlled compositional terminology through a terminology application. The extensiveness, complexity of the hierarchy, and the language usage of an interface terminology are defining for its usability. Carefully crafted domain-specific subsets and a well-designed terminology application are needed to facilitate the use of a complex compositional interface terminology based on SNOMED CT.

Factors known to influence acceptance of clinical decision support systems.

Clinical Decision Support Systems (CDSS) have been shown to improve clinical performance and patient outcomes, but the failure rate of such systems is still over 50 percent. To contribute to a wider understanding of issues surrounding CDDS acceptance, we performed a systematic review of studies that evaluated CDSS implementations in clinical care to determine the factors that are associated with acceptance of CDSS by physicians. The factors that were found were categorized according to the HOT-fit framework. The mapping of factors concerning CDSS acceptance on the HOT-fit framework revealed gaps in each domain of the framework and showed that research has mainly focused on human and technology factors and a lack of research on organizational factors. A potential area of research could thus be studying the organizational factors that may influence CDSS acceptance.

Reducing clinicians' cognitive workload by system redesign; a pre-post think aloud usability study.

Interactive Health Information systems are often considered cognitively complex by their users, leading to high cognitive burden and increased workload. This paper explores if Think Aloud usability testing provides valuable input to effectively redesign a web-based Data Query Tool in Intensive Care and to reduce physicians' cognitive workload during system interaction. Pre and post redesign usability testing demonstrated a major reduction in the cognitive task workload after redesign of the tool. Classification of revealed usability problems by means of the User Action Framework pointed out that usability problems related to the cognitively planning of actions by system users foremost affected cognitive task workload. This result may support Health Information system (re)design efforts on how to tackle the system's cognitive complexity and in so doing improve on its usability.