The feasibility and usability of a personal health record for patients with multiple sclerosis: a 2-year evaluation study.

Background: Multiple sclerosis (MS) is a persistent inflammatory condition impacting the brain and spinal cord, affecting globally approximately 2.8 million individuals. Effective self-management plays a crucial role in the treatment of chronic diseases, including MS, significantly influencing health outcomes. A personal health record (PHR) is a promising tool to support self-management, potentially empowering patients and enhancing their engagement in treatment and health. Despite these promising aspects, challenges in implementation persist and PHRs are still a relatively new concept undergoing rapid development. Objective: This study aimed to assess the feasibility and usability of the PHR. Secondary objectives included evaluating implementation determinants, and exploring preliminary effects on quality of care for both patients and healthcare professionals (HCPs), self-management, self-efficacy for patients, job satisfaction, efficiency, and demand for HCPs, and preliminary effects on costs and health-related quality of life. Methods: This study had a mixed-methods design. Quantitative data of patients (n = 80) and HCPs (n = 12) were collected via self-reported questionnaires at baseline (T0), after one year (T1), and after two years (T2). One focus group interview was conducted at T2 with patients (n = 7), and another one with HCPs (n = 4), to get a more in-depth understanding of the feasibility and usability of the PHR via the Unified Theory of Acceptance and Use of Technology framework, and to further explore the secondary objectives in-depth. Results: Most patients never logged in during the first year and logged in a couple of times per year during the second year, averaging around 15 min per log-in session. The HCPs mainly logged in a couple of times per year over the two years with an average use of six minutes per session. Patient usability and satisfaction scores were below average and moderate, respectively: with SUS-scores of 59.9 (SD = 14.2, n = 33) at T1 and 59.0 (SD = 16.3, n = 37) at T2, and CSQ-8 scores of 21.4 (SD = 5.0, n = 34) at T1, and 22.1 (SD = 5.0, n = 39) at T2. HCPs had similar usability and satisfaction scores. Multiple facilitators and barriers were identified by both patients and HCPs, such as (in)sufficient knowledge of how to use the PHR, lack of staff capacity and ICT obstacles. No significant differences were found in the preliminary effects. Qualitative data showed, among others, that both patients and HCPs saw the benefit of the PHR in terms of performance expectancy, by gaining more insight into health and health data, but challenges remained regarding effort expectancy, such as log-in issues and experiencing difficulties with information retrieval. Conclusion: The feasibility and usability were considered moderate by patients and HCPs; however, potential regarding the performance of the PHR was observed. Implementation challenges, such as the complexity of usage, lowered the adoption of the PHR. The evolving nature of PHRs requires ongoing evaluation and adaptation to optimize their potential benefits. Utilizing a participatory design approach and a dedicated implementation team could help in achieving this optimization, ultimately enhancing their adoption.

Participatory Development of an Integrated, eHealth-Supported, Educational Care Pathway (Diabetes Box) for People With Type 2 Diabetes: Development and Usability Study.

BACKGROUND: Type 2 diabetes (T2D) tremendously affects patient health and health care globally. Changing lifestyle behaviors can help curb the burden of T2D. However, health behavior change is a complex interplay of medical, behavioral, and psychological factors. Personalized lifestyle advice and promotion of self-management can help patients change their health behavior and improve glucose regulation. Digital tools are effective in areas of self-management and have great potential to support patient self-management due to low costs, 24/7 availability, and the option of dynamic automated feedback. To develop successful eHealth solutions, it is important to include stakeholders throughout the development and use a structured approach to guide the development team in planning, coordinating, and executing the development process. OBJECTIVE: The aim of this study is to develop an integrated, eHealth-supported, educational care pathway for patients with T2D. METHODS: The educational care pathway was developed using the first 3 phases of the Center for eHealth and Wellbeing Research roadmap: the contextual inquiry, the value specification, and the design phase. Following this roadmap, we used a scoping review about diabetes self-management education and eHealth, past experiences of eHealth practices in our hospital, focus groups with health care professionals (HCPs), and a patient panel to develop a prototype of an educational care pathway. This care pathway is called the Diabetes Box (Leiden University Medical Center) and consists of personalized education, digital educational material, self-measurements of glucose, blood pressure, activity, and sleep, and a smartphone app to bring it all together. RESULTS: The scoping review highlights the importance of self-management education and the potential of telemonitoring and mobile apps for blood glucose regulation in patients with T2D. Focus groups with HCPs revealed the importance of including all relevant lifestyle factors, using a tailored approach, and using digital consultations. The contextual inquiry led to a set of values that stakeholders found important to include in the educational care pathway. All values were specified in biweekly meetings with key stakeholders, and a prototype was designed. This prototype was evaluated in a patient panel that revealed an overall positive impression of the care pathway but stressed that the number of apps should be restricted to one, that there should be no delay in glucose value visualization, and that insulin use should be incorporated into the app. Both patients and HCPs stressed the importance of direct automated feedback in the Diabetes Box. CONCLUSIONS: After developing the Diabetes Box prototype using the Center for eHealth and Wellbeing Research roadmap, all stakeholders believe that the concept of the Diabetes Box is useful and feasible and that direct automated feedback and education on stress and sleep are essential. A pilot study is planned to assess feasibility, acceptability, and usefulness in more detail.

Feasibility and Acceptability of a Health App Platform Providing Individuals With a Budget to Purchase Preselected Apps to Work on Their Health and Well-Being: Quantitative Evaluation Study.

BACKGROUND: The potential of health apps for health promotion and disease prevention is widely recognized. However, uptake is limited due to barriers individuals face in finding suitable and trustworthy apps, such as the overwhelming amount of available health apps. Therefore, the health app platform "FitKnip" was developed, enabling individuals to purchase preselected, trustworthy health apps with a budget of 100 euros (a currency exchange rate of EUR €1=US $1.0831 is applicable). The platform aimed to empower individuals to improve their health and vitality, ultimately supporting a more healthy society. OBJECTIVE: The primary aim of this study was to evaluate the health app platform in terms of feasibility and acceptability. Potential effects on health empowerment and health outcomes were secondarily explored. METHODS: This quantitative study was part of a mixed methods study with a prospective pre-post interventional design. We collected web-based user data, and self-reported web-based questionnaires were collected over 5 measurements over an 8-month period. Use statistics were tracked on the platform, including the number of purchased apps and euros spent per user registered within the health app platform. We measured the user-friendliness of the health app platform using the System Usability Scale (SUS) and satisfaction using the Client Satisfaction Questionnaire-8 (CSQ-8) and several 10-point Likert items. We asked participants to indicate, on a scale from 1 (not at all) to 10 (completely), how much the health app platform contributed to various areas related to health empowerment. We assessed health-related quality of life by the 12-item Short-Form Health Survey (SF-12) and one's perceived level of stress by the 10-item Perceived Stress Scale (PSS-10). RESULTS: A total of 1650 participants were included, of whom 42% (685/1650) bought at least 1 app. The majority of those purchased one app (244/685, 35.6%). The health app platform was rated as user-friendly (SUS mean 66.5, SD 20.7; range 66.5-70.0), and the acceptability of the health app platform was moderate (CSQ-8 mean 20.0, SD 1.5; range 19.6-20.0). Results furthermore showed that participants were generally satisfied to highly satisfied with the ease of the payment system to purchase apps on the platform (median 8, IQR 7-10), the look and feel of the platform (median 7, IQR 6-8), as well as the provided budget of 100 euros (median 9, IQR 7-10). Participants were less satisfied with the amount (median 6, IQR 4-7) and diversity (median 6, IQR 4-7) of apps offered on the platform. CONCLUSIONS: A health app platform is a promising initiative to enhance public health. Feasibility and acceptability are critical for success, as they ensure that such a platform is accessible, user-friendly, and meets end users' needs and preferences. This can help to increase uptake, engagement, and ultimately the platform's adoption and effectiveness.

Evaluation of completely online psychotherapy with app-support versus therapy as usual for clients with depression or anxiety disorder: A retrospective matched cohort study investigating the effectiveness, efficiency, client satisfaction, and costs.

INTRODUCTION: Depressive and anxiety disorders are common mental disorders ranking among the leading causes of global disease burden. Not all clients currently benefit from therapy and clients are looking for modern ways of therapy. Online psychotherapy is a promising option for better meeting clients' needs. Recently, a new psychotherapy concept has emerged that combines videoconferencing sessions with support through a mobile application. The latter allows for ecological momentary assessments and interventions, facilitates communication between patients and therapists in between sessions through chat, and allows for incorporating feedback-informed treatment principles. MATERIAL AND METHODS: The study was a retrospective observational matched cohort study, comparing online psychotherapy with Therapy As Usual (TAU) for clients with depressive or anxiety disorders. Data were obtained via questionnaires, which are part of standard clinical care. Primary outcomes included general mental functioning, and symptoms of depression and anxiety. Secondary outcomes were efficiency, client satisfaction, and therapy costs. Primary endpoints were analyzed using linear mixed models analysis, with an interaction term between time and group. Secondary outcomes were analyzed using linear regression. RESULTS: Larger improvements were observed in the online compared to the TAU group for general mental functioning and depressive disorder (i.e., General mental functioning: B = -8.50, 95 CI: -15.01 - -1.97, p = 0.011; Depressive disorder: B = - 3.66, 95 % CI: -5.79 - -1.54p < 0.01). No significant differences in change over time between the two groups were observed for anxiety disorder (B = -3.64, 95 % CI: (-13.10 - 5.82) p = 0.447). The total number of sessions was significantly higher in the online psychotherapy group than in TAU (B = 3.71, p < 0.01), although clients were matched on treatment time in weeks. Treatment session duration in minutes was comparable across the groups. DISCUSSION: Online psychotherapy with app support showed to be a promising alternative to TAU for depressive and anxiety disorders. More research is needed to evaluate the effectiveness, cost-effectiveness and client satisfaction of online psychotherapy compared to TAU, such as randomized controlled trials or studies multiple baseline series designs, and in-depth qualitative research.

A Health App Platform Providing a Budget to Purchase Preselected Apps as an Innovative Way to Support Public Health: Qualitative Study With End Users and Other Stakeholders.

BACKGROUND: eHealth has the potential to improve health outcomes. However, this potential is largely untapped. Individuals face an overload of apps and have difficulties choosing suitable apps for themselves. In the FitKnip experiment, individuals were given access to a health app platform, where they could purchase reliable preselected health apps with a personal budget of €100 (US $107.35). By conducting a prospective study, we aimed to scientifically evaluate the FitKnip experiment as an innovative way to improve population health. OBJECTIVE: The aim of the experiment was to scientifically evaluate the FitKnip experiment as an innovative way to improve population health. More specifically, we conducted an in-depth qualitative evaluation of the concept and acceptability of FitKnip, its perceived impact on health empowerment, as well as the roles of stakeholders for the future implementation of a health app platform through focus group interviews. METHODS: This study followed a phenomenological research design and included 7 focus group interviews with end users and 1 with stakeholders, held between July and December 2020. End users were recruited through various institutions in the Netherlands, for example, insurance companies and local governments. All focus groups were semistructured using interview guides and were held via videoconferencing due to the COVID-19 pandemic measures. Each participant received access to a health app platform where they were enabled to purchase reliable, preselected health apps with a budget of €100 (US $107.35). The budget was valid for the entire research period. The health app platform offered 38 apps. A third party, a health care coalition, selected the apps to be included in FitKnip. The analyses were conducted according to the principles of the Framework Method. RESULTS: A priori formulated themes were concept, acceptability, health empowerment, and outcomes, and the roles of stakeholders for the future implementation of a health app platform. Both end users (n=31) and stakeholders (n=5) were enthusiastic about the concept of a health app platform. End users indicated missing apps regarding physical health and lifestyle and needing more guidance toward suitable apps. End users saw health empowerment as a precondition to using a health app platform and achieving health outcomes depending on the purchased mobile apps. End users and stakeholders identified potential providers and financing parties of FitKnip. Stakeholders recommended the establishment of a reputable national or international quality guidelines or certification for health and wellbeing apps, that can demonstrate the quality and reliability of mobile health applications. CONCLUSIONS: This study showed the need for a personalized and flexible platform. Next to this, a deeper understanding of the roles of stakeholders in such initiatives is needed especially on financing and reimbursement of health promotion and digital health services. A personalized, flexible health app platform is a promising initiative to support individuals in their health.

Exploring colorectal cancer survivors' perspectives on improving care delivery and the role of e-health technology: a qualitative study.

PURPOSE: The purpose of this study was to gather insights from colorectal cancer (CRC) survivors on how to improve care for CRC survivors and how e-health technology could be utilized to improve CRC care delivery. METHODS: Three semi-structured focus groups were held with sixteen CRC survivors. To initiate the discussion, an online registration form and two vignettes were used. The data was analyzed using the framework method. RESULTS: Based on survivors' experiences, five themes were identified as opportunities for improving CRC care delivery. These themes include better recognition of complaints and faster referrals, more information as part of the care delivery, more guidance and monitoring of health outcomes, more collaboration between practitioners, and more attention for partners and relatives. In addition, survivors expressed opportunities for using e-health to facilitate information provision, improve communication, and monitor survivors' health conditions. CONCLUSION: Several suggestions for improvement of CRC care delivery were identified. These often translated into possibilities for e-health to support or improve CRC care delivery. The ideas of survivors align with the vast array of existing e-health resources that can be utilized to enhance CRC care delivery. Therefore, the next step involves addressing the implementation gap between the needs of stakeholders, such as CRC survivors and healthcare providers, and the e-health tools currently available in clinical practice.

Using Animated Videos to Promote the Accessibility and Understandability of Package Leaflets: Retrospective Observational Study Evaluating the First Year of Implementation.

BACKGROUND: The medication package leaflet is the most used and trusted source of information in the home situation but is often incomprehensible for individuals, especially for those with limited health literacy. The platform "Watchyourmeds" comprises a web-based library with over 10,000 animated videos that explain the most essential information from the package leaflet in an unambiguous and simple manner to increase the accessibility and understandability of package leaflets. OBJECTIVE: This study aimed to investigate Watchyourmeds in the Netherlands from a user perspective during the first year of implementation by investigating (1) usage data, (2) self-reported user experiences, and (3) the preliminary and potential impact on medication knowledge. METHODS: This was a retrospective observational study. The first aim was investigated by examining objective user data from 1815 pharmacies from the first year of implementation of Watchyourmeds. User experiences (second aim) were investigated by examining individuals' completed self-report questionnaires (n=4926) that they received after completing a video. The preliminary and potential impact on medication knowledge (third aim) was investigated by examining users' self-report questionnaire data (n=67) that assessed their medication knowledge about their prescribed medication. RESULTS: Nearly 1.8 million videos have been distributed to users by over 1400 pharmacies, with monthly numbers increasing to 280,000 in the last month of the implementation year. Most users (4444/4805, 92.5%) indicated to have fully understood the information presented in the videos. Female users reported more often to have fully understood the information than male users (χ24=11.5, P=.02). Most users (3662/4805, 76.2%) said that they did not think any information was missing in the video. Users with a lower educational level stated more often (1104/1290, 85.6%) than those with a middle (984/1230, 80%) or higher (964/1229, 78.4%) educational level that they did not seem to be missing any information in the videos (χ212=70.6, P<.001). A total of 84% (4142/4926) of the users stated that they would like to use Watchyourmeds more often and for all their medication, or would like to use it most of the time. Male users and older users stated more often that they would use Watchyourmeds again for other medication than the female (χ23=25.0, P<.001) and younger users (χ23=38.1, P<.001), respectively. Almost 88% (4318/4926) of the users would recommend the web-based library to friends, family, or acquaintances. Regarding the third aim, results showed that 73.8% (293/397) of the questions assessing users' medication knowledge were answered correctly. CONCLUSIONS: The results of this study suggest that a web-based library with animated videos is a valuable and acceptable addition to stand-alone package leaflets to increase the understanding and accessibility of medication information.

Improving the colorectal cancer care pathway via e-health: a qualitative study among Dutch healthcare providers and managers.

PURPOSE: This study aims to identify improvement opportunities within the colorectal cancer (CRC) care pathway using e-health and to examine how these opportunities would contribute to the Quadruple Aim. METHODS: In total, 17 semi-structured interviews were held (i.e., nine healthcare providers and eight managers involved in Dutch CRC care). The Quadruple Aim was used as a conceptual framework to gather and systematically structure the data. A directed content analysis approach was employed to code and analyze the data. RESULTS: Interviewees believe the available e-health technology could be better exploited in CRC care. Twelve different improvement opportunities were identified to enhance the CRC care pathway. Some opportunities could be applied in one specific phase of the pathway (e.g., digital applications to support patients in the prehabilitation program to enhance the program's effects). Others could be deployed in multiple phases or extended outside the hospital care setting (e.g., digital consultation hours to increase care accessibility). Some opportunities could be easily implemented (e.g., digital communication to facilitate treatment preparation), whereas others require structural, systemic changes (e.g., increasing efficiency in patient data exchanges among healthcare professionals). CONCLUSION: This study provides insights into how e-health could add value to CRC care and contribute to the Quadruple Aim. It shows that e-health has the potential to contribute to the challenges in cancer care. To take the next step forward, the perspectives of other stakeholders must be examined, the identified opportunities should be prioritized, and the requirements for successful implementation should be mapped out.

Cost-effectiveness of Internet Interventions Compared With Treatment as Usual for People With Mental Disorders: Systematic Review and Meta-analysis of Randomized Controlled Trials.

BACKGROUND: The economic costs of mental disorders for society are huge. Internet-based interventions are often coined as cost-effective alternatives to usual care, but the evidence is mixed. OBJECTIVE: The aim was to review the literature on the cost-effectiveness of internet interventions for mental disorders compared with usual care and to provide an estimate of the monetary benefits of such interventions compared with usual care. METHODS: A systematic review and meta-analysis of randomized controlled trials was conducted, which included participants with symptoms of mental disorders; investigated a telephone- or internet-based intervention; included a control condition in the form of treatment as usual, psychological placebo, waiting list control, or bibliotherapy; reported outcomes on both quality of life and costs; and included articles published in English. Electronic databases such as PubMed (including MEDLINE), Embase, Emcare, PsycINFO, Web of Science, and the Cochrane Library were used. Data on risk of bias, quality of the economic evaluation, quality-adjusted life years, and costs were extracted from the included studies, and the incremental net benefit was calculated and pooled. RESULTS: The search yielded 6226 abstracts, and 37 studies with 14,946 participants were included. The quality of economic evaluations of the included studies was rated as moderate, and the risk of bias was high. A random-effects approach was maintained. Analyses suggested internet interventions were slightly more effective than usual care in terms of quality-adjusted life years gain (Hedges g=0.052, 95% CI 0.010-0.094; P=.02) and equally expensive (Hedges g=0.002, 95% CI -0.080 to 0.84; P=.96). The pooled incremental net benefit was US $255 (95% CI US $91 to US $419; P=.002), favoring internet interventions over usual care. The perspective of the economic evaluation and targeted mental disorder moderated the results. CONCLUSIONS: The findings indicate that the cost-effectiveness of internet interventions for mental disorders compared with a care-as-usual approach is likely, but generalizability to new studies is poor given the substantial heterogeneity. This is the first study in the field of mental health to pool cost-effectiveness outcomes in an aggregate data meta-analysis. TRIAL REGISTRATION: PROSPERO CRD42019141659; https://tinyurl.com/3cu99b34.

The feasibility of using Apple's ResearchKit for recruitment and data collection: Considerations for mental health research.

In 2015, Apple launched an open-source software framework called ResearchKit. ResearchKit provides an infrastructure for conducting remote, smartphone-based research trials through the means of Apple's App Store. Such trials may have several advantages over conventional trial methods including the removal of geographic barriers, frequent assessments of participants in real-life settings, and increased inclusion of seldom-heard communities. The aim of the current study was to explore the feasibility of participant recruitment and the potential for data collection in the non-clinical population in a smartphone-based trial using ResearchKit. As a case example, an app called eMovit, a behavioural activation (BA) app with the aim of helping users to build healthy habits was used. The study was conducted over a 9-month period. Any iPhone user with access to the App Stores of The Netherlands, Belgium, and Germany could download the app and participate in the study. During the study period, the eMovit app was disseminated amongst potential users via social media posts (Twitter, Facebook, LinkedIn), paid social media advertisements (Facebook), digital newsletters and newspaper articles, blogposts and other websites. In total, 1,788 individuals visited the eMovit landing page. A total of 144 visitors subsequently entered Apple's App Store through that landing page. The eMovit product page was viewed 10,327 times on the App Store. With 79 installs, eMovit showed a conversion rate of 0.76% from product view to install of the app. Of those 79 installs, 53 users indicated that they were interested to participate in the research study and 36 subsequently consented and completed the demographics and the participants quiz. Fifteen participants completed the first PHQ-8 assessment and one participant completed the second PHQ-8 assessment. We conclude that from a technological point of view, the means provided by ResearchKit are well suited to be integrated into the app process and thus facilitate conducting smartphone-based studies. However, this study shows that although participant recruitment is technically straightforward, only low recruitment rates were achieved with the dissemination strategies applied. We argue that smartphone-based trials (using ResearchKit) require a well-designed app dissemination process to attain a sufficient sample size. Guidelines for smartphone-based trial designs and recommendations on how to work with challenges of mHealth research will ensure the quality of these trials, facilitate researchers to do more testing of mental health apps and with that enlarge the evidence-base for mHealth.

Optimizing the Acceptability, Adherence, and Inclusiveness of the COVID Radar Surveillance App: Qualitative Study Using Focus Groups, Thematic Content Analysis, and Usability Testing.

BACKGROUND: The COVID Radar app was developed as a population-based surveillance instrument to identify at-risk populations and regions in response to the COVID-19 pandemic. The app boasts of >8.5 million completed questionnaires, with >280,000 unique users. Although the COVID Radar app is a valid tool for population-level surveillance, high user engagement is critical to the success of the COVID Radar app in maintaining validity. OBJECTIVE: This study aimed to identify optimization targets of the COVID Radar app to improve its acceptability, adherence, and inclusiveness. METHODS: The main component of the COVID Radar app is a self-report questionnaire that assesses COVID-19 symptoms and social distancing behaviors. A total of 3 qualitative substudies were conducted. First, 3 semistructured focus group interviews with end users (N=14) of the app were conducted to gather information on user experiences. The output was transcribed and thematically coded using the framework method. Second, a similar qualitative thematic analysis was conducted on 1080 end-user emails. Third, usability testing was conducted in one-on-one sessions with 4 individuals with low literacy levels. RESULTS: All 3 substudies identified optimization targets in terms of design and content. The results of substudy 1 showed that the participants generally evaluated the app positively. They reported the app to be user-friendly and were satisfied with its design and functionalities. Participants' main motivation to use the app was to contribute to science. Participants suggested adding motivational tools to stimulate user engagement. A larger national publicity campaign for the app was considered potentially helpful for increasing the user population. In-app updates informing users about the project and its outputs motivated users to continue using the app. Feedback on the self-report questionnaire, stemming from substudies 1 and 2, mostly concerned the content and phrasing of the questions. Furthermore, the section of the app allowing users to compare their symptoms and behaviors to those of their peers was found to be suboptimal because of difficulties in interpreting the figures presented in the app. Finally, the output of substudy 3 resulted in recommendations primarily related to simplification of the text to render it more accessible and comprehensible for individuals with low literacy levels. CONCLUSIONS: The convenience of app use, enabling personal adjustments of the app experience, and considering motivational factors for continued app use (ie, altruism and collectivism) were found to be crucial to procuring and maintaining a population of active users of the COVID Radar app. Further, there seems to be a need to increase the accessibility of public health tools for individuals with low literacy levels. These results can be used to improve the this and future public health apps and improve the representativeness of their user populations and user engagement, ultimately increasing the validity of the tools.

A Pharmacy-Based eHealth Intervention Promoting Correct Use of Medication in Patients With Asthma and COPD: Nonrandomized Pre-Post Study.

BACKGROUND: Asthma and chronic obstructive pulmonary disease (COPD) affect millions of people worldwide. While medication can control and improve disease symptoms, incorrect use of medication is a common problem. The eHealth intervention SARA (Service Apothecary Respiratory Advice) aims to improve participants' correct use of inhalation medication by providing information and as-needed tailored follow-up support by a pharmacist. OBJECTIVE: The primary aim of this study was to investigate the effect of SARA on exacerbation rates in participants with asthma and COPD. Secondary aims were to investigate its effects in terms of adherence to maintenance medication and antimycotic treatment. METHODS: In this nonrandomized pre-post study, medication dispensing data from 382 Dutch community pharmacies were included. Exacerbation rates were assessed with dispensed short-course oral corticosteroids. Medication adherence between new and chronic users was assessed by calculating the proportion of days covered from dispensed inhalation maintenance medication. Antimycotic treatment was investigated from dispensed oral antimycotics in participants who were also dispensed inhaled corticosteroids (ICS). Outcomes were assessed 1 year before and 1 year after implementation of SARA and were compared between SARA participants and control participants. More specifically, for exacerbation rates and medication adherence, a difference score was calculated (ie, 1 year after SARA minus 1 year before SARA) and was subsequently compared between the study groups with independent-samples t tests. For antimycotics, the relative number of participants who were dispensed antimycotics was calculated and subsequently analyzed with a mixed-effects logistic regression. RESULTS: The study population comprised 9452 participants, of whom 2400 (25.39%) were SARA participants. The mean age of the population was 60.8 (15.0) years, and approximately two-thirds (n=5677, 60.06%) were female. The results showed an increase in mean exacerbation rates over time for both study groups (SARA: 0.05; control: 0.15). However, this increase in exacerbation rates was significantly lower for SARA participants (t9450=3.10, 95% CI 0.04-0.16; P=.002; Cohen d=0.06). Chronic users of inhalation medication in both study groups showed an increase in mean medication adherence over time (SARA: 6.73; control: 4.48); however, this increase was significantly higher for SARA participants (t5886=-2.74, 95% CI -3.86 to -0.84; P=.01; Cohen d=-0.07). Among new users of inhalation medication, results showed no significant difference in medication adherence between SARA and control participants in the year after implementation of SARA (t1434=-1.85, 95% CI -5.60 to 0.16; P=.06; Cohen d=-0.10). Among ICS users, no significant differences between the study groups were found over time in terms of the proportion of participants who were dispensed antimycotics (t5654=0.29, 95% CI -0.40 to 0.54; P=.76; Cohen d=0). CONCLUSIONS: This study provides preliminary evidence that the SARA eHealth intervention might have the potential to decrease exacerbation rates and improve medication adherence among patients with asthma and COPD.

eHealth Interventions for Dutch Cancer Care: Systematic Review Using the Triple Aim Lens.

BACKGROUND: Globally, the burden of cancer on population health is growing. Recent trends such as increasing survival rates have resulted in a need to adapt cancer care to ensure a good care experience and manageable expenditures. eHealth is a promising way to increase the quality of cancer care and support patients and survivors. OBJECTIVE: The aim of this systematic review was 2-fold. First, we aimed to provide an overview of eHealth interventions and their characteristics for Dutch patients with and survivors of cancer. Second, we aimed to provide an overview of the empirical evidence regarding the impact of eHealth interventions in cancer care on population health, quality of care, and per capita costs (the Triple Aim domains). METHODS: The electronic databases Web of Science, PubMed, Cochrane, and Ovid PsycINFO were searched using 3 key search themes: eHealth interventions, cancer care, and the Netherlands. The identified interventions were classified according to predetermined criteria describing the intervention characteristics (eg, type, function, and target population). Their impact was subsequently examined using the Triple Aim framework. RESULTS: A total of 38 interventions were identified. Most of these were web portals or web applications functioning to inform and self-manage, and target psychosocial factors or problems. Few interventions have been tailored to age, disease severity, or gender. The results of this study indicate that eHealth interventions could positively affect sleep quality, fatigue, and physical activity of patients with and survivors of cancer. Inconclusive results were found regarding daily functioning and quality of life, psychological complaints, and psychological adjustment to the disease. CONCLUSIONS: eHealth can improve outcomes in the Triple Aim domains, particularly in the population health and quality of care domains. Cancer-related pain and common symptoms of active treatment were not targeted in the included interventions and should receive more attention. Further research is needed to fully understand the impact of eHealth interventions in cancer care on participation, accessibility, and costs. The latter can be examined in economic evaluations by comparing eHealth interventions with care as usual.

A Preoperative Virtual Reality App for Patients Scheduled for Cardiac Catheterization: Pre-Post Questionnaire Study Examining Feasibility, Usability, and Acceptability.

BACKGROUND: Pre- and postoperative anxiety is a common phenomenon associated with negative postoperative outcomes. Symptoms of posttraumatic stress disorder, such as fear, nightmares, and sleep deprivation, are prevalent in approximately 30% to 50% of patients following discharge from intensive care units after cardiac surgery. Preliminary evidence suggests a promising role of virtual reality (VR) in preventing stress-related reactions using stress inoculation training. Such training enables cognitive preparation of individuals for stressful situations, thereby becoming more tolerant and resistant to stress, subsequently reducing the risk of potential negative psychological consequences. This study investigated a preoperative VR app-Pre-View-aimed at better informing and preparing patients for cardiac catheterization. OBJECTIVE: This study aims to assess the feasibility, usability, and acceptability of Pre-View in patients undergoing cardiac catheterization. METHODS: Eligible participants were adults scheduled for elective cardiac catheterization. Pre-View comprised an interactive virtual representation of the whole care process related to cardiac catheterization, from entering the hospital for admission to postprocedural stay and discharge. These processes were represented through 360° videos and interactive photos. Self-report questionnaires were completed at baseline (ie, before catheterization and after undergoing the VR experience) and after cardiac catheterization. Outcome measures included user experience and satisfaction, VR presence and immersive tendencies, and user friendliness. The perceived effectiveness was assessed exploratively. RESULTS: A total of 8 individuals, with a mean age of 67 (SD 7.5) years, participated in this study. Half of them underwent the VR experience at the hospital and the other half at home. Participants reported high levels of presence in the virtual environment (Presence Questionnaire score: mean 129.1, SD 13.4). The usability of Pre-View was well evaluated (System Usability Scale score: mean 89.1, SD 12.0), and patient satisfaction was high (Client Satisfaction Questionnaire score: mean 27.1, SD 3.2). Usability and satisfaction scores were higher for participants who underwent Pre-View at home versus those who underwent Pre-View at the hospital, although the latter group was significantly older; 72.8 versus 61.3, respectively. All participants reported Pre-View to be effective in terms of feeling better informed about the care process of cardiac catheterization. Most participants (7/8, 88%) reported Pre-View to be effective in terms of feeling better prepared for cardiac catheterization, acknowledging the potential of Pre-View in reducing negative psychological consequences after catheterization. CONCLUSIONS: The results provide initial support for the feasibility and acceptability of a preoperative VR app, creating a virtual environment that supports patient education and preparation for upcoming cardiac catheterization. More studies are needed to further investigate the effects of VR as a tool to better prepare patients for medical procedures, its effectiveness in reducing negative patient outcomes (eg, anxiety, stress, and postoperative recovery outcomes), and the generalizability of effects across different settings and patient populations.

Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review.

While the opportunities of ML and AI in healthcare are promising, the growth of complex data-driven prediction models requires careful quality and applicability assessment before they are applied and disseminated in daily practice. This scoping review aimed to identify actionable guidance for those closely involved in AI-based prediction model (AIPM) development, evaluation and implementation including software engineers, data scientists, and healthcare professionals and to identify potential gaps in this guidance. We performed a scoping review of the relevant literature providing guidance or quality criteria regarding the development, evaluation, and implementation of AIPMs using a comprehensive multi-stage screening strategy. PubMed, Web of Science, and the ACM Digital Library were searched, and AI experts were consulted. Topics were extracted from the identified literature and summarized across the six phases at the core of this review: (1) data preparation, (2) AIPM development, (3) AIPM validation, (4) software development, (5) AIPM impact assessment, and (6) AIPM implementation into daily healthcare practice. From 2683 unique hits, 72 relevant guidance documents were identified. Substantial guidance was found for data preparation, AIPM development and AIPM validation (phases 1-3), while later phases clearly have received less attention (software development, impact assessment and implementation) in the scientific literature. The six phases of the AIPM development, evaluation and implementation cycle provide a framework for responsible introduction of AI-based prediction models in healthcare. Additional domain and technology specific research may be necessary and more practical experience with implementing AIPMs is needed to support further guidance.

Effectiveness of Telemonitoring for Respiratory and Systemic Symptoms of Asthma and COPD: A Narrative Review.

Asthma and chronic obstructive pulmonary diseases (COPD) are highly prevalent chronic lung diseases that require ongoing self-management, which itself is often suboptimal. Therefore, telemonitoring has been used to help patients measure their symptoms, share data with healthcare providers and receive education and feedback to improve disease management. In this study, we conducted a narrative review of recent evidence on the effectiveness of telemonitoring for asthma and COPD in adults. Of the thirteen identified studies, eleven focused on COPD and two focused on asthma. All studies were reviewed, and effects were compared between intervention and care as usual groups. Of the study interventions, seven showed a positive outcome on at least one outcome measure, and six had no significant results on any of the outcome measures. All of the interventions with a positive outcome included an educational component, while only one of the six interventions without positive outcomes included an educational component. We conclude that telemonitoring interventions for asthma and COPD seem more effective if they included an educational component regarding different aspects of self-management.

Effectiveness of eHealth Interventions in Improving Medication Adherence for Patients With Chronic Obstructive Pulmonary Disease or Asthma: Systematic Review.

BACKGROUND: Poor treatment adherence in patients with chronic obstructive pulmonary disease (COPD) or asthma is a global public health concern with severe consequences in terms of patient health and societal costs. A potentially promising tool for addressing poor compliance is eHealth. OBJECTIVE: This review investigates the effects of eHealth interventions on medication adherence in patients with COPD or asthma. METHODS: A systematic literature search was conducted in the databases of Cochrane Library, PsycINFO, PubMed, and Embase for studies with publication dates between January 1, 2000, and October 29, 2020. We selected randomized controlled trials targeting adult patients with COPD or asthma, which evaluated the effectiveness of an eHealth intervention on medication adherence. The risk of bias in the included studies was examined using the Cochrane Collaboration's risk of bias tool. The results were narratively reviewed. RESULTS: In total, six studies focusing on COPD and seven focusing on asthma were analyzed. Interventions were mostly internet-based or telephone-based, and could entail telemonitoring of symptoms and medication adherence, education, counseling, consultations, and self-support modules. Control groups mostly comprised usual care conditions, whereas a small number of studies used a face-to-face intervention or waiting list as the control condition. For COPD, the majority of eHealth interventions were investigated as an add-on to usual care (5/6 studies), whereas for asthma the majority of interventions were investigated as a standalone intervention (5/7 studies). Regarding eHealth interventions targeting medication adherence for COPD, two studies reported nonsignificant effects, one study found a significant effect in comparison to usual care, and three reported mixed results. Of the seven studies that investigated eHealth interventions targeting medication adherence in asthma, three studies found significant effects, two reported nonsignificant effects, and two reported mixed effects. CONCLUSIONS: The mixed results on the effectiveness of eHealth interventions in improving treatment adherence for asthma and COPD are presumably related to the type, context, and intensity of the interventions, as well as to differences in the operationalization and measurement of adherence outcomes. Much remains to be learned about the potential of eHealth to optimize treatment adherence in COPD and asthma.

COVID RADAR app: Description and validation of population surveillance of symptoms and behavior in relation to COVID-19.

BACKGROUND: Monitoring of symptoms and behavior may enable prediction of emerging COVID-19 hotspots. The COVID Radar smartphone app, active in the Netherlands, allows users to self-report symptoms, social distancing behaviors, and COVID-19 status daily. The objective of this study is to describe the validation of the COVID Radar. METHODS: COVID Radar users are asked to complete a daily questionnaire consisting of 20 questions assessing their symptoms, social distancing behavior, and COVID-19 status. We describe the internal and external validation of symptoms, behavior, and both user-reported COVID-19 status and state-reported COVID-19 case numbers. RESULTS: Since April 2nd, 2020, over 6 million observations from over 250,000 users have been collected using the COVID Radar app. Almost 2,000 users reported having tested positive for SARS-CoV-2. Amongst users testing positive for SARS-CoV-2, the proportion of observations reporting symptoms was higher than that of the cohort as a whole in the week prior to a positive SARS-CoV-2 test. Likewise, users who tested positive for SARS-CoV-2 showed above average risk social-distancing behavior. Per-capita user-reported SARS-CoV-2 positive tests closely matched government-reported per-capita case counts in provinces with high user engagement. DISCUSSION: The COVID Radar app allows voluntarily self-reporting of COVID-19 related symptoms and social distancing behaviors. Symptoms and risk behavior increase prior to a positive SARS-CoV-2 test, and user-reported case counts match closely with nationally-reported case counts in regions with high user engagement. These results suggest the COVID Radar may be a valid instrument for future surveillance and potential predictive analytics to identify emerging hotspots.

The Computer Will See You Now: Overcoming Barriers to Adoption of Computer-Assisted History Taking (CAHT) in Primary Care.

Patient health information is increasingly collected through multiple modalities, including electronic health records, wearables, and connected devices. Computer-assisted history taking could provide an additional channel to collect highly relevant, comprehensive, and accurate patient information while reducing the burden on clinicians and face-to-face consultation time. Considering restrictions to consultation time and the associated negative health outcomes, patient-provided health data outside of consultation can prove invaluable in health care delivery. Over the years, research has highlighted the numerous benefits of computer-assisted history taking; however, the limitations have proved an obstacle to adoption. In this viewpoint, we review these limitations under 4 main categories (accessibility, affordability, accuracy, and acceptability) and discuss how advances in technology, computing power, and ubiquity of personal devices offer solutions to overcoming these.

Development and implementation of guidelines for the management of depression: a systematic review.

OBJECTIVE: To evaluate the development and implementation of clinical practice guidelines for the management of depression globally. METHODS: We conducted a systematic review of existing guidelines for the management of depression in adults with major depressive or bipolar disorder. For each identified guideline, we assessed compliance with measures of guideline development quality (such as transparency in guideline development processes and funding, multidisciplinary author group composition, systematic review of comparative efficacy research) and implementation (such as quality indicators). We compared guidelines from low- and middle-income countries with those from high-income countries. FINDINGS: We identified 82 national and 13 international clinical practice guidelines from 83 countries in 27 languages. Guideline development processes and funding sources were explicitly specified in a smaller proportion of guidelines from low- and middle-income countries (8/29; 28%) relative to high-income countries (35/58; 60%). Fewer guidelines (2/29; 7%) from low- and middle-income countries, relative to high-income countries (22/58; 38%), were authored by a multidisciplinary development group. A systematic review of comparative effectiveness was conducted in 31% (9/29) of low- and middle-income country guidelines versus 71% (41/58) of high-income country guidelines. Only 10% (3/29) of low- and middle-income country and 19% (11/58) of high-income country guidelines described plans to assess quality indicators or recommendation adherence. CONCLUSION: Globally, guideline implementation is inadequately planned, reported and measured. Narrowing disparities in the development and implementation of guidelines in low- and middle-income countries is a priority. Future guidelines should present strategies to implement recommendations and measure feasibility, cost-effectiveness and impact on health outcomes.