Comparing usage of a web and app stress management intervention: An observational study.

Choices in the design and delivery of digital health behaviour interventions may have a direct influence on subsequent usage and engagement. Few studies have been able to make direct, detailed comparisons of differences in usage between interventions that are delivered via web or app. This study compared the usage of two versions of a digital stress management intervention, one delivered via a website (Healthy Paths) and the other delivered via an app (Healthy Mind). Design modifications were introduced within Healthy Mind to take account of reported differences in how individuals engage with websites compared to apps and mobile phones. Data were collected as part of an observational study nested within a broader exploratory trial of Healthy Mind. Objective usage of Healthy Paths and Healthy Mind were automatically recorded, including frequency and duration of logins, access to specific components within the intervention and order of page/screen visits. Usage was compared for a two week period following initial registration. In total, 381 participants completed the registration process for Healthy Paths (web) and 162 participants completed the registration process for Healthy Mind (app). App users logged in twice as often (Mdn = 2.00) as web users (Mdn = 1.00), U = 13,059.50, p ≤ 0.001, but spent half as much time (Mdn = 5.23 min) on the intervention compared to web users (Mdn = 10.52 min), U = 19,740.00, p ≤ 0.001. Visual exploration of usage patterns over time revealed that a significantly higher proportion of app users (n = 126, 82.35%) accessed both types of support available within the intervention (i.e. awareness and change-focused tools) compared to web users (n = 92, 40.17%), χ2(1, n = 382) = 66.60, p < 0.001. This study suggests that the digital platform used to deliver an intervention (i.e. web versus app) and specific design choices (e.g. navigation, length and volume of content) may be associated with differences in how the intervention content is used. Broad summative usage data (e.g. total time spent on the intervention) may mask important differences in how an intervention is used by different user groups if it is not complemented by more fine-grained analyses of usage patterns over time. TRIAL REGISTRATION NUMBER: ISRCTN67177737.

Correction: The Effect of Timing and Frequency of Push Notifications on Usage of a Smartphone-Based Stress Management Intervention: An Exploratory Trial.

[This corrects the article DOI: 10.1371/journal.pone.0169162.].

The Effect of Timing and Frequency of Push Notifications on Usage of a Smartphone-Based Stress Management Intervention: An Exploratory Trial.

Push notifications offer a promising strategy for enhancing engagement with smartphone-based health interventions. Intelligent sensor-driven machine learning models may improve the timeliness of notifications by adapting delivery to a user's current context (e.g. location). This exploratory mixed-methods study examined the potential impact of timing and frequency on notification response and usage of Healthy Mind, a smartphone-based stress management intervention. 77 participants were randomised to use one of three versions of Healthy Mind that provided: intelligent notifications; daily notifications within pre-defined time frames; or occasional notifications within pre-defined time frames. Notification response and Healthy Mind usage were automatically recorded. Telephone interviews explored participants' experiences of using Healthy Mind. Participants in the intelligent and daily conditions viewed (d = .47, .44 respectively) and actioned (d = .50, .43 respectively) more notifications compared to the occasional group. Notification group had no meaningful effects on percentage of notifications viewed or usage of Healthy Mind. No meaningful differences were indicated between the intelligent and non-intelligent groups. Our findings suggest that frequent notifications may encourage greater exposure to intervention content without deterring engagement, but adaptive tailoring of notification timing does not always enhance their use. Hypotheses generated from this study require testing in future work. TRIAL REGISTRATION NUMBER: ISRCTN67177737.

Understanding and Promoting Effective Engagement With Digital Behavior Change Interventions.

This paper is one in a series developed through a process of expert consensus to provide an overview of questions of current importance in research into engagement with digital behavior change interventions, identifying guidance based on research to date and priority topics for future research. The first part of this paper critically reflects on current approaches to conceptualizing and measuring engagement. Next, issues relevant to promoting effective engagement are discussed, including how best to tailor to individual needs and combine digital and human support. A key conclusion with regard to conceptualizing engagement is that it is important to understand the relationship between engagement with the digital intervention and the desired behavior change. This paper argues that it may be more valuable to establish and promote "effective engagement," rather than simply more engagement, with "effective engagement" defined empirically as sufficient engagement with the intervention to achieve intended outcomes. Appraisal of the value and limitations of methods of assessing different aspects of engagement highlights the need to identify valid and efficient combinations of measures to develop and test multidimensional models of engagement. The final section of the paper reflects on how interventions can be designed to fit the user and their specific needs and context. Despite many unresolved questions posed by novel and rapidly changing technologies, there is widespread consensus that successful intervention design demands a user-centered and iterative approach to development, using mixed methods and in-depth qualitative research to progressively refine the intervention to meet user requirements.

Theory-based strategies for enhancing the impact and usage of digital health behaviour change interventions: A review.

There is growing evidence that digital interventions can successfully effect meaningful changes in health-related behaviour. However, optimisation of digital intervention delivery is challenged by low usage, high attrition and small effect sizes. Whilst a number of conceptual frameworks and models exist to guide intervention planning and development, insufficient attention has been paid to how existing psychological theory could inform the optimal implementation and delivery of the design features commonly used in digital health behaviour change interventions. This paper provides a critical review of psychological theories and models in order to consider their implications for the design of digital interventions. The theories reviewed include theories of: persuasion and attitude change; motivation; volition and self-regulation; patient preferences for participation in medical decision making; and social support. A set of theory-based guidelines is provided to inform the development of future interventions.

Understanding usage of a hybrid website and smartphone app for weight management: a mixed-methods study.

BACKGROUND: Advancements in mobile phone technology offer huge potential for enhancing the timely delivery of health behavior change interventions. The development of smartphone-based health interventions (apps) is a rapidly growing field of research, yet there have been few longitudinal examinations of how people experience and use these apps within their day-to-day routines, particularly within the context of a hybrid Web- and app-based intervention. OBJECTIVE: This study used an in-depth mixed-methods design to examine individual variation in (1) impact on self-reported goal engagement (ie, motivation, self-efficacy, awareness, effort, achievement) of access to a weight management app (POWeR Tracker) when provided alongside a Web-based weight management intervention (POWeR) and (2) usage and views of POWeR Tracker. METHODS: Thirteen adults were provided access to POWeR and were monitored over a 4-week period. Access to POWeR Tracker was provided in 2 alternate weeks (ie, weeks 1 and 3 or weeks 2 and 4). Participants' goal engagement was measured daily via self-report. Mixed effects models were used to examine change in goal engagement between the weeks when POWeR Tracker was and was not available and whether the extent of change in goal engagement varied between individual participants. Usage of POWeR and POWeR Tracker was automatically recorded for each participant. Telephone interviews were conducted and analyzed using inductive thematic analysis to further explore participants' experiences using POWeR and POWeR Tracker. RESULTS: Access to POWeR Tracker was associated with a significant increase in participants' awareness of their eating (ß1=0.31, P=.04) and physical activity goals (ß1=0.28, P=.03). The level of increase varied between individual participants. Usage data showed that participants used the POWeR website for similar amounts of time during the weeks when POWeR Tracker was (mean 29 minutes, SD 31 minutes) and was not available (mean 27 minutes, SD 33 minutes). POWeR Tracker was mostly accessed in short bursts (mean 3 minutes, SD 2 minutes) during convenient moments or moments when participants deemed the intervention content most relevant. The qualitative data indicated that nearly all participants agreed that it was more convenient to access information on-the-go via their mobiles compared to a computer. However, participants varied in their views and usage of the Web- versus app-based components and the informational versus tracking tools provided by POWeR Tracker. CONCLUSIONS: This study provides evidence that smartphones have the potential to improve individuals' engagement with their health-related goals when used as a supplement to an existing online intervention. The perceived convenience of mobile access to information does not appear to deter use of Web-based interventions or strengthen the impact of app access on goal engagement. A mixed-methods design enabled exploration of individual variation in daily usage of the app-based tools.

What design features are used in effective e-health interventions? A review using techniques from Critical Interpretive Synthesis.

The effectiveness of e-health interventions varies greatly. Despite this, there has been relatively little formal consideration of how differences in the design of an intervention (i.e., how the content is delivered) may explain why some interventions are more effective than others. This review primarily examines the use of the Internet to provide educational and self-management interventions to promote health. The article develops hypotheses about how the design of these interventions may be associated with outcomes. In total, 52 published reports from both a diversity sample and a representative sample were reviewed using techniques from Critical Interpretive Synthesis. Four core interactive design features were identified that may mediate the effects of intervention design on outcomes: Social context and support, contacts with intervention, tailoring, and self-management. A conceptual framework to summarize the design of e-health interventions delivered using the Internet is proposed. The framework provides a guide for systematic research to identify the effects of specific design features on intervention outcomes and to identify the mechanisms underlying any effects. To optimize the design of e-health interventions more work is needed to understand how and why these design features may affect intervention outcomes and to investigate the optimal implementation and dosage of each design feature.

Understanding reactions to an internet-delivered health-care intervention: accommodating user preferences for information provision.

BACKGROUND: It is recognised as good practice to use qualitative methods to elicit users' views of internet-delivered health-care interventions during their development. This paper seeks to illustrate the advantages of combining usability testing with 'theoretical modelling', i.e. analyses that relate the findings of qualitative studies during intervention development to social science theory, in order to gain deeper insights into the reasons and context for how people respond to the intervention. This paper illustrates how usability testing may be enriched by theoretical modelling by means of two qualitative studies of users' views of the delivery of information in an internet-delivered intervention to help users decide whether they needed to seek medical care for their cold or flu symptoms. METHODS: In Study 1, 21 participants recruited from a city in southern England were asked to 'think aloud' while viewing draft web-pages presented in paper format. In Study 2, views of our prototype website were elicited, again using think aloud methods, in a sample of 26 participants purposively sampled for diversity in education levels. Both data-sets were analysed by thematic analysis. RESULTS: Study 1 revealed that although the information provided by the draft web-pages had many of the intended empowering benefits, users often felt overwhelmed by the quantity of information. Relating these findings to theory and research on factors influencing preferences for information-seeking we hypothesised that to meet the needs of different users (especially those with lower literacy levels) our website should be designed to provide only essential personalised advice, but with options to access further information. Study 2 showed that our website design did prove accessible to users with different literacy levels. However, some users seemed to want still greater control over how information was accessed. CONCLUSIONS: Educational level need not be an insuperable barrier to appreciating web-based access to detailed health-related information, provided that users feel they can quickly gain access to the specific information they seek.

What infection control measures will people carry out to reduce transmission of pandemic influenza? A focus group study.

BACKGROUND: Pandemic influenza poses a future health threat against which infection control behaviours may be an important defence. However, there is little qualitative research examining perceptions of infection control measures in the context of pandemic influenza. METHODS: Eight focus groups and one interview were conducted with a purposive sample of 31 participants. Participants were invited to discuss their perceptions of infection transmission and likely adherence to infection control measures in both non-pandemic and pandemic contexts. Infection control measures discussed included handwashing, social distancing and cough hygiene (e.g. covering mouth, disposing of tissues immediately etc.). RESULTS: Thematic analysis revealed that although participants were knowledgeable about infection transmission, most expressed unfavourable attitudes toward control behaviours in non-pandemic situations. However, with the provision of adequate education about control measures and appropriate practical support (e.g. memory aids, access to facilities), most individuals report that they are likely to adhere to infection control protocols in the event of a pandemic. Of the behaviours likely to influence infection transmission, handwashing was regarded by our participants as more feasible than cough and sneeze hygiene and more acceptable than social distancing. CONCLUSION: Handwashing could prove a useful target for health promotion, but interventions to promote infection control may need to address a number of factors identified within this study as potential barriers to carrying out infection control behaviours.