An Online Psychological Program for Adolescents and Young Adults With Headaches: Iterative Design and Rapid Usability Testing.

BACKGROUND: Headache disorders are common, debilitating health problems. Cognitive-behavioral therapy (CBT) is recommended but rarely easily available. With the use of the internet and communication technologies among youth and young adults, these individuals could be self-trained in CBT skills. There is an increasing number of internet-based interventions for headaches, but there has been little research into the usability of these interventions because evaluating usability across the intervention development life cycle is costly. We developed an internet-based CBT program, the Specialized Program for Headache Reduction (SPHERE). While developing it, we aimed to improve SPHERE through rapid usability testing cycles. OBJECTIVE: This study aims to presents a rapid and affordable usability testing approach that can be performed throughout the intervention development life cycle. This paper also provides evidence of the usability of SPHERE. METHODS: We used the "think aloud" usability testing method based on Krug's approach to test user interaction within a lab setting. This was followed by a short posttest interview. We planned to test SPHERE with 3-5 participants testing the same part of the program each cycle. Both the design and development team and the research team actively participated in the usability testing process. Observers independently identified the top 3 usability issues, rated their severity, and conducted debriefing sessions to come to consensus on major issues and generate potential solutions. RESULTS: The testing process allowed major usability issues to be identified and rectified rapidly before piloting SPHERE in a real-world context. A total of 2 cycles of testing were conducted. Of the usability issues encountered in cycles 1 and 2, a total of 68% (17/25) and 32% (12/38), respectively, were rated as major, discussed, and fixed. CONCLUSIONS: This study shows that rapid usability testing is an essential part of the design process that improves program functionality and can be easy and inexpensive to undertake.

A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression.

Depression is a common mental health condition for which many mobile apps aim to provide support. This review aims to identify self-help apps available exclusively for people with depression and evaluate those that offer cognitive behavioural therapy (CBT) or behavioural activation (BA). One hundred and seventeen apps have been identified after searching both the scientific literature and the commercial market. 10.26% (n = 12) of these apps identified through our search offer support that seems to be consistent with evidence-based principles of CBT or BA. Taking into account the non existence of effectiveness/efficacy studies, and the low level of adherence to the core ingredients of the CBT/BA models, the utility of these CBT/BA apps are questionable. The usability of reviewed apps is highly variable and they rarely are accompanied by explicit privacy or safety policies. Despite the growing public demand, there is a concerning lack of appropiate CBT or BA apps, especially from a clinical and legal point of view. The application of superior scientific, technological, and legal knowledge is needed to improve the development, testing, and accessibility of apps for people with depression.

A Systematic Review Exploring the Social Cognitive Theory of Self-Regulation as a Framework for Chronic Health Condition Interventions.

BACKGROUND: Theory is often recommended as a framework for guiding hypothesized mechanisms of treatment effect. However, there is limited guidance about how to use theory in intervention development. METHODS: We conducted a systematic review to provide an exemplar review evaluating the extent to which use of theory is identified and incorporated within existing interventions. We searched electronic databases PubMed, PsycINFO, CENTRAL, and EMBASE from inception to May 2014. We searched clinicaltrials.gov for registered protocols, reference lists of relevant systematic reviews and included studies, and conducted a citation search in Web of Science. We included peer-reviewed publications of interventions that referenced the social cognitive theory of self-regulation as a framework for interventions to manage chronic health conditions. Two reviewers independently assessed articles for eligibility. We contacted all authors of included studies for information detailing intervention content. We describe how often theory mechanisms were addressed by interventions, and report intervention characteristics used to address theory. RESULTS: Of 202 articles that reported using the social cognitive theory of self-regulation, 52% failed to incorporate self-monitoring, a main theory component, and were therefore excluded. We included 35 interventions that adequately used the theory framework. Intervention characteristics were often poorly reported in peer-reviewed publications, 21 of 35 interventions incorporated characteristics that addressed each of the main theory components. Each intervention addressed, on average, six of eight self-monitoring mechanisms, two of five self-judgement mechanisms, and one of three self-evaluation mechanisms. The self-monitoring mechanisms 'Feedback' and 'Consistency' were addressed by all interventions, whereas the self-evaluation mechanisms 'Self-incentives' and 'External rewards' were addressed by six and four interventions, respectively. The present review establishes that systematic review is a feasible method of identifying use of theory as a conceptual framework for existing interventions. We identified the social cognitive theory of self-regulation as a feasible framework to guide intervention development for chronic health conditions.

Testing the Feasibility and Psychometric Properties of a Mobile Diary (myWHI) in Adolescents and Young Adults With Headaches.

BACKGROUND: Headaches are prevalent among teens and young adults. Self-monitoring is essential for managing headaches and can be accomplished with the help of electronic headache diaries. An increasing number of electronic headache diaries exist, yet the absence of quality standards compromises their use for research and clinical purposes. OBJECTIVE: Our goal was to develop and test the usability, feasibility, and psychometric properties of an electronic diary iPhone application for self-monitoring by adolescents and young adults with headaches. METHODS: We used an iterative participatory design to develop and test our electronic headache diary. Participants aged 14-28 years old with recurrent headaches were recruited internationally. Screening and consent were conducted online. Following completion of an online pre-questionnaire, participants downloaded the diary to use in their natural environment for 14 days. An online post-questionnaire was completed following testing. The diary's usability and feasibility were tested first and determined to be complete when improvements to the diary did not result in a statistically significant impact on indicators of feasibility and adherence. Interviews were conducted with participants of usability and feasibility testing. The psychometric properties of the diary were then tested, and a case study analysis of one participant was completed. RESULTS: Three cycles to test the usability and feasibility were conducted. Each cycle included 11-19 unique participants ranging in age from 16 to 28 years. Following the testing period for each cycle, 15% to 25% of participants took part in the post-cycle interview. Participants perceived the final version of the diary as useful, easy to learn, and efficient to use. Psychometric properties were then tested with a sample of 65 participants (6 aged 14-17 years old; 59 aged 18-28 years old). All items in the diary had substantial between- and within-subjects variability (percent of variance for the two participant groups ranged from 20.64 to 75.60 and 23.74 to 79.21, respectively). Moreover, the Migraine Disability Assessment (MIDAS) included in the diary had adequate between-subjects reliability (R1F=0.66, RKF=0.98), but low within-subjects reliability (RC=0.51). Critical elements of the diary demonstrated adequate convergent and concurrent validity, particularly in the older age group (18-28 years). The validity of some critical elements of the diary could not be explored in the younger age group due to the small subgroup size. The case study provides an example of the potential utility of the diary. CONCLUSIONS: Our electronic headache diary was shown to be a usable and feasible self-monitoring tool when used by adolescents and young adults with headaches for 14 days. This study provides preliminary support of its psychometric properties. Our diary has the potential for helping users to better understand their headaches and, consequently, to change behaviors to improve self-management of their headaches. Its effectiveness as a component of an intervention will be the focus of future research.