The methodological integrity of critical qualitative research: Principles to support design and research review.

This article articulates principles and practices that support methodological integrity in relation to critical qualitative research. We begin by describing 2 changes that have occurred in psychological methods over the last 15 years. (a) Building on foundational work advocating for epistemological pluralism, guidelines on how to design, review, and report qualitative and mixed methods have been advanced to support methodological integrity in keeping with a diversity of researchers' aims and approaches. (b) There has been an increased use of critical epistemological perspectives and critical methods. In light of these changes, the current article puts forward principles to support critical qualitative researchers when considering methodological rigor and when formulating rationales to support their methods in the journal article review process. Illustrating the principles with an example of critical research, the article describes common problems and issues in the research design process that can be considered in order to strengthen the returns of critical studies. Recommendations are made for editors and reviewers on how to conduct reviews of critical qualitative research, and pressing concerns for publishing critical qualitative research are detailed. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Pilot Randomized Controlled Trial of a Novel Smoking Cessation App Designed for Individuals With Co-Occurring Tobacco Use Disorder and Serious Mental Illness.

INTRODUCTION: High rates of tobacco use among people with serious mental illness (SMI), along with their unique needs, suggest the importance of developing tailored smoking cessation interventions for this group. Previous early-phase work empirically validated the design and content of Learn to Quit, a theory-based app designed for this population. METHODS: In a pilot randomized controlled trial, we compared the feasibility, acceptability, and preliminary efficacy of Learn to Quit versus QuitGuide, an app designed for the general population. All participants received nicotine replacement therapy and technical assistance. Daily smokers with SMI (N = 62) participated in the trial with outcomes assessed at weeks 4, 8, 12, and 16. RESULTS: Compared to QuitGuide, Learn to Quit participants had similar number of days of app use (34 vs. 32, p = .754), but larger number of app interactions (335 vs. 205; p = .001), longer durations of app use (4.24 hrs. vs. 2.14 hrs; p = .044), and higher usability scores (85 vs. 79, p = .046). At week 16, Learn to Quit led to greater reductions in cigarettes per day (12.3 vs. 5.9 for QuitGuide; p = 0.10). Thirty-day point prevalence abstinence was verified in 12% of Learn to Quit participants versus 3% of QuitGuide participants (odds ratio = 3.86, confidence interval = 0.41 to 36, p = .239). Changes in psychiatric symptoms and adverse events were not clinically significant between conditions. CONCLUSIONS: This pilot trial provides strong evidence of Learn to Quit's usability, feasibility, and safety. Preliminary evidence suggests the app may be efficacious. A randomized controlled efficacy trial is needed to test the app in a larger sample of smokers with SMI. IMPLICATIONS: This study suggests that the Learn to Quit app is a feasible approach to deliver smoking cessation treatment in patients with co-occurring tobacco use disorder and SMI. This means that, if found efficacious, this technology could be used to deploy smoking cessation treatment to larger segments of this population, hence improving public health. Therefore, a randomized controlled trial should be conducted to examine the efficacy of this digital intervention.

Formative, multimethod case studies of learn to quit, an acceptance and commitment therapy smoking cessation app designed for people with serious mental illness.

Despite public health efforts, individuals with serious mental illness (SMI) still have very high rates of tobacco smoking. Innovative approaches to reach this population are needed. These series of case studies aimed to descriptively evaluate the usability, user experience (UX), and user engagement (UE) of Learn to Quit (LTQ), an acceptance and commitment therapy smoking cessation app designed for people with SMI, and to compare it with an app designed for the general population, NCI (National Cancer Institute) QuitGuide (QG). Both apps were combined with nicotine replacement therapy and technical coaching. Inspired by the ORBIT model, we implemented two case studies with crossover AB interventions, two B-phase training designs, and three bi-phasic AB single-case designs with Start-Point and Order randomization (A = QG, B = LTQ). Study outcomes were measured using the System Usability Scale, UX interviews, and background analytics. LTQ's usability levels were above the standard cutoff and on average higher than QG. UX outcomes suggested the relative benefits of LTQ's visual design, gamification and simple design structure. LTQ's overall UE was high; the app was opened for an average of 14 min per day (vs. QG: 7 min). However, users showed low levels of UE with each of the app's tracking feature. Measures of psychiatric functioning suggested the safety of LTQ in people with SMI. LTQ appears to be a usable and engaging smoking cessation app in people with SMI. An optimized version of LTQ should be tested in a Phase II study.

User-Centered Design of Learn to Quit, a Smoking Cessation Smartphone App for People With Serious Mental Illness.

BACKGROUND: Smoking rates in the United States have been reduced in the past decades to 15% of the general population. However, up to 88% of people with psychiatric symptoms still smoke, leading to high rates of disease and mortality. Therefore, there is a great need to develop smoking cessation interventions that have adequate levels of usability and can reach this population. OBJECTIVE: The objective of this study was to report the rationale, ideation, design, user research, and final specifications of a novel smoking cessation app for people with serious mental illness (SMI) that will be tested in a feasibility trial. METHODS: We used a variety of user-centered design methods and materials to develop the tailored smoking cessation app. This included expert panel guidance, a set of design principles and theory-based smoking cessation content, development of personas and paper prototyping, usability testing of the app prototype, establishment of app's core vision and design specification, and collaboration with a software development company. RESULTS: We developed Learn to Quit, a smoking cessation app designed and tailored to individuals with SMI that incorporates the following: (1) evidence-based smoking cessation content from Acceptance and Commitment Therapy and US Clinical Practice Guidelines for smoking cessation aimed at providing skills for quitting while addressing mental health symptoms, (2) a set of behavioral principles to increase retention and comprehension of smoking cessation content, (3) a gamification component to encourage and sustain app engagement during a 14-day period, (4) an app structure and layout designed to minimize usability errors in people with SMI, and (5) a set of stories and visuals that communicate smoking cessation concepts and skills in simple terms. CONCLUSIONS: Despite its increasing importance, the design and development of mHealth technology is typically underreported, hampering scientific innovation. This report describes the systematic development of the first smoking cessation app tailored to people with SMI, a population with very high rates of nicotine addiction, and offers new design strategies to engage this population. mHealth developers in smoking cessation and related fields could benefit from a design strategy that capitalizes on the role visual engagement, storytelling, and the systematic application of behavior analytic principles to deliver evidence-based content.

User Experience Evaluation of a Smoking Cessation App in People With Serious Mental Illness.

INTRODUCTION: Smoking rates among people with serious mental illness are 3 to 4 times higher than the general population, yet currently there are no smoking cessation apps specifically designed to address this need. We report the results of a User Experience (UX) evaluation of a National Cancer Institute smoking cessation app, QuitPal, and provide user centered design data that can be used to tailor smoking cessation apps for this population. METHODS: Two hundred forty hours of field experience with QuitPal, 10 hours of recorded interviews and task performances, usage logs and a self-reported usability scale, informed the results of our study. Participants were five individuals recruited from a community mental health clinic with a reported serious mental illness history. Performance, self-reports, usage logs and interview data were triangulated to identify critical usability errors and UX themes emerging from this population. RESULTS: Data suggests QuitPal has below average levels of usability, elevated time on task performances and required considerable amounts of guidance. UX themes provided critical information to tailor smoking cessation apps for this population, such as the importance of breaking down "cessation" into smaller steps and use of a reward system. CONCLUSIONS: This is the first study to examine the UX of a smoking cessation app among people with serious mental illness. Data from this study will inform future research efforts to expand the effectiveness and reach of smoking cessation apps for this highly nicotine dependent yet under-served population. IMPLICATIONS: Data from this study will inform future research efforts to expand the effectiveness and reach of smoking cessation apps for people with serious mental illness, a highly nicotine dependent yet under-served population.