Masked analysis for small-scale cluster randomized controlled trials.

Researchers conducting small-scale cluster randomized controlled trials (RCTs) during the pilot testing of an intervention often look for evidence of promise to justify an efficacy trial. We developed a method to test for intervention effects that is adaptive (i.e., responsive to data exploration), requires few assumptions, and is statistically valid (i.e., controls the type I error rate), by adapting masked visual analysis techniques to cluster RCTs. We illustrate the creation of masked graphs and their analysis using data from a pilot study in which 15 high school programs were randomly assigned to either business as usual or an intervention developed to promote psychological and academic well-being in 9th grade students in accelerated coursework. We conclude that in small-scale cluster RCTs there can be benefits of testing for effects without a priori specification of a statistical model or test statistic.

A Motivational Interviewing Intervention for Adolescents in Accelerated High School Curricula: Applicability and Acceptability in a Second Sample.

The paper describes the applicability and acceptability of a selective intervention-Motivation, Assessment, and Planning (MAP)-for high school students that was developed based on the principles of motivational interviewing (MI) and tailored to the unique needs and strengths of students taking accelerated coursework, specifically Advanced Placement (AP) and International Baccalaureate (IB) classes. In addition to detailing the intervention in terms of MI spirit, processes, and relational and technical skills, we report applicability and acceptability data from a second iteration of MAP implementation in eight AP/IB programs in a Southeastern state during spring 2018. We analyzed quantitative and qualitative acceptability data from 121 high school freshmen (97 from AP and 24 from IB courses), as well as the seven MAP coaches who were trained using the Motivational Interview Training and Assessment System (Frey et al. 2017). To gain perspectives from the intended end users of the refined MAP, 12 school counselors and school psychologists who were not trained in MAP evaluated the intervention and provided qualitative and quantitative data on applicability and acceptability. All three stakeholder groups (students, coaches, and school mental health staff) rated and described the intervention as highly acceptable and appropriate for addressing the social-emotional needs of adolescents in AP/IB classes.