ABSTRACT
Preschool-aged children's performance on inhibitory control tasks is typically represented by the overall accuracy of their item responses (e.g., mean proportion correct). However, in settings where children vary widely in age or ability level, inhibitory control tasks are susceptible to ceiling effects, which undermine measurement precision. We have previously demonstrated a general approach for scoring inhibitory control tasks that combines item-level accuracy and reaction-time information to minimize ceiling effects. Here, we extend that approach by incorporating additional item-level reaction time data from an adjunct (simple reaction time) task. We contrast three approaches for scoring inhibitory control tasks, two of which rely exclusively on item accuracy information and a third which also considers item reaction time information. We demonstrate the impacts of these different approaches to scoring with two inhibitory control tasks that were included in a recent evaluation of the Red Light, Purple Light intervention in preprimary classrooms in Nairobi County, Kenya. We limited our study to children who met inclusion criteria at pre-test (N = 418; 51% male; mean age = 4.8 years) or post-test (N = 386; 51% male; mean age = 4.8 years). Children's performance on individual inhibitory control tasks was strongly correlated regardless of the scoring approach (rs = 0.73-0.97 across two tasks). However, the combined accuracy and reaction time scores eliminated ceiling effects that were common when only accuracy information was used. The combined accuracy and reaction time models also distinguished item-level RT into inhibitory control and processing speed components, which are distinct constructs. Results are discussed with respect to the challenges and nuances of the estimation and interpretation of inhibitory control task scores with children of varied ages and ability levels.
ABSTRACT
This study adapted and tested the efficacy of the Red-Light Purple-Light (RLPL) games for improving executive function (EF) skills in preprimary classrooms in Nairobi, Kenya. A cluster randomized controlled trial was used to evaluate the efficacy of the adapted RLPL intervention. Specifically, 24 centers (including 48 classrooms) were randomized to the RLPL or a wait-list control condition. Consistent with previous studies, participating classrooms delivered 16 lessons across an 8-week intervention period. A total of 479 children were recruited into the study. After exclusions based on child age and data quality, 451 and 404 children (90% retention) had completed computerized assessments of EF skills at pre- and posttest assessments, respectively. Children in the RLPL centers did not demonstrate any improvements in EF skills relative to their peers in the wait-list control condition (Cohen's ds = -0.14 to 0.03, all ps > 0.20). Exploratory tests of moderators (language of assessment, grade, school type, baseline ability) were also all null. Results are discussed with respect to measurement limitations and contextual factors that may explain the null results of RLPL on EF skills in young children in Kenya.
