Integrating Validity Evidence to Revise a Child Abuse Knowledge Test for Early Childhood Education Providers: A Mixed Methods Approach.

Knowledge tests used to evaluate child protection training program effectiveness for early childhood education providers may suffer from threats to construct validity given the contextual variability inherent within state-specific regulations around mandated reporting requirements. Unfortunately, guidance on instrument revision that accounts for such state-specific mandated reporting requirements is lacking across research on evaluation practices. This study, therefore, explored how collection and integration of validity evidence using a mixed methods framework can guide the instrument revision process to arrive at a more valid program outcome measure.

A randomized control trial of a child abuse mandated reporter training: Knowledge and attitudes.

BACKGROUND: Despite being well-positioned to identify maltreatment in the children that they provide care for and being legally required to report suspected child maltreatment, early childhood professionals (ECPs) make a limited proportion of reports to child protective services. It is critical to identify evidence-based interventions to improve the reporting practices of this group of mandated reporters allowing for the better protection of children from maltreatment. OBJECTIVE: The goal of the present study was to determine if iLookOut, an online child abuse identification and reporting training for ECPs, results in differential gains in knowledge and attitudes towards child abuse and its reporting among ECPs, as compared to an online standard training. PARTICIPANTS AND SETTING: Both interventions were completed online by participants recruited from licensed child care programs in Southern Maine from October 2017 to January 2020. Eligibility criteria included being at least 18 years of age, English-speaking, and working as paid or volunteer staff at a licensed child care program taking care of children 5 years of age or younger. Of the 1152 enrolled individuals, 1094 provided complete pre- and post-intervention data. METHODS: A randomized controlled trial comparing iLookOut with an online standard training. RESULTS: ECPs who completed iLookOut significantly outperformed those who completed Standard mandated reporter training in terms of both knowledge (d=1.09 vs. 0.67) and attitudes (d=0.67 vs. 0.54) relative to pre-test scores. CONCLUSIONS: iLookOut is a promising candidate for widespread use in meeting the need for evidence-based training on child abuse and its reporting.

COGNITIVE MAPPING FOR ILOOKOUT FOR CHILD ABUSE: AN ONLINE TRAINING PROGRAM FOR EARLY CHILDHOOD PROFESSIONALS.

This article delineates the theory and framework for an innovative child abuse training program for mandated reporters called 'iLookOut'. iLookOut is an online learning delivery system that utilizes mastery learning and self-determination theory in the Core Training program, along with spaced retrieval and retrieval practice in a follow-up micro-learning program that reinforces learning from the Core Training. A cognitive mapping model provides the structure for documenting and organizing the learning content in both the Core training and the follow-up micro-learning program. The article provides a conceptual framework for designing and implementing effective and efficient online learning programs.

Generalizing findings from a randomized controlled trial to a real-world study of the iLookOut, an online education program to improve early childhood care and education providers' knowledge and attitudes about reporting child maltreatment.

In recent years, real-world studies (RWS) are gaining increasing interests, because they can generate more realistic and generalizable results than randomized controlled clinical trials (RCT). In 2017, we published a RCT in 741 early childhood care and education providers (CCPs). It is the Phase I of our iLookOut for Child Abuse project (iLookOut), an online, interactive learning module about reporting suspected child maltreatment. That study demonstrated that in a RCT setting, the iLookOut is efficient at improving CCPs' knowledge of and attitudes towards child maltreatment reporting. However, the generalizability of that RCT's results in a RWS setting remains unknown. To address this question, we design and conduct this large RWS in 11,065 CCPs, which is the Phase II of the iLookOut. We hypothesize replication of the earlier RCT findings, i.e., the iLookOut can improve CCPs' knowledge of and attitudes toward child maltreatment reporting in a real world setting. In addition, this RWS also explores whether demographic factors affect CCPs' performance. Results of this RWS confirmed the generalizability of the previous RCT's results in a real world setting. It yielded similar effect sizes for knowledge and attitudes as were found in the earlier RCT. Cohen's d for knowledge improvement was 0.95 in that RCT, 0.96 in this RWS; Cohen's d for attitude improvement was 0.98 in that RCT, 0.80 in this RWS. Also, we found several significant differences in knowledge and attitude improvement with regard to age, race, education, and employment status. In conclusion, iLookOut improves knowledge and attitudes of CCPs about child maltreatment prevention and reporting in a real-world setting. The generalizability of the initial RCT findings to this RWS provides strong evidence that the iLookout will be effective in other real world settings. It can be a useful model for other interventions aimed at preventing child maltreatment. Clinical trial registration for the original RCT: NCT02225301 (ClinicalTrials.gov Identifier).