The challenges of assessing sample representativeness within community-based evaluations of parenting programmes delivered in England and Ireland.

The findings from evaluations of parenting programmes can help inform policy and practice decisions, including how best to allocate scarce resources designed to support families. However, studies often fail to consider the extent to which the findings can be generalised to other settings or populations. One, yet unexplored solution, is to compare study findings and large-scale data sets including publicly available population data. The aims of this study were to assess the feasibility of assessing sample representativeness using publicly available data and to identify the challenges involved in considering the generalisability of study findings. Sociodemographic data from two community-based evaluations of parenting programmes conducted in England and Ireland between 2015 and 2018 were used in the study (N = 395 parent-infant dyads). The results indicated some differences between the trial samples and the wider population. However, it is difficult to reach definitive conclusions about these findings due to the limitations associated with using the comparative data sets. Our study revealed three key challenges, including: (1) how best to define and conceptualise representativeness; (2) the availability of comparative data sets; and (3) the quality of the available data. Our study suggests that there is a need for up-to-date, good-quality comparative data sets to allow for the assessment of representativeness. Further work is required to identify parameters for making claims about representativeness, specifically regarding the acceptable level of difference between the target population and the study sample. This is the first study to explore the feasibility of using publicly available population data in two jurisdictions, for the purpose of making judgements about the representativeness of the findings from parent programmes. It is hoped that our results will encourage further investigation around the reporting of trial external validity to enable effective decision-making at policy and practice level.

Psychometric Properties of Parent-Child (0-5 years) Interaction Outcome Measures as Used in Randomized Controlled Trials of Parent Programs: A Systematic Review.

This systematic review sought to identify observational measures of parent-child interactions commonly implemented in parenting program research, and to assess the level of psychometric evidence available for their use with this age group. Two separate searches of the same databases were conducted; firstly, to identify eligible instruments, and secondly to identify studies reporting on the psychometric properties of the identified measures. Five commercial platforms hosting 19 electronic databases were searched from their inception to conducted search dates. Fourteen measures were identified from Search 1; a systematic search of randomized controlled trial evaluations of parenting programs. For Search 2, inclusion/exclusion criteria were applied to 1327 retrieved papers that described the development and/or validation of the 14 measures identified in Search 1. Seventeen articles met the inclusion criteria, resulting in five observational measures for the final review. Data were extracted and synthesized using the COSMIN rating system to describe the methodological quality of each article alongside the overall quality rating of the psychometric property reported for each measure using the Terwee checklist. Measure reliability was categorized into four domains (internal consistency, test-re-test, inter-rater, and intra-rater). Measure validity was categorized into four domains (content, structural, convergent/divergent, and discriminant). Results indicated that the majority of psychometric evidence related to children aged from birth the three with internal consistency, inter-rater reliability, and structural validity the most commonly reported properties, although this evidence was often weak. The findings suggest further validation of the included measures is required to establish acceptability for the whole target age group.

Psychometric Properties of Child (0-5 Years) Outcome Measures as used in Randomized Controlled Trials of Parent Programs: A Systematic Review.

This systematic review is one of the three which sought to identify measures commonly implemented in parenting program research, and to assess the level of psychometric evidence available for their use with this age group. This review focuses specifically on measures of child social-emotional and behavioral outcomes. Two separate searches of the same databases were conducted; firstly to identify eligible instruments, and secondly to identify studies reporting on the psychometric properties of the identified measures. Five commercial platforms hosting 19 electronic databases were searched from their inception to conducted search dates. Twenty-four measures were identified from Search 1: a systematic search of randomized controlled trial evaluations of parenting programs. For Search 2, inclusion/exclusion criteria were applied to 21,329 articles that described the development and/or validation of the 24 measures identified in Search 1. Thirty articles met the inclusion criteria. resulting in 11 parent report questionnaires and three developmental assessment measures for review. Data were extracted and synthesized to describe the methodological quality of each article using the COSMIN checklist alongside the overall quality rating of the psychometric property reported for each measure. Measure reliability was categorized into four domains (internal consistency, test-re-test, inter-rater, and intra-rater). Measure validity was categorized into four domains (content, structural, convergent/divergent, and discriminant). Results indicated that supporting evidence for included measures is weak. Further work is required to improve the evidence base for those measures designed to assess children's social-emotional and behavioral development in this age group. PROSPERO Registration number: CRD42016039600.

Psychometric Properties of Parent Outcome Measures Used in RCTs of Antenatal and Early Years Parent Programs: A Systematic Review.

Parenting programs are effective in the early intervention and treatment of children's social, emotional and behavioural difficulties. However, inconsistency in the use of outcome measures limits the comparability of programs and creates challenges for practitioners seeking to monitor progress of families in their care. A systematic review was conducted to identify measures, appraise their psychometric properties and ease of implementation, with the overall objective of recommending a small battery of measures for use by researchers and practitioners. This article provides an overview of the most commonly used measures in experimental evaluations of parenting programs delivered to parents of children up to, and including, the age of 5 years (including antenatal programs). An in-depth appraisal of the psychometric properties and ease of implementation of parent outcome measures is also presented (findings in relation to child and dyadic outcome measures are presented elsewhere). Following a systematic search, 64 measures were identified as being used in three or more of 279 included evaluation studies. Data on the psychometric properties of 18 parent outcome measures were synthesised from 87 development and validation studies. Whilst it was not possible to identify a definitive battery of recommended measures, we are able to recommend specific measures that could be prioritised in further research and development and hold promise for those seeking to monitor the outcomes of parents and children in receipt of parenting programs.

Enhancing Social-Emotional Health and Wellbeing in the Early Years (E-SEE): a study protocol of a community-based randomised controlled trial with process and economic evaluations of the incredible years infant and toddler parenting programmes, delivered in a proportionate universal model.

INTRODUCTION: Behavioural and mental disorders have become a public health crisis and by 2020 may surpass physical illness as a major cause of disability. Early prevention is key. Two Incredible Years (IY) parent programmes that aim to enhance child well-being and development, IY Infant and IY Toddler, will be delivered and evaluated in a proportionate universal intervention model called Enhancing Social-Emotional Health and Wellbeing in the Early Years (E-SEE) Steps. The main research question is: Does E-SEE Steps enhance child social emotional well-being at 20 months when compared with services as usual? METHODS AND ANALYSIS: E-SEE Steps will be delivered in community settings by Early Years Children's Services and/or Public Health staff across local authorities. Parents of children aged 8 weeks or less, identified by health visitors, children's centre staff or self-referral, are eligible for participation in the trial. The randomisation allocation ratio is 5:1 (intervention to control). All intervention parents will receive an Incredible Years Infant book (universal level), and may be offered the Infant and/or Toddler group-based programme/s-based on parent depression scores on the Patient Health Questionnaire or child social emotional well-being scores on the Ages and Stages Questionnaire: Social Emotional, Second Edition (ASQ:SE-2). Control group parents will receive services as usual. A process and economic evaluation are included. The primary outcome for the study is social emotional well-being, assessed at 20 months, using the ASQ:SE-2. Intention-to-treat and per protocol analyses will be conducted. Clustering and hierarchical effects will be accounted for using linear mixed models. ETHICS AND DISSEMINATION: Ethical approvals have been obtained from the University of York Education Ethics Committee (ref: FC15/03, 10 August 2015) and UK NHS REC 5 (ref: 15/WA/0178, 22 May 2015. The current protocol is Version 9, 26 February 2018. The sponsor of the trial is the University of York. Dissemination of findings will be via peer-reviewed journals, conference presentations and public events. TRIAL REGISTRATION NUMBER: ISRCTN11079129; Pre-results.