Transparency and reproducibility in the Adolescent Brain Cognitive Development (ABCD) study.

BACKGROUND: Transparency can build trust in the scientific process, but scientific findings can be undermined by poor and obscure data use and reporting practices. The purpose of this work is to report how data from the Adolescent Brain Cognitive Development (ABCD) Study has been used to date, and to provide practical recommendations on how to improve the transparency and reproducibility of findings. METHODS: Articles published from 2017 to 2023 that used ABCD Study data were reviewed using more than 30 data extraction items to gather information on data use practices. Total frequencies were reported for each extraction item, along with computation of a Level of Completeness (LOC) score that represented overall endorsement of extraction items. Univariate linear regression models were used to examine the correlation between LOC scores and individual extraction items. Post hoc analysis included examination of whether LOC scores were correlated with the logged 2-year journal impact factor. RESULTS: There were 549 full-length articles included in the main analysis. Analytic scripts were shared in 30 % of full-length articles. The number of participants excluded due to missing data was reported in 60 % of articles, and information on missing data for individual variables (e.g., household income) was provided in 38 % of articles. A table describing the analytic sample was included in 83 % of articles. A race and/or ethnicity variable was included in 78 % of reviewed articles, while its inclusion was justified in only 41 % of these articles. LOC scores were highly correlated with extraction items related to examination of missing data. A bottom 10 % of LOC score was significantly correlated with a lower logged journal impact factor when compared to the top 10 % of LOC scores (ß=-0.77, 95 % -1.02, -0.51; p-value < 0.0001). CONCLUSION: These findings highlight opportunities for improvement in future papers using ABCD Study data to readily adapt analytic practices for better transparency and reproducibility efforts. A list of recommendations is provided to facilitate adherence in future research.

Transparency and Reproducibility in the Adolescent Brain Cognitive Development (ABCD) Study.

Background: Transparency can build trust in the scientific process, but scientific findings can be undermined by poor and obscure data use and reporting practices. The purpose of this work is to report how data from the Adolescent Brain Cognitive Development (ABCD) Study has been used to date, and to provide practical recommendations on how to improve the transparency and reproducibility of findings. Methods: Articles published from 2017 to 2023 that used ABCD Study data were reviewed using more than 30 data extraction items to gather information on data use practices. Total frequencies were reported for each extraction item, along with computation of a Level of Completeness (LOC) score that represented overall endorsement of extraction items. Univariate linear regression models were used to examine the correlation between LOC scores and individual extraction items. Post hoc analysis included examination of whether LOC scores were correlated with the logged 2-year journal impact factor. Results: There were 549 full-length articles included in the main analysis. Analytic scripts were shared in 30% of full-length articles. The number of participants excluded due to missing data was reported in 60% of articles, and information on missing data for individual variables (e.g., household income) was provided in 38% of articles. A table describing the analytic sample was included in 83% of articles. A race and/or ethnicity variable was included in 78% of reviewed articles, while its inclusion was justified in only 41% of these articles. LOC scores were highly correlated with extraction items related to examination of missing data. A bottom 10% of LOC score was significantly correlated with a lower logged journal impact factor when compared to the top 10% of LOC scores (ß=-0.77, 95% -1.02, -0.51; p-value < 0.0001). Conclusion: These findings highlight opportunities for improvement in future papers using ABCD Study data to readily adapt analytic practices for better transparency and reproducibility efforts. A list of recommendations is provided to facilitate adherence in future research.

Lifetime residential data collection protocol for the Adolescent Brain Cognitive Development (ABCD) Study.

Understanding the impacts of environmental exposures on health outcomes during development is an important area of research for plenty of reasons. Collecting retrospective and prospective residential history can enrich observational studies through eventual linkages to external sources. Augmenting participant health outcome data with environmental data can better inform on the role of the environment, thereby enhancing prevention and intervention efforts. However, collecting the geospatial information needed for this type of research can be difficult, especially when data are collected directly from participants. Participants' residential histories are unique and often complex. Collecting residential history data often involves capturing precise spatial locations along specific timeframes as well as contending with recall bias and unique, complex living arrangements. When trying to assess lifetime environmental exposures, researchers must consider the many changes in location a person goes through and the timeframes in which these changes occur, ultimately creating a multidimensional and dynamic dataset. Creating data collection protocols that are feasible to administer, result in accurate data, and minimize data missingness is a major challenge to undertake. Here, we provide an overview of the protocol developed to collect the lifetime residential address information of participants in the Adolescent Brain Cognitive Development (ABCD) Study.

Lifetime residential history collection and processing for environmental data linkages in the ABCD study.

By using geospatial information such as participants' residential history along with external datasets of environmental exposures, ongoing studies can enrich their cohorts to investigate the role of the environment on brain-behavior health outcomes. However, challenges may arise if clear guidance and key quality control steps are not taken at the outset of data collection of residential information. Here, we detail the protocol development aimed at improving the collection of lifetime residential address information from the Adolescent Brain Cognitive Development (ABCD) Study. This protocol generates a workflow for minimizing gaps in residential information, improving data collection processes, and reducing misclassification error in exposure estimates.