Preregistration in practice: A comparison of preregistered and non-preregistered studies in psychology.

Preregistration has gained traction as one of the most promising solutions to improve the replicability of scientific effects. In this project, we compared 193 psychology studies that earned a Preregistration Challenge prize or preregistration badge to 193 related studies that were not preregistered. In contrast to our theoretical expectations and prior research, we did not find that preregistered studies had a lower proportion of positive results (Hypothesis 1), smaller effect sizes (Hypothesis 2), or fewer statistical errors (Hypothesis 3) than non-preregistered studies. Supporting our Hypotheses 4 and 5, we found that preregistered studies more often contained power analyses and typically had larger sample sizes than non-preregistered studies. Finally, concerns about the publishability and impact of preregistered studies seem unwarranted, as preregistered studies did not take longer to publish and scored better on several impact measures. Overall, our data indicate that preregistration has beneficial effects in the realm of statistical power and impact, but we did not find robust evidence that preregistration prevents p-hacking and HARKing (Hypothesizing After the Results are Known).

Increasing the transparency of systematic reviews: presenting a generalized registration form.

This paper presents a generalized registration form for systematic reviews that can be used when currently available forms are not adequate. The form is designed to be applicable across disciplines (i.e., psychology, economics, law, physics, or any other field) and across review types (i.e., scoping review, review of qualitative studies, meta-analysis, or any other type of review). That means that the reviewed records may include research reports as well as archive documents, case law, books, poems, etc. Items were selected and formulated to optimize broad applicability instead of specificity, forgoing some benefits afforded by a tighter focus. This PRISMA 2020 compliant form is a fallback for more specialized forms and can be used if no specialized form or registration platform is available. When accessing this form on the Open Science Framework website, users will therefore first be guided to specialized forms when they exist. In addition to this use case, the form can also serve as a starting point for creating registration forms that cater to specific fields or review types.

Comparing the prevalence of statistical reporting inconsistencies in COVID-19 preprints and matched controls: a registered report.

The COVID-19 outbreak has led to an exponential increase of publications and preprints about the virus, its causes, consequences, and possible cures. COVID-19 research has been conducted under high time pressure and has been subject to financial and societal interests. Doing research under such pressure may influence the scrutiny with which researchers perform and write up their studies. Either researchers become more diligent, because of the high-stakes nature of the research, or the time pressure may lead to cutting corners and lower quality output. In this study, we conducted a natural experiment to compare the prevalence of incorrectly reported statistics in a stratified random sample of COVID-19 preprints and a matched sample of non-COVID-19 preprints. Our results show that the overall prevalence of incorrectly reported statistics is 9-10%, but frequentist as well as Bayesian hypothesis tests show no difference in the number of statistical inconsistencies between COVID-19 and non-COVID-19 preprints. In conclusion, the literature suggests that COVID-19 research may on average have more methodological problems than non-COVID-19 research, but our results show that there is no difference in the statistical reporting quality.

How do psychology researchers interpret the results of multiple replication studies?

Employing two vignette studies, we examined how psychology researchers interpret the results of a set of four experiments that all test a given theory. In both studies, we found that participants' belief in the theory increased with the number of statistically significant results, and that the result of a direct replication had a stronger effect on belief in the theory than the result of a conceptual replication. In Study 2, we additionally found that participants' belief in the theory was lower when they assumed the presence of p-hacking, but that belief in the theory did not differ between preregistered and non-preregistered replication studies. In analyses of individual participant data from both studies, we examined the heuristics academics use to interpret the results of four experiments. Only a small proportion (Study 1: 1.6%; Study 2: 2.2%) of participants used the normative method of Bayesian inference, whereas many of the participants' responses were in line with generally dismissed and problematic vote-counting approaches. Our studies demonstrate that many psychology researchers overestimate the evidence in favor of a theory if one or more results from a set of replication studies are statistically significant, highlighting the need for better statistical education.

Prevalence of responsible research practices among academics in The Netherlands.

Background: Traditionally, research integrity studies have focused on research misbehaviors and their explanations. Over time, attention has shifted towards preventing questionable research practices and promoting responsible ones. However, data on the prevalence of responsible research practices, especially open methods, open codes and open data and their underlying associative factors, remains scarce. Methods: We conducted a web-based anonymized questionnaire, targeting all academic researchers working at or affiliated to a university or university medical center in The Netherlands, to investigate the prevalence and potential explanatory factors of 11 responsible research practices. Results: A total of 6,813 academics completed the survey, the results of which show that prevalence of responsible practices differs substantially across disciplines and ranks, with 99 percent avoiding plagiarism in their work but less than 50 percent pre-registering a research protocol. Arts and humanities scholars as well as PhD candidates and junior researchers engaged less often in responsible research practices. Publication pressure negatively affected responsible practices, while mentoring, scientific norms subscription and funding pressure stimulated them. Conclusions: Understanding the prevalence of responsible research practices across disciplines and ranks, as well as their associated explanatory factors, can help to systematically address disciplinary- and academic rank-specific obstacles, and thereby facilitate responsible conduct of research.

Chronic kidney disease and vascular risk - what's new?

No disponible

Consensus-based guidance for conducting and reporting multi-analyst studies.

Any large dataset can be analyzed in a number of ways, and it is possible that the use of different analysis strategies will lead to different results and conclusions. One way to assess whether the results obtained depend on the analysis strategy chosen is to employ multiple analysts and leave each of them free to follow their own approach. Here, we present consensus-based guidance for conducting and reporting such multi-analyst studies, and we discuss how broader adoption of the multi-analyst approach has the potential to strengthen the robustness of results and conclusions obtained from analyses of datasets in basic and applied research.

The role of meta-analysis and preregistration in assessing the evidence for cleansing effects.

Lee and Schwarz interpret meta-analytic research and replication studies as providing evidence for the robustness of cleansing effects. We argue that the currently available evidence is unconvincing because (a) publication bias and the opportunistic use of researcher degrees of freedom appear to have inflated meta-analytic effect size estimates, and (b) preregistered replications failed to find any evidence of cleansing effects.

Recommendations in pre-registrations and internal review board proposals promote formal power analyses but do not increase sample size.

In this preregistered study, we investigated whether the statistical power of a study is higher when researchers are asked to make a formal power analysis before collecting data. We compared the sample size descriptions from two sources: (i) a sample of pre-registrations created according to the guidelines for the Center for Open Science Preregistration Challenge (PCRs) and a sample of institutional review board (IRB) proposals from Tilburg School of Behavior and Social Sciences, which both include a recommendation to do a formal power analysis, and (ii) a sample of pre-registrations created according to the guidelines for Open Science Framework Standard Pre-Data Collection Registrations (SPRs) in which no guidance on sample size planning is given. We found that PCRs and IRBs (72%) more often included sample size decisions based on power analyses than the SPRs (45%). However, this did not result in larger planned sample sizes. The determined sample size of the PCRs and IRB proposals (Md = 90.50) was not higher than the determined sample size of the SPRs (Md = 126.00; W = 3389.5, p = 0.936). Typically, power analyses in the registrations were conducted with G*power, assuming a medium effect size, α = .05 and a power of .80. Only 20% of the power analyses contained enough information to fully reproduce the results and only 62% of these power analyses pertained to the main hypothesis test in the pre-registration. Therefore, we see ample room for improvements in the quality of the registrations and we offer several recommendations to do so.

Guía de práctica clínica multidisciplinar española sobre la enfermedad de Anderson-Fabry en adultos. I: Método y recomendaciones / Spanish multidisciplinary clinical practice guidelines for Anderson-Fabry Disease in Adults. I. Method and recommendations

La enfermedad de Anderson-Fabry es una afección multisistémica progresiva y grave de origen genético que afecta tanto a hombres como a mujeres y que reduce sus expectativas y calidad de vida. La gran variabilidad en su expresión clínica, las dificultades para su diagnóstico y la disponibilidad actual de varias alternativas para su tratamiento suponen un gran reto que justifica la realización de una guía de práctica clínica basada en la evidencia que pueda ayudar a los profesionales sanitarios en la toma de decisiones en el manejo de estos pacientes. Para elaborarla se ha realizado una búsqueda sistemática en las principales bases de datos bibliográficas mediante estrategias adaptadas a cada una de las 32 preguntas clínicas consideradas. Se confeccionaron fichas para la síntesis y evaluación de la calidad de las evidencias para cada una de las preguntas. La metodología empleada se basa en el Manual metodológico español para la elaboración de guías de práctica clínica e incorpora en la evaluación de la evidencia científica y en la elaboración de las recomendaciones la metodología GRADE, considerando la calidad de la evidencia, el balance entre beneficios y riesgos, valores y preferencias de los pacientes, equidad y uso de recursos. Para la elaboración definitiva de las recomendaciones se llevó a cabo un proceso de consenso estructurado basado en la metodología Delphi-RAND en 2 rondas, con un panel de expertos propuesto por diferentes sociedades científicas, centros de investigación y asociaciones de pacientes. Finalmente, se han elaborado 92 recomendaciones específicas para el manejo de la enfermedad de Fabry

Anderson-Fabry disease is a severe progressive multisystem condition of genetic origin that affects men and women, reducing their life expectancy and quality of life. The considerable variability in its clinical expression, the difficulties in diagnosing the condition and the current availability of several alternatives for its treatment represent a considerable challenge that justifies the development of evidence-based clinical practice guidelines that can help health professionals in the decision-making process for managing these patients. To develop these guidelines, we conducted a systematic search of the main reference databases using strategies adapted to each of the 32 clinical questions considered. We prepared documents to synthesise the evidence and assess its quality for each of the questions. The methodology employed is based on the Spanish methodology manual for preparing clinical practice guidelines, incorporating the GRADE methodology in the assessment of the scientific evidence and the preparation of the recommendations, considering the quality of the evidence, the risk-benefit balance, patient values and preferences, equity and use of resources. For the definitive preparation of the recommendations, we conducted a structured consensus process based on the Delphi-RAND methodology in 2 rounds, with an expert panel proposed by various scientific societies, research centres and patient associations. Ultimately, we developed 92 specific recommendations for managing Fabry disease

Spanish multidisciplinary clinical practice guidelines for Anderson-Fabry Disease in Adults. I. Method and recommendations. / Guía de práctica clínica multidisciplinar española sobre la enfermedad de Anderson-Fabry en adultos. I: Método y recomendaciones.

Anderson-Fabry disease is a severe progressive multisystem condition of genetic origin that affects men and women, reducing their life expectancy and quality of life. The considerable variability in its clinical expression, the difficulties in diagnosing the condition and the current availability of several alternatives for its treatment represent a considerable challenge that justifies the development of evidence-based clinical practice guidelines that can help health professionals in the decision-making process for managing these patients. To develop these guidelines, we conducted a systematic search of the main reference databases using strategies adapted to each of the 32 clinical questions considered. We prepared documents to synthesise the evidence and assess its quality for each of the questions. The methodology employed is based on the Spanish methodology manual for preparing clinical practice guidelines, incorporating the GRADE methodology in the assessment of the scientific evidence and the preparation of the recommendations, considering the quality of the evidence, the risk-benefit balance, patient values and preferences, equity and use of resources. For the definitive preparation of the recommendations, we conducted a structured consensus process based on the Delphi-RAND methodology in 2 rounds, with an expert panel proposed by various scientific societies, research centres and patient associations. Ultimately, we developed 92 specific recommendations for managing Fabry disease.

Oral immunotherapy for food allergy: A Spanish guideline. Egg and milk immunotherapy Spanish guide (ITEMS GUIDE). Part 2: Maintenance phase of cow milk (CM) and egg oral immunotherapy (OIT), special treatment dosing schedules. Models of dosing schedules of OIT with CM and EGG

Introduction: Cow's milk and egg are the most frequent causes of food allergy in the first years of life. Treatments such as oral immunotherapy (OIT) have been investigated as an alternative to avoidance diets. No clinical practice guides on the management of OIT with milk and egg are currently available. Objectives: To develop a clinical guide on OIT based on the available scientific evidence and the opinions of experts. Methods: A review was made of studies published in the period between 1984 and June 2016, Doctoral Theses published in Spain, and summaries of communications at congresses (SEAIC, SEICAP, EAACI, AAAAI), with evaluation of the opinion consensus established by a group of experts pertaining to the scientific societies SEICAP and SEAIC. Results: Recommendations have been established regarding the indications, requirements and practical aspects of the different phases of OIT, as well as special protocols for patients at high risk of suffering adverse reactions. Conclusions: A clinical practice guide is presented for the management of OIT with milk and egg, based on the opinion consensus of Spanish experts (AU)

No disponible

Oral immunotherapy for food allergy: A Spanish guideline. Immunotherapy egg and milk Spanish guide (items guide). Part I: Cow milk and egg oral immunotherapy: Introduction, methodology, rationale, current state, indications contraindications and oral immunotherapy build-up phase

Introduction: Cow's milk and egg are the most frequent causes of food allergy in the first years of life. Treatments such as oral immunotherapy (OIT) have been investigated as an alternative to avoidance diets. No clinical practice guides on the management of OIT with milk and egg are currently available. Objectives: To develop a clinical guide on OIT based on the available scientific evidence and the opinions of experts. Methods: A review was made of studies published in the period between 1984 and June 2016, Doctoral Theses published in Spain, and summaries of communications at congresses (SEAIC, SEICAP, EAACI, AAAAI), with evaluation of the opinion consensus established by a group of experts pertaining to the scientific societies SEICAP and SEAIC. Results: Recommendations have been established regarding the indications, requirements and practical aspects of the different phases of OIT, as well as special protocols for patients at high risk of suffering adverse reactions. Conclusions: A clinical practice guide is presented for the management of OIT with milk and egg, based on the opinion consensus of Spanish experts (AU)

No disponible

Oral Immunotherapy for Food Allergy: A Spanish Guideline. Immunotherapy Egg and Milk Spanish Guide (ITEMS Guide). Part I: Cow Milk and Egg Oral Immunotherapy: Introduction, Methodology, Rationale, Current State, Indications, Contraindications, and Oral Immunotherapy Build-up Phase.

BACKGROUND AND OBJECTIVE: Cow milk and egg are the most frequent causes of food allergy in the first years of life. Oral immunotherapy (OIT) has been investigated as an alternative to avoidance diets. No clinical practice guidelines on the management of OIT with milk and egg are currently available. Objectives: To develop clinical guidelines for OIT based on available scientific evidence and the opinions of experts. METHODS: A review was made of studies published between 1984 and June 2016, doctoral theses published in Spain, summaries of communications at scientific meetings (SEAIC, SEICAP, EAACI, and AAAAI), and the consensus of opinion established by a group of experts from the scientific societies SEICAP and SEAIC. RESULTS: Recommendations were established regarding the indications, requirements and practical aspects of the different phases of OIT, as well as special protocols for patients at high risk of adverse reactions. CONCLUSIONS: Clinical practice guidelines based on the consensus reached between Spanish experts are presented for the management of OIT with milk and egg.

Oral immunotherapy for food allergy: A Spanish guideline. Egg and milk immunotherapy Spanish guide (ITEMS GUIDE). Part 2: Maintenance phase of cow milk (CM) and egg oral immunotherapy (OIT), special treatment dosing schedules. Models of dosing schedules of OIT with CM and EGG.

INTRODUCTION: Cow's milk and egg are the most frequent causes of food allergy in the first years of life. Treatments such as oral immunotherapy (OIT) have been investigated as an alternative to avoidance diets. No clinical practice guides on the management of OIT with milk and egg are currently available. OBJECTIVES: To develop a clinical guide on OIT based on the available scientific evidence and the opinions of experts. METHODS: A review was made of studies published in the period between 1984 and June 2016, Doctoral Theses published in Spain, and summaries of communications at congresses (SEAIC, SEICAP, EAACI, AAAAI), with evaluation of the opinion consensus established by a group of experts pertaining to the scientific societies SEICAP and SEAIC. RESULTS: Recommendations have been established regarding the indications, requirements and practical aspects of the different phases of OIT, as well as special protocols for patients at high risk of suffering adverse reactions. CONCLUSIONS: A clinical practice guide is presented for the management of OIT with milk and egg, based on the opinion consensus of Spanish experts.

Oral immunotherapy for food allergy: A Spanish guideline. Immunotherapy egg and milk Spanish guide (items guide). Part I: Cow milk and egg oral immunotherapy: Introduction, methodology, rationale, current state, indications contraindications and oral immunotherapy build-up phase.

INTRODUCTION: Cow's milk and egg are the most frequent causes of food allergy in the first years of life. Treatments such as oral immunotherapy (OIT) have been investigated as an alternative to avoidance diets. No clinical practice guides on the management of OIT with milk and egg are currently available. OBJECTIVES: To develop a clinical guide on OIT based on the available scientific evidence and the opinions of experts. METHODS: A review was made of studies published in the period between 1984 and June 2016, Doctoral Theses published in Spain, and summaries of communications at congresses (SEAIC, SEICAP, EAACI, AAAAI), with evaluation of the opinion consensus established by a group of experts pertaining to the scientific societies SEICAP and SEAIC. RESULTS: Recommendations have been established regarding the indications, requirements and practical aspects of the different phases of OIT, as well as special protocols for patients at high risk of suffering adverse reactions. CONCLUSIONS: A clinical practice guide is presented for the management of OIT with milk and egg, based on the opinion consensus of Spanish experts.

Oral Immunotherapy for Food Allergy: A Spanish Guideline. Egg and Milk Immunotherapy Spanish Guide (ITEMS GUIDE). Part II: Maintenance Phase of Cow Milk (CM) and Egg Oral Immunotherapy (OIT), Special Treatment Dosing Schedules. Models of Dosing Schedules of OIT With CM and Egg.

BACKGROUND AND OBJECTIVE: Cow milk and egg are the most frequent causes of food allergy in the first years of life. Oral immunotherapy (OIT) has been investigated as an alternative to avoidance diets. No clinical practice guidelines on the management of OIT with milk and egg are currently available. Objectives: To develop clinical guidelines for OIT based on available scientific evidence and the opinions of experts. METHODS: A review was made of studies published between 1984 and June 2016, doctoral theses published in Spain, summaries of communications at scientific meetings (SEAIC, SEICAP, EAACI, and AAAAI), and the consensus of opinion established by a group of experts from the scientific societies SEICAP and SEAIC. RESULTS: Recommendations were established regarding the indications, requirements and practical aspects of the different phases of OIT, as well as special protocols for patients at high risk of adverse reactions. CONCLUSIONS: Clinical practice guidelines based on the consensus reached between Spanish experts are presented for the management of OIT with milk and egg.