Questionable research practices in competitive grant funding: A survey.

There has been a surge of interest in research integrity over the last decade, with a wide range of studies investigating the prevalence of questionable research practices (QRPs). However, nearly all these studies focus on research design, data collection and analysis, and hardly any empirical research has been done on the occurrence of QRPs in the context of research funding. To fill this gap, we conducted a cross-sectional pre-registered survey of applicants, reviewers and panel members from the Research Foundation-Flanders (FWO), one of the main funding agencies in Belgium. We developed a bespoke survey and further refined it through feedback from experienced researchers and a pilot study. We asked how often respondents had engaged in a series of QRPs over the last ten years. A total of 1748 emails were sent, inviting recipients to participate in the survey, complemented by featuring the survey in the FWO newsletter. This resulted in 704 complete responses. Our results indicate that such QRPs are remarkably prevalent. Of the 496 participants who answered both the applicant and reviewer track, more than 60% responded that they engaged regularly in at least one of such practices, and around 40% indicated that they engaged at least occasionally in half of the QRPs queried. Only 12% reported not to have engaged in any of the QRPs. Contrary to our hypotheses, male respondents did not self-report to engage in the QRPs more often than female respondents, nor was there an association between the prevalence of QRPs and self-reported success rate in grant funding. Furthermore, half of the respondents indicated that they doubted the reliability of the grant peer review process more often than not. These results suggest that preventive action is needed, and provide new reasons to reconsider the practice of allocating research money through grant peer review.

Leaving academia: PhD attrition and unhealthy research environments.

This study investigates PhD candidates' (N = 391) perceptions about their research environment at a Dutch university in terms of the research climate, (un)ethical supervisory practices, and questionable research practices. We assessed whether their perceptions are related to career considerations. We gathered quantitative self-report estimations of the perceptions of PhD candidates using an online survey tool and then conducted descriptive and within-subject correlation analysis of the results. While most PhD candidates experience fair evaluation processes, openness, integrity, trust, and freedom in their research climate, many report lack of time and support, insufficient supervision, and witness questionable research practices. Results based on Spearman correlations indicate that those who experience a less healthy research environment (including experiences with unethical supervision, questionable practices, and barriers to responsible research), more often consider leaving academia and their current PhD position.

Middle Pleistocene fire use: The first signal of widespread cultural diffusion in human evolution.

Control of fire is one of the most important technological innovations within the evolution of humankind. The archaeological signal of fire use becomes very visible from around 400,000 y ago onward. Interestingly, this occurs at a geologically similar time over major parts of the Old World, in Africa, as well as in western Eurasia, and in different subpopulations of the wider hominin metapopulation. We interpret this spatiotemporal pattern as the result of cultural diffusion, and as representing the earliest clear-cut case of widespread cultural change resulting from diffusion in human evolution. This fire-use pattern is followed slightly later by a similar spatiotemporal distribution of Levallois technology, at the beginning of the African Middle Stone Age and the western Eurasian Middle Paleolithic. These archaeological data, as well as studies of ancient genomes, lead us to hypothesize that at the latest by 400,000 y ago, hominin subpopulations encountered one another often enough and were sufficiently tolerant toward one another to transmit ideas and techniques over large regions within relatively short time periods. Furthermore, it is likely that the large-scale social networks necessary to transmit complicated skills were also in place. Most importantly, this suggests a form of cultural behavior significantly more similar to that of extant Homo sapiens than to our great ape relatives.

A new framework for teaching scientific reasoning to students from application-oriented sciences.

About three decades ago, the late Ronald Giere introduced a new framework for teaching scientific reasoning to science students. Giere's framework presents a model-based alternative to the traditional statement approach-in which scientific inferences are reconstructed as explicit arguments, composed of (single-sentence) premises and a conclusion. Subsequent research in science education has shown that model-based approaches are particularly effective in teaching science students how to understand and evaluate scientific reasoning. One limitation of Giere's framework, however, is that it covers only one type of scientific reasoning, namely the reasoning deployed in hypothesis-driven research practices. In this paper, we describe an extension of the framework. More specifically, we develop an additional model-based scheme that captures reasoning in application-oriented practices (which are very well represented in contemporary science). Our own teaching experience suggests that this extended framework is able to engage a wider audience than Giere's original. With an eye on going beyond such anecdotal evidence, we invite our readers to test out the framework in their own teaching.

Social information use and social information waste.

Social information is immensely valuable. Yet we waste it. The information we get from observing other humans and from communicating with them is a cheap and reliable informational resource. It is considered the backbone of human cultural evolution. Theories and models focused on the evolution of social learning show the great adaptive benefits of evolving cognitive tools to process it. In spite of this, human adults in the experimental literature use social information quite inefficiently: they do not take it sufficiently into account. A comprehensive review of the literature on five experimental tasks documented 45 studies showing social information waste, and four studies showing social information being over-used. These studies cover 'egocentric discounting' phenomena as studied by social psychology, but also include experimental social learning studies. Social information waste means that human adults fail to give social information its optimal weight. Both proximal explanations and accounts derived from evolutionary theory leave crucial aspects of the phenomenon unaccounted for: egocentric discounting is a pervasive effect that no single unifying explanation fully captures. Cultural evolutionary theory's insistence on the power and benefits of social influence is to be balanced against this phenomenon. This article is part of the theme issue 'Foundations of cultural evolution'.

An emerging consensus in palaeoanthropology: demography was the main factor responsible for the disappearance of Neanderthals.

The causes of Neanderthal disappearance about 40,000 years ago remain highly contested. Over a dozen serious hypotheses are currently endorsed to explain this enigmatic event. Given the relatively large number of contending explanations and the relatively large number of participants in the debate, it is unclear how strongly each contender is supported by the research community. What does the community actually believe about the demise of Neanderthals? To address this question, we conducted a survey among practicing palaeo-anthropologists (total number of respondents = 216). It appears that received wisdom is that demography was the principal cause of the demise of Neanderthals. In contrast, there is no received wisdom about the role that environmental factors and competition with modern humans played in the extinction process; the research community is deeply divided about these issues. Finally, we tested the hypothesis that palaeo-anthropologists' stand in the debate co-varies with their socio-political views and attitudes. We found no evidence for such a correlation.

Grant writing and grant peer review as questionable research practices.

A large part of governmental research funding is currently distributed through the peer review of project proposals. In this paper, we argue that such funding systems incentivize and even force researchers to violate five moral values, each of which is central to commonly used scientific codes of conduct. Our argument complements existing epistemic arguments against peer-review project funding systems and, accordingly, strengthens the mounting calls for reform of these systems.

How will we find the elephant in the room?

We argue that Osirak's and Reynaud's technological-reasoning hypothesis raises conceptual and methodological challenges. Interrelations between technical potential and expertise leave it unclear exactly what the technical-reasoning hypothesis encompasses. We submit that it is compatible with a range of hypotheses that are difficult to differentiate empirically.

The National Science Foundation and philosophy of science's withdrawal from social concerns.

At some point during the 1950s, mainstream American philosophy of science began increasingly to avoid questions about the role of non-cognitive values in science and, accordingly, increasingly to avoid active engagement with social, political and moral concerns. Such questions and engagement eventually ceased to be part of the mainstream. Here we show that the eventual dominance of 'value-free' philosophy of science can be attributed, at least in part, to the policies of the U.S. National Science Foundation's "History and Philosophy of Science" sub-program. In turn, the sub-program's policies were set by logical empiricists who espoused value-free philosophy of science; these philosophers' actions, we also point out, fit a broad pattern, one in which analytic philosophers used institutional control to marginalize rival approaches to philosophy. We go on to draw on existing knowledge of this pattern to suggest two further, similar, contributors to the withdrawal from value-laden philosophy of science, namely decisions by the editors of Philosophy of Science and by the editors of The Journal of Philosophy. Political climate was, we argue, at most an indirect contributor to the withdrawal and was neither a factor that decided whether it occurred nor one that was sufficient to bring it about. Moreover, we argue that the actions at the National Science Foundation went beyond what was required by its senior administrators and are better viewed as part of what drove, rather than as what was being driven by, the adoption of logical empiricism by the philosophy of science community.

Inbreeding, Allee effects and stochasticity might be sufficient to account for Neanderthal extinction.

The replacement of Neanderthals by Anatomically Modern Humans has typically been attributed to environmental pressure or a superiority of modern humans with respect to competition for resources. Here we present two independent models that suggest that no such heatedly debated factors might be needed to account for the demise of Neanderthals. Starting from the observation that Neanderthal populations already were small before the arrival of modern humans, the models implement three factors that conservation biology identifies as critical for a small population's persistence, namely inbreeding, Allee effects and stochasticity. Our results indicate that the disappearance of Neanderthals might have resided in the smallness of their population(s) alone: even if they had been identical to modern humans in their cognitive, social and cultural traits, and even in the absence of inter-specific competition, Neanderthals faced a considerable risk of extinction. Furthermore, we suggest that if modern humans contributed to the demise of Neanderthals, that contribution might have had nothing to do with resource competition, but rather with how the incoming populations geographically restructured the resident populations, in a way that reinforced Allee effects, and the effects of inbreeding and stochasticity.

How much would each researcher receive if competitive government research funding were distributed equally among researchers?

Scientists are increasingly dissatisfied with funding systems that rely on peer assessment and, accordingly, have suggested several proposals for reform. One of these proposals is to distribute available funds equally among all qualified researchers, with no interference from peer review. Despite its numerous benefits, such egalitarian sharing faces the objection, among others, that it would lead to an unacceptable dilution of resources. The aim of the present paper is to assess this particular objection. We estimate (for the Netherlands, the U.S. and the U.K.) how much researchers would receive were they to get an equal share of the government budgets that are currently allocated through competitive peer assessment. For the Netherlands, we furthermore estimate what researchers would receive were we to differentiate between researchers working in low-cost, intermediate-cost and high-cost disciplines. Given these estimates, we then determine what researchers could afford in terms of PhD students, Postdocs, travel and equipment. According to our results, researchers could, on average, maintain current PhD student and Postdoc employment levels, and still have at their disposal a moderate (the U.K.) to considerable (the Netherlands, U.S.) budget for travel and equipment. This suggests that the worry that egalitarian sharing leads to unacceptable dilution of resources is unjustified. Indeed, our results strongly suggest that there is room for far more egalitarian distribution of funds than happens in the highly competitive funding schemes so prevalent today.

Complexity and technological evolution: What everybody knows?

The consensus among cultural evolutionists seems to be that human cultural evolution is cumulative, which is commonly understood in the specific sense that cultural traits, especially technological traits, increase in complexity over generations. Here we argue that there is insufficient credible evidence in favor of or against this technological complexity thesis. For one thing, the few datasets that are available hardly constitute a representative sample. For another, they substantiate very specific, and usually different versions of the complexity thesis or, even worse, do not point to complexity increases. We highlight the problems our findings raise for current work in cultural-evolutionary theory, and present various suggestions for future research.

The empirical case against the 'demographic turn' in Palaeolithic archaeology.

Recently, it has become commonplace to interpret major transitions and other patterns in the Palaeolithic archaeological record in terms of population size. Increases in cultural complexity are claimed to result from increases in population size; decreases in cultural complexity are suggested to be due to decreases in population size; and periods of no change are attributed to low numbers or frequent extirpation. In this paper, we argue that this approach is not defensible. We show that the available empirical evidence does not support the idea that cultural complexity in hunter-gatherers is governed by population size. Instead, ethnographic and archaeological data suggest that hunter-gatherer cultural complexity is most strongly influenced by environmental factors. Because all hominins were hunter-gatherers until the Holocene, this means using population size to interpret patterns in the Palaeolithic archaeological record is problematic. In future, the population size hypothesis should be viewed as one of several competing hypotheses and its predictions formally tested alongside those of its competitors.This article is part of the themed issue 'Major transitions in human evolution'.

Population size does not explain past changes in cultural complexity.

Demography is increasingly being invoked to account for features of the archaeological record, such as the technological conservatism of the Lower and Middle Pleistocene, the Middle to Upper Paleolithic transition, and cultural loss in Holocene Tasmania. Such explanations are commonly justified in relation to population dynamic models developed by Henrich [Henrich J (2004)Am Antiq69:197-214] and Powell et al. [Powell A, et al. (2009)Science324(5932):1298-1301], which appear to demonstrate that population size is the crucial determinant of cultural complexity. Here, we show that these models fail in two important respects. First, they only support a relationship between demography and culture in implausible conditions. Second, their predictions conflict with the available archaeological and ethnographic evidence. We conclude that new theoretical and empirical research is required to identify the factors that drove the changes in cultural complexity that are documented by the archaeological record.

The Acheulean handaxe: More like a bird's song than a beatles' tune?

The goal of this paper is to provoke debate about the nature of an iconic artifact-the Acheulean handaxe. Specifically, we want to initiate a conversation about whether or not they are cultural objects. The vast majority of archeologists assume that the behaviors involved in the production of handaxes were acquired by social learning and that handaxes are therefore cultural. We will argue that this assumption is not warranted on the basis of the available evidence and that an alternative hypothesis should be given serious consideration. This alternative hypothesis is that the form of Acheulean handaxes was at least partly under genetic control.

Complexity and demographic explanations of cumulative culture.

Formal models have linked prehistoric and historical instances of technological change (e.g., the Upper Paleolithic transition, cultural loss in Holocene Tasmania, scientific progress since the late nineteenth century) to demographic change. According to these models, cumulation of technological complexity is inhibited by decreasing--while favoured by increasing--population levels. Here we show that these findings are contingent on how complexity is defined: demography plays a much more limited role in sustaining cumulative culture in case formal models deploy Herbert Simon's definition of complexity rather than the particular definitions of complexity hitherto assumed. Given that currently available empirical evidence doesn't afford discriminating proper from improper definitions of complexity, our robustness analyses put into question the force of recent demographic explanations of particular episodes of cultural change.

Chimpocentrism and reconstructions of human evolution (a timely reminder).

Chimpanzees, but very few other animals, figure prominently in (recent) attempts to reconstruct the evolution of uniquely human traits. In particular, the chimpanzee is used (i) to identify traits unique to humans, and thus in need of reconstruction; (ii) to initialize the reconstruction, by taking its state to reflect the state of the last common ancestor of humans and chimpanzees; (iii) as a baseline against which to test evolutionary hypotheses. Here I point out the flaws in this three-step procedure, and show how they can be overcome by taking advantage of much broader phylogenetic comparisons. More specifically, I explain how such comparisons yield more reliable estimations of ancestral states and how they help to resolve problems of underdetermination inherent to chimpocentric accounts. To illustrate my points, I use a recent chimpocentric argument by Kitcher.