Everyday amnesia: Residual memory for high confidence misses and implications for decision models of recognition.

Despite studying a list of items only minutes earlier, when reencountered in a recognition memory test, undergraduate participants often say with total confidence that they have not studied some of the items before. Such high confidence miss (HCM) responses have been taken as evidence of rapid and complete forgetting and of everyday amnesia (Roediger & Tekin, 2020). We investigated (a) if memory for HCMs is completely lost or whether a residual memory effect exists and (b) whether dominant decision models predict the effect. Participants studied faces (Experiments 1a, 2, and 3) or words (Experiment 1b), then completed a single-item recognition memory task, followed by either (a) a two-alternative forced-choice recognition task, in which the studied and nonstudied alternatives on each trial were matched for their previous old/new decision and confidence rating (Experiments 1 and 2) or (b) a second single-item recognition task in which the targets and foils were HCMs and high confidence correct rejections, respectively (Experiment 3). In each experiment, participants reliably distinguished HCMs from high-confidence correct rejections. The unequal variance signal detection and dual-process signal detection models were fit to the single-item recognition data, and the parameter estimates were used to predict the memory effect for HCMs. The dual-process signal detection model predicted the residual memory effect (as did another popular model, the mixture signal detection theory model). However, the unequal variance signal detection model incorrectly predicted a negative, or no, effect, invalidating this model. The residual memory effect for HCMs demonstrates that everyday amnesia is not associated with complete memory loss and distinguishes between decision models. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Exploring open science practices in behavioural public policy research.

In their book 'Nudge: Improving Decisions About Health, Wealth and Happiness', Thaler & Sunstein (2009) argue that choice architectures are promising public policy interventions. This research programme motivated the creation of 'nudge units', government agencies which aim to apply insights from behavioural science to improve public policy. We closely examine a meta-analysis of the evidence gathered by two of the largest and most influential nudge units (DellaVigna & Linos (2022 Econometrica 90, 81-116 (doi:10.3982/ECTA18709))) and use statistical techniques to detect reporting biases. Our analysis shows evidence suggestive of selective reporting. We additionally evaluate the public pre-analysis plans from one of the two nudge units (Office of Evaluation Sciences). We identify several instances of excellent practice; however, we also find that the analysis plans and reporting often lack sufficient detail to evaluate (unintentional) reporting biases. We highlight several improvements that would enhance the effectiveness of the pre-analysis plans and reports as a means to combat reporting biases. Our findings and suggestions can further improve the evidence base for policy decisions.

Confidence ratings increase response thresholds in decision making.

Many mental processes are reactive - they are altered as a result of introspection and monitoring. It has been documented that soliciting trial-by-trial confidence ratings (CRs) reactively improves decision accuracy and lengthens response times (RTs), but the cognitive mechanisms underlying CR reactivity in decision-making remain unknown. The current study conducted two experiments and employed the drift-diffusion model (DDM) to explore why reporting confidence reactively alters the decision-making process. The results showed that CRs led to enhanced decision accuracy, longer RTs, and higher response thresholds. The findings are consistent with an increased conservatism hypothesis which asserts that soliciting CRs provokes feelings of uncertainty and makes individuals more cautious in their decision making.

Conscious and unconscious memory and eye movements in context-guided visual search: A computational and experimental reassessment of Ramey, Yonelinas, and Henderson (2019).

Are eye movements unconsciously guided towards target locations in familiar scenes? In a recent eyetracking study, Ramey, Yonelinas, and Henderson (2019) measured eye-movement efficiency (scanpath ratio) and memory judgments when participants searched for targets in repeated and novel scenes. When trials judged new with high confidence were selected, scanpath ratio was lower for old scenes (misses) than for new scenes (correct rejections). In addition, familiarity as measured by recognition confidence did not significantly predict scanpath ratio. Ramey et al. attributed these results to unconscious learning guiding eye movements. In a re-assessment of Ramey et al.'s data, we show that their findings can be accounted for by a single-system computational model in which eye movements and memory judgments are driven by a common latent memory representation. In particular, (a) the scanpath ratio difference between high-confidence misses and correct rejections is a consequence of regression to the mean, while (b) the null correlation between familiarity and scanpath ratio, partly a natural consequence of the low reliability of the scanpath ratio measure, is also reproduced by the model. Two pre-registered experiments confirm a novel prediction of the alternative single-system model. This work offers a parsimonious account of Ramey et al.'s findings without recourse to unconscious guidance of eye movements.

Meta-analyses in psychology often overestimate evidence for and size of effects.

Adjusting for publication bias is essential when drawing meta-analytic inferences. However, most methods that adjust for publication bias do not perform well across a range of research conditions, such as the degree of heterogeneity in effect sizes across studies. Sladekova et al. 2022 (Estimating the change in meta-analytic effect size estimates after the application of publication bias adjustment methods. Psychol. Methods) tried to circumvent this complication by selecting the methods that are most appropriate for a given set of conditions, and concluded that publication bias on average causes only minimal over-estimation of effect sizes in psychology. However, this approach suffers from a 'Catch-22' problem-to know the underlying research conditions, one needs to have adjusted for publication bias correctly, but to correctly adjust for publication bias, one needs to know the underlying research conditions. To alleviate this problem, we conduct an alternative analysis, robust Bayesian meta-analysis (RoBMA), which is not based on model-selection but on model-averaging. In RoBMA, models that predict the observed results better are given correspondingly larger weights. A RoBMA reanalysis of Sladekova et al.'s dataset reveals that more than 60% of meta-analyses in psychology notably overestimate the evidence for the presence of the meta-analytic effect and more than 50% overestimate its magnitude.

Metamemory judgments have dissociable reactivity effects on item and interitem relational memory.

Making metamemory judgments reactively changes item memory itself. Here we report the first investigation of reactive influences of making judgments of learning (JOLs) on interitem relational memory-specifically, temporal (serial) order memory. Experiment 1 found that making JOLs impaired order reconstruction. Experiment 2 observed minimal reactivity on free recall and negative reactivity on temporal clustering. Experiment 3 demonstrated a positive reactivity effect on recognition memory, and Experiment 4 detected dissociable effects of making JOLs on order reconstruction (negative) and forced-choice recognition (positive) by using the same participants and stimuli. Finally, a meta-analysis was conducted to explore reactivity effects on word list learning and to investigate whether test format moderates these effects. The results show a negative reactivity effect on interitem relational memory (order reconstruction), a modest positive effect on free recall, and a medium-to-large positive effect on recognition. Overall, these findings imply that even though making metacognitive judgments facilitates item-specific processing, it disrupts relational processing, supporting the item-order account of the reactivity effect on word list learning. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Judgments of learning reactively facilitate visual memory by enhancing learning engagement.

Recent studies have found that making judgments of learning (JOLs) for verbal materials changes memory itself, a form of reactivity effect on memory. The current study explores the reactivity effect on visual (image) memory and tests the potential role of enhanced learning engagement in this effect. Experiment 1 employed object image pairs as stimuli and observed a positive reactivity effect on memory for visual details. Experiment 2 conceptually replicated this positive reactivity effect using pairs of scene images. Experiment 3 introduced mind wandering (MW) probes to measure participants' attentional state (learning engagement) and observed that making JOLs significantly reduced MW. More importantly, reduced MW mediated the reactivity effect. Lastly, Experiment 4 found that a manipulation that heightened learning motivation decreased the reactivity effect. Overall, the current study provides the first demonstration of the reactivity effect on visual memory, as well as support for the enhanced learning engagement explanation. Practical implications are discussed.

Do partial and distributed tests enhance new learning?

Testing facilitates subsequent learning of new information, a phenomenon known as the forward testing effect. The effect is often investigated in multilist procedures, where studied lists are followed by a retrieval test, or a control task such as restudying, and learning is compared on the final list. In most studies of the effect, tests include all material from the preceding list. We report four experiments, three of which were preregistered, to determine whether tests that are partial (not including all studied items) and distributed (including retrieval of items from earlier lists) are effective in enhancing new learning. The results show that testing of all studied material is not necessary to produce beneficial effects on new learning or to reduce intrusions. The beneficial effects of testing were substantially mediated by reduced proactive interference. Importantly, there was minimal evidence that the forward learning benefits of partial and distributed tests are offset by a cost to untested items via retrieval-induced forgetting. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Publication bias casts doubt on implicit processing in inattentional blindness.

Two recent meta-analyses on inattentional blindness (Kreitz, Pugnaghi, & Memmert, 2020; Nobre et al., 2020) concluded that objects can be processed implicitly even when attention is directed elsewhere. However, signs of publication bias are evident in both of these meta-analyses. Here, we employed multiple tools to correct for publication bias in the data aggregated in those meta-analyses. Analyses using the Precision-Effect Test (PET) and robust Bayesian meta-analysis (RoBMA) suggest that the estimates in the original meta-analyses were inflated, together with strong evidence of publication bias. Indeed, the data are consistent with no overall implicit effects. We suggest that more evidence, particularly from well-powered pre-registered experiments, is needed before solid conclusions can be drawn regarding implicit processing during inattentional blindness.

The role of working memory in contextual cueing of visual attention.

It is usually easier to find objects in familiar contexts that we have seen before. The type of learning that underlies this facilitation, known as contextual cueing, has been understood as an incidental and automatic process given that, among other reasons, it seems to be independent of working memory (WM) resources. This claim has found support in previous research showing that contextual cueing can be acquired latently, while participants perform a demanding WM task. However, previous studies have not always found this pattern of results and, in general, the available evidence is far from conclusive. The aim of the present study was to clarify the role of WM in contextual learning with two large-sample, confirmatory experiments. Our results show a robust contextual cueing effect even when visuospatial working memory resources were recruited by a demanding secondary task.

The Pervasive Problem of Post Hoc Data Selection in Studies on Unconscious Processing.

Studies on unconscious mental processes typically require that participants are unaware of some information (e.g., a visual stimulus). An important methodological question in this field of research is how to deal with data from participants who become aware of the critical stimulus according to some measure of awareness. While it has previously been argued that the post hoc selection of participants dependent on an awareness measure may often result in regression-to-the-mean artifacts (Shanks, 2017), a recent article (Sklar et al., 2021) challenged this conclusion claiming that the consideration of this statistical artifact might lead to unjustified rejections of true unconscious influences. In this reply, we explain this pervasive statistical problem with a basic and concrete example, show that Sklar et al. fundamentally mischaracterize it, and then refute the argument that the influence of the artifact has previously been overestimated. We conclude that, without safeguards, the method of post hoc data selection should never be employed in studies on unconscious processing.

When judging what you know changes what you really know: Soliciting metamemory judgments reactively enhances children's learning.

Recent studies established that making concurrent judgments of learning (JOLs) can significantly alter (typically enhance) memory itself-a reactivity effect. The current study recruited 190 Chinese children (Mage  = 8.68 years; 101 female) in 2020 and 2021 to explore the reactivity effect on children's learning, its developmental trajectory and associated metacognitive awareness. The results showed that making JOLs significantly enhanced retention for students in Grades 1, 3, and 5, with Cohen's ds ranging from 0.40 to 1.33. Grade 5 students exhibited a larger reactivity effect than Grade 1 and 3 students. Children's metacognitive appreciation of the effect was weak. Firsthand experience of the reactivity effect, induced by taking a memory test, enhanced their awareness and calibrated their judgment accuracy.

Testing potential mechanisms underlying test-potentiated new learning.

An emerging body of studies demonstrates that practicing retrieval of studied information, by comparison with restudying or no treatment, can facilitate subsequent learning and retrieval of new information, a phenomenon termed the forward testing effect (FTE) or test-potentiated new learning. Several theoretical explanations have been proposed to account for the FTE. A release-from-PI theory proposes that interpolated testing induces context changes and enhances event segregation, which in turn protect new learning from proactive interference (PI). A strategy-change view hypothesizes that prior tests teach learners to adopt more effective/elaborative learning and retrieval strategies in subsequent study and test phases. Finally, a reset-of-encoding account proposes that interim testing on studied information reduces memory load, resets the subsequent encoding process, and enhances encoding of new information. The current study recruited a large sample (over 1,000 participants) and employed a multilist learning task and mediation analyses to test these theories. The results suggest that prior list intrusions (an index of PI) significantly mediated the FTE, supporting the release-from-PI theory. In addition, interim testing enhanced strategic processing of temporal information during new learning (reflected by increased clustering), and temporal clustering significantly mediated the FTE, supporting a role for strategy-change in the FTE. Lastly, a variety of indices were constructed to represent the benefit of reset-of-encoding, but none of them provided evidence supporting the reset-of-encoding view. The results shed new light on the complex mechanisms underlying the forward benefits of testing. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Raising awareness about measurement error in research on unconscious mental processes.

Experimental psychologists often neglect the poor psychometric properties of the dependent measures collected in their studies. In particular, a low reliability of measures can have dramatic consequences for the interpretation of key findings in some of the most popular experimental paradigms, especially when strong inferences are drawn from the absence of statistically significant correlations. In research on unconscious cognition, for instance, it is commonly argued that the lack of a correlation between task performance and measures of awareness or explicit recollection of the target stimuli provides strong support for the conclusion that the cognitive processes underlying performance must be unconscious. Using contextual cuing of visual search as a case study, we show that given the low reliability of the dependent measures collected in these studies, it is usually impossible to draw any firm conclusion about the unconscious character of this effect from correlational analyses. Furthermore, both a psychometric meta-analysis of the available evidence and a cognitive-modeling approach suggest that, in fact, we should expect to see very low correlations between performance and awareness at the empirical level, even if both constructs are perfectly related at the latent level. Convincing evidence for the unconscious character of contextual cuing and other effects will most likely demand richer and larger data sets, coupled with more powerful analytic approaches.

Is probabilistic cuing of visual search an inflexible attentional habit? A meta-analytic review.

In studies on probabilistic cuing of visual search, participants search for a target among several distractors and report some feature of the target. In a biased stage the target appears more frequently in one specific area of the search display. Eventually, participants become faster at finding the target in that rich region compared to the sparse region. In some experiments, this stage is followed by an unbiased stage, where the target is evenly located across all regions of the display. Despite this change in the spatial distribution of targets, search speed usually remains faster when the target is located in the previously rich region. The persistence of the bias even when it is no longer advantageous has been taken as evidence that this phenomenon is an attentional habit. The aim of this meta-analysis was to test whether the magnitude of probabilistic cuing decreases from the biased to the unbiased stage. A meta-analysis of 42 studies confirmed that probabilistic cuing during the unbiased stage was roughly half the size of cuing during the biased stage, and this decrease persisted even after correcting for publication bias. Thus, the evidence supporting the claim that probabilistic cuing is an attentional habit might not be as compelling as previously thought.

Improving research quality: the view from the UK Reproducibility Network institutional leads for research improvement.

The adoption and incentivisation of open and transparent research practices is critical in addressing issues around research reproducibility and research integrity. These practices will require training and funding. Individuals need to be incentivised to adopt open and transparent research practices (e.g., added as desirable criteria in hiring, probation, and promotion decisions, recognition that funded research should be conducted openly and transparently, the importance of publishers mandating the publication of research workflows and appropriately curated data associated with each research output). Similarly, institutions need to be incentivised to encourage the adoption of open and transparent practices by researchers. Research quality should be prioritised over research quantity. As research transparency will look different for different disciplines, there can be no one-size-fits-all approach. An outward looking and joined up UK research strategy is needed that places openness and transparency at the heart of research activity. This should involve key stakeholders (institutions, research organisations, funders, publishers, and Government) and crucially should be focused on action. Failure to do this will have negative consequences not just for UK research, but also for our ability to innovate and subsequently commercialise UK-led discovery.

Consensus-based guidance for conducting and reporting multi-analyst studies.

Any large dataset can be analyzed in a number of ways, and it is possible that the use of different analysis strategies will lead to different results and conclusions. One way to assess whether the results obtained depend on the analysis strategy chosen is to employ multiple analysts and leave each of them free to follow their own approach. Here, we present consensus-based guidance for conducting and reporting such multi-analyst studies, and we discuss how broader adoption of the multi-analyst approach has the potential to strengthen the robustness of results and conclusions obtained from analyses of datasets in basic and applied research.

Publication bias and low power in field studies on goal priming.

Research on goal priming asks whether the subtle activation of an achievement goal can improve task performance. Studies in this domain employ a range of priming methods, such as surreptitiously displaying a photograph of an athlete winning a race, and a range of dependent variables including measures of creativity and workplace performance. Chen, Latham, Piccolo and Itzchakov (Chen et al. 2021 J. Appl. Psychol. 70, 216-253) recently undertook a meta-analysis of this research and reported positive overall effects in both laboratory and field studies, with field studies yielding a moderate-to-large effect that was significantly larger than that obtained in laboratory experiments. We highlight a number of issues with Chen et al.'s selection of field studies and then report a new meta-analysis (k = 13, N = 683) that corrects these. The new meta-analysis reveals suggestive evidence of publication bias and low power in goal priming field studies. We conclude that the available evidence falls short of demonstrating goal priming effects in the workplace, and offer proposals for how future research can provide stronger tests.

The Challenge of Inferring Unconscious Mental Processes.

Studies of unconscious mental processes often compare a performance measure (e.g., some assessment of perception or memory) with a measure of awareness (e.g., a verbal report or forced-choice response) of the critical cue or contingency taken either concurrently or separately. The resulting patterns of bivariate data across participants lend themselves to several analytic approaches for inferring the existence of unconscious mental processes, but it is rare for researchers to consider the underlying generative processes that might cause these patterns. We show that bivariate data are generally insufficient to discriminate single-process models, with a unitary latent process determining both performance and awareness, from dual-process models, comprising distinct latent processes for performance and awareness. Future research attempting to isolate and investigate unconscious processes will need to employ richer types of data and analyses.