Pre-supplementary motor area strengthens reward sensitivity in intertemporal choice.

Previous investigations on the causal neural mechanisms underlying intertemporal decision making focused on the dorsolateral prefrontal cortex as neural substrate of cognitive control. However, little is known, about the causal contributions of further parts of the frontoparietal control network to delaying gratification, including the pre-supplementary motor area (pre-SMA) and posterior parietal cortex (PPC). Conflicting previous evidence related pre-SMA and PPC either to evidence accumulation processes, choice biases, or response caution. To disentangle between these alternatives, we combined drift diffusion models of decision making with online transcranial magnetic stimulation (TMS) over pre-SMA and PPC during an intertemporal decision task. While we observed no robust effects of PPC TMS, perturbation of pre-SMA activity reduced preferences for larger over smaller rewards. A drift diffusion model of decision making suggests that pre-SMA increases the weight assigned to reward magnitudes during the evidence accumulation process without affecting choice biases or response caution. Taken together, the current findings reveal the computational role of the pre-SMA in value-based decision making, showing that pre-SMA promotes choices of larger, costly rewards by strengthening the sensitivity to reward magnitudes.

Dopamine neurons encode trial-by-trial subjective reward value in an auction-like task.

The dopamine reward prediction error signal is known to be subjective but has so far only been assessed in aggregate choices. However, personal choices fluctuate across trials and thus reflect the instantaneous subjective reward value. In the well-established Becker-DeGroot-Marschak (BDM) auction-like mechanism, participants are encouraged to place bids that accurately reveal their instantaneous subjective reward value; inaccurate bidding results in suboptimal reward ("incentive compatibility"). In our experiment, male rhesus monkeys became experienced over several years to place accurate BDM bids for juice rewards without specific external constraints. Their bids for physically identical rewards varied trial by trial and increased overall for larger rewards. In these highly experienced animals, responses of midbrain dopamine neurons followed the trial-by-trial variations of bids despite constant, explicitly predicted reward amounts. Inversely, dopamine responses were similar with similar bids for different physical reward amounts. Support Vector Regression demonstrated accurate prediction of the animals' bids by as few as twenty dopamine neurons. Thus, the phasic dopamine reward signal reflects instantaneous subjective reward value.

Surprising sounds influence risky decision making.

Adaptive behavior depends on appropriate responses to environmental uncertainty. Incidental sensory events might simply be distracting and increase errors, but alternatively can lead to stereotyped responses despite their irrelevance. To evaluate these possibilities, we test whether task-irrelevant sensory prediction errors influence risky decision making in humans across seven experiments (total n = 1600). Rare auditory sequences preceding option presentation systematically increase risk taking and decrease choice perseveration (i.e., increased tendency to switch away from previously chosen options). The risk-taking and perseveration effects are dissociable by manipulating auditory statistics: when rare sequences end on standard tones, including when rare sequences consist only of standard tones, participants are less likely to perseverate after rare sequences but not more likely to take risks. Computational modeling reveals that these effects cannot be explained by increased decision noise but can be explained by value-independent risky bias and perseveration parameters, decision biases previously linked to dopamine. Control experiments demonstrate that both surprise effects can be eliminated when tone sequences are presented in a balanced or fully predictable manner, and that surprise effects cannot be explained by erroneous beliefs. These findings suggest that incidental sounds may influence many of the decisions we make in daily life.

Sex differences in neural representations of social and nonsocial reward in the medial prefrontal cortex.

The reinforcing nature of social interactions is necessary for the maintenance of appropriate social behavior. However, the neural substrates underlying social reward processing and how they might differ based on the sex and internal state of the animal remains unknown. It is also unclear whether these neural substrates are shared with those involved in nonsocial rewarding processing. We developed a fully automated, two choice (social-sucrose) operant assay in which mice choose between social and nonsocial rewards to directly compare the reward-related behaviors associated with two competing stimuli. We performed cellular resolution calcium imaging of medial prefrontal cortex (mPFC) neurons in male and female mice across varying states of water restriction and social isolation. We found that mPFC neurons maintain largely non-overlapping, flexible representations of social and nonsocial reward that vary with internal state in a sex-dependent manner. Additionally, optogenetic manipulation of mPFC activity during the reward period of the assay disrupted reward-seeking behavior across male and female mice. Thus, using a two choice operant assay, we have identified sex-dependent, non-overlapping neural representations of social and nonsocial reward in the mPFC that vary with internal state and that are essential for appropriate reward-seeking behavior.

Fins, feathers, fingers, and finding an explanation for the puzzle of ephemeral rewards.

This article discusses the ephemeral reward task and how it is not always a clear and concise choice. This is demonstrated through some animal studies involving birds and primates. This article also shows that when compared to human studies, that there are positive correlations between the BART and optimal choice in the ephemeral reward task, meaning that those who took more risks also were more inclined to be optimal. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Plaudits for logits in sensory neuroscience.

A workhorse tool of economic decision-making has long sought to get inside people's heads through careful examination of their choices. In this issue of Neuron, Carandini1 flips the script, showing how it can model how the brain makes sensory choices.

Using recurrent neural network to estimate irreducible stochasticity in human choice behavior.

Theoretical computational models are widely used to describe latent cognitive processes. However, these models do not equally explain data across participants, with some individuals showing a bigger predictive gap than others. In the current study, we examined the use of theory-independent models, specifically recurrent neural networks (RNNs), to classify the source of a predictive gap in the observed data of a single individual. This approach aims to identify whether the low predictability of behavioral data is mainly due to noisy decision-making or misspecification of the theoretical model. First, we used computer simulation in the context of reinforcement learning to demonstrate that RNNs can be used to identify model misspecification in simulated agents with varying degrees of behavioral noise. Specifically, both prediction performance and the number of RNN training epochs (i.e., the point of early stopping) can be used to estimate the amount of stochasticity in the data. Second, we applied our approach to an empirical dataset where the actions of low IQ participants, compared with high IQ participants, showed lower predictability by a well-known theoretical model (i.e., Daw's hybrid model for the two-step task). Both the predictive gap and the point of early stopping of the RNN suggested that model misspecification is similar across individuals. This led us to a provisional conclusion that low IQ subjects are mostly noisier compared to their high IQ peers, rather than being more misspecified by the theoretical model. We discuss the implications and limitations of this approach, considering the growing literature in both theoretical and data-driven computational modeling in decision-making science.

Why am I obsessed with viewing mukbang ASMR? The roles of mediated voyeurism and intertemporal choice.

This study investigates the determinants of the obsessive view of mukbang autonomous sensory meridian response (Mukbang ASMR) and examines the moderation role of intertemporal choice and the mediating effect of mediated voyeurism among university students in Malaysia. A quantitative survey was conducted with 408 university students in Malaysia who viewed mukbang channel(s) often on social media. PLS-SEM is adopted to examine the associated paths and effects. The results demonstrate the significant impact of alienation and novelty, vicarious satisfaction, companionship and loneliness on mukbang ASMR obsession. Mediated voyeurism intervenes the effects of alienation and novelty on mukbang ASMR and intertemporal choice positively moderates the relationship between companionship and loneliness and mukbang ASMR. This study constructs a model to estimate Mukbang ASMR obsession by identifying specific motives and relationships among key factors, highlighting loneliness as the most effective determinant of mukbang ASMR among Malaysian younger generation. Research results provide an extended understanding of the mukbang ASMR, offering valuable insights in the areas of lifestyle, social well-being, and social media consumption.

A cognitive approach to better understand foraging strategies of the adult domestic hen.

Foraging is known to be one of the most important activities in the behavioral budget of chickens. However, how these animals adapt different foraging strategies to diverse environmental variations is currently poorly understood. To gain further insight into this matter, in the present study, hens were submitted to the sloped-tubes task. In this task, the experimenter can manipulate the information that enables the hens to find a food reward (visible or not), placed in one of two hollow tubes. First, 12 hens were tested under free-choice conditions (no penalty for exhaustive searching in both tubes). Under these conditions, the hens adopted a non-random, side-biased strategy when the food location was not directly visible. Then, we divided the hens in two cohorts of equal size to study deeper the hens' foraging strategy when faced (1) with a different container, or (2) with a restrictive environmental constraint under forced-choice conditions (no food reward if the unbaited tube is visited first). This latter constraint increased the risk of the hen not receiving food. A change in the containers didn't modify the search behavior of the hens. However, in forced-choice conditions when the location of the food was not directly visible, four out of six hens learned to choose by exclusion. We conclude that hens can selectively adapt their foraging strategy to the point of adopting an exclusion performance, depending on available information and environmental constraints (high or low risk).

Task-specific relationships between error-related ERPs and behavior: Flanker, Stroop, and Go/Nogo tasks.

Performance monitoring has been widely studied during different forced-choice response tasks. Participants typically show longer response times (RTs) and increased accuracy following errors, but there are inconsistencies regarding the connection between error-related event-related brain potentials (ERPs) and behavior, such as RT and accuracy. The specific task in any given study could contribute to these inconsistencies, as different tasks may require distinct cognitive processes that impact ERP-behavior relationships. The present study sought to determine whether task moderates ERP-behavior relationships and whether these relationships are robustly observed when tasks and stimuli are treated as random effects. ERPs and behavioral indices (RTs and accuracy) recorded during flanker, Stroop, and Go/Nogo tasks from 180 people demonstrated a task-specific effect on ERP-behavior relationships, such that larger previous-trial error-related negativity (ERN) predicted longer RTs and greater likelihood of a correct response on subsequent trials during flanker and Stroop tasks but not during Go/Nogo task. Additionally, larger previous-trial error positivity (Pe) predicted faster RTs and smaller variances of RTs on subsequent trials for Stroop and Go/Nogo tasks but not for flanker task. When tasks and stimuli were treated as random effects, ERP-behavior relationships were not observed. These findings support the need to consider the task used for recording performance monitoring measures when interpreting results across studies.

Distinct roles of monkey OFC-subcortical pathways in adaptive behavior.

Primates must adapt to changing environments by optimizing their behavior to make beneficial choices. At the core of adaptive behavior is the orbitofrontal cortex (OFC) of the brain, which updates choice value through direct experience or knowledge-based inference. Here, we identify distinct neural circuitry underlying these two separate abilities. We designed two behavioral tasks in which two male macaque monkeys updated the values of certain items, either by directly experiencing changes in stimulus-reward associations, or by inferring the value of unexperienced items based on the task's rules. Chemogenetic silencing of bilateral OFC combined with mathematical model-fitting analysis revealed that monkey OFC is involved in updating item value based on both experience and inference. In vivo imaging of chemogenetic receptors by positron emission tomography allowed us to map projections from the OFC to the rostromedial caudate nucleus (rmCD) and the medial part of the mediodorsal thalamus (MDm). Chemogenetic silencing of the OFC-rmCD pathway impaired experience-based value updating, while silencing the OFC-MDm pathway impaired inference-based value updating. Our results thus demonstrate dissociable contributions of distinct OFC projections to different behavioral strategies, and provide new insights into the neural basis of value-based adaptive decision-making in primates.

Differential stability of task variable representations in retrosplenial cortex.

Cortical neurons store information across different timescales, from seconds to years. Although information stability is variable across regions, it can vary within a region as well. Association areas are known to multiplex behaviorally relevant variables, but the stability of their representations is not well understood. Here, we longitudinally recorded the activity of neuronal populations in the mouse retrosplenial cortex (RSC) during the performance of a context-choice association task. We found that the activity of neurons exhibits different levels of stability across days. Using linear classifiers, we quantified the stability of three task-relevant variables. We find that RSC representations of context and trial outcome display higher stability than motor choice, both at the single cell and population levels. Together, our findings show an important characteristic of association areas, where diverse streams of information are stored with varying levels of stability, which may balance representational reliability and flexibility according to behavioral demands.

Generalized Encoding of the Relative Subjective Value of Cognitive Effort in the Dorsal ACC.

Making choices about whether and when to engage cognitive effort are a common feature of everyday experience, with important consequences for academic, career, and health outcomes. Yet, despite their hypothesized importance, very little is understood about the underlying mechanisms that support this form of human cost-benefit decision-making. To investigate these mechanisms, we used the Cognitive Effort Discounting Paradigm (Cog-ED) during fMRI scanning to precisely quantify the neural encoding of varying cognitive effort demands relative to reward outcomes, within two distinct cognitive domains (working memory, speech comprehension). The findings provide strong evidence that the dorsal anterior cingulate cortex (dACC) plays a central and selective role in this decision-making process. Trial-by-trial modulations in dACC activation tracked the relative subjective value of the low-effort, low-reward option, with the strongest activity occurring when this was of greater value than the high-effort, high-reward option. In contrast, dACC activity was not modulated by decision difficulty, though such effects were found in other frontoparietal regions. Critically, dACC activity was also strongly correlated across the two decision-making task domains and further predicted subsequent choice behavior in both. Together, the results suggest that dACC activity modulation reflects a domain-general valuation comparison mechanism, which acts to bias participants away from decisions to engage in cognitive effort, when the perceived subjective costs of such engagement outweigh the reward-related benefits. These findings complement work in other cost domains and species by pointing to a clear role of the dACC in representing subjective value differences between choice options during cost-benefit decision-making.

Ground-nesting birds learn egg appearance to guide background choice for camouflage.

Camouflage is vital for the survival of many prey species1,2, including ground-nesting birds3,4,5,6. Egg camouflage via background matching and disruptive coloration (high contrast markings that break up the body outline) is often behaviourally mediated by selecting substrates that enhance egg camouflage1,2,3,4,5,6. However, the mechanisms controlling this behaviour in birds have remained unknown. Several, not mutually exclusive, mechanisms have been suggested to control background choice for egg camouflage7. These include where individual background preferences are genetically linked to egg coloration, enabled through learning egg appearances from previous breeding attempts, or modified by imprinting on visual backgrounds during early life7, Here, using predator vision models, we compared the camouflage of Japanese quail (Coturnix japonica) eggs among females who were allowed to choose one of four coloured substrates on which to lay3. Birds were divided into experienced females who had been given the opportunity to observe the appearance of their eggs, versus naïve females breeding for the first time. Our experiment revealed that breeding experience leads to improved background choices made for egg background matching. However, substrate choice for disruptive coloration appeared genetically determined, as both bird groups chose backgrounds that enhanced egg disruptiveness regardless of experience. These mechanisms underpin behaviours that are likely essential for birds and other animals to optimise camouflage and avoid predation6.

Exploring the neuropsychological basis of behavioral contagion during learning about another agent's social preferences: Evidence from an ERP study.

Social contagion is a pervasive phenomenon and an important social influence that involves the rapid dissemination (propagation) of behaviors, attitudes, emotions, or ideas from one person to another, often without conscious reflection or rational thought. This phenomenon is closely related to conformity, by which a person changes his/her original ideas and attitude and imitates certain behavior of others. Although some behavioral research has been carried out on contagion and conformity, there is very little neuropsychological understanding of these phenomena. Existing research on social influence and conformity has predominantly focused on tasks like mental rotation or rating tasks involving facial expressions, with fewer studies exploring risk preferences and temporal discounting. However, there is a notable gap in the literature when it comes to examining social influence and conformity using other­regarding preference models derived from heterodox economics. To address this research gap, the present study investigates the neuropsychological underpinnings of social contagion by utilizing event­related potentials (ERPs) recorded while subjects engage in mini­dictator games. The behavioral analysis revealed that contagion had an impact on the participants' preferences, leading to a change in their choices. We observed a P300 component in the midline and right posterior during the time window of 200­350 ms after stimulus onset, which showed a significant increase in mean amplitude when participants observed others' behavior, compared to when they made decisions based on their own preferences. Moreover, the lack of late positive potential in the time window of 500­650 ms suggests that the presence of P300 may indicate difficulty in making decisions. In summary, by analyzing both behavioral and ERP data, this study may provide a more comprehensive understanding of the cognitive and neural processes that drive conformity and contagion behavior. Our analysis has the potential to inform policymakers in developing effective interventions for promoting positive social behaviors and reducing negative ones.

My choice, my actions: self-determination, not instrumental value of outcomes enhances outcome monitoring during learning.

Freedom of choice enhances our sense of agency. During goal-directed behavior, the freedom to choose between different response options increases the neural processing of positive and negative feedback, indicating enhanced outcome monitoring under conditions of high agency experience. However, it is unclear whether this enhancement is predominantly driven by an increased salience of self- compared to externally determined action outcomes or whether differences in the perceived instrumental value of outcomes contribute to outcome monitoring in goal-directed tasks. To test this, we recorded electroencephalography while participants performed a reinforcement learning task involving free choices, action-relevant forced choices, and action-irrelevant forced choices. We observed larger midfrontal theta power and N100 amplitudes for feedback following free choices compared with action-relevant and action-irrelevant forced choices. In addition, a Reward Positivity was only present for free but not forced choice outcomes. Crucially, our results indicate that enhanced outcome processing is not driven by the relevance of outcomes for future actions but rather stems from the association of outcomes with recent self-determined choice. Our findings highlight the pivotal role of self-determination in tracking the consequences of our actions and contribute to an understanding of the cognitive processes underlying the choice-induced facilitation in outcome monitoring.

The right posterior parietal cortex mediates spatial reorienting of attentional choice bias.

Attention facilitates behavior by enhancing perceptual sensitivity (sensory processing) and choice bias (decisional weighting) for attended information. Whether distinct neural substrates mediate these distinct components of attention remains unknown. We investigate the causal role of key nodes of the right posterior parietal cortex (rPPC) in the forebrain attention network in sensitivity versus bias control. Two groups of participants performed a cued attention task while we applied either inhibitory, repetitive transcranial magnetic stimulation (n = 28) or 40 Hz transcranial alternating current stimulation (n = 26) to the dorsal rPPC. We show that rPPC stimulation - with either modality - impairs task performance by selectively altering attentional modulation of bias but not sensitivity. Specifically, participants' bias toward the uncued, but not the cued, location reduced significantly following rPPC stimulation - an effect that was consistent across both neurostimulation cohorts. In sum, the dorsal rPPC causally mediates the reorienting of choice bias, one particular component of visual spatial attention.

Attentional dynamics of evidence accumulation explain why more numerate people make better decisions under risk.

In decisions under risk, more numerate people are typically more likely to choose the option with the highest expected value (EV) than less numerate ones. Prior research indicates that this finding cannot be explained by differences in the reliance on explicit EV calculation. The current work uses the attentional Drift Diffusion Model as a unified computational framework to formalize three candidate mechanisms of pre-decisional information search and processing-namely, attention allocation, amount of deliberation, and distorted processing of value-which may differ between more and less numerate people and explain differences in decision quality. Computational modeling of an eye-tracking experiment on risky choice demonstrates that numeracy is linked to how people allocate their attention across the options, how much evidence they require before committing to a choice, and also how strongly they distort currently non-attended information during preference formation. Together, especially the latter two mechanisms largely mediate the effect of numeracy on decision quality. Overall, the current work disentangles and quantifies latent aspects of the dynamics of preference formation, explicates how their interplay may give rise to manifest differences in decision quality, and thereby provides a fully formalized, mechanistic explanation for the link between numeracy and decision quality in risky choice.

The consequences of AI training on human decision-making.

AI is now an integral part of everyday decision-making, assisting us in both routine and high-stakes choices. These AI models often learn from human behavior, assuming this training data is unbiased. However, we report five studies that show that people change their behavior to instill desired routines into AI, indicating this assumption is invalid. To show this behavioral shift, we recruited participants to play the ultimatum game, where they were asked to decide whether to accept proposals of monetary splits made by either other human participants or AI. Some participants were informed their choices would be used to train an AI proposer, while others did not receive this information. Across five experiments, we found that people modified their behavior to train AI to make fair proposals, regardless of whether they could directly benefit from the AI training. After completing this task once, participants were invited to complete this task again but were told their responses would not be used for AI training. People who had previously trained AI persisted with this behavioral shift, indicating that the new behavioral routine had become habitual. This work demonstrates that using human behavior as training data has more consequences than previously thought since it can engender AI to perpetuate human biases and cause people to form habits that deviate from how they would normally act. Therefore, this work underscores a problem for AI algorithms that aim to learn unbiased representations of human preferences.

Increased color preference through the introduction of luminance noise in chromatic stimuli.

Humans exhibit consistent color preferences that are often described as a curvilinear pattern across hues. The recent literature posits that color preference is linked to the preference for objects or other entities associated with those colors. However, many studies examine this preference using isoluminant colors, which don't reflect the natural viewing experience typically influenced by different light intensities. The inclusion of random luminance levels (luminance noise) in chromatic stimuli may provide an initial step towards assessing color preference as it is presented in the real world. Employing mosaic stimuli, this study aimed to evaluate the influence of luminance noise on human color preference. Thirty normal trichromats engaged in a two-alternative forced-choice paradigm, indicating their color preferences between presented pairs. The chromatic stimuli included saturated versions of 8 standard hues, presented in mosaics with varying diameters under different luminance noise conditions. Results indicated that the inclusion of luminance noise increased color preference across all hues, specifically under the high luminance noise range, while the curvilinear pattern remained unchanged. Finally, women exhibit a greater sensitivity to the presence of luminance noise than men, potentially due to differences between men and women in aesthetic evaluation strategies.