Are lateralized and bold fish optimistic or pessimistic?

Cognitive bias is defined as the influence of emotions on cognitive processes. The concept of the cognitive judgement bias has its origins in human psychology but has been applied to animals over the past 2 decades. In this study we were interested in determining if laterality and personality traits, which are known to influence learning style, might also be correlated with a cognitive bias in the three-spined sticklebacks (Gasterosteus aculeatus). We used the judgement bias test with the go/no-go procedure where fish were first trained to discriminate between a black and white card and, after reaching a minimum learning criterion, tested their response to an ambiguous card (grey). Optimistic subjects were expected to have a high expectation of reward associated with an ambiguous stimulus, whereas pessimistic subjects a high expectation of non-reward. We used an emergence and a mirror test to quantify boldness and laterality, respectively. We hypothesised that male, bolder and more strongly lateralized fish would be more optimistic than female, shy and less strongly lateralised fish. We found that males and more strongly lateralized fish were more optimistic than females and less strongly lateralized fish. In addition, bold males were more optimistic than shy males as we predicted, but females showed the opposite pattern. Finally, fish trained on the black colour card learned the training task faster than those trained on a white card. Our results indicate that both laterality and personality traits are linked to animals' internal states (pessimistic or optimistic outlooks) which likely has broad implications for understanding animal behaviour particularly in a welfare context.

Multiplexed representation of others in the hippocampal CA1 subfield of female mice.

Hippocampal place cells represent the position of a rodent within an environment. In addition, recent experiments show that the CA1 subfield of a passive observer also represents the position of a conspecific performing a spatial task. However, whether this representation is allocentric, egocentric or mixed is less clear. In this study we investigated the representation of others during free behavior and in a task where female mice learned to follow a conspecific for a reward. We found that most cells represent the position of others relative to self-position (social-vector cells) rather than to the environment, with a prevalence of purely egocentric coding modulated by context and mouse identity. Learning of a pursuit task improved the tuning of social-vector cells, but their number remained invariant. Collectively, our results suggest that the hippocampus flexibly codes the position of others in multiple coordinate systems, albeit favoring the self as a reference point.

Evidence for socially influenced and potentially actively coordinated cooperation by bumblebees.

Cooperation is common in animals, yet the specific mechanisms driving collaborative behaviour in different species remain unclear. We investigated the proximate mechanisms underlying the cooperative behaviour of bumblebees in two different tasks, where bees had to simultaneously push a block in an arena or a door at the end of a tunnel for access to reward. In both tasks, when their partner's entry into the arena/tunnel was delayed, bees took longer to first push the block/door compared with control bees that learned to push alone. In the tunnel task, just before gaining access to reward, bees were more likely to face towards their partner than expected by chance or compared with controls. These results show that bumblebees' cooperative behaviour is not simply a by-product of individual efforts but is socially influenced. We discuss how bees' turning behaviours, e.g. turning around before first reaching the door when their partner was delayed and turning back towards the door in response to seeing their partner heading towards the door, suggest the potential for active coordination. However, because these behaviours could also be interpreted as combined responses to social and secondary reinforcement cues, future studies are needed to help clarify whether bumblebees truly use active coordination.

Physiological paradigm for assessing reward prediction and extinction using cortical direct current potential responses in rats.

Anticipating positive outcomes is a core cognitive function in the process of reward prediction. However, no neurophysiological method objectively assesses reward prediction in basic medical research. In the present study, we established a physiological paradigm using cortical direct current (DC) potential responses in rats to assess reward prediction. This paradigm consisted of five daily 1-h sessions with two tones, wherein the rewarded tone was followed by electrical stimulation of the medial forebrain bundle (MFB) scheduled at 1000 ms later, whereas the unrewarded tone was not. On day 1, both tones induced a negative DC shift immediately after auditory responses, persisting up to MFB stimulation. This negative shift progressively increased and peaked on day 4. Starting from day 3, the negative shift from 600 to 1000 ms was significantly larger following the rewarded tone than that following the unrewarded tone. This negative DC shift was particularly prominent in the frontal cortex, suggesting its crucial role in discriminative reward prediction. During the extinction sessions, the shift diminished significantly on extinction day 1. These findings suggest that cortical DC potential is related to reward prediction and could be a valuable tool for evaluating animal models of depression, providing a testing system for anhedonia.

Nucleus accumbens neuronal ensembles vary with cocaine reinforcement in male and female rats.

Neuronal ensembles in the medial prefrontal cortex mediate cocaine self-administration via projections to the nucleus accumbens. We have recently shown that neuronal ensembles in the prelimbic cortex form rapidly to mediate cocaine self-administration. However, the role of neuronal ensembles within the nucleus accumbens in initial cocaine-seeking behaviour remains unknown. Here, we sought to expand the current literature by testing the necessity of the cocaine self-administration ensemble in the nucleus accumbens core (NAcCore) 1 day after male and female rats acquire cocaine self-administration by using the Daun02 inactivation procedure. We found that disrupting the NAcCore ensembles after a no-cocaine reward-seeking test increased subsequent cocaine seeking, while disrupting NAcCore ensembles following a cocaine self-administration session decreased subsequent cocaine seeking. We then characterized neuronal cell type in the NAcCore using RNAscope in situ hybridization. In the no-cocaine session, we saw reduced dopamine D1 type neuronal activation, while in the cocaine self-administration session, we found preferential dopamine D1 type neuronal activity in the NAcCore.

Effort-reward imbalance and sleep quality in railway locomotive stewards: a cross-sectional study.

OBJECTIVE: To assess the correlation between the effort-reward imbalance (ERI) and sleep quality among railway locomotive stewards. DESIGN: Cross-sectional study. SETTING: Lanzhou Bureau Group, China Railway, between July and August 2022. PARTICIPANTS: Railway locomotive stewards. PRIMARY AND SECONDARY OUTCOME MEASURES: Sleep quality was assessed using the Pittsburgh Sleep Quality Index Scale (PSQI), categorising scores of >14 as poor, 8-14 as fair and <8 as good. RESULTS: A total of 5738 valid questionnaires (mean age of 30.85±6.91 years and 5730 males) were included. The response rate was 92.27%. The PSQI score was 11.52±3.95; 2304 (40.15%) respondents had good sleep quality, 1590 (27.71%) had fair sleep quality and 1844 (32.14%) had poor sleep quality. Stepwise multivariable logistic regression analysis showed that, compared with poor sleep quality, Jiayuguan Locomotive Depot workers (OR 0.775, 95% CI 0.587 to 0.971, p=0.028), electric locomotive drivers (OR 0.499, 95% CI 0.316 to 0.786, p=0.003), passenger train locomotive drivers (OR 0.209, 95% CI 1.313 to 3.337, p=0.002), working <40 hours weekly (OR 2.291, 95% CI 1.686 to 3.112, p<0.001), working 40-50 hours weekly (OR 1.602, 95% CI 1.299 to 1.977, p<0.001), senior titles (OR 0.727, 95% CI 0.570 to 0.928, p=0.010), high effort/low reward (OR 2.812, 95% CI 2.218 to 3.564, p<0.001) and low overcommitment (OR 5.848, 95% CI 4.710 to 7.261, p<0.001) were independently associated with fair sleep quality. Electric locomotive drivers (OR 0.535, 95% CI 0.364 to 0.787, p=0.001), diesel locomotive drivers (OR 0.567, 95% CI 0.348 to 0.924, p=0.023), passenger train locomotive drivers (OR 1.471, 95% CI 1.005 to 2.155, p=0.047), working <40 hours weekly (OR 1.549, 95% CI 1.196 to 2.006, p=0.001), working 40-50 hours weekly (OR 1.340, 95% CI 1.141 to 1.574, p<0.001), high school diploma or less (OR 1.448, 95% CI 1.062 to 1.975, p=0.019), high effort/low reward (OR 1.237, 95% CI 1.006 to 1.521, p=0.044), balanced effort-reward (OR 0.653, 95% CI 0.478 to 0.892, p=0.007) and low overcommitment (OR 2.553, 95% CI 2.224 to 2.931, p<0.001) were independently associated with good sleep quality. CONCLUSION: The results revealed an acceptable ERI and poor sleep quality among railway stewards. ERI was correlated with sleep quality. Health education, lifestyle changes and improved work schedules may help boost sleep quality and well-being among railway locomotive stewards.

How can we reward you? A compliance and reward ontology (CaRO) for eliciting quantitative reward rules for engagement in mHealth app and healthy behaviors.

OBJECTIVE: When developing mHealth apps with point reward systems, knowledge engineers and domain experts should define app requirements capturing quantitative reward patterns that reflect patient compliance with health behaviors. This is a difficult task, and they could be aided by an ontology that defines systematically quantitative behavior goals that address more than merely the recommended behavior but also rewards for partial compliance or practicing the behavior more than recommended. No ontology and algorithm exist for defining point rewards systematically. METHODS: We developed an OWL ontology for point rewards that leverages the Basic Formal Ontology, the Behaviour Change Intervention Ontology and the Gamification Domain Ontology. This Compliance and Reward Ontology (CaRO) allows defining temporal elementary reward patterns for single and multiple sessions of practicing a behavior. These could be assembled to define more complex temporal patterns for persistence behavior over longer time intervals as well as logical combinations of simpler reward patterns. We also developed an algorithm for calculating the points that should be rewarded to users, given data regarding their actual performance. A natural language generation algorithm generates from ontology instances app requirements in the form of user stories. To assess the usefulness of the ontology and algorithms, information system students who are trained to be system analysts/knowledge engineers evaluated whether the ontology and algorithms can improve the requirement elicitation of point rewards for compliance patterns more completely and correctly. RESULTS: For single-session rewards, the ontology improved formulation of two of the six requirements as well as the total time for specifying them. For multi-session rewards, the ontology improved formulation of five of the 11 requirements. CONCLUSION: CaRO is a first attempt of its kind, and it covers all of the cases of compliance and reward pattern definitions that were needed for a full-scale system that was developed as part of a large European project. The ontology and algorithm are available at https://github.com/capable-project/rewards.

Reward, relief, and habit drinking profiles in treatment seeking individuals with an AUD.

AIMS: This study aimed to compare reward, relief, and habit treatment-seeking individuals on recent drinking, alcohol use disorder (AUD) phenomenology, and mood. The second aim of the study was to evaluate the predictive validity of reward, relief, and habit profiles. METHOD: Treatment-seeking individuals with an AUD (n = 169) were recruited to participate in a medication trial for AUD (NCT03594435). Reward, relief, and habit drinking groups were assessed using the UCLA Reward Relief Habit Drinking Scale. Group differences at baseline were evaluated using univariate analyses of variance. A subset of participants were enrolled in a 12-week, double-blind, placebo-controlled medication trial (n = 102), and provided longitudinal drinking and phenomenology data. The predictive validity of group membership was assessed using linear regression analyses. RESULTS: At baseline, individuals who drink primarily for relief had higher craving and negative mood than those who drink for reward and habit. Prospectively, membership in the relief drinking group predicted greater alcohol use, greater heavy drinking, and fewer days abstinent compared to those in the reward drinking group. Membership in the relief drinking group also predicted greater alcohol craving, more alcohol-related consequences, and more anxiety symptoms over 12 weeks compared to those in the reward drinking group. CONCLUSIONS: This study provides support for reward and relief drinking motive profiles in treatment-seeking individuals with an AUD. Membership in the relief drinking motive group was predictive of poorer drinking outcomes and more negative symptomology over 12 weeks, indicating that individuals who drink for relief may be a particularly vulnerable sub-population of individuals with AUD.

The neurocomputational link between defensive cardiac states and approach-avoidance arbitration under threat.

Avoidance, a hallmark of anxiety-related psychopathology, often comes at a cost; avoiding threat may forgo the possibility of a reward. Theories predict that optimal approach-avoidance arbitration depends on threat-induced psychophysiological states, like freezing-related bradycardia. Here we used model-based fMRI analyses to investigate whether and how bradycardia states are linked to the neurocomputational underpinnings of approach-avoidance arbitration under varying reward and threat magnitudes. We show that bradycardia states are associated with increased threat-induced avoidance and more pronounced reward-threat value comparison (i.e., a stronger tendency to approach vs. avoid when expected reward outweighs threat). An amygdala-striatal-prefrontal circuit supports approach-avoidance arbitration under threat, with specific involvement of the amygdala and dorsal anterior cingulate (dACC) in integrating reward-threat value and bradycardia states. These findings highlight the role of human freezing states in value-based decision making, relevant for optimal threat coping. They point to a specific role for amygdala/dACC in state-value integration under threat.

Pulling the lever in a hurry: the influence of impulsivity and sensitivity to reward on moral decision-making under time pressure.

BACKGROUND: Making timely moral decisions can save a life. However, literature on how moral decisions are made under time pressure reports conflicting results. Moreover, it is unclear whether and how moral choices under time pressure may be influenced by personality traits like impulsivity and sensitivity to reward and punishment. METHODS: To address these gaps, in this study we employed a moral dilemma task, manipulating decision time between participants: one group (N = 25) was subjected to time pressure (TP), with 8 s maximum time for response (including the reading time), the other (N = 28) was left free to take all the time to respond (noTP). We measured type of choice (utilitarian vs. non-utilitarian), decision times, self-reported unpleasantness and arousal during decision-making, and participants' impulsivity and BIS-BAS sensitivity. RESULTS: We found no group effect on the type of choice, suggesting that time pressure per se did not influence moral decisions. However, impulsivity affected the impact of time pressure, in that individuals with higher cognitive instability showed slower response times under no time constraint. In addition, higher sensitivity to reward predicted a higher proportion of utilitarian choices regardless of the time available for decision. CONCLUSIONS: Results are discussed within the dual-process theory of moral judgement, revealing that the impact of time pressure on moral decision-making might be more complex and multifaceted than expected, potentially interacting with a specific facet of attentional impulsivity.

Investment in nursing reaps rewards.

Sam Foster, Executive Director of Professional Practice, Nursing and Midwifery Council, considers the potential of nurses to improve their local health systems and, through those, the societies in which they live.

Understanding the Role of Naive Learners in Cultural Change.

AbstractA change to a population's social network is a change to the substrate of cultural transmission, affecting behavioral diversity and adaptive cultural evolution. While features of network structure such as population size and density have been well studied, less is understood about the influence of social processes such as population turnover-or the repeated replacement of individuals by naive individuals. Experimental data have led to the hypothesis that naive learners can drive cultural evolution by better assessing the relative value of behaviors, although this hypothesis has been expressed only verbally. We conducted a formal exploration of this hypothesis using a generative model that concurrently simulated its two key ingredients: social transmission and reinforcement learning. We simulated competition between high- and low-reward behaviors while varying turnover magnitude and tempo. Variation in turnover influenced changes in the distributions of cultural behaviors, irrespective of initial knowledge-state conditions. We found optimal turnover regimes that amplified the production of higher reward behaviors through two key mechanisms: repertoire composition and enhanced valuation by agents that knew both behaviors. These effects depended on network and learning parameters. Our model provides formal theoretical support for, and predictions about, the hypothesis that naive learners can shape cultural change through their enhanced sampling ability. By moving from experimental data to theory, we illuminate an underdiscussed generative process that can lead to changes in cultural behavior, arising from an interaction between social dynamics and learning.

Localized and global representation of prior value, sensory evidence, and choice in male mouse cerebral cortex.

Adaptive behavior requires integrating prior knowledge of action outcomes and sensory evidence for making decisions while maintaining prior knowledge for future actions. As outcome- and sensory-based decisions are often tested separately, it is unclear how these processes are integrated in the brain. In a tone frequency discrimination task with two sound durations and asymmetric reward blocks, we found that neurons in the medial prefrontal cortex of male mice represented the additive combination of prior reward expectations and choices. The sensory inputs and choices were selectively decoded from the auditory cortex irrespective of reward priors and the secondary motor cortex, respectively, suggesting localized computations of task variables are required within single trials. In contrast, all the recorded regions represented prior values that needed to be maintained across trials. We propose localized and global computations of task variables in different time scales in the cerebral cortex.

Dogs understand the role of a human partner in a cooperative task.

Humans are exceptionally flexible in cooperation, partly due to our ability to recognize the roles of cooperative partners. While some non-human animals understand the need for a partner in such interactions, it is unclear whether they grasp the consequences of their partner's actions and adjust accordingly. Previous studies utilizing economic games with non-human animals yielded mixed results. We investigated dogs, known for their close cooperation with humans, in a stag hunt game. Dogs could cooperate for better rewards or defect for lower ones, while their human partners would either cooperate, never cooperate, or act randomly. We control for attraction to food, side bias, and local enhancement. Dogs were more likely to coordinate with their partners when it led to better rewards, suggesting that they understood their partner's actions. By highlighting this cognitive skill in dogs, we advance our knowledge of the intricate mechanisms driving cooperative behavior in non-human animals.

Give it a second try? The influence of feedback and performance in the decision of reattempting.

Feedback evaluation can affect behavioural continuation or discontinuation, and is essential for cognitive and motor skill learning. One critical factor that influences feedback evaluation is participants' internal estimation of self-performance. Previous research has shown that two event-related potential components, the Feedback-Related Negativity (FRN) and the P3, are related to feedback evaluation. In the present study, we used a time estimation task and EEG recordings to test the influence of feedback and performance on participants' decisions, and the sensitivity of the FRN and P3 components to those factors. In the experiment, participants were asked to reproduce the total duration of an intermittently presented visual stimulus. Feedback was given after every response, and participants had then to decide whether to retry the same trial and try to earn reward points, or to move on to the next trial. Results showed that both performance and feedback influenced participants' decision on whether to retry the ongoing trial. In line with previous studies, the FRN showed larger amplitude in response to negative than to positive feedback. Moreover, our results were also in agreement with previous works showing the relationship between the amplitude of the FRN and the size of feedback-related prediction error (PE), and provide further insight in how PE size influences participants' decisions on whether or not to retry a task. Specifically, we found that the larger the FRN, the more likely participants were to base their decision on their performance - choosing to retry the current trial after good performance or to move on to the next trial after poor performance, regardless of the feedback received. Conversely, the smaller the FRN, the more likely participants were to base their decision on the feedback received.

A shared "optimal-level of arousal": Seeking basis for creativity and curiosity.

We argue that the phases identified in the novelty-seeking model can be clarified by considering an updated version of the optimal-level of arousal model, which incorporates the "arousal" and "mood changing" potentials of stimuli and contexts. Such a model provides valuable insights into what determines one's state of mind, inter-individual differences, and the rewarding effects of curiosity and creativity.

Dopamine, activation of ingestion and evaluation of response efficacy: a focus on the within-session time-course of licking burst number.

RATIONALE: Evidence on the effect of dopamine D1-like and D2-like receptor antagonists on licking microstructure and the forced swimming response led us to suggest that (i) dopamine on D1-like receptors plays a role in activating reward-directed responses and (ii) the level of response activation is reboosted based on a process of evaluation of response efficacy requiring dopamine on D2-like receptors. A main piece of evidence in support of this hypothesis is the observation that the dopamine D2-like receptor antagonist raclopride induces a within-session decrement of burst number occurring after the contact with the reward. The few published studies with a detailed analysis of the time-course of this measure were conducted in our laboratory. OBJECTIVES: The aim of this review is to recapitulate and discuss the evidence in support of the analysis of the within-session burst number as a behavioural substrate for the study of the mechanisms governing ingestion, behavioural activation and the related evaluation processes, and its relevance in the analysis of drug effects on ingestion. CONCLUSIONS: The evidence gathered so far suggests that the analysis of the within-session time-course of burst number provides an important behavioural substrate for the study of the mechanisms governing ingestion, behavioural activation and the related evaluation processes, and might provide decisive evidence in the analysis of the effects of drugs on ingestion. However, further evidence from independent sources is necessary to validate the use and the proposed interpretation of this measure.

Heuristics in risky decision-making relate to preferential representation of information.

When making choices, individuals differ from one another, as well as from normativity, in how they weigh different types of information. One explanation for this relates to idiosyncratic preferences in what information individuals represent when evaluating choice options. Here, we test this explanation with a simple risky-decision making task, combined with magnetoencephalography (MEG). We examine the relationship between individual differences in behavioral markers of information weighting and neural representation of stimuli pertinent to incorporating that information. We find that the extent to which individuals (N = 19) behaviorally weight probability versus reward information is related to how preferentially they neurally represent stimuli most informative for making probability and reward comparisons. These results are further validated in an additional behavioral experiment (N = 88) that measures stimulus representation as the latency of perceptual detection following priming. Overall, the results suggest that differences in the information individuals consider during choice relate to their risk-taking tendencies.

Learning to Choose: Behavioral Dynamics Underlying the Initial Acquisition of Decision-Making.

Current theories of decision-making propose that decisions arise through competition between choice options. Computational models of the decision process estimate how quickly information about choice options is integrated and how much information is needed to trigger a choice. Experiments using this approach typically report data from well-trained participants. As such, we do not know how the decision process evolves as a decision-making task is learned for the first time. To address this gap, we used a behavioral design separating learning the value of choice options from learning to make choices. We trained male rats to respond to single visual stimuli with different reward values. Then, we trained them to make choices between pairs of stimuli. Initially, the rats responded more slowly when presented with choices. However, as they gained experience in making choices, this slowing reduced. Response slowing on choice trials persisted throughout the testing period. We found that it was specifically associated with increased exponential variability when the rats chose the higher value stimulus. Additionally, our analysis using drift diffusion modeling revealed that the rats required less information to make choices over time. These reductions in the decision threshold occurred after just a single session of choice learning. These findings provide new insights into the learning process of decision-making tasks. They suggest that the value of choice options and the ability to make choices are learned separately and that experience plays a crucial role in improving decision-making performance.