Multisensory integration of speech and gestures in a naturalistic paradigm.

Speech comprehension is crucial for human social interaction, relying on the integration of auditory and visual cues across various levels of representation. While research has extensively studied multisensory integration (MSI) using idealised, well-controlled stimuli, there is a need to understand this process in response to complex, naturalistic stimuli encountered in everyday life. This study investigated behavioural and neural MSI in neurotypical adults experiencing audio-visual speech within a naturalistic, social context. Our novel paradigm incorporated a broader social situational context, complete words, and speech-supporting iconic gestures, allowing for context-based pragmatics and semantic priors. We investigated MSI in the presence of unimodal (auditory or visual) or complementary, bimodal speech signals. During audio-visual speech trials, compared to unimodal trials, participants more accurately recognised spoken words and showed a more pronounced suppression of alpha power-an indicator of heightened integration load. Importantly, on the neural level, these effects surpassed mere summation of unimodal responses, suggesting non-linear MSI mechanisms. Overall, our findings demonstrate that typically developing adults integrate audio-visual speech and gesture information to facilitate speech comprehension in noisy environments, highlighting the importance of studying MSI in ecologically valid contexts.

Reward responsiveness in autism and autistic traits - Evidence from neuronal, autonomic, and behavioural levels.

Autism has been linked to atypicalities in reward processing, especially in the social domain. However, results are heterogeneous, and their interpretation is hindered by the use of personally non-relevant social rewards. In this study we investigated behavioural (reaction times), neuronal (event-related potentials), and autonomic (pupil sizes) responses to personally relevant social rewards, money, and neutral outcomes in 26 autistic and 53 non-autistic subjects varying in levels of autistic traits. As hypothesised and preregistered, autism and autistic traits did not differently influence responses to social, monetary, or neutral outcomes on either response level. While groups did not differ in behaviour (reaction times), autism was linked to generally enhanced brain responses in early anticipation and larger pupil constrictions in reward reception. Together, these results suggest that when using personally relevant stimuli, autism is linked to generally preserved, although less neuronally efficient processing of rewards. Considering the role of social relevance in reward processing, we propose an interpretation of contradictory evidence from clinical practice and empirical research.

Doctoral researchers' mental health and PhD training satisfaction during the German COVID-19 lockdown: results from an international research sample.

Academia has been facing a mental health crisis particularly affecting early career researchers (ECRs). Moreover, the COVID-19 pandemic posed an unprecedented burden on the mental health of many individuals. Therefore, we cross-sectionally investigated how doctoral researchers (N = 222) evaluate their mental health status and satisfaction with their PhD training before and during the pandemic. As compared to self-reported, retrospective evaluations about the pre-pandemic state, we found decreased satisfaction with PhD training and overall well-being. The whole sample exhibited high levels of personal and work-related burnout, a fifth indicated clinically meaningful levels of depressive symptoms and almost 25% experienced severe loneliness. When exploring predictors of depression, anxiety, and burnout, we identified low satisfaction with PhD training as the most prominent predictor for poor mental health, suggesting a link between the doctoral work and their mental health status. Females vs. males and doctoral researchers in individual doctorate vs. structured PhD programs reported higher symptoms of burnout. Our study replicates previous findings of poor mental health in doctoral researchers and indicates further decreases of mental wellbeing under the influence of the pandemic. Systematic adjustments in academia are required to improve the mental health of ECRs.

Subjective and objective difficulty of emotional facial expression perception from dynamic stimuli.

This study aimed to discover predictors of subjective and objective difficulty in emotion perception from dynamic facial expressions. We used a multidimensional emotion perception framework, in which observers rated the perceived emotion along a number of dimensions instead of choosing from traditionally-used discrete categories of emotions. Data were collected online from 441 participants who rated facial expression stimuli in a novel paradigm designed to separately measure subjective (self-reported) and objective (deviation from the population consensus) difficulty. We targeted person-specific (sex and age of observers and actors) and stimulus-specific (valence and arousal values) predictors of those difficulty scores. Our findings suggest that increasing age of actors makes emotion perception more difficult for observers, and that perception difficulty is underestimated by men in comparison to women, and by younger and older adults in comparison to middle-aged adults. The results also yielded an increase in the objective difficulty measure for female observers and female actors. Stimulus-specific factors-valence and arousal-exhibited quadratic relationships with subjective and objective difficulties: Very positive and very negative stimuli were linked to reduced subjective and objective difficulty, whereas stimuli of very low and high arousal were linked to decreased subjective but increased objective difficulty. Exploratory analyses revealed low relevance of person-specific variables for the prediction of difficulty but highlighted the importance of valence in emotion perception, in line with functional accounts of emotions. Our findings highlight the need to complement traditional emotion recognition paradigms with novel designs, like the one presented here, to grasp the "big picture" of human emotion perception.

Pupillary Responses to Faces Are Modulated by Familiarity and Rewarding Context.

Observing familiar (known, recognisable) and socially relevant (personally important) faces elicits activation in the brain's reward circuit. Although smiling faces are often used as social rewards in research, it is firstly unclear whether familiarity and social relevance modulate the processing of faces differently, and secondly whether this processing depends on the feedback context, i.e., if it is different when smiles are delivered depending on performance or in the absence of any action (passive viewing). In this preregistered study, we compared pupillary responses to smiling faces differing in subjective familiarity and social relevance. They were displayed in a passive viewing task and in an active task (a speeded visual short-term memory task). The pupils were affected only in the active task and only by subjective familiarity. Contrary to expectations, smaller dilations were observed in response to more familiar faces. Behavioural ratings supported the superior rewarding context of the active task, with higher reward ratings for the game than the passive task. This study offers two major insights. Firstly, familiarity plays a role in the processing of social rewards, as known and unknown faces influence the autonomic responses differently. Secondly, the feedback context is crucial in reward research as positive stimuli are rewarding when they are dependent on performance.

Socially Induced Negative Emotions Elicit Neural Activity in the Mentalizing Network in a Subsequent Inhibitory Task.

Despite the growing emphasis on embedding interactive social paradigms in the field of cognitive and affective neuroscience, the impact of socially induced emotions on cognition remains widely unknown. The aim of the present study was to fill this gap by testing whether facial stimuli whose emotional valence was acquired through social learning in an economic trust game may influence cognitive performance in a subsequent stop-signal task. The study was designed as a conceptual replication of previous event-related potential experiments, extending them to more naturalistic settings. We hypothesized that response inhibition to briefly presented faces of negative and positive game partners would be enhanced on the behavioral and neural levels as compared to trials with a neutral player. The results revealed that the trust game was an effective paradigm for the induction of differently valenced emotions towards players; however, behavioral inhibitory performance was comparable in all stop-signal conditions. On the neural level, we found decreased P3 amplitude in negative trials due to significantly stronger activation in the right frontoparietal control network, which is involved in theory-of-mind operations and underlies social abilities in humans, especially memory-guided inference of others' mental states. Our findings make an important contribution to the cognition-emotion literature by showing that social interactions that take place during an economic game may influence brain activity within the mentalizing network in a subsequent cognitive task.

Socially induced negative affective knowledge modulates early face perception but not gaze cueing of attention.

Prior affective and social knowledge about other individuals has been shown to modulate perception of their faces and gaze-related attentional processes. However, it remains unclear whether emotionally charged knowledge acquired through interactive social learning also modulates face processing and attentional control. Thus, the aim of this study was to test whether affective knowledge induced through social interactions in a naturalistic exchange game can influence early stages of face processing and attentional shifts in a subsequent gaze-cueing task. As indicated by self-reported ratings, the game was successful in inducing valenced affective knowledge towards positive and negative players. In the subsequent task, in which the locations of future targets were cued by the gaze of the game players, we observed enhanced early neural activity (larger amplitude of the P1 component) in response to a photograph of the negative player. This indicates that negative affective knowledge about an individual indeed modulates very early stages of the processing of this individual's face. Our study contributes to the existing literature by providing further evidence for the saliency of interactive social exchange paradigms that are used to induce affective knowledge. Moreover, it extends the previous research by presenting a very early modulation of perception by socially learned affective knowledge. Importantly, it also offers increased ecological validity of the findings due to the use of naturalistic social exchange in the study design.

A Multidimensional View on Social and Non-Social Rewards.

Social rewards are a broad and heterogeneous set of stimuli including for instance smiling faces, gestures, or praise. They have been widely investigated in cognitive and social neuroscience as well as psychology. Research often contrasts the neural processing of social rewards with non-social ones, with the aim to demonstrate the privileged and unique nature of social rewards or to examine shared neural processing underlying them. However, such comparisons mostly neglect other important dimensions of rewards that are conflated in those types of rewards: primacy, temporal proximity, duration, familiarity, source, tangibility, naturalness, and magnitude. We identify how commonly used rewards in both social and non-social domains may differ in respect to these dimensions and how their interaction calls for careful consideration of alternative interpretations of observed effects. Additionally, we propose potential solutions on how to adapt the multidimensional view to experimental research. Altogether, these methodological considerations aim to inform and improve future experimental designs in research utilizing rewarding stimuli, especially in the social domain.

Autistic Traits Affect Reward Anticipation but not Reception.

Autism spectrum conditions (ASC) have been linked to aberrant reward processing, but it remains unclear whether it is a general dysfunction or limited to social stimuli, and whether it affects both phases of reward processing, namely anticipation and reception. We used event-related brain potentials and a population-based approach to investigate reward anticipation and reception to socially relevant (i.e., picture of experimenter's face showing approval/disapproval) and monetary rewards in 51 neurotypical individuals with varying levels of autistic traits. Higher autistic traits were associated with enhanced reward anticipation across reward types in the early anticipation phase (triggered by incentive cues), but not in the late anticipation phase (directly before reward reception), as reflected by the CNV component. The P3 component in response to reward reception showed a general increase for monetary outcomes, which was not modulated by autistic traits. These results suggest that higher autistic traits are related to enhanced reward anticipation, but do not modulate reward reception. No interaction between reward types and autistic traits was observed. We propose that the relevance of social rewards had higher reward value than commonly used pictures of strangers, which specifically normalised responses for individuals with high autistic traits.

Post-error Brain Activity Correlates With Incidental Memory for Negative Words.

The present study had three main objectives. First, we aimed to evaluate whether short-duration affective states induced by negative and positive words can lead to increased error-monitoring activity relative to a neutral task condition. Second, we intended to determine whether such an enhancement is limited to words of specific valence or is a general response to arousing material. Third, we wanted to assess whether post-error brain activity is associated with incidental memory for negative and/or positive words. Participants performed an emotional stop-signal task that required response inhibition to negative, positive or neutral nouns while EEG was recorded. Immediately after the completion of the task, they were instructed to recall as many of the presented words as they could in an unexpected free recall test. We observed significantly greater brain activity in the error-positivity (Pe) time window in both negative and positive trials. The error-related negativity amplitudes were comparable in both the neutral and emotional arousing trials, regardless of their valence. Regarding behavior, increased processing of emotional words was reflected in better incidental recall. Importantly, the memory performance for negative words was positively correlated with the Pe amplitude, particularly in the negative condition. The source localization analysis revealed that the subsequent memory recall for negative words was associated with widespread bilateral brain activity in the dorsal anterior cingulate cortex and in the medial frontal gyrus, which was registered in the Pe time window during negative trials. The present study has several important conclusions. First, it indicates that the emotional enhancement of error monitoring, as reflected by the Pe amplitude, may be induced by stimuli with symbolic, ontogenetically learned emotional significance. Second, it indicates that the emotion-related enhancement of the Pe occurs across both negative and positive conditions, thus it is preferentially driven by the arousal content of an affective stimuli. Third, our findings suggest that enhanced error monitoring and facilitated recall of negative words may both reflect responsivity to negative events. More speculatively, they can also indicate that post-error activity of the medial prefrontal cortex may selectively support encoding for negative stimuli and contribute to their privileged access to memory.