Uncertainty of treatment efficacy moderates placebo effects on reinforcement learning.

The placebo-reward hypothesis postulates that positive effects of treatment expectations on health (i.e., placebo effects) and reward processing share common neural underpinnings. Moreover, experiments in humans and animals indicate that reward uncertainty increases striatal dopamine, which is presumably involved in placebo responses and reward learning. Therefore, treatment uncertainty analogously to reward uncertainty may affect updating from rewards after placebo treatment. Here, we address whether different degrees of uncertainty regarding the efficacy of a sham treatment affect reward sensitivity. In an online between-subjects experiment with N = 141 participants, we systematically varied the provided efficacy instructions before participants first received a sham treatment that consisted of listening to binaural beats and then performed a probabilistic reinforcement learning task. We fitted a Q-learning model including two different learning rates for positive (gain) and negative (loss) reward prediction errors and an inverse gain parameter to behavioral decision data in the reinforcement learning task. Our results yielded an inverted-U-relationship between provided treatment efficacy probability and learning rates for gain, such that higher levels of treatment uncertainty, rather than of expected net efficacy, affect presumably dopamine-related reward learning. These findings support the placebo-reward hypothesis and suggest harnessing uncertainty in placebo treatment for recovering reward learning capabilities.

A primitive-based representation of dance: modulations by experience and perceptual validity.

The generation of complex movements such as dance might be possible due to the utilization of movement building blocks, i.e., movement primitives. However, it is largely unexplored how the temporal structure of a movement sequence and the recruitment of these primitives change with experience. Therefore, we obtained a representation of primitives with the temporal movement primitive model from the motion capture data of dancers with varying experiences, both for improvised and choreographed movements (elements from contemporary/modern/jazz) with different qualitative expressions. We analyzed differences between movement conditions regarding the number of temporal segments and the number of primitives, as well as their association with dance experience. Especially for the choreography with a neutral expression, the results indicate a negative association between experience and the number of segments and a positive association between experience and the number of primitives. The variation in the recruitment of these primitives suggests an increased consistency of modular control with experience, particularly for improvised dance. A prerequisite for the meaningful interpretation of these results regarding human movement production is that the model can generate perceptually valid dance movements. This was confirmed in a subsequent experiment, although the validity was slightly impaired for improvised movements. Overall, the results of the choreographed movement sequences suggest that experience is associated with an increase in motor repertoire that might facilitate fewer and longer temporal segments.NEW & NOTEWORTHY This study demonstrates that a temporal movement primitive model, trained with movements performed by dancers with different levels of experience, is able to generate natural-looking dance movements. The results suggest that motor experience in dance is associated not only with fewer temporal segments but also with an increase in the number of underlying movement building blocks. The recruitment of these primitives, which might be used to simplify movement production, additionally seems to become more consistent with experience.

Modeling face recognition in the predictive coding framework: A combined computational modeling and functional imaging study.

The learning of new facial identities and the recognition of familiar faces are crucial processes for social interactions. Recently, a combined computational modeling and functional magnetic resonance imaging (fMRI) study used predictive coding as a biologically plausible framework to model face identity learning and to relate specific model parameters with brain activity (Apps and Tsakiris, Nat Commun 4, 2698, 2013). On the one hand, it was shown that behavioral responses on a two-option face recognition task could be predicted by the level of contextual and facial familiarity in a computational model derived from predictive-coding principles. On the other hand, brain activity in specific brain regions was associated with these parameters. More specifically, brain activity in the superior temporal sulcus (STS) varied with contextual familiarity, whereas activity in the fusiform face area (FFA) covaried with the prediction error parameter that updated facial familiarity. Literature combining fMRI assessments and computational modeling in humans still needs to be expanded. Furthermore, prior results are largely not replicated. The present study was, therefore, specifically set up to replicate these previous findings. Our results support the original findings in two critical aspects. First, on a group level, the behavioral responses were modeled best by the same computational model reported by the original authors. Second, we showed that estimates of these model parameters covary with brain activity in specific, face-sensitive brain regions. Our results thus provide further evidence that the functional properties of the face perception network conform to central principles of predictive coding. However, our study yielded diverging findings on specific computational model parameters reflected in brain activity. On the one hand, we did not find any evidence of a computational involvement of the STS. On the other hand, our results showed that activity in the right FFA was associated with multiple computational model parameters. Our data do not provide evidence for functional segregation between particular face-sensitive brain regions, as previously proposed.

Integration of optic flow into the sky compass network in the brain of the desert locust.

Flexible orientation through any environment requires a sense of current relative heading that is updated based on self-motion. Global external cues originating from the sky or the earth's magnetic field and local cues provide a reference frame for the sense of direction. Locally, optic flow may inform about turning maneuvers, travel speed and covered distance. The central complex in the insect brain is associated with orientation behavior and largely acts as a navigation center. Visual information from global celestial cues and local landmarks are integrated in the central complex to form an internal representation of current heading. However, it is less clear how optic flow is integrated into the central-complex network. We recorded intracellularly from neurons in the locust central complex while presenting lateral grating patterns that simulated translational and rotational motion to identify these sites of integration. Certain types of central-complex neurons were sensitive to optic-flow stimulation independent of the type and direction of simulated motion. Columnar neurons innervating the noduli, paired central-complex substructures, were tuned to the direction of simulated horizontal turns. Modeling the connectivity of these neurons with a system of proposed compass neurons can account for rotation-direction specific shifts in the activity profile in the central complex corresponding to turn direction. Our model is similar but not identical to the mechanisms proposed for angular velocity integration in the navigation compass of the fly Drosophila.

A Bayesian model for chronic pain.

The perceiving mind constructs our coherent and embodied experience of the world from noisy, ambiguous and multi-modal sensory information. In this paper, we adopt the perspective that the experience of pain may similarly be the result of a probabilistic, inferential process. Prior beliefs about pain, learned from past experiences, are combined with incoming sensory information in a Bayesian manner to give rise to pain perception. Chronic pain emerges when prior beliefs and likelihoods are biased towards inferring pain from a wide range of sensory data that would otherwise be perceived as harmless. We present a computational model of interoceptive inference and pain experience. It is based on a Bayesian graphical network which comprises a hidden layer, representing the inferred pain state; and an observable layer, representing current sensory information. Within the hidden layer, pain states are inferred from a combination of priors p ( pain ) , transition probabilities between hidden states p ( pain t + 1 ∣ pain t ) and likelihoods of certain observations p ( sensation ∣ pain ) . Using variational inference and free-energy minimization, the model is able to learn from observations over time. By systematically manipulating parameter settings, we demonstrate that the model is capable of reproducing key features of both healthy- and chronic pain experience. Drawing on mathematical concepts, we finally simulate treatment resistant chronic pain and discuss mathematically informed treatment options.

Inpatient psychotherapy for depression in a large routine clinical care sample: A Bayesian approach to examining clinical outcomes and predictors of change.

BACKGROUND: A routinely collected dataset was analyzed (1) to determine the naturalistic effectiveness of inpatient psychotherapy for depression in routine psychotherapeutic care, and (2) to identify potential predictors of change. METHODS: In a sample of 22,681 inpatients with depression, pre-post and pre-follow-up effect sizes were computed for various outcome variables. To build a probabilistic model of predictors of change, an independent component analysis generated components from demographic and clinical data, and Bayesian EFA extracted factors from the available pre-test, post-test and follow-up questionnaires in a subsample (N = 6377). To select the best-fitted model, the BIC of different path models were compared. A Bayesian path analysis was performed to identify the most important factors to predict changes. RESULTS: Effect sizes were large for the primary outcome and moderate for various secondary outcomes. Almost all pretreatment factors exerted significant influences on different baseline factors. Several factors were found to be resistant to change during treatment: suicidality, agoraphobia, life dissatisfaction, physical disability and pain. The strongest cross-loadings were observed from suicidality on negative cognitions, from agoraphobia on anxiety, and from physical disability on perceived disability. LIMITATIONS: No causal conclusions can be drawn directly from our results as we only used cross-lagged panel data without control group. CONCLUSIONS: The results indicate large effects of inpatient psychotherapy for depression in routine clinical care. The direct influence of pretreatment factors decreased over the course of treatment. However, some factors appeared stable and difficult to treat, which might hinder treatment outcome. Findings of different predictors of change are discussed.

Heuristics from bounded meta-learned inference.

Numerous researchers have put forward heuristics as models of human decision-making. However, where such heuristics come from is still a topic of ongoing debate. In this work, we propose a novel computational model that advances our understanding of heuristic decision-making by explaining how different heuristics are discovered and how they are selected. This model-called bounded meta-learned inference (BMI)-is based on the idea that people make environment-specific inferences about which strategies to use while being efficient in terms of how they use computational resources. We show that our approach discovers two previously suggested types of heuristics-one reason decision-making and equal weighting-in specific environments. Furthermore, the model provides clear and precise predictions about when each heuristic should be applied: Knowing the correct ranking of attributes leads to one reason decision-making, knowing the directions of the attributes leads to equal weighting, and not knowing about either leads to strategies that use weighted combinations of multiple attributes. In three empirical paired comparison studies with continuous features, we verify predictions of our theory and show that it captures several characteristics of human decision-making not explained by alternative theories. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Subdimensions of social-communication behavior in autism-A replication study.

Introduction: In order to identify more refined dimensions of social-communication impairments in autism spectrum disorder (ASD) a previous study applied exploratory and confirmatory factor analyses to diagnostic algorithm scores of the autism diagnostic observation schedule (ADOS), Module 3. A three-factor model consisting of repetitive behaviors, impairments in 'Basic Social-Communication' and in 'Interaction quality' (IQ) was established and confirmed. The current study aimed to replicate this model in an independent sample. To advance our understanding of the latent structure of social communication deficits, previous work was complemented by a probabilistic approach. Methods: Participants (N = 1363) included verbally fluent children and young adults, diagnosed as ASD or non-ASD based on "gold standard" best-estimate clinical diagnosis. Confirmatory factor analysis examined the factor structure of algorithm items from the ADOS Module 3 and correlations with individual characteristics (cognitive abilities, age) were analyzed. Linear Regressions were used to test the contribution of each latent factor to the prediction of an ASD diagnosis. To tackle large inter-correlations of the latent factors, a Bayesian exploratory factor analysis (BEFA) was applied. Results: Results confirmed the previously reported observation of three latent dimensions in the ADOS algorithm reflecting 'Restricted, Repetitive Behaviors', 'Basic Social-Communication' behaviors and 'Interaction Quality'. All three dimensions contributed independently and additively to the prediction of an ASD diagnosis. Conclusion: By replicating previous findings in a large clinical sample our results contribute to further conceptualize the social-communication impairments in ASD as two dimensional.

A Revised Framework for the Investigation of Expectation Update Versus Maintenance in the Context of Expectation Violations: The ViolEx 2.0 Model.

Expectations are probabilistic beliefs about the future that shape and influence our perception, affect, cognition, and behavior in many contexts. This makes expectations a highly relevant concept across basic and applied psychological disciplines. When expectations are confirmed or violated, individuals can respond by either updating or maintaining their prior expectations in light of the new evidence. Moreover, proactive and reactive behavior can change the probability with which individuals encounter expectation confirmations or violations. The investigation of predictors and mechanisms underlying expectation update and maintenance has been approached from many research perspectives. However, in many instances there has been little exchange between different research fields. To further advance research on expectations and expectation violations, collaborative efforts across different disciplines in psychology, cognitive (neuro)science, and other life sciences are warranted. For fostering and facilitating such efforts, we introduce the ViolEx 2.0 model, a revised framework for interdisciplinary research on cognitive and behavioral mechanisms of expectation update and maintenance in the context of expectation violations. To support different goals and stages in interdisciplinary exchange, the ViolEx 2.0 model features three model levels with varying degrees of specificity in order to address questions about the research synopsis, central concepts, or functional processes and relationships, respectively. The framework can be applied to different research fields and has high potential for guiding collaborative research efforts in expectation research.

Preferred auditory temporal processing regimes and auditory-motor synchronization.

Decoding the rich temporal dynamics of complex sounds such as speech is constrained by the underlying neuronal-processing mechanisms. Oscillatory theories suggest the existence of one optimal perceptual performance regime at auditory stimulation rates in the delta to theta range (< 10 Hz), but reduced performance in the alpha range (10-14 Hz) is controversial. Additionally, the widely discussed motor system contribution to timing remains unclear. We measured rate discrimination thresholds between 4 and 15 Hz, and auditory-motor coupling strength was estimated through a behavioral auditory-motor synchronization task. In a Bayesian model comparison, high auditory-motor synchronizers showed a larger range of constant optimal temporal judgments than low synchronizers, with performance decreasing in the alpha range. This evidence for optimal processing in the theta range is consistent with preferred oscillatory regimes in auditory cortex that compartmentalize stimulus encoding and processing. The findings suggest, remarkably, that increased auditory-motor synchronization might extend such an optimal range towards faster rates.

Why expectations do or do not change after expectation violation: A comparison of seven models.

Individuals are often confronted with events that violate their expectations, but disconfirming evidence does not always lead to expectation change. We review seven theoretical models on how individuals cope with disconfirming expectations: associative learning theories, the ViolEx Model, the model of coping with expectation disconfirmation (Roese & Sherman, 2007), the Meaning Maintenance Model, the Predictive Processing Framework, Expectancy Violations Theory, and the Expectation-Disconfirmation Model of consumer satisfaction. We focus on the proposed processes that relate to persistence or change of expectations. We discuss similarities and differences between the models. Three core coping processes are identified across most of these models - minimization of the importance of expectation-disconfirming evidence, search for/production of future expectation-confirming evidence, and expectation change. Suggestions for refinements and extensions of the models as well as for future empirical work on model testing are drawn.

Threat-conditioned contexts modulate the late positive potential to faces-A mobile EEG/virtual reality study.

In everyday life, the motivational value of faces is bound to the contexts in which faces are perceived. Electrophysiological studies have demonstrated that inherent negatively valent contexts modulate cortical face processing as assessed with ERP components. However, it is not well understood whether learned (rather than inherent) and three-dimensional aversive contexts similarly modulate the neural processing of faces. Using full immersive virtual reality (VR) and mobile EEG techniques, 25 participants underwent a differential fear conditioning paradigm, in which one virtual room was paired with an aversive noise burst (threat context) and another with a nonaversive noise burst (safe context). Subsequently, avatars with neutral or angry facial expressions were presented in the threat and safe contexts while EEG was recorded. Analysis of the late positive potential (LPP), which presumably indicates motivational salience, revealed a significant interaction of context (threat vs. safe) and face type (neutral vs. angry). Neutral faces evoked increased LPP amplitudes in threat versus safe contexts, while angry faces evoked increased early LPP amplitudes regardless of context. In addition to indicating that threat-conditioned contexts alter the processing of ambiguous faces, the present study demonstrates the successful integration of EEG and VR with particular relevance for affective neuroscience research.

Learning from the past: A reverberation of past errors in the cerebellar climbing fiber signal.

The cerebellum allows us to rapidly adjust motor behavior to the needs of the situation. It is commonly assumed that cerebellum-based motor learning is guided by the difference between the desired and the actual behavior, i.e., by error information. Not only immediate but also future behavior will benefit from an error because it induces lasting changes of parallel fiber synapses on Purkinje cells (PCs), whose output mediates the behavioral adjustments. Olivary climbing fibers, likewise connecting with PCs, are thought to transport information on instant errors needed for the synaptic modification yet not to contribute to error memory. Here, we report work on monkeys tested in a saccadic learning paradigm that challenges this concept. We demonstrate not only a clear complex spikes (CS) signature of the error at the time of its occurrence but also a reverberation of this signature much later, before a new manifestation of the behavior, suitable to improve it.

Perceptual integration of kinematic components in the recognition of emotional facial expressions.

According to a long-standing hypothesis in motor control, complex body motion is organized in terms of movement primitives, reducing massively the dimensionality of the underlying control problems. For body movements, this low-dimensional organization has been convincingly demonstrated by the learning of low-dimensional representations from kinematic and EMG data. In contrast, the effective dimensionality of dynamic facial expressions is unknown, and dominant analysis approaches have been based on heuristically defined facial "action units," which reflect contributions of individual face muscles. We determined the effective dimensionality of dynamic facial expressions by learning of a low-dimensional model from 11 facial expressions. We found an amazingly low dimensionality with only two movement primitives being sufficient to simulate these dynamic expressions with high accuracy. This low dimensionality is confirmed statistically, by Bayesian model comparison of models with different numbers of primitives, and by a psychophysical experiment that demonstrates that expressions, simulated with only two primitives, are indistinguishable from natural ones. In addition, we find statistically optimal integration of the emotion information specified by these primitives in visual perception. Taken together, our results indicate that facial expressions might be controlled by a very small number of independent control units, permitting very low-dimensional parametrization of the associated facial expression.

Making the Coupled Gaussian Process Dynamical Model Modular and Scalable with Variational Approximations.

We describe a sparse, variational posterior approximation to the Coupled Gaussian Process Dynamical Model (CGPDM), which is a latent space coupled dynamical model in discrete time. The purpose of the approximation is threefold: first, to reduce training time of the model; second, to enable modular re-use of learned dynamics; and, third, to store these learned dynamics compactly. Our target applications here are human movement primitive (MP) models, where an MP is a reusable spatiotemporal component, or "module" of a human full-body movement. Besides re-usability of learned MPs, compactness is crucial, to allow for the storage of a large library of movements. We first derive the variational approximation, illustrate it on toy data, test its predictions against a range of other MP models and finally compare movements produced by the model against human perceptual expectations. We show that the variational CGPDM outperforms several other MP models on movement trajectory prediction. Furthermore, human observers find its movements nearly indistinguishable from replays of natural movement recordings for a very compact parameterization of the approximation.

Detection and Evaluation of Spatio-Temporal Spike Patterns in Massively Parallel Spike Train Data with SPADE.

Repeated, precise sequences of spikes are largely considered a signature of activation of cell assemblies. These repeated sequences are commonly known under the name of spatio-temporal patterns (STPs). STPs are hypothesized to play a role in the communication of information in the computational process operated by the cerebral cortex. A variety of statistical methods for the detection of STPs have been developed and applied to electrophysiological recordings, but such methods scale poorly with the current size of available parallel spike train recordings (more than 100 neurons). In this work, we introduce a novel method capable of overcoming the computational and statistical limits of existing analysis techniques in detecting repeating STPs within massively parallel spike trains (MPST). We employ advanced data mining techniques to efficiently extract repeating sequences of spikes from the data. Then, we introduce and compare two alternative approaches to distinguish statistically significant patterns from chance sequences. The first approach uses a measure known as conceptual stability, of which we investigate a computationally cheap approximation for applications to such large data sets. The second approach is based on the evaluation of pattern statistical significance. In particular, we provide an extension to STPs of a method we recently introduced for the evaluation of statistical significance of synchronous spike patterns. The performance of the two approaches is evaluated in terms of computational load and statistical power on a variety of artificial data sets that replicate specific features of experimental data. Both methods provide an effective and robust procedure for detection of STPs in MPST data. The method based on significance evaluation shows the best overall performance, although at a higher computational cost. We name the novel procedure the spatio-temporal Spike PAttern Detection and Evaluation (SPADE) analysis.

Why Harmless Sensations Might Hurt in Individuals with Chronic Pain: About Heightened Prediction and Perception of Pain in the Mind.

In individuals with chronic pain harmless bodily sensations can elicit anticipatory fear of pain resulting in maladaptive responses such as taking pain medication. Here, we aim to broaden the perspective taking into account recent evidence that suggests that interoceptive perception is largely a construction of beliefs, which are based on past experience and that are kept in check by the actual state of the body. Taking a Bayesian perspective, we propose that individuals with chronic pain display a heightened prediction of pain [prior probability p(pain)], which results in heightened pain perception [posterior probability p(pain|sensation)] due to an assumed link between pain and a harmless bodily sensation [p(sensation|pain)]. This pain perception emerges because their mind infers pain as the most likely cause for the sensation. When confronted with a mismatch between predicted pain and a (harmless bodily) sensation, individuals with chronic pain try to minimize the mismatch most likely by active inference of pain or alternatively by an attentional shift away from the sensation. The active inference results in activities that produce a stronger sensation that will match with the prediction, allowing subsequent perceptual inference of pain. Here, we depict heightened pain perception in individuals with chronic pain by reformulating and extending the assumptions of the interoceptive predictive coding model from a Bayesian perspective. The review concludes with a research agenda and clinical considerations.

Overtone-based pitch selection in hermit thrush song: unexpected convergence with scale construction in human music.

Many human musical scales, including the diatonic major scale prevalent in Western music, are built partially or entirely from intervals (ratios between adjacent frequencies) corresponding to small-integer proportions drawn from the harmonic series. Scientists have long debated the extent to which principles of scale generation in human music are biologically or culturally determined. Data from animal "song" may provide new insights into this discussion. Here, by examining pitch relationships using both a simple linear regression model and a Bayesian generative model, we show that most songs of the hermit thrush (Catharus guttatus) favor simple frequency ratios derived from the harmonic (or overtone) series. Furthermore, we show that this frequency selection results not from physical constraints governing peripheral production mechanisms but from active selection at a central level. These data provide the most rigorous empirical evidence to date of a bird song that makes use of the same mathematical principles that underlie Western and many non-Western musical scales, demonstrating surprising convergence between human and animal "song cultures." Although there is no evidence that the songs of most bird species follow the overtone series, our findings add to a small but growing body of research showing that a preference for small-integer frequency ratios is not unique to humans. These findings thus have important implications for current debates about the origins of human musical systems and may call for a reevaluation of existing theories of musical consonance based on specific human vocal characteristics.

Segmenting sign language into motor primitives with Bayesian binning.

The endpoint trajectories of human movements fulfill characteristic power laws linking velocity and curvature. The parameters of these power laws typically vary between different segments of longer action sequences. These parameters might thus be exploited for the unsupervised segmentation of actions into movement primitives. For the example of sign language we investigate whether such segments can be identified by Bayesian binning (BB), using a Gaussian observation model whose mean has a polynomial time dependence. We show that this method yields good segmentation and correctly models ground truth kinematics composed of consecutive segments derived from wrist trajectories recorded from users of Israeli Sign Language (ISL). Importantly, polynomial orders between 3 and 5 yield an optimal trade-off between complexity and accuracy of the trajectory approximation, in accordance with the minimum acceleration and minimum jerk models. Comparing the orders of the polynomials best approximating natural kinematics against those needed to fit the power law ground truth data suggests that kinematic properties not compatible with power laws are also not adequately represented by low order polynomials and require higher order polynomials for a good approximation.

Model selection for the extraction of movement primitives.

A wide range of blind source separation methods have been used in motor control research for the extraction of movement primitives from EMG and kinematic data. Popular examples are principal component analysis (PCA), independent component analysis (ICA), anechoic demixing, and the time-varying synergy model (d'Avella and Tresch, 2002). However, choosing the parameters of these models, or indeed choosing the type of model, is often done in a heuristic fashion, driven by result expectations as much as by the data. We propose an objective criterion which allows to select the model type, number of primitives and the temporal smoothness prior. Our approach is based on a Laplace approximation to the posterior distribution of the parameters of a given blind source separation model, re-formulated as a Bayesian generative model. We first validate our criterion on ground truth data, showing that it performs at least as good as traditional model selection criteria [Bayesian information criterion, BIC (Schwarz, 1978) and the Akaike Information Criterion (AIC) (Akaike, 1974)]. Then, we analyze human gait data, finding that an anechoic mixture model with a temporal smoothness constraint on the sources can best account for the data.