A cognitive account of the puzzle of ideography.

We posit a cognitive account of the puzzle of ideography, which complements the standardization account of Morin. Efficient standardization of spoken language is phenomenologically attributed to a modality effect coupled with chunking of cognitive representations, further aided by multisensory integration and the serialized nature of attention. These mechanisms explain why languages dominate graphic codes for general-purpose communication.

Sense of agency for mental actions: Insights from a belief-based action-effect paradigm.

A substantial body of research has converged on the idea that the sense of agency arises from the integration of multiple sources of information. In this study, we investigated whether a measurable sense of agency can be detected for mental actions, without the contribution of motor components. We used a fake action-effect paradigm, where participants were led to think that a motor action or a particular thought could trigger a sound. Results showed that the sense of agency, when measured through explicit reports, was of comparable strength for motor and mental actions. The intentional binding effect, a phenomenon typically associated with the experience of agency, was also observed for both motor and mental actions. Taken together, our results provide novel insights into the specific role of intentional cues in instantiating a sense of agency, even in the absence of motor signals.

Distinguishing Self, Other, and Autonomy From Visual Feedback: A Combined Correlation and Acceleration Transfer Analysis.

In cognitive science, Theory of Mind (ToM) is the mental faculty of assessing intentions and beliefs of others and requires, in part, to distinguish incoming sensorimotor (SM) signals and, accordingly, attribute these to either the self-model, the model of the other, or one pertaining to the external world, including inanimate objects. To gain an understanding of this mechanism, we perform a computational analysis of SM interactions in a dual-arm robotic setup. Our main contribution is that, under the common fate principle, a correlation analysis of the velocities of visual pivots is shown to be sufficient to characterize "the self" (including proximo-distal arm-joint dependencies) and to assess motor to sensory influences, and "the other" by computing clusters in the correlation dependency graph. A correlational analysis, however, is not sufficient to assess the non-symmetric/directed dependencies required to infer autonomy, the ability of entities to move by themselves. We subsequently validate 3 measures that can potentially quantify a metric for autonomy: Granger causality (GC), transfer entropy (TE), as well as a novel "Acceleration Transfer" (AT) measure, which is an instantaneous measure that computes the estimated instantaneous transfer of acceleration between visual features, from which one can compute a directed SM graph. Subsequently, autonomy is characterized by the sink nodes in this directed graph. This study results show that although TE can capture the directional dependencies, a rectified subtraction operation denoted, in this study, as AT is both sufficient and computationally cheaper.

Modeling the formation of social conventions from embodied real-time interactions.

What is the role of real-time control and learning in the formation of social conventions? To answer this question, we propose a computational model that matches human behavioral data in a social decision-making game that was analyzed both in discrete-time and continuous-time setups. Furthermore, unlike previous approaches, our model takes into account the role of sensorimotor control loops in embodied decision-making scenarios. For this purpose, we introduce the Control-based Reinforcement Learning (CRL) model. CRL is grounded in the Distributed Adaptive Control (DAC) theory of mind and brain, where low-level sensorimotor control is modulated through perceptual and behavioral learning in a layered structure. CRL follows these principles by implementing a feedback control loop handling the agent's reactive behaviors (pre-wired reflexes), along with an Adaptive Layer that uses reinforcement learning to maximize long-term reward. We test our model in a multi-agent game-theoretic task in which coordination must be achieved to find an optimal solution. We show that CRL is able to reach human-level performance on standard game-theoretic metrics such as efficiency in acquiring rewards and fairness in reward distribution.

Beyond Neural Coding? Lessons from Perceptual Control Theory.

Pointing to similarities between challenges encountered in today's neural coding and twentieth-century behaviorism, we draw attention to lessons learned from resolving the latter. In particular, Perceptual Control Theory posits behavior as a closed-loop control process with immediate and teleological causes. With two examples, we illustrate how these ideas may also address challenges facing current neural coding paradigms.

A computational analysis of dynamic, multi-organ inflammatory crosstalk induced by endotoxin in mice.

Bacterial lipopolysaccharide (LPS) induces an acute inflammatory response across multiple organs, primarily via Toll-like receptor 4 (TLR4). We sought to define novel aspects of the complex spatiotemporal dynamics of LPS-induced inflammation using computational modeling, with a special focus on the timing of pathological systemic spillover. An analysis of principal drivers of LPS-induced inflammation in the heart, gut, lung, liver, spleen, and kidney to assess organ-specific dynamics, as well as in the plasma (as an assessment of systemic spillover), was carried out using data on 20 protein-level inflammatory mediators measured over 0-48h in both C57BL/6 and TLR4-null mice. Using a suite of computational techniques, including a time-interval variant of Principal Component Analysis, we confirm key roles for cytokines such as tumor necrosis factor-α and interleukin-17A, define a temporal hierarchy of organ-localized inflammation, and infer the point at which organ-localized inflammation spills over systemically. Thus, by employing a systems biology approach, we obtain a novel perspective on the time- and organ-specific components in the propagation of acute systemic inflammation.

Measuring the Complexity of Consciousness.

The grand quest for a scientific understanding of consciousness has given rise to many new theoretical and empirical paradigms for investigating the phenomenology of consciousness as well as clinical disorders associated to it. A major challenge in this field is to formalize computational measures that can reliably quantify global brain states from data. In particular, information-theoretic complexity measures such as integrated information have been proposed as measures of conscious awareness. This suggests a new framework to quantitatively classify states of consciousness. However, it has proven increasingly difficult to apply these complexity measures to realistic brain networks. In part, this is due to high computational costs incurred when implementing these measures on realistically large network dimensions. Nonetheless, complexity measures for quantifying states of consciousness are important for assisting clinical diagnosis and therapy. This article is meant to serve as a lookup table of measures of consciousness, with particular emphasis on clinical applicability. We consider both, principle-based complexity measures as well as empirical measures tested on patients. We address challenges facing these measures with regard to realistic brain networks, and where necessary, suggest possible resolutions.

Linear distributed source modeling of local field potentials recorded with intra-cortical electrode arrays.

Planar intra-cortical electrode (Utah) arrays provide a unique window into the spatial organization of cortical activity. Reconstruction of the current source density (CSD) underlying such recordings, however, requires "inverting" Poisson's equation. For inter-laminar recordings, this is commonly done by the CSD method, which consists in taking the second-order spatial derivative of the recorded local field potentials (LFPs). Although the CSD method has been tremendously successful in mapping the current generators underlying inter-laminar LFPs, its application to planar recordings is more challenging. While for inter-laminar recordings the CSD method seems reasonably robust against violations of its assumptions, is it unclear as to what extent this holds for planar recordings. One of the objectives of this study is to characterize the conditions under which the CSD method can be successfully applied to Utah array data. Using forward modeling, we find that for spatially coherent CSDs, the CSD method yields inaccurate reconstructions due to volume-conducted contamination from currents in deeper cortical layers. An alternative approach is to "invert" a constructed forward model. The advantage of this approach is that any a priori knowledge about the geometrical and electrical properties of the tissue can be taken into account. Although several inverse methods have been proposed for LFP data, the applicability of existing electroencephalographic (EEG) and magnetoencephalographic (MEG) inverse methods to LFP data is largely unexplored. Another objective of our study therefore, is to assess the applicability of the most commonly used EEG/MEG inverse methods to Utah array data. Our main conclusion is that these inverse methods provide more accurate CSD reconstructions than the CSD method. We illustrate the inverse methods using event-related potentials recorded from primary visual cortex of a macaque monkey during a motion discrimination task.

Discrepancies between Multi-Electrode LFP and CSD Phase-Patterns: A Forward Modeling Study.

Multi-electrode recordings of local field potentials (LFPs) provide the opportunity to investigate the spatiotemporal organization of neural activity on the scale of several millimeters. In particular, the phases of oscillatory LFPs allow studying the coordination of neural oscillations in time and space and to tie it to cognitive processing. Given the computational roles of LFP phases, it is important to know how they relate to the phases of the underlying current source densities (CSDs) that generate them. Although CSDs and LFPs are distinct physical quantities, they are often (implicitly) identified when interpreting experimental observations. That this identification is problematic is clear from the fact that LFP phases change when switching to different electrode montages, while the underlying CSD phases remain unchanged. In this study we use a volume-conductor model to characterize discrepancies between LFP and CSD phase-patterns, to identify the contributing factors, and to assess the effect of different electrode montages. Although we focus on cortical LFPs recorded with two-dimensional (Utah) arrays, our findings are also relevant for other electrode configurations. We found that the main factors that determine the discrepancy between CSD and LFP phase-patterns are the frequency of the neural oscillations and the extent to which the laminar CSD profile is balanced. Furthermore, the presence of laminar phase-differences in cortical oscillations, as commonly observed in experiments, precludes identifying LFP phases with those of the CSD oscillations at a given cortical depth. This observation potentially complicates the interpretation of spike-LFP coherence and spike-triggered LFP averages. With respect to reference strategies, we found that the average-reference montage leads to larger discrepancies between LFP and CSD phases as compared with the referential montage, while the Laplacian montage reduces these discrepancies. We therefore advice to conduct analysis of two-dimensional LFP recordings using the Laplacian montage.

The global dynamical complexity of the human brain network.

How much information do large brain networks integrate as a whole over the sum of their parts? Can the dynamical complexity of such networks be globally quantified in an information-theoretic way and be meaningfully coupled to brain function? Recently, measures of dynamical complexity such as integrated information have been proposed. However, problems related to the normalization and Bell number of partitions associated to these measures make these approaches computationally infeasible for large-scale brain networks. Our goal in this work is to address this problem. Our formulation of network integrated information is based on the Kullback-Leibler divergence between the multivariate distribution on the set of network states versus the corresponding factorized distribution over its parts. We find that implementing the maximum information partition optimizes computations. These methods are well-suited for large networks with linear stochastic dynamics. We compute the integrated information for both, the system's attractor states, as well as non-stationary dynamical states of the network. We then apply this formalism to brain networks to compute the integrated information for the human brain's connectome. Compared to a randomly re-wired network, we find that the specific topology of the brain generates greater information complexity.

Network dynamics with BrainX(3): a large-scale simulation of the human brain network with real-time interaction.

BrainX(3) is a large-scale simulation of human brain activity with real-time interaction, rendered in 3D in a virtual reality environment, which combines computational power with human intuition for the exploration and analysis of complex dynamical networks. We ground this simulation on structural connectivity obtained from diffusion spectrum imaging data and model it on neuronal population dynamics. Users can interact with BrainX(3) in real-time by perturbing brain regions with transient stimulations to observe reverberating network activity, simulate lesion dynamics or implement network analysis functions from a library of graph theoretic measures. BrainX(3) can thus be used as a novel immersive platform for exploration and analysis of dynamical activity patterns in brain networks, both at rest or in a task-related state, for discovery of signaling pathways associated to brain function and/or dysfunction and as a tool for virtual neurosurgery. Our results demonstrate these functionalities and shed insight on the dynamics of the resting-state attractor. Specifically, we found that a noisy network seems to favor a low firing attractor state. We also found that the dynamics of a noisy network is less resilient to lesions. Our simulations on TMS perturbations show that even though TMS inhibits most of the network, it also sparsely excites a few regions. This is presumably due to anti-correlations in the dynamics and suggests that even a lesioned network can show sparsely distributed increased activity compared to healthy resting-state, over specific brain areas.

Inference of human affective states from psychophysiological measurements extracted under ecologically valid conditions.

Compared to standard laboratory protocols, the measurement of psychophysiological signals in real world experiments poses technical and methodological challenges due to external factors that cannot be directly controlled. To address this problem, we propose a hybrid approach based on an immersive and human accessible space called the eXperience Induction Machine (XIM), that incorporates the advantages of a laboratory within a life-like setting. The XIM integrates unobtrusive wearable sensors for the acquisition of psychophysiological signals suitable for ambulatory emotion research. In this paper, we present results from two different studies conducted to validate the XIM as a general-purpose sensing infrastructure for the study of human affective states under ecologically valid conditions. In the first investigation, we recorded and classified signals from subjects exposed to pictorial stimuli corresponding to a range of arousal levels, while they were free to walk and gesticulate. In the second study, we designed an experiment that follows the classical conditioning paradigm, a well-known procedure in the behavioral sciences, with the additional feature that participants were free to move in the physical space, as opposed to similar studies measuring physiological signals in constrained laboratory settings. Our results indicate that, by using our sensing infrastructure, it is indeed possible to infer human event-elicited affective states through measurements of psychophysiological signals under ecological conditions.