In vivo ephaptic coupling allows memory network formation.

It is increasingly clear that memories are distributed across multiple brain areas. Such "engram complexes" are important features of memory formation and consolidation. Here, we test the hypothesis that engram complexes are formed in part by bioelectric fields that sculpt and guide the neural activity and tie together the areas that participate in engram complexes. Like the conductor of an orchestra, the fields influence each musician or neuron and orchestrate the output, the symphony. Our results use the theory of synergetics, machine learning, and data from a spatial delayed saccade task and provide evidence for in vivo ephaptic coupling in memory representations.

Cytoelectric coupling: Electric fields sculpt neural activity and "tune" the brain's infrastructure.

We propose and present converging evidence for the Cytoelectric Coupling Hypothesis: Electric fields generated by neurons are causal down to the level of the cytoskeleton. This could be achieved via electrodiffusion and mechanotransduction and exchanges between electrical, potential and chemical energy. Ephaptic coupling organizes neural activity, forming neural ensembles at the macroscale level. This information propagates to the neuron level, affecting spiking, and down to molecular level to stabilize the cytoskeleton, "tuning" it to process information more efficiently.

Dynamic causal modelling shows a prominent role of local inhibition in alpha power modulation in higher visual cortex.

During resting-state EEG recordings, alpha activity is more prominent over the posterior cortex in eyes-closed (EC) conditions compared to eyes-open (EO). In this study, we characterized the difference in spectra between EO and EC conditions using dynamic causal modelling. Specifically, we investigated the role of intrinsic and extrinsic connectivity-within the visual cortex-in generating EC-EO alpha power differences over posterior electrodes. The primary visual cortex (V1) and the bilateral middle temporal visual areas (V5) were equipped with bidirectional extrinsic connections using a canonical microcircuit. The states of four intrinsically coupled subpopulations-within each occipital source-were also modelled. Using Bayesian model selection, we tested whether modulations of the intrinsic connections in V1, V5 or extrinsic connections (or a combination thereof) provided the best evidence for the data. In addition, using parametric empirical Bayes (PEB), we estimated group averages under the winning model. Bayesian model selection showed that the winning model contained both extrinsic connectivity modulations, as well as intrinsic connectivity modulations in all sources. The PEB analysis revealed increased extrinsic connectivity during EC. Overall, we found a reduction in the inhibitory intrinsic connections during EC. The results suggest that the intrinsic modulations in V5 played the most important role in producing EC-EO alpha differences, suggesting an intrinsic disinhibition in higher order visual cortex, during EC resting state.

Augmenting Human Selves Through Artificial Agents - Lessons From the Brain.

Much of current artificial intelligence (AI) and the drive toward artificial general intelligence (AGI) focuses on developing machines for functional tasks that humans accomplish. These may be narrowly specified tasks as in AI, or more general tasks as in AGI - but typically these tasks do not target higher-level human cognitive abilities, such as consciousness or morality; these are left to the realm of so-called "strong AI" or "artificial consciousness." In this paper, we focus on how a machine can augment humans rather than do what they do, and we extend this beyond AGI-style tasks to augmenting peculiarly personal human capacities, such as wellbeing and morality. We base this proposal on associating such capacities with the "self," which we define as the "environment-agent nexus"; namely, a fine-tuned interaction of brain with environment in all its relevant variables. We consider richly adaptive architectures that have the potential to implement this interaction by taking lessons from the brain. In particular, we suggest conjoining the free energy principle (FEP) with the dynamic temporo-spatial (TSD) view of neuro-mental processes. Our proposed integration of FEP and TSD - in the implementation of artificial agents - offers a novel, expressive, and explainable way for artificial agents to adapt to different environmental contexts. The targeted applications are broad: from adaptive intelligence augmenting agents (IA's) that assist psychiatric self-regulation to environmental disaster prediction and personal assistants. This reflects the central role of the mind and moral decision-making in most of what we do as humans.

Beyond dimension reduction: Stable electric fields emerge from and allow representational drift.

It is known that the exact neurons maintaining a given memory (the neural ensemble) change from trial to trial. This raises the question of how the brain achieves stability in the face of this representational drift. Here, we demonstrate that this stability emerges at the level of the electric fields that arise from neural activity. We show that electric fields carry information about working memory content. The electric fields, in turn, can act as "guard rails" that funnel higher dimensional variable neural activity along stable lower dimensional routes. We obtained the latent space associated with each memory. We then confirmed the stability of the electric field by mapping the latent space to different cortical patches (that comprise a neural ensemble) and reconstructing information flow between patches. Stable electric fields can allow latent states to be transferred between brain areas, in accord with modern engram theory.

Computational Modeling of Electroencephalography and Functional Magnetic Resonance Imaging Paradigms Indicates a Consistent Loss of Pyramidal Cell Synaptic Gain in Schizophrenia.

BACKGROUND: Diminished synaptic gain-the sensitivity of postsynaptic responses to neural inputs-may be a fundamental synaptic pathology in schizophrenia. Evidence for this is indirect, however. Furthermore, it is unclear whether pyramidal cells or interneurons (or both) are affected, or how these deficits relate to symptoms. METHODS: People with schizophrenia diagnoses (PScz) (n = 108), their relatives (n = 57), and control subjects (n = 107) underwent 3 electroencephalography (EEG) paradigms-resting, mismatch negativity, and 40-Hz auditory steady-state response-and resting functional magnetic resonance imaging. Dynamic causal modeling was used to quantify synaptic connectivity in cortical microcircuits. RESULTS: Classic group differences in EEG features between PScz and control subjects were replicated, including increased theta and other spectral changes (resting EEG), reduced mismatch negativity, and reduced 40-Hz power. Across all 4 paradigms, characteristic PScz data features were all best explained by models with greater self-inhibition (decreased synaptic gain) in pyramidal cells. Furthermore, disinhibition in auditory areas predicted abnormal auditory perception (and positive symptoms) in PScz in 3 paradigms. CONCLUSIONS: First, characteristic EEG changes in PScz in 3 classic paradigms are all attributable to the same underlying parameter change: greater self-inhibition in pyramidal cells. Second, psychotic symptoms in PScz relate to disinhibition in neural circuits. These findings are more commensurate with the hypothesis that in PScz, a primary loss of synaptic gain on pyramidal cells is then compensated by interneuron downregulation (rather than the converse). They further suggest that psychotic symptoms relate to this secondary downregulation.

Differences in visually induced MEG oscillations reflect differences in deep cortical layer activity.

Neural activity is organized at multiple scales, ranging from the cellular to the whole brain level. Connecting neural dynamics at different scales is important for understanding brain pathology. Neurological diseases and disorders arise from interactions between factors that are expressed in multiple scales. Here, we suggest a new way to link microscopic and macroscopic dynamics through combinations of computational models. This exploits results from statistical decision theory and Bayesian inference. To validate our approach, we used two independent MEG datasets. In both, we found that variability in visually induced oscillations recorded from different people in simple visual perception tasks resulted from differences in the level of inhibition specific to deep cortical layers. This suggests differences in feedback to sensory areas and each subject's hypotheses about sensations due to differences in their prior experience. Our approach provides a new link between non-invasive brain imaging data, laminar dynamics and top-down control.

Thalamocortical inhibitory dynamics support conscious perception.

Whether thalamocortical interactions play a decisive role in conscious perception remains an open question. We presented rapid red/green color flickering stimuli, which induced the mental perception of either an illusory orange color or non-fused red and green colors. Using magnetoencephalography, we observed 6-Hz thalamic activity associated with thalamocortical inhibitory coupling only during the conscious perception of the illusory orange color. This sustained thalamic disinhibition was temporally coupled with higher visual cortical activation during the conscious perception of the orange color, providing neurophysiological evidence of the role of thalamocortical synchronization in conscious awareness of mental representation. Bayesian model comparison consistently supported the thalamocortical model in conscious perception. Taken together, experimental and theoretical evidence established the thalamocortical inhibitory network as a gateway to conscious mental representations.

Sensory processing and categorization in cortical and deep neural networks.

Many recent advances in artificial intelligence (AI) are rooted in visual neuroscience. However, ideas from more complicated paradigms like decision-making are less used. Although automated decision-making systems are ubiquitous (driverless cars, pilot support systems, medical diagnosis algorithms etc.), achieving human-level performance in decision making tasks is still a challenge. At the same time, these tasks that are hard for AI are easy for humans. Thus, understanding human brain dynamics during these decision-making tasks and modeling them using deep neural networks could improve AI performance. Here we modelled some of the complex neural interactions during a sensorimotor decision making task. We investigated how brain dynamics flexibly represented and distinguished between sensory processing and categorization in two sensory domains: motion direction and color. We used two different approaches for understanding neural representations. We compared brain responses to 1) the geometry of a sensory or category domain (domain selectivity) and 2) predictions from deep neural networks (computation selectivity). Both approaches gave us similar results. This confirmed the validity of our analyses. Using the first approach, we found that neural representations changed depending on context. We then trained deep recurrent neural networks to perform the same tasks as the animals. Using the second approach, we found that computations in different brain areas also changed flexibly depending on context. Color computations appeared to rely more on sensory processing, while motion computations more on abstract categories. Overall, our results shed light to the biological basis of categorization and differences in selectivity and computations in different brain areas. They also suggest a way for studying sensory and categorical representations in the brain: compare brain responses to both a behavioral model and a deep neural network and test if they give similar results.

Working Memory Load Modulates Neuronal Coupling.

There is a severe limitation in the number of items that can be held in working memory. However, the neurophysiological limits remain unknown. We asked whether the capacity limit might be explained by differences in neuronal coupling. We developed a theoretical model based on Predictive Coding and used it to analyze Cross Spectral Density data from the prefrontal cortex (PFC), frontal eye fields (FEF), and lateral intraparietal area (LIP). Monkeys performed a change detection task. The number of objects that had to be remembered (memory load) was varied (1-3 objects in the same visual hemifield). Changes in memory load changed the connectivity in the PFC-FEF-LIP network. Feedback (top-down) coupling broke down when the number of objects exceeded cognitive capacity. Thus, impaired behavioral performance coincided with a break-down of Prediction signals. This provides new insights into the neuronal underpinnings of cognitive capacity and how coupling in a distributed working memory network is affected by memory load.

Bayesian Modelling of Induced Responses and Neuronal Rhythms.

Neural rhythms or oscillations are ubiquitous in neuroimaging data. These spectral responses have been linked to several cognitive processes; including working memory, attention, perceptual binding and neuronal coordination. In this paper, we show how Bayesian methods can be used to finesse the ill-posed problem of reconstructing-and explaining-oscillatory responses. We offer an overview of recent developments in this field, focusing on (i) the use of MEG data and Empirical Bayes to build hierarchical models for group analyses-and the identification of important sources of inter-subject variability and (ii) the construction of novel dynamic causal models of intralaminar recordings to explain layer-specific activity. We hope to show that electrophysiological measurements contain much more spatial information than is often thought: on the one hand, the dynamic causal modelling of non-invasive (low spatial resolution) electrophysiology can afford sub-millimetre (hyper-acute) resolution that is limited only by the (spatial) complexity of the underlying (dynamic causal) forward model. On the other hand, invasive microelectrode recordings (that penetrate different cortical layers) can reveal laminar-specific responses and elucidate hierarchical message passing and information processing within and between cortical regions at a macroscopic scale. In short, the careful and biophysically grounded modelling of sparse data enables one to characterise the neuronal architectures generating oscillations in a remarkable detail.

On memories, neural ensembles and mental flexibility.

Memories are assumed to be represented by groups of co-activated neurons, called neural ensembles. Describing ensembles is a challenge: complexity of the underlying micro-circuitry is immense. Current approaches use a piecemeal fashion, focusing on single neurons and employing local measures like pairwise correlations. We introduce an alternative approach that identifies ensembles and describes the effective connectivity between them in a holistic fashion. It also links the oscillatory frequencies observed in ensembles with the spatial scales at which activity is expressed. Using unsupervised learning, biophysical modeling and graph theory, we analyze multi-electrode LFPs from frontal cortex during a spatial delayed response task. We find distinct ensembles for different cues and more parsimonious connectivity for cues on the horizontal axis, which may explain the oblique effect in psychophysics. Our approach paves the way for biophysical models with learned parameters that can guide future Brain Computer Interface development.

Abnormal frontoparietal synaptic gain mediating the P300 in patients with psychotic disorder and their unaffected relatives.

The "dysconnection hypothesis" of psychosis suggests that a disruption of functional integration underlies cognitive deficits and clinical symptoms. Impairments in the P300 potential are well documented in psychosis. Intrinsic (self-)connectivity in a frontoparietal cortical hierarchy during a P300 experiment was investigated. Dynamic Causal Modeling was used to estimate how evoked activity results from the dynamics of coupled neural populations and how neural coupling changes with the experimental factors. Twenty-four patients with psychotic disorder, twenty-four unaffected relatives, and twenty-five controls underwent EEG recordings during an auditory oddball paradigm. Sixteen frontoparietal network models (including primary auditory, superior parietal, and superior frontal sources) were analyzed and an optimal model of neural coupling, explaining diagnosis and genetic risk effects, as well as their interactions with task condition were identified. The winning model included changes in connectivity at all three hierarchical levels. Patients showed decreased self-inhibition-that is, increased cortical excitability-in left superior frontal gyrus across task conditions, compared with unaffected participants. Relatives had similar increases in excitability in left superior frontal and right superior parietal sources, and a reversal of the normal synaptic gain changes in response to targets relative to standard tones. It was confirmed that both subjects with psychotic disorder and their relatives show a context-independent loss of synaptic gain control at the highest hierarchy levels. The relatives also showed abnormal gain modulation responses to task-relevant stimuli. These may be caused by NMDA-receptor and/or GABAergic pathologies that change the excitability of superficial pyramidal cells and may be a potential biological marker for psychosis. Hum Brain Mapp 38:3262-3276, 2017. © 2017 Wiley Periodicals, Inc.

Intersubject variability and induced gamma in the visual cortex: DCM with empirical Bayes and neural fields.

This article describes the first application of a generic (empirical) Bayesian analysis of between-subject effects in the dynamic causal modeling (DCM) of electrophysiological (MEG) data. It shows that (i) non-invasive (MEG) data can be used to characterize subject-specific differences in cortical microcircuitry and (ii) presents a validation of DCM with neural fields that exploits intersubject variability in gamma oscillations. We find that intersubject variability in visually induced gamma responses reflects changes in the excitation-inhibition balance in a canonical cortical circuit. Crucially, this variability can be explained by subject-specific differences in intrinsic connections to and from inhibitory interneurons that form a pyramidal-interneuron gamma network. Our approach uses Bayesian model reduction to evaluate the evidence for (large sets of) nested models-and optimize the corresponding connectivity estimates at the within and between-subject level. We also consider Bayesian cross-validation to obtain predictive estimates for gamma-response phenotypes, using a leave-one-out procedure. Hum Brain Mapp 37:4597-4614, 2016. © The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

Dynamic causal modelling of eye movements during pursuit: Confirming precision-encoding in V1 using MEG.

This paper shows that it is possible to estimate the subjective precision (inverse variance) of Bayesian beliefs during oculomotor pursuit. Subjects viewed a sinusoidal target, with or without random fluctuations in its motion. Eye trajectories and magnetoencephalographic (MEG) data were recorded concurrently. The target was periodically occluded, such that its reappearance caused a visual evoked response field (ERF). Dynamic causal modelling (DCM) was used to fit models of eye trajectories and the ERFs. The DCM for pursuit was based on predictive coding and active inference, and predicts subjects' eye movements based on their (subjective) Bayesian beliefs about target (and eye) motion. The precisions of these hierarchical beliefs can be inferred from behavioural (pursuit) data. The DCM for MEG data used an established biophysical model of neuronal activity that includes parameters for the gain of superficial pyramidal cells, which is thought to encode precision at the neuronal level. Previous studies (using DCM of pursuit data) suggest that noisy target motion increases subjective precision at the sensory level: i.e., subjects attend more to the target's sensory attributes. We compared (noisy motion-induced) changes in the synaptic gain based on the modelling of MEG data to changes in subjective precision estimated using the pursuit data. We demonstrate that imprecise target motion increases the gain of superficial pyramidal cells in V1 (across subjects). Furthermore, increases in sensory precision - inferred by our behavioural DCM - correlate with the increase in gain in V1, across subjects. This is a step towards a fully integrated model of brain computations, cortical responses and behaviour that may provide a useful clinical tool in conditions like schizophrenia.

Impaired prefrontal synaptic gain in people with psychosis and their relatives during the mismatch negativity.

The mismatch negativity (MMN) evoked potential, a preattentive brain response to a discriminable change in auditory stimulation, is significantly reduced in psychosis. Glutamatergic theories of psychosis propose that hypofunction of NMDA receptors (on pyramidal cells and inhibitory interneurons) causes a loss of synaptic gain control. We measured changes in neuronal effective connectivity underlying the MMN using dynamic causal modeling (DCM), where the gain (excitability) of superficial pyramidal cells is explicitly parameterised. EEG data were obtained during a MMN task--for 24 patients with psychosis, 25 of their first-degree unaffected relatives, and 35 controls--and DCM was used to estimate the excitability (modeled as self-inhibition) of (source-specific) superficial pyramidal populations. The MMN sources, based on previous research, included primary and secondary auditory cortices, and the right inferior frontal gyrus. Both patients with psychosis and unaffected relatives (to a lesser degree) showed increased excitability in right inferior frontal gyrus across task conditions, compared to controls. Furthermore, in the same region, both patients and their relatives showed a reversal of the normal response to deviant stimuli; that is, a decrease in excitability in comparison to standard conditions. Our results suggest that psychosis and genetic risk for the illness are associated with both context-dependent (condition-specific) and context-independent abnormalities of the excitability of superficial pyramidal cell populations in the MMN paradigm. These abnormalities could relate to NMDA receptor hypofunction on both pyramidal cells and inhibitory interneurons, and appear to be linked to the genetic aetiology of the illness, thereby constituting potential endophenotypes for psychosis.

LFP and oscillations-what do they tell us?

This review surveys recent trends in the use of local field potentials-and their non-invasive counterparts-to address the principles of functional brain architectures. In particular, we treat oscillations as the (observable) signature of context-sensitive changes in synaptic efficacy that underlie coordinated dynamics and message-passing in the brain. This rich source of information is now being exploited by various procedures-like dynamic causal modelling-to test hypotheses about neuronal circuits in health and disease. Furthermore, the roles played by neuromodulatory mechanisms can be addressed directly through their effects on oscillatory phenomena. These neuromodulatory or gain control processes are central to many theories of normal brain function (e.g. attention) and the pathophysiology of several neuropsychiatric conditions (e.g. Parkinson's disease).

On conductance-based neural field models.

This technical note introduces a conductance-based neural field model that combines biologically realistic synaptic dynamics-based on transmembrane currents-with neural field equations, describing the propagation of spikes over the cortical surface. This model allows for fairly realistic inter-and intra-laminar intrinsic connections that underlie spatiotemporal neuronal dynamics. We focus on the response functions of expected neuronal states (such as depolarization) that generate observed electrophysiological signals (like LFP recordings and EEG). These response functions characterize the model's transfer functions and implicit spectral responses to (uncorrelated) input. Our main finding is that both the evoked responses (impulse response functions) and induced responses (transfer functions) show qualitative differences depending upon whether one uses a neural mass or field model. Furthermore, there are differences between the equivalent convolution and conductance models. Overall, all models reproduce a characteristic increase in frequency, when inhibition was increased by increasing the rate constants of inhibitory populations. However, convolution and conductance-based models showed qualitatively different changes in power, with convolution models showing decreases with increasing inhibition, while conductance models show the opposite effect. These differences suggest that conductance based field models may be important in empirical studies of cortical gain control or pharmacological manipulations.

Neural masses and fields in dynamic causal modeling.

Dynamic causal modeling (DCM) provides a framework for the analysis of effective connectivity among neuronal subpopulations that subtend invasive (electrocorticograms and local field potentials) and non-invasive (electroencephalography and magnetoencephalography) electrophysiological responses. This paper reviews the suite of neuronal population models including neural masses, fields and conductance-based models that are used in DCM. These models are expressed in terms of sets of differential equations that allow one to model the synaptic underpinnings of connectivity. We describe early developments using neural mass models, where convolution-based dynamics are used to generate responses in laminar-specific populations of excitatory and inhibitory cells. We show that these models, though resting on only two simple transforms, can recapitulate the characteristics of both evoked and spectral responses observed empirically. Using an identical neuronal architecture, we show that a set of conductance based models-that consider the dynamics of specific ion-channels-present a richer space of responses; owing to non-linear interactions between conductances and membrane potentials. We propose that conductance-based models may be more appropriate when spectra present with multiple resonances. Finally, we outline a third class of models, where each neuronal subpopulation is treated as a field; in other words, as a manifold on the cortical surface. By explicitly accounting for the spatial propagation of cortical activity through partial differential equations (PDEs), we show that the topology of connectivity-through local lateral interactions among cortical layers-may be inferred, even in the absence of spatially resolved data. We also show that these models allow for a detailed analysis of structure-function relationships in the cortex. Our review highlights the relationship among these models and how the hypothesis asked of empirical data suggests an appropriate model class.