A VTA GABAergic computational model of dissociated reward prediction error computation in classical conditioning.

Classical Conditioning is a fundamental learning mechanism where the Ventral Striatum is generally thought to be the source of inhibition to Ventral Tegmental Area (VTA) Dopamine neurons when a reward is expected. However, recent evidences point to a new candidate in VTA GABA encoding expectation for computing the reward prediction error in the VTA. In this system-level computational model, the VTA GABA signal is hypothesised to be a combination of magnitude and timing computed in the Peduncolopontine and Ventral Striatum respectively. This dissociation enables the model to explain recent results wherein Ventral Striatum lesions affected the temporal expectation of the reward but the magnitude of the reward was intact. This model also exhibits other features in classical conditioning namely, progressively decreasing firing for early rewards closer to the actual reward, twin peaks of VTA dopamine during training and cancellation of US dopamine after training.

Why, What and How to Help Each Citizen to Understand Artificial Intelligence?

A critical understanding of digital technologies is an empowering competence for citizens of all ages. In this paper we introduce an open educational approach of artificial intelligence (AI) for everyone. Through a hybrid and participative MOOC we aim to develop a critical and creative perspective about the way AI is integrated in the different domains of our lives. We have built and now operate a MOOC in AI for all the citizens from 15 years old. The MOOC aims to help understanding AI foundations and applications, intended for a large public beyond the school domain, with more than 20,000 participants engaged in the MOOC after nine months. This study addresses the pedagogical methods for designing and evaluating the MOOC in AI. Through this study we raise four questions regarding citizen education in AI: Why (i.e., to which aim) sharing such citizen formation? What is the disciplinary knowledge to be shared? What are the competencies to develop? How can it be shared and evaluated? We finally share learning analytics, quantitative and qualitative evaluations and explain to which extent educational science research helps enlighten such large scale initiatives. The analysis of the MOOC in AI helps to identify that the main feedback related to AI is "fear", because AI is unknown and mysterious to the participants. After developing playful AI simulations, the AI mechanisms become familiar for the MOOC participants and they can overcome their misconception on AI to develop a more critical point of view. This contribution describes a K-12 AI educational project or initiatives of a considerable impact, via the formation of teachers and other educators. Supplementary Information: The online version contains supplementary material available at 10.1007/s13218-021-00725-7.

A global framework for a systemic view of brain modeling.

The brain is a complex system, due to the heterogeneity of its structure, the diversity of the functions in which it participates and to its reciprocal relationships with the body and the environment. A systemic description of the brain is presented here, as a contribution to developing a brain theory and as a general framework where specific models in computational neuroscience can be integrated and associated with global information flows and cognitive functions. In an enactive view, this framework integrates the fundamental organization of the brain in sensorimotor loops with the internal and the external worlds, answering four fundamental questions (what, why, where and how). Our survival-oriented definition of behavior gives a prominent role to pavlovian and instrumental conditioning, augmented during phylogeny by the specific contribution of other kinds of learning, related to semantic memory in the posterior cortex, episodic memory in the hippocampus and working memory in the frontal cortex. This framework highlights that responses can be prepared in different ways, from pavlovian reflexes and habitual behavior to deliberations for goal-directed planning and reasoning, and explains that these different kinds of responses coexist, collaborate and compete for the control of behavior. It also lays emphasis on the fact that cognition can be described as a dynamical system of interacting memories, some acting to provide information to others, to replace them when they are not efficient enough, or to help for their improvement. Describing the brain as an architecture of learning systems has also strong implications in Machine Learning. Our biologically informed view of pavlovian and instrumental conditioning can be very precious to revisit classical Reinforcement Learning and provide a basis to ensure really autonomous learning.

Pattern separation in the hippocampus: distinct circuits under different conditions.

Pattern separation is a fundamental hippocampal process thought to be critical for distinguishing similar episodic memories, and has long been recognized as a natural function of the dentate gyrus (DG), supporting autoassociative learning in CA3. Understanding how neural circuits within the DG-CA3 network mediate this process has received much interest, yet the exact mechanisms behind remain elusive. Here, we argue for the case that sparse coding is necessary but not sufficient to ensure efficient separation and, alternatively, propose a possible interaction of distinct circuits which, nevertheless, act in synergy to produce a unitary function of pattern separation. The proposed circuits involve different functional granule-cell populations, a primary population mediates sparsification and provides recurrent excitation to the other populations which are related to additional pattern separation mechanisms with higher degrees of robustness against interference in CA3. A variety of top-down and bottom-up factors, such as motivation, emotion, and pattern similarity, control the selection of circuitry depending on circumstances. According to this framework, a computational model is implemented and tested against model variants in a series of numerical simulations and biological experiments. The results demonstrate that the model combines fast learning, robust pattern separation and high storage capacity. It also accounts for the controversy around the involvement of the DG during memory recall, explains other puzzling findings, and makes predictions that can inform future investigations.

Bio-inspired Analysis of Deep Learning on Not-So-Big Data Using Data-Prototypes.

Deep artificial neural networks are feed-forward architectures capable of very impressive performances in diverse domains. Indeed stacking multiple layers allows a hierarchical composition of local functions, providing efficient compact mappings. Compared to the brain, however, such architectures are closer to a single pipeline and require huge amounts of data, while concrete cases for either human or machine learning systems are often restricted to not-so-big data sets. Furthermore, interpretability of the obtained results is a key issue: since deep learning applications are increasingly present in society, it is important that the underlying processes be accessible and understandable to every one. In order to target these challenges, in this contribution we analyze how considering prototypes in a rather generalized sense (with respect to the state of the art) allows to reasonably work with small data sets while providing an interpretable view of the obtained results. Some mathematical interpretation of this proposal is discussed. Sensitivity to hyperparameters is a key issue for reproducible deep learning results, and is carefully considered in our methodology. Performances and limitations of the proposed setup are explored in details, under different hyperparameter sets, in an analogous way as biological experiments are conducted. We obtain a rather simple architecture, easy to explain, and which allows, combined with a standard method, to target both performances and interpretability.

Sustainable computational science: the ReScience initiative.

Computer science offers a large set of tools for prototyping, writing, running, testing, validating, sharing and reproducing results; however, computational science lags behind. In the best case, authors may provide their source code as a compressed archive and they may feel confident their research is reproducible. But this is not exactly true. James Buckheit and David Donoho proposed more than two decades ago that an article about computational results is advertising, not scholarship. The actual scholarship is the full software environment, code, and data that produced the result. This implies new workflows, in particular in peer-reviews. Existing journals have been slow to adapt: source codes are rarely requested and are hardly ever actually executed to check that they produce the results advertised in the article. ReScience is a peer-reviewed journal that targets computational research and encourages the explicit replication of already published research, promoting new and open-source implementations in order to ensure that the original research can be replicated from its description. To achieve this goal, the whole publishing chain is radically different from other traditional scientific journals. ReScience resides on GitHub where each new implementation of a computational study is made available together with comments, explanations, and software tests.

A parsimonious computational model of visual target position encoding in the superior colliculus.

The superior colliculus (SC) is a brainstem structure at the crossroad of multiple functional pathways. Several neurophysiological studies suggest that the population of active neurons in the SC encodes the location of a visual target to foveate, pursue or attend to. Although extensive research has been carried out on computational modeling, most of the reported models are often based on complex mechanisms and explain a limited number of experimental results. This suggests that a key aspect may have been overlooked in the design of previous computational models. After a careful study of the literature, we hypothesized that the representation of the whole retinal stimulus (not only its center) might play an important role in the dynamics of SC activity. To test this hypothesis, we designed a model of the SC which is built upon three well-accepted principles: the log-polar representation of the visual field onto the SC, the interplay between a center excitation and a surround inhibition and a simple neuronal dynamics, like the one proposed by the dynamic neural field theory. Results show that the retinotopic organization of the collicular activity conveys an implicit computation that deeply impacts the target selection process.

Integration of exteroceptive and interoceptive information within the hippocampus: a computational study.

Many episodic memory studies have critically implicated the hippocampus in the rapid binding of sensory information from the perception of the external environment, reported by exteroception. Other structures in the medial temporal lobe, especially the amygdala, have been more specifically linked with emotional dimension of episodic memories, reported by interoception. The hippocampal projection to the amygdala is proposed as a substrate important for the formation of extero-interoceptive associations, allowing adaptive behaviors based on past experiences. Recently growing evidence suggests that hippocampal activity observed in a wide range of behavioral tasks could reflect associations between exteroceptive patterns and their emotional valences. The hippocampal computational models, therefore, need to be updated to elaborate better interpretation of hippocampal-dependent behaviors. In earlier models, interoceptive features, if not neglected, are bound together with other exteroceptive features through autoassociative learning mechanisms. This way of binding integrates both kinds of features at the same level, which is not always suitable for example in the case of pattern completion. Based on the anatomical and functional heterogeneity along the septotemporal and transverse axes of the hippocampus, we suggest instead that distinct hippocampal subregions may be engaged in the representation of these different types of information, each stored apart in autoassociative memories but linked together in a heteroassociative way. The model is developed within the hard constraint of rapid, even single trial, learning of episodic memories. The performance of the model is assessed quantitatively and its resistance to interference is demonstrated through a series of numerical experiments. An experiment of reversal learning in patients with amnesic cognitive impairment is also reproduced.

A pavlovian model of the amygdala and its influence within the medial temporal lobe.

Recent advances in neuroscience give us a better view of the inner structure of the amygdala, of its relations with other regions in the Medial Temporal Lobe (MTL) and of the prominent role of neuromodulation. They have particularly shed light on two kinds of neurons in the basal nucleus of the amygdala, the so-called fear neurons and extinction neurons. Fear neurons mediate context-dependent fear by receiving contextual information from the hippocampus, whereas extinction neurons are linked with the medial prefrontal cortex (mPFC) and involved in fear extinction. The computational model of the amygdala that we describe in this paper is primarily a model of pavlovian conditioning, but its architecture also emphasizes the central role of the amygdala in the MTL memory processes through three main information flows. (i) Thalamic and higher order sensory cortical inputs including from the perirhinal cortex are received in the lateral amygdalar nucleus, where CS-US associations can be acquired. (ii) These associations are subsequently modulated, in the basal nucleus of the amygdala, by contextual inputs coming from the hippocampus and the mPFC. Basal fear and extinction neurons indicate the currently valid association to their main targets including in the MTL and the mPFC. (iii) The competition for the choice of the pavlovian response is ultimately performed by projection of these amygdalar neurons in the central nucleus of the amygdala where, beyond motor responding, a hormonal response, including cholinergic modulation, is also triggered via the basal forebrain. In turn, acetylcholine modulates activation in the basal nucleus and facilitates learning in the hippocampus. Based on biologically founded arguments, our model replicates a number of biological experiments, proposes some predictions about the role of amygdalar regions and describes pavlovian conditioning as a distributed systemic learning, binding memory processes in the MTL.

Postsynaptic dysfunction is associated with spatial and object recognition memory loss in a natural model of Alzheimer's disease.

Alzheimer's disease (AD) is an age-related neurodegenerative disorder associated with progressive memory loss, severe dementia, and hallmark neuropathological markers, such as deposition of amyloid-ß (Aß) peptides in senile plaques and accumulation of hyperphosphorylated tau proteins in neurofibrillary tangles. Recent evidence obtained from transgenic mouse models suggests that soluble, nonfibrillar Aß oligomers may induce synaptic failure early in AD. Despite their undoubted value, these transgenic models rely on genetic manipulations that represent the inherited and familial, but not the most abundant, sporadic form of AD. A nontransgenic animal model that still develops hallmarks of AD would be an important step toward understanding how sporadic AD is initiated. Here we show that starting between 12 and 36 mo of age, the rodent Octodon degus naturally develops neuropathological signs of AD, such as accumulation of Aß oligomers and phosphorylated tau proteins. Moreover, age-related changes in Aß oligomers and tau phosphorylation levels are correlated with decreases in spatial and object recognition memory, postsynaptic function, and synaptic plasticity. These findings validate O. degus as a suitable natural model for studying how sporadic AD may be initiated.

No clock to rule them all.

This article introduces general concepts and definitions related to the notion of asynchronous computation in the framework of artificial neural networks. Using the dynamic field theory as an illustrative example, we explain why one may want to perform such asynchronous computation and how one can implement it since this computational scheme draws several consequences on both the trajectories and the stability of the whole system. After giving an unequivocal definition of asynchronous computation, we present a few practically usable methods and quantitative bounds that can guarantee most of the mesoscopic properties of the system.

Cortical basis of communication: local computation, coordination, attention.

Human communication emerges from cortical processing, known to be implemented on a regular repetitive neuronal substratum. The supposed genericity of cortical processing has elicited a series of modeling works in computational neuroscience that underline the information flows driven by the cortical circuitry. In the minimalist framework underlying the current theories for the embodiment of cognition, such a generic cortical processing is exploited for the coordination of poles of representation, as is reported in this paper for the case of visual attention. Interestingly, this case emphasizes how abstract internal referents are built to conform to memory requirements. This paper proposes that these referents are the basis for communication in humans, which is firstly a coordination and an attentional procedure with regard to their congeners.

Is there continuity between categorical and coordinate spatial relations coding? Evidence from a grid/no-grid working memory paradigm.

We ask the question whether the coding of categorical versus coordinate spatial relations depends on different neural networks showing hemispheric specialization or whether there is continuity between these two coding types. The 'continuous spatial coding' hypothesis would mean that the two coding types rely essentially on the same neural network consisting of more general-purpose processes, such as visuo-spatial attention, but with a different weighting of these general processes depending on exact task requirements. With event-related fMRI, we have studied right-handed male subjects performing a grid/no-grid visuo-spatial working memory task inducing categorical and coordinate spatial relations coding. Our data support the 'continuous spatial coding' hypothesis, indicating that, while based on the same fronto-parieto-occipital neural network than categorical spatial relations coding, the coding of coordinate spatial relations relies more heavily on attentional and executive processes, which could induce hemispheric differences similar to those described in the literature. The results also show that visuo-spatial working memory consists of a short-term posterior store with a capacity of up to three elements in the parietal and extrastriate cortices. This store depends on the presence of a visible space categorization and thus can be used for the coding of categorical spatial relations. When no visible space categorization is given or when more than three elements have to be coded, additional attentional and executive processes are recruited, mainly located in the dorso-lateral prefrontal cortex.

From physiological principles to computational models of the cortex.

Understanding the brain goes through the assimilation of an increasing amount of biological data going from single cell recording to brain imaging studies and behavioral analysis. The description of cognition at these three levels provides us with a grid of analysis that can be exploited for the design of computational models. Beyond data related to specific tasks to be emulated by models, each of these levels also lays emphasis on principles of computation that must be obeyed to really implement biologically inspired computations. Similarly, the advantages of such a joint approach are twofold: computational models are a powerful tool to experiment brain theories and assess them on the implementation of realistic tasks, such as visual search tasks. They are also a way to explore and exploit an original formalism of asynchronous, distributed and adaptive computations with such precious properties as self-organization, emergence, robustness and more generally abilities to cope with an intelligent interaction with the world. In this article, we first discuss three levels at which a cortical circuit might be observed to provide a modeler with sufficient information to design a computational model and illustrate this principle with an application to the control of visual attention.

A model of contextual effect on reproduced extents in recall tasks: the issue of the imputed motion hypothesis.

In this article the fundamental question of space and time dependencies in the reproduction of spatial or temporal extents is studied. The functional dependence of spatial responses on the temporal context and the corresponding dependence of temporal responses on spatial context are reported as the tau and kappa effects, respectively. A common explanation suggested that the participant imputes motion to discontinuous displays. Using a mathematical model we explore the imputed velocity hypothesis and provide a globally fit model that addresses the question of sequences modelling. Our model accounts for observed data in the tau experiment. The accuracy of the model is improved introducing a new hypothesis based on small velocity variations. On the other hand, results show that the imputed velocity hypothesis fails to reproduce the kappa effect. This result definitively shows that both effects are not symmetric.