Dose-response relationship between the variables of unilateral optogenetic stimulation and transcallosal evoked responses in rat motor cortex.

Efficient interhemispheric integration of neural activity between left and right primary motor cortex (M1) is critical for inter-limb motor control. We employed optogenetic stimulation to establish a framework for probing transcallosal M1-M1 interactions in rats. We performed optogenetic stimulation of excitatory neurons in right M1 of male Sprague-Dawley rats. We recorded the transcallosal evoked potential in contralateral left M1 via chronically implanted electrodes. Recordings were performed under anesthesia combination of dexmedetomidine and a low concentration of isoflurane. We systematically varied the stimulation intensity and duration to characterize the relationship between stimulation parameters in right M1 and the characteristics of the evoked intracortical potentials in left M1. Optogenetic stimulation of right M1 consistently evoked a transcallosal response in left M1 with a consistent negative peak (N1) that sometimes was preceded by a smaller positive peak (P1). Higher stimulation intensity or longer stimulation duration gradually increased N1 amplitude and reduced N1 variability across trials. A combination of stimulation intensities of 5-10 mW with stimulus durations of 1-10 ms were generally sufficient to elicit a robust transcallosal response in most animal, with our optic fiber setup. Optogenetically stimulated excitatory neurons in M1 can reliably evoke a transcallosal response in anesthetized rats. Characterizing the relationship between "stimulation dose" and "response magnitude" (i.e., the gain function) of transcallosal M1-to-M1 excitatory connections can be used to optimize the variables of optogenetic stimulation and ensure stimulation efficacy.

Choice history effects in mice and humans improve reward harvesting efficiency.

Choice history effects describe how future choices depend on the history of past choices. In experimental tasks this is typically framed as a bias because it often diminishes the experienced reward rates. However, in natural habitats, choices made in the past constrain choices that can be made in the future. For foraging animals, the probability of earning a reward in a given patch depends on the degree to which the animals have exploited the patch in the past. One problem with many experimental tasks that show choice history effects is that such tasks artificially decouple choice history from its consequences on reward availability over time. To circumvent this, we use a variable interval (VI) reward schedule that reinstates a more natural contingency between past choices and future reward availability. By examining the behavior of optimal agents in the VI task we discover that choice history effects observed in animals serve to maximize reward harvesting efficiency. We further distil the function of choice history effects by manipulating first- and second-order statistics of the environment. We find that choice history effects primarily reflect the growth rate of the reward probability of the unchosen option, whereas reward history effects primarily reflect environmental volatility. Based on observed choice history effects in animals, we develop a reinforcement learning model that explicitly incorporates choice history over multiple time scales into the decision process, and we assess its predictive adequacy in accounting for the associated behavior. We show that this new variant, known as the double trace model, has a higher performance in predicting choice data, and shows near optimal reward harvesting efficiency in simulated environments. These results suggests that choice history effects may be adaptive for natural contingencies between consumption and reward availability. This concept lends credence to a normative account of choice history effects that extends beyond its description as a bias.

Reward foraging task and model-based analysis reveal how fruit flies learn value of available options.

Foraging animals have to evaluate, compare and select food patches in order to increase their fitness. Understanding what drives foraging decisions requires careful manipulation of the value of alternative options while monitoring animals choices. Value-based decision-making tasks in combination with formal learning models have provided both an experimental and theoretical framework to study foraging decisions in lab settings. While these approaches were successfully used in the past to understand what drives choices in mammals, very little work has been done on fruit flies. This is despite the fact that fruit flies have served as model organism for many complex behavioural paradigms. To fill this gap we developed a single-animal, trial-based decision making task, where freely walking flies experienced optogenetic sugar-receptor neuron stimulation. We controlled the value of available options by manipulating the probabilities of optogenetic stimulation. We show that flies integrate reward history of chosen options and forget value of unchosen options. We further discover that flies assign higher values to rewards experienced early in the behavioural session, consistent with formal reinforcement learning models. Finally, we also show that the probabilistic rewards affect walking trajectories of flies, suggesting that accumulated value is controlling the navigation vector of flies in a graded fashion. These findings establish the fruit fly as a model organism to explore the genetic and circuit basis of reward foraging decisions.

Extending models of "How Foraging Works": Uncertainty, controllability, and survivability.

We argue that How Foraging Works sketches a good foundational model, but it needs expanding to incorporate hierarchical and multiscale conceptions of uncertainty and to incorporate inference of environmental controllability. Most pressingly, its algorithmic implementation needs to be better justified in terms of its functional forms and, ultimately, to be more heavily constrained by survival optimality.

From circuit motifs to computations: mapping the behavioral repertoire of cortical interneurons.

The exquisite architecture of cortex incorporates a myriad of inhibitory interneuron types. Until recently, the dearth of techniques for cell type identification in awake animals has made it difficult to link interneuron activity with circuit function, computation and behavior. This situation has changed dramatically in recent years with the advent of novel tools for targeting genetically distinct interneuron types so their activity can be observed and manipulated. The association of different interneuron subtypes with specific circuit functions, such as gain modulation or disinhibition, is starting to reveal canonical circuit motifs conserved across neocortical regions. Moreover, it appears that some interneuron types are recruited at specific behavioral events and likely control the flow of information among and within brain areas at behavioral time scales. Based on these results we propose that interneuron function goes beyond network coordination and interneurons should be viewed as integral elements of cortical computations serving behavior.

Cortical interneurons that specialize in disinhibitory control.

In the mammalian cerebral cortex the diversity of interneuronal subtypes underlies a division of labour subserving distinct modes of inhibitory control. A unique mode of inhibitory control may be provided by inhibitory neurons that specifically suppress the firing of other inhibitory neurons. Such disinhibition could lead to the selective amplification of local processing and serve the important computational functions of gating and gain modulation. Although several interneuron populations are known to target other interneurons to varying degrees, little is known about interneurons specializing in disinhibition and their in vivo function. Here we show that a class of interneurons that express vasoactive intestinal polypeptide (VIP) mediates disinhibitory control in multiple areas of neocortex and is recruited by reinforcement signals. By combining optogenetic activation with single-cell recordings, we examined the functional role of VIP interneurons in awake mice, and investigated the underlying circuit mechanisms in vitro in auditory and medial prefrontal cortices. We identified a basic disinhibitory circuit module in which activation of VIP interneurons transiently suppresses primarily somatostatin- and a fraction of parvalbumin-expressing inhibitory interneurons that specialize in the control of the input and output of principal cells, respectively. During the performance of an auditory discrimination task, reinforcement signals (reward and punishment) strongly and uniformly activated VIP neurons in auditory cortex, and in turn VIP recruitment increased the gain of a functional subpopulation of principal neurons. These results reveal a specific cell type and microcircuit underlying disinhibitory control in cortex and demonstrate that it is activated under specific behavioural conditions.

A resource of Cre driver lines for genetic targeting of GABAergic neurons in cerebral cortex.

A key obstacle to understanding neural circuits in the cerebral cortex is that of unraveling the diversity of GABAergic interneurons. This diversity poses general questions for neural circuit analysis: how are these interneuron cell types generated and assembled into stereotyped local circuits and how do they differentially contribute to circuit operations that underlie cortical functions ranging from perception to cognition? Using genetic engineering in mice, we have generated and characterized approximately 20 Cre and inducible CreER knockin driver lines that reliably target major classes and lineages of GABAergic neurons. More select populations are captured by intersection of Cre and Flp drivers. Genetic targeting allows reliable identification, monitoring, and manipulation of cortical GABAergic neurons, thereby enabling a systematic and comprehensive analysis from cell fate specification, migration, and connectivity, to their functions in network dynamics and behavior. As such, this approach will accelerate the study of GABAergic circuits throughout the mammalian brain.

Neural circuitry that governs Drosophila male courtship behavior.

Male-specific fruitless (fru) products (Fru(M)) are both necessary and sufficient to "hardwire" the potential for male courtship behavior into the Drosophila nervous system. Fru(M) is expressed in approximately 2% of neurons in the male nervous system, but not in the female. We have targeted the insertion of GAL4 into the fru locus, allowing us to visualize and manipulate the Fru(M)-expressing neurons in the male as well as their counterparts in the female. We present evidence that these neurons are directly and specifically involved in male courtship behavior and that at least some of them are interconnected in a circuit. This circuit includes olfactory neurons required for the behavioral response to sex pheromones. Anatomical differences in this circuit that might account for the dramatic differences in male and female sexual behavior are not apparent.