Neural Networks With Motivation.

Animals rely on internal motivational states to make decisions. The role of motivational salience in decision making is in early stages of mathematical understanding. Here, we propose a reinforcement learning framework that relies on neural networks to learn optimal ongoing behavior for dynamically changing motivation values. First, we show that neural networks implementing Q-learning with motivational salience can navigate in environment with dynamic rewards without adjustments in synaptic strengths when the needs of an agent shift. In this setting, our networks may display elements of addictive behaviors. Second, we use a similar framework in hierarchical manager-agent system to implement a reinforcement learning algorithm with motivation that both infers motivational states and behaves. Finally, we show that, when trained in the Pavlovian conditioning setting, the responses of the neurons in our model resemble previously published neuronal recordings in the ventral pallidum, a basal ganglia structure involved in motivated behaviors. We conclude that motivation allows Q-learning networks to quickly adapt their behavior to conditions when expected reward is modulated by agent's dynamic needs. Our approach addresses the algorithmic rationale of motivation and makes a step toward better interpretability of behavioral data via inference of motivational dynamics in the brain.

Click histochemistry for whole-mount staining of brain structures.

Labeling of the replicating DNA with synthetic thymidine analogs is commonly used for marking the dividing cells. However, until now this method has only been applied to histological sections. A growing number of current approaches for three-dimensional visualization of large tissue samples requires detection of dividing cells within whole organs. Here we describe a method for labeling dividing cells with 5-ethynyl-2'-deoxyuridine (EdU) and their further detection in whole brain structures (for example, hippocampus) using the Cu (I) -catalyzed [3 + 2] cycloaddition reaction (so-called click-reaction). The presented method can be used for brain neurogenesis studies as well as for whole-mount staining of any preparations in which the terminal ethynyl group has been introduced. •New click histochemistry method based on Cu (I) -catalyzed [3 + 2] cycloaddition reaction allows whole-mount staining of brain structures and other tissues.•Our whole-mount click histochemistry method allows to visualize dividing cells in 3D and can be used in neurogenesis studies, i.e. for birthdating dividing early progenitors and further tracking of proliferation, survival, migration, differentiation, and fate of their progeny.•Our whole-mount click histochemistry staining demonstrates high staining specificity, high signal intensity, and low background levels in young and adult mouse brain tissue.

Suppressed neurogenesis without cognitive deficits: effects of fast neutron irradiation in mice.

This study assessed the effects of combined low-dose neutron and γ-ray irradiation on hippocampal neurogenesis and hippocampal-dependent memory. Neural progenitor cell division and survival were evaluated in brain sections and whole hippocampal preparations following head irradiation at a dose of 0.34 Gy for neutron radiation and 0.36 Gy for γ-ray radiation. Hippocampal-dependent memory formation was tested in a contextual fear conditioning task following irradiation at doses of 0.4 Gy for neutron radiation and 0.42 Gy for γ-ray radiation. Cell division was suppressed consistently along the entire dorsoventral axis of the hippocampus 24 h after the irradiation, but quiescent stem cells remained unaffected. The control and irradiated mice showed no differences in terms of exploratory behavior or anxiety 6 weeks after the irradiation. The ability to form hippocampus-dependent memory was also unaffected. The data may be indicative of a negligible effect of the low-dose of fast neutron irradiation and the neurogenesis suppression on animal behavior at 6 weeks after irradiation.

Network cloning using DNA barcodes.

The connections between neurons determine the computations performed by both artificial and biological neural networks. Recently, we have proposed SYNSeq, a method for converting the connectivity of a biological network into a form that can exploit the tremendous efficiencies of high-throughput DNA sequencing. In SYNSeq, each neuron is tagged with a random sequence of DNA-a "barcode"-and synapses are represented as barcode pairs. SYNSeq addresses the analysis problem, reducing a network into a suspension of barcode pairs. Here, we formulate a complementary synthesis problem: How can the suspension of barcode pairs be used to "clone" or copy the network back into an uninitialized tabula rasa network? Although this synthesis problem might be expected to be computationally intractable, we find that, surprisingly, this problem can be solved efficiently, using only neuron-local information. We present the "one-barcode-one-cell" (OBOC) algorithm, which forces all barcodes of a given sequence to coalesce into the same neuron, and show that it converges in a number of steps that is a power law of the network size. Rapid and reliable network cloning with single-synapse precision is thus theoretically possible.

DALMATIAN: An Algorithm for Automatic Cell Detection and Counting in 3D.

Current 3D imaging methods, including optical projection tomography, light-sheet microscopy, block-face imaging, and serial two photon tomography enable visualization of large samples of biological tissue. Large volumes of data obtained at high resolution require development of automatic image processing techniques, such as algorithms for automatic cell detection or, more generally, point-like object detection. Current approaches to automated cell detection suffer from difficulties originating from detection of particular cell types, cell populations of different brightness, non-uniformly stained, and overlapping cells. In this study, we present a set of algorithms for robust automatic cell detection in 3D. Our algorithms are suitable for, but not limited to, whole brain regions and individual brain sections. We used watershed procedure to split regional maxima representing overlapping cells. We developed a bootstrap Gaussian fit procedure to evaluate the statistical significance of detected cells. We compared cell detection quality of our algorithm and other software using 42 samples, representing 6 staining and imaging techniques. The results provided by our algorithm matched manual expert quantification with signal-to-noise dependent confidence, including samples with cells of different brightness, non-uniformly stained, and overlapping cells for whole brain regions and individual tissue sections. Our algorithm provided the best cell detection quality among tested free and commercial software.