Mice identify subgoal locations through an action-driven mapping process.

Mammals form mental maps of the environments by exploring their surroundings. Here, we investigate which elements of exploration are important for this process. We studied mouse escape behavior, in which mice are known to memorize subgoal locations-obstacle edges-to execute efficient escape routes to shelter. To test the role of exploratory actions, we developed closed-loop neural-stimulation protocols for interrupting various actions while mice explored. We found that blocking running movements directed at obstacle edges prevented subgoal learning; however, blocking several control movements had no effect. Reinforcement learning simulations and analysis of spatial data show that artificial agents can match these results if they have a region-level spatial representation and explore with object-directed movements. We conclude that mice employ an action-driven process for integrating subgoals into a hierarchical cognitive map. These findings broaden our understanding of the cognitive toolkit that mammals use to acquire spatial knowledge.

Protocol to Study Spatial Subgoal Learning Using Escape Behavior in Mice.

Rodent spatial navigation is a key model system for studying mammalian cognition and its neural mechanisms. Of particular interest is how animals memorize the structure of their environments and compute multi-step routes to a goal. Previous work on multi-step spatial reasoning has generally involved placing rodents at the start of a maze until they learn to navigate to a reward without making wrong turns. It thus remains poorly understood how animals rapidly learn about the structure of naturalistic open environments with goals and obstacles. Here we present an assay in which mice spontaneously memorize two-step routes in an environment with a shelter and an obstacle. We allow the mice to explore this environment for 20 min, and then we remove the obstacle. We then present auditory threat stimuli, causing the mouse to escape to the shelter. Finally, we record each escape route and measure whether it targets the shelter directly (a 'homing-vector' escape) or instead targets the location where the obstacle edge was formerly located (an 'edge-vector' escape). Since the obstacle is no longer there, these obstacle-edge-directed escape routes provide evidence that the mouse has memorized a subgoal location, i.e., a waypoint targeted in order to efficiently get to the shelter in the presence of an obstacle. By taking advantage of instinctive escape responses, this assay probes a multi-step spatial memory that is learned in a single session without pretraining. The subgoal learning phenomenon it generates can be useful not only for researchers working on navigation and instinctive behavior, but also for neuroscientists studying the neural basis of multi-step spatial reasoning.

Mice learn multi-step routes by memorizing subgoal locations.

The behavioral strategies that mammals use to learn multi-step routes are unknown. In this study, we investigated how mice navigate to shelter in response to threats when the direct path is blocked. Initially, they fled toward the shelter and negotiated obstacles using sensory cues. Within 20 min, they spontaneously adopted a subgoal strategy, initiating escapes by running directly to the obstacle's edge. Mice continued to escape in this manner even after the obstacle had been removed, indicating use of spatial memory. However, standard models of spatial learning-habitual movement repetition and internal map building-did not explain how subgoal memories formed. Instead, mice used a hybrid approach: memorizing salient locations encountered during spontaneous 'practice runs' to the shelter. This strategy was also used during a geometrically identical food-seeking task. These results suggest that subgoal memorization is a fundamental strategy by which rodents learn efficient multi-step routes in new environments.

Transient and Persistent Representations of Odor Value in Prefrontal Cortex.

The representation of odor in olfactory cortex (piriform) is distributive and unstructured and can only be afforded behavioral significance upon learning. We performed 2-photon imaging to examine the representation of odors in piriform and in two downstream areas, the orbitofrontal cortex (OFC) and the medial prefrontal cortex (mPFC), as mice learned olfactory associations. In piriform, we observed that odor responses were largely unchanged during learning. In OFC, 30% of the neurons acquired robust responses to conditioned stimuli (CS+) after learning, and these responses were gated by internal state and task context. Moreover, direct projections from piriform to OFC can be entrained to elicit learned olfactory behavior. CS+ responses in OFC diminished with continued training, whereas persistent representations of both CS+ and CS- odors emerged in mPFC. Optogenetic silencing indicates that these two brain structures function sequentially to consolidate the learning of appetitive associations.

Context-Dependent Decision Making in a Premotor Circuit.

Cognitive capacities afford contingent associations between sensory information and behavioral responses. We studied this problem using an olfactory delayed match to sample task whereby a sample odor specifies the association between a subsequent test odor and rewarding action. Multi-neuron recordings revealed representations of the sample and test odors in olfactory sensory and association cortex, which were sufficient to identify the test odor as match or non-match. Yet, inactivation of a downstream premotor area (ALM), but not orbitofrontal cortex, confined to the epoch preceding the test odor led to gross impairment. Olfactory decisions that were not context-dependent were unimpaired. Therefore, ALM does not receive the outcome of a match/non-match decision from upstream areas. It receives contextual information-the identity of the sample-to establish the mapping between test odor and action. A novel population of pyramidal neurons in ALM layer 2 may mediate this process.