Serial dependence promotes the stability of perceived emotional expression depending on face similarity.

Individuals can quickly and effortlessly recognize facial expressions, which is critical for social perception and emotion regulation. This sensitivity to even slight facial changes could result in unstable percepts of an individual's expression over time. The visual system must therefore balance accuracy with maintaining perceptual stability. However, previous research has focused on our sensitivity to changing expressions, and the mechanism behind expression stability remains an open question. Recent results demonstrate that perception of facial identity is systematically biased toward recently seen visual input. This positive perceptual pull, or serial dependence, may help stabilize perceived expression. To test this, observers judged random facial expression morphs ranging from happy to sad to angry. We found a pull in perceived expression toward previously seen expressions, but only when the 1-back and current face had similar identities. Our results are consistent with the existence of the continuity field for expression, a specialized mechanism that promotes the stability of emotion perception, which could help facilitate social interactions and emotion regulation.

Serial dependence in position occurs at the time of perception.

Observers perceive objects in the world as stable over space and time, even though the visual experience of those objects is often discontinuous and distorted due to masking, occlusion, camouflage, or noise. How are we able to easily and quickly achieve stable perception in spite of this constantly changing visual input? It was previously shown that observers experience serial dependence in the perception of features and objects, an effect that extends up to 15 seconds back in time. Here, we asked whether the visual system utilizes an object's prior physical location to inform future position assignments in order to maximize location stability of an object over time. To test this, we presented subjects with small targets at random angular locations relative to central fixation in the peripheral visual field. Subjects reported the perceived location of the target on each trial by adjusting a cursor's position to match its location. Subjects made consistent errors when reporting the perceived position of the target on the current trial, mislocalizing it toward the position of the target in the preceding two trials (Experiment 1). This pull in position perception occurred even when a response was not required on the previous trial (Experiment 2). In addition, we show that serial dependence in perceived position occurs immediately after stimulus presentation, and it is a fast stabilization mechanism that does not require a delay (Experiment 3). This indicates that serial dependence occurs for position representations and facilitates the stable perception of objects in space. Taken together with previous work, our results show that serial dependence occurs at many stages of visual processing, from initial position assignment to object categorization.

The perceived stability of scenes: serial dependence in ensemble representations.

We are continuously surrounded by a noisy and ever-changing environment. Instead of analyzing all the elements in a scene, our visual system has the ability to compress an enormous amount of visual information into ensemble representations, such as perceiving a forest instead of every single tree. Still, it is unclear why such complex scenes appear to be the same from moment to moment despite fluctuations, noise, and discontinuities in retinal images. The general effects of change blindness are usually thought to stabilize scene perception, making us unaware of minor inconsistencies between scenes. Here, we propose an alternative, that stable scene perception is actively achieved by the visual system through global serial dependencies: the appearance of scene gist is sequentially dependent on the gist perceived in previous moments. To test this hypothesis, we used summary statistical information as a proxy for "gist" level, global information in a scene. We found evidence for serial dependence in summary statistical representations. Furthermore, we show that this kind of serial dependence occurs at the ensemble level, where local elements are already merged into global representations. Taken together, our results provide a mechanism through which serial dependence can promote the apparent consistency of scenes over time.

Experience Shapes the Development of Neural Substrates of Face Processing in Human Ventral Temporal Cortex.

In adult humans, the ventral temporal cortex (VTC) represents faces in a reproducible topology. However, it is unknown what role visual experience plays in the development of this topology. Using functional magnetic resonance imaging in children and adults, we found a sequential development, in which the topology of face-selective activations across the VTC was matured by age 7, but the spatial extent and degree of face selectivity continued to develop past age 7 into adulthood. Importantly, own- and other-age faces were differentially represented, both in the distributed multivoxel patterns across the VTC, and also in the magnitude of responses of face-selective regions. These results provide strong evidence that experience shapes cortical representations of faces during development from childhood to adulthood. Our findings have important implications for the role of experience and age in shaping the neural substrates of face processing in the human VTC.

Serial dependence promotes object stability during occlusion.

Object identities somehow appear stable and continuous over time despite eye movements, disruptions in visibility, and constantly changing visual input. Recent results have demonstrated that the perception of orientation, numerosity, and facial identity is systematically biased (i.e., pulled) toward visual input from the recent past. The spatial region over which current orientations or face identities are pulled by previous orientations or identities, respectively, is known as the continuity field, which is temporally tuned over the past several seconds (Fischer & Whitney, 2014). This perceptual pull could contribute to the visual stability of objects over short time periods, but does it also address how perceptual stability occurs during visual discontinuities? Here, we tested whether the continuity field helps maintain perceived object identity during occlusion. Specifically, we found that the perception of an oriented Gabor that emerged from behind an occluder was significantly pulled toward the random (and unrelated) orientation of the Gabor that was seen entering the occluder. Importantly, this serial dependence was stronger for predictable, continuously moving trajectories, compared to unpredictable ones or static displacements. This result suggests that our visual system takes advantage of expectations about a stable world, helping to maintain perceived object continuity despite interrupted visibility.

Functionally defined white matter reveals segregated pathways in human ventral temporal cortex associated with category-specific processing.

It is unknown if the white-matter properties associated with specific visual networks selectively affect category-specific processing. In a novel protocol we combined measurements of white-matter structure, functional selectivity, and behavior in the same subjects. We find two parallel white-matter pathways along the ventral temporal lobe connecting to either face-selective or place-selective regions. Diffusion properties of portions of these tracts adjacent to face- and place-selective regions of ventral temporal cortex correlate with behavioral performance for face or place processing, respectively. Strikingly, adults with developmental prosopagnosia (face blindness) express an atypical structure-behavior relationship near face-selective cortex, suggesting that white-matter atypicalities in this region may have behavioral consequences. These data suggest that examining the interplay between cortical function, anatomical connectivity, and visual behavior is integral to understanding functional networks and their role in producing visual abilities and deficits.

Serial dependence in the perception of faces.

From moment to moment, we perceive objects in the world as continuous despite fluctuations in their image properties due to factors like occlusion, visual noise, and eye movements. The mechanism by which the visual system accomplishes this object continuity remains elusive. Recent results have demonstrated that the perception of low-level stimulus features such as orientation and numerosity is systematically biased (i.e., pulled) toward visual input from the recent past. The spatial region over which current orientations are pulled by previous orientations is known as the continuity field, which is temporally tuned for the past 10-15 s. This perceptual pull could contribute to the visual stability of low-level features over short time periods, but it does not address how visual stability occurs at the level of object identity. Here, we tested whether the visual system facilitates stable perception by biasing current perception of a face, a complex and behaviorally relevant object, toward recently seen faces. We found that perception of face identity is systematically biased toward identities seen up to several seconds prior, even across changes in viewpoint. This effect did not depend on subjects' prior responses or on the method used to measure identity perception. Although this bias in perceived identity manifests as a misperception, it is adaptive: visual processing echoes the stability of objects in the world to create perceptual continuity. The serial dependence of identity perception promotes object identity invariance over time and provides the clearest evidence for the existence of an object-selective perceptual continuity field.

Where is human V4? Predicting the location of hV4 and VO1 from cortical folding.

A strong relationship between cortical folding and the location of primary sensory areas in the human brain is well established. However, it is unknown if coupling between functional responses and gross anatomy is found at higher stages of sensory processing. We examined the relationship between cortical folding and the location of the retinotopic maps hV4 and VO1, which are intermediate stages in the human ventral visual processing stream. Our data show a consistent arrangement of the eccentricity maps within hV4 and VO1 with respect to anatomy, with the consequence that the hV4/VO1 boundary is found consistently in the posterior transverse collateral sulcus (ptCoS) despite individual variability in map size and cortical folding. Understanding this relationship allowed us to predict the location of visual areas hV4 and VO1 in a separate set of individuals, using only their anatomies, with >85% accuracy. These findings have important implications for understanding the relation between cortical folding and functional maps as well as for defining visual areas from anatomical landmarks alone.

Differential development of the ventral visual cortex extends through adolescence.

The ventral temporal cortex (VTC) in humans includes functionally defined regions that preferentially respond to objects, faces, and places. Recent developmental studies suggest that the face selective region in the fusiform gyrus ('fusiform face area', FFA) undergoes a prolonged development involving substantial increases in its volume after 7 years of age. However, the endpoint of this development is not known. Here we used functional magnetic resonance imaging (fMRI) to examine the development of face-, object- and place selective regions in the VTC of adolescents (12-16 year olds) and adults (18-40 year olds). We found that the volume of face selective activations in the right fusiform gyrus was substantially larger in adults than in adolescents, and was positively correlated with age. This development was associated with higher response amplitudes and selectivity for faces in face selective regions of VTC and increased differentiation of the distributed response patterns to faces versus non-face stimuli across the entire VTC. Furthermore, right FFA size was positively correlated with face recognition memory performance, but not with recognition memory of objects or places. In contrast, the volume of object- and place selective cortical regions or their response amplitudes did not change across these age groups. Thus, we found a striking and prolonged development of face selectivity across the VTC during adolescence that was specifically associated with proficiency in face recognition memory. These findings have important implications for theories of development and functional specialization in VTC.