An analysis of metaphor in COVID-19 TV news in English and Spanish.

BACKGROUND: Latinxs lack equitable access to science-based, accessible, trustworthy, and bilingual health information and rely heavily on TV news as a source of health information. This study examines how TV news media convey COVID-19 health- and safety-related information to the public, focusing on communications that target Latinxs in the US, a group disproportionately affected by COVID-19. METHOD: To understand how information targets Latinxs, we analyzed conceptual metaphors used in Spanish and English descriptions of the COVID-19 pandemic using TV news archive. Metaphor is an integral part of daily communication that can help people explain what is abstract in terms of what is concrete. Our analysis focused on prominent COVID-19 metaphors in both languages: war, journey, and natural disaster. RESULTS: Similar to previous studies, we found that war metaphors were pervasive in English, for instance, as in 'Diagnostic testing is the only weapon that allows you to fight COVID-19' and 'a 15-day battle with COVID-19.' A new finding was that war metaphors were even more common in Spanish than in English. The journey metaphor had similar rates of use in both languages, while the natural disaster metaphors were more common in English than in Spanish. CONCLUSIONS: Our work provides novel insights into how TV news reports use metaphor to convey information about COVID-19 to viewers in English and Spanish. We also offer implications on using culturally informed language and conclude with directions for future research to guide health communications serving linguistic minority communities such as Latinxs.

'Tiny numbers' are actually tiny: Evidence from gestures in the TV News Archive.

We report a large-scale, quantitative investigation of manual gestures that speakers perform when speaking metaphorically about numerical quantities. We used the TV News Archive-an online database of over 2 million English language news broadcasts-to examine 681 videos in which 584 speakers used the phrase 'tiny number', 'small number', 'large number', or 'huge number', which metaphorically frame numerical quantity in terms of physical size. We found that the gestures speakers used reflect a number of different strategies to express the metaphoric size of quantities. When referring to greater versus lesser quantities, speakers were far more likely to gesture (1) with an open versus closed hand configuration, (2) with an outward versus inward movement, and (3) with a wider distance between the gesturing hands. These patterns were often more pronounced for the phrases containing more extreme adjectives ('tiny/huge number'). However, we did not find that speakers performed two-handed versus one-handed gestures. Nor did we find that speakers performed right-handed versus left-handed gestures, when referring to greater versus lesser quantities. Overall, this work supports the claim that metaphoric thought is involved in the production of verbal metaphors that describe numerical magnitudes. It demonstrates that size-based numerical associations observed in previous lab experiments are active in real-life communication outside the lab.

Implied motion language can influence visual spatial memory.

How do language and vision interact? Specifically, what impact can language have on visual processing, especially related to spatial memory? What are typically considered errors in visual processing, such as remembering the location of an object to be farther along its motion trajectory than it actually is, can be explained as perceptual achievements that are driven by our ability to anticipate future events. In two experiments, we tested whether the prior presentation of motion language influences visual spatial memory in ways that afford greater perceptual prediction. Experiment 1 showed that motion language influenced judgments for the spatial memory of an object beyond the known effects of implied motion present in the image itself. Experiment 2 replicated this finding. Our findings support a theory of perception as prediction.

Mental number space in three dimensions.

A large number of experimental findings from neuroscience and experimental psychology demonstrated interactions between spatial cognition and numerical cognition. In particular, many researchers posited a horizontal mental number line, where small numbers are thought of as being to the left of larger numbers. This review synthesizes work on the mental association between space and number, indicating the existence of multiple spatial mappings: recent research has found associations between number and vertical space, as well as associations between number and near/far space. We discuss number space in three dimensions with an eye on potential origins of the different number mappings, and how these number mappings fit in with our current knowledge of brain organization and brain-culture interactions. We derive novel predictions and show how this research fits into a general view of cognition as embodied, grounded and situated.

Timescales of massive human entrainment.

The past two decades have seen an upsurge of interest in the collective behaviors of complex systems composed of many agents entrained to each other and to external events. In this paper, we extend the concept of entrainment to the dynamics of human collective attention. We conducted a detailed investigation of the unfolding of human entrainment--as expressed by the content and patterns of hundreds of thousands of messages on Twitter--during the 2012 US presidential debates. By time-locking these data sources, we quantify the impact of the unfolding debate on human attention at three time scales. We show that collective social behavior covaries second-by-second to the interactional dynamics of the debates: A candidate speaking induces rapid increases in mentions of his name on social media and decreases in mentions of the other candidate. Moreover, interruptions by an interlocutor increase the attention received. We also highlight a distinct time scale for the impact of salient content during the debates: Across well-known remarks in each debate, mentions in social media start within 5-10 seconds after it occurs; peak at approximately one minute; and slowly decay in a consistent fashion across well-known events during the debates. Finally, we show that public attention after an initial burst slowly decays through the course of the debates. Thus we demonstrate that large-scale human entrainment may hold across a number of distinct scales, in an exquisitely time-locked fashion. The methods and results pave the way for careful study of the dynamics and mechanisms of large-scale human entrainment.

Of magnitudes and metaphors: explaining cognitive interactions between space, time, and number.

Space, time, and number are fundamental to how we act within and reason about the world. These three experiential domains are systematically intertwined in behavior, language, and the brain. Two main theories have attempted to account for cross-domain interactions. A Theory of Magnitude (ATOM) posits a domain-general magnitude system. Conceptual Metaphor Theory (CMT) maintains that cross-domain interactions are manifestations of asymmetric mappings that use representations of space to structure the domains of number and time. These theories are often viewed as competing accounts. We propose instead that ATOM and CMT are complementary, each illuminating different aspects of cross-domain interactions. We argue that simple representations of magnitude cannot, on their own, account for the rich, complex interactions between space, time and number described by CMT. On the other hand, ATOM is better at accounting for low-level and language-independent associations that arise early in ontogeny. We conclude by discussing how magnitudes and metaphors are both needed to understand our neural and cognitive web of space, time and number.

High-level context effects on spatial displacement: the effects of body orientation and language on memory.

Three decades of research suggests that cognitive simulation of motion is involved in the comprehension of object location, bodily configuration, and linguistic meaning. For example, the remembered location of an object associated with actual or implied motion is typically displaced in the direction of motion. In this paper, two experiments explore context effects in spatial displacement. They provide a novel approach to estimating the remembered location of an implied motion image by employing a cursor-positioning task. Both experiments examine how the remembered spatial location of a person is influenced by subtle differences in implied motion, specifically, by shifting the orientation of the person's body to face upward or downward, and by pairing the image with motion language that differed on intentionality, fell versus jumped. The results of Experiment 1, a survey-based experiment, suggest that language and body orientation influenced vertical spatial displacement. Results of Experiment 2, a task that used Adobe Flash and Amazon Mechanical Turk, showed consistent effects of body orientation on vertical spatial displacement but no effect of language. Our findings are in line with previous work on spatial displacement that uses a cursor-positioning task with implied motion stimuli. We discuss how different ways of simulating motion can influence spatial memory.

Eye movements during listening reveal spontaneous grammatical processing.

Recent research using eye-tracking typically relies on constrained visual contexts in particular goal-oriented contexts, viewing a small array of objects on a computer screen and performing some overt decision or identification. Eyetracking paradigms that use pictures as a measure of word or sentence comprehension are sometimes touted as ecologically invalid because pictures and explicit tasks are not always present during language comprehension. This study compared the comprehension of sentences with two different grammatical forms: the past progressive (e.g., was walking), which emphasizes the ongoing nature of actions, and the simple past (e.g., walked), which emphasizes the end-state of an action. The results showed that the distribution and timing of eye movements mirrors the underlying conceptual structure of this linguistic difference in the absence of any visual stimuli or task constraint: Fixations were shorter and saccades were more dispersed across the screen, as if thinking about more dynamic events when listening to the past progressive stories. Thus, eye movement data suggest that visual inputs or an explicit task are unnecessary to solicit analog representations of features such as movement, that could be a key perceptual component to grammatical comprehension.

Grammatical aspect and temporal distance in motion descriptions.

Grammatical aspect is known to shape event understanding. However, little is known about how it interacts with other important temporal information, such as recent and distant past. The current work uses computer-mouse tracking (Spivey et al., 2005) to explore the interaction of aspect and temporal context. Participants in our experiment listened to past motion event descriptions that varied according to aspect (simple past, past progressive) and temporal distance (recent past, distant past) while viewing scenes with paths and implied destinations. Participants used a computer mouse to place characters into the scene to match event descriptions. Our results indicated that aspect and temporal context interact in interesting ways. When aspect placed emphasis on the ongoing details of the event and the temporal context was recent (thus, making fine details available in memory), this match between conditions elicited smoother and faster computer mouse movements than when conditions mismatched. Likewise, when aspect placed emphasis on the less-detailed end state of the event and temporal context was in the distant past (thus making fine details less available), this match between conditions also elicited smoother and faster computer mouse movements.

Processing motion implied in language: eye-movement differences during aspect comprehension.

Previous research on language comprehension has used the eyes as a window into processing. However, these methods are entirely reliant upon using visual or orthographic stimuli that map onto the linguistic stimuli being used. The potential danger of this method is that the pictures used may not perfectly match the internal aspects of language processing. Thus, a method was developed in which participants listened to stories while wearing a head-mounted eyetracker. Preliminary results demonstrate that this method is uniquely suited to measure responses to stimuli in the absence of visual stimulation.

Categorization in the wild.

In studying categorization, cognitive science has focused primarily on cultural categorization, ignoring individual and institutional categorization. Because recent technological developments have made individual and institutional classification systems much more available and powerful, our understanding of the cognitive and social mechanisms that produce these systems is increasingly important. Furthermore, key aspects of categorization that have received little previous attention emerge from considering diverse types of categorization together, such as the social factors that create stability in classification systems, and the interoperability that shared conceptual systems establish between agents. Finally, the profound impact of recent technological developments on classification systems indicates that basic categorization mechanisms are highly adaptive, producing new classification systems as the situations in which they operate change.

The integration of figurative language and static depictions: an eye movement study of fictive motion.

Do we view the world differently if it is described to us in figurative rather than literal terms? An answer to this question would reveal something about both the conceptual representation of figurative language and the scope of top-down influences on scene perception. Previous work has shown that participants will look longer at a path region of a picture when it is described with a type of figurative language called fictive motion (The road goes through the desert) rather than without (The road is in the desert). The current experiment provided evidence that such fictive motion descriptions affect eye movements by evoking mental representations of motion. If participants heard contextual information that would hinder actual motion, it influenced how they viewed a picture when it was described with fictive motion. Inspection times and eye movements scanning along the path increased during fictive motion descriptions when the terrain was first described as difficult (The desert is hilly) as compared to easy (The desert is flat); there were no such effects for descriptions without fictive motion. It is argued that fictive motion evokes a mental simulation of motion that is immediately integrated with visual processing, and hence figurative language can have a distinct effect on perception.

Spatial and linguistic aspects of visual imagery in sentence comprehension.

There is mounting evidence that language comprehension involves the activation of mental imagery of the content of utterances (Barsalou, 1999; Bergen, Chang, & Narayan, 2004; Bergen, Narayan, & Feldman, 2003; Narayan, Bergen, & Weinberg, 2004; Richardson, Spivey, McRae, & Barsalou, 2003; Stanfield & Zwaan, 2001; Zwaan, Stanfield, & Yaxley, 2002). This imagery can have motor or perceptual content. Three main questions about the process remain under-explored, however. First, are lexical associations with perception or motion sufficient to yield mental simulation, or is the integration of lexical semantics into larger structures, like sentences, necessary? Second, what linguistic elements (e.g., verbs, nouns, etc.) trigger mental simulations? Third, how detailed are the visual simulations that are performed? A series of behavioral experiments address these questions, using a visual object categorization task to investigate whether up- or down-related language selectively interferes with visual processing in the same part of the visual field (following Richardson et al., 2003). The results demonstrate that either subject nouns or main verbs can trigger visual imagery, but only when used in literal sentences about real space-metaphorical language does not yield significant effects-which implies that it is the comprehension of the sentence as a whole and not simply lexical associations that yields imagery effects. These studies also show that the evoked imagery contains detail as to the part of the visual field where the described scene would take place.

On the experiential link between spatial and temporal language.

How do we understand time and other entities we can neither touch nor see? One possibility is that we tap into our concrete, experiential knowledge, including our understanding of physical space and motion, to make sense of abstract domains such as time. To examine how pervasive an aspect of cognition this is, we investigated whether thought about a nonliteral type of motion called fictive motion (FM; as in The road runs along the coast) can influence thought about time. Our results suggest that FM uses the same structures evoked in understanding literal motion, and that these literal aspects of FM influence temporal reasoning.

Fictive motion as cognitive simulation.

Sentences such as The road runs through the valley and The mountain range goes from Canada to Mexico include a motion verb but express no explicit motion or state change. It is argued that these sentences involve fictive motion, an implicit type of motion. But do people trying to understand these sentences mentally simulate motion? This question was addressed in four experiments. In each, participants read a story about travel--for instance, fast versus slow, short versus long distance, and easy versus difficult terrain--and then made a timed decision about a fictive motion sentence. Overall, latencies were shorter after they had read about fast travel, short distances, and easy terrains. Critically, the effect did not arise with nonfictive motion target sentences (e.g., The road is in the valley), as was demonstrated in three control studies. The results suggest that the processing of fictive motion includes mental simulation.