Large-scale patterns of number use in spoken and written English.

This paper describes patterns of number use in spoken and written English and the main factors that contribute to these patterns. We analysed more than 1.7 million occurrences of numbers between 0 and a billion in the British National Corpus, including conversational speech, presentational speech (e.g., lectures, interviews), imaginative writing (e.g., fiction), and informative writing (e.g., academic books). We find that four main factors affect number frequency: (1) Magnitude - smaller numbers are more frequent than larger numbers; (2) Roundness - round numbers are more frequent than unround numbers of a comparable magnitude, and some round numbers are more frequent than others; (3) Cultural salience - culturally salient numbers (e.g., recent years) are more frequent than non-salient numbers; and (4) Register - more informational texts contain more numbers (in writing), types of numbers, decimals, and larger numbers than less informational texts. In writing, we find that the numbers 1-9 are mostly represented by number words (e.g., 'three'), 10-999,999 are mostly represented by numerals (e.g., '14'), and 1 million-1 billion are mostly represented by a mix of numerals and number words (e.g., '8 million'). Altogether, this study builds a detailed profile of number use in spoken and written English.

Viewing angle matters in British Sign Language processing.

The impact of adverse listening conditions on spoken language perception is well established, but the role of suboptimal viewing conditions on signed language processing is less clear. Viewing angle, i.e. the physical orientation of a perceiver relative to a signer, varies in many everyday deaf community settings for L1 signers and may impact comprehension. Further, processing from various viewing angles may be more difficult for late L2 learners of a signed language, with less variation in sign input while learning. Using a semantic decision task in a distance priming paradigm, we show that British Sign Language signers are slower and less accurate to comprehend signs shown from side viewing angles, with L2 learners in particular making disproportionately more errors when viewing signs from side angles. We also investigated how individual differences in mental rotation ability modulate processing signs from different angles. Speed and accuracy on the BSL task correlated with mental rotation ability, suggesting that signers may mentally represent signs from a frontal view, and use mental rotation to process signs from other viewing angles. Our results extend the literature on viewpoint specificity in visual recognition to linguistic stimuli. The data suggests that L2 signed language learners should maximise their exposure to diverse signed language input, both in terms of viewing angle and other difficult viewing conditions to maximise comprehension.

Iconicity ratings for 14,000+ English words.

Iconic words and signs are characterized by a perceived resemblance between aspects of their form and aspects of their meaning. For example, in English, iconic words include peep and crash, which mimic the sounds they denote, and wiggle and zigzag, which mimic motion. As a semiotic property of words and signs, iconicity has been demonstrated to play a role in word learning, language processing, and language evolution. This paper presents the results of a large-scale norming study for more than 14,000 English words conducted with over 1400 American English speakers. We demonstrate the utility of these ratings by replicating a number of existing findings showing that iconicity ratings are related to age of acquisition, sensory modality, semantic neighborhood density, structural markedness, and playfulness. We discuss possible use cases and limitations of the rating dataset, which is made publicly available.

Multimodality matters in numerical communication.

Modern society depends on numerical information, which must be communicated accurately and effectively. Numerical communication is accomplished in different modalities-speech, writing, sign, gesture, graphs, and in naturally occurring settings it almost always involves more than one modality at once. Yet the modalities of numerical communication are often studied in isolation. Here we argue that, to understand and improve numerical communication, we must take seriously this multimodality. We first discuss each modality on its own terms, identifying their commonalities and differences. We then argue that numerical communication is shaped critically by interactions among modalities. We boil down these interactions to four types: one modality can amplify the message of another; it can direct attention to content from another modality (e.g., using a gesture to guide attention to a relevant aspect of a graph); it can explain another modality (e.g., verbally explaining the meaning of an axis in a graph); and it can reinterpret a modality (e.g., framing an upwards-oriented trend as a bad outcome). We conclude by discussing how a focus on multimodality raises entirely new research questions about numerical communication.

More is Better: English Language Statistics are Biased Toward Addition.

We have evolved to become who we are, at least in part, due to our general drive to create new things and ideas. When seeking to improve our creations, ideas, or situations, we systematically overlook opportunities to perform subtractive changes. For example, when tasked with giving feedback on an academic paper, reviewers will tend to suggest additional explanations and analyses rather than delete existing ones. Here, we show that this addition bias is systematically reflected in English language statistics along several distinct dimensions. First, we show that words associated with an increase in quantity or number (e.g., add, addition, more, most) are more frequent than words associated with a decrease in quantity or number (e.g., subtract, subtraction, less, least). Second, we show that in binomial expressions, addition-related words are mentioned first, that is, add and subtract rather than subtract and add. Third, we show that the distributional semantics of verbs of change, such as to improve and to transform, overlap more with the distributional semantics of add/increase than subtract/decrease, which suggests that change verbs are implicitly biased toward addition. Fourth, addition-related words have more positive connotations than subtraction-related words. Fifth, we demonstrate that state-of-the-art large language models, such as the Generative Pre-trained Transformer (GPT-3), are also biased toward addition. We discuss the implications of our results for research on cognitive biases and decision-making.

Abstract concepts and emotion: cross-linguistic evidence and arguments against affective embodiment.

How are abstract concepts such as 'freedom' and 'democracy' represented in the mind? One prominent proposal suggests that abstract concepts are grounded in emotion. Supporting this 'affective embodiment' account, abstract concepts are rated to be more strongly positive or more strongly negative than concrete concepts. This paper demonstrates that this finding generalizes across languages by synthesizing rating data from Cantonese, Mandarin Chinese, Croatian, Dutch, French, German, Indonesian, Italian, Polish and Spanish. However, a deeper look at the same data suggests that the idea of emotional grounding only characterizes a small subset of abstract concepts. Moreover, when the concreteness/abstractness dimension is not operationalized using concreteness ratings, it is actually found that concrete concepts are rated as more emotional than abstract ones. Altogether, these results suggest limitations to the idea that emotion is an important factor in the grounding of abstract concepts. This article is part of the theme issue 'Concepts in interaction: social engagement and inner experiences'.

Tracing the Phonetic Space of Prosodic Focus Marking.

Focus is known to be expressed by a wide range of phonetic cues but only a few studies have explicitly compared different phonetic variables within the same experiment. Therefore, we presented results from an analysis of 19 phonetic variables conducted on a data set of the German language that comprises the opposition of unaccented (background) vs. accented (in focus), as well as different focus types with the nuclear accent on the same syllable (broad, narrow, and contrastive focus). The phonetic variables are measures of the acoustic and articulographic signals of a target syllable. Overall, our results provide the highest number of reliable effects and largest effect sizes for accentuation (unaccented vs. accented), while the differentiation of focus types with accented target syllables (broad, narrow, and contrastive focus) are more subtle. The most important phonetic variables across all conditions are measures of the fundamental frequency. The articulatory variables and their corresponding acoustic formants reveal lower tongue positions for both vowels /o, a/, and larger lip openings for the vowel /a/ under increased prosodic prominence with the strongest effects for accentuation. While duration exhibits consistent mid-ranked results for both accentuation and the differentiation of focus types, measures related to intensity are particularly important for accentuation. Furthermore, voice quality and spectral tilt are affected by accentuation but also in the differentiation of focus types. Our results confirm that focus is realized via multiple phonetic cues. Additionally, the present analysis allows a comparison of the relative importance of different measures to better understand the phonetic space of focus marking.

Trilled /r/ is associated with roughness, linking sound and touch across spoken languages.

Cross-modal integration between sound and texture is important to perception and action. Here we show this has repercussions for the structure of spoken languages. We present a new statistical universal linking speech with the evolutionarily ancient sense of touch. Words that express roughness-the primary perceptual dimension of texture-are highly likely to feature a trilled /r/, the most commonly occurring rhotic consonant. In four studies, we show the pattern to be extremely robust, being the first widespread pattern of iconicity documented not just across a large, diverse sample of the world's spoken languages, but also across numerous sensory words within languages. Our deep analysis of Indo-European languages and Proto-Indo-European roots indicates remarkable historical stability of the pattern, which appears to date back at least 6000 years.

Conceptual Metaphor and Graphical Convention Influence the Interpretation of Line Graphs.

Many metaphors in language reflect conceptual metaphors that structure thought. In line with metaphorical expressions such as 'high number', experiments show that people associate larger numbers with upward space. Consistent with this metaphor, high numbers are conventionally depicted in high positions on the y-axis of line graphs. People also associate good and bad (emotional valence) with upward and downward locations, in line with metaphorical expressions such as 'uplifting' and 'down in the dumps'. Graphs depicting good quantities (e.g., vacation days) are consistent with graphical convention and the valence metaphor, because 'more' of the good quantity is represented by higher y-axis positions. In contrast, graphs depicting bad quantities (e.g., murders) are consistent with graphical convention, but not the valence metaphor, because more of the bad quantity is represented by higher (rather than lower) y-axis positions. We conducted two experiments (N = 300 per experiment) where participants answered questions about line graphs depicting good and bad quantities. For some graphs, we inverted the conventional axis ordering of numbers. Line graphs that aligned (versus misaligned) with valence metaphors (up = good) were easier to interpret, but this beneficial effect did not outweigh the adverse effect of inverting the axis numbering. Line graphs depicting good (versus bad) quantities were easier to interpret, as were graphs that depicted quantity using the x-axis (versus y-axis). Our results suggest that conceptual metaphors matter for the interpretation of line graphs. However, designers of line graphs are warned against subverting graphical convention to align with conceptual metaphors.

The bouba/kiki effect is robust across cultures and writing systems.

The bouba/kiki effect-the association of the nonce word bouba with a round shape and kiki with a spiky shape-is a type of correspondence between speech sounds and visual properties with potentially deep implications for the evolution of spoken language. However, there is debate over the robustness of the effect across cultures and the influence of orthography. We report an online experiment that tested the bouba/kiki effect across speakers of 25 languages representing nine language families and 10 writing systems. Overall, we found strong evidence for the effect across languages, with bouba eliciting more congruent responses than kiki. Participants who spoke languages with Roman scripts were only marginally more likely to show the effect, and analysis of the orthographic shape of the words in different scripts showed that the effect was no stronger for scripts that use rounder forms for bouba and spikier forms for kiki. These results confirm that the bouba/kiki phenomenon is rooted in crossmodal correspondence between aspects of the voice and visual shape, largely independent of orthography. They provide the strongest demonstration to date that the bouba/kiki effect is robust across cultures and writing systems. This article is part of the theme issue 'Voice modulation: from origin and mechanism to social impact (Part II)'.

Rethinking the frequency code: a meta-analytic review of the role of acoustic body size in communicative phenomena.

The widely cited frequency code hypothesis attempts to explain a diverse range of communicative phenomena through the acoustic projection of body size. The set of phenomena includes size sound symbolism (using /i/ to signal smallness in words such as teeny), intonational phonology (using rising contours to signal questions) and the indexing of social relations via vocal modulation, such as lowering one's voice pitch to signal dominance. Among other things, the frequency code is commonly interpreted to suggest that polite speech should be universally signalled via high pitch owing to the association of high pitch with small size and submissiveness. We present a cross-cultural meta-analysis of polite speech of 101 speakers from seven different languages. While we find evidence for cross-cultural variation, voice pitch is on average lower when speakers speak politely, contrary to what the frequency code predicts. We interpret our findings in the light of the fact that pitch has a multiplicity of possible communicative meanings. Cultural and contextual variation determines which specific meanings become manifest in a specific interactional context. We use the evidence from our meta-analysis to propose an updated view of the frequency code hypothesis that is based on the existence of many-to-many mappings between speech acoustics and communicative interpretations. This article is part of the theme issue 'Voice modulation: from origin and mechanism to social impact (Part I)'.

Novel vocalizations are understood across cultures.

Linguistic communication requires speakers to mutually agree on the meanings of words, but how does such a system first get off the ground? One solution is to rely on iconic gestures: visual signs whose form directly resembles or otherwise cues their meaning without any previously established correspondence. However, it is debated whether vocalizations could have played a similar role. We report the first extensive cross-cultural study investigating whether people from diverse linguistic backgrounds can understand novel vocalizations for a range of meanings. In two comprehension experiments, we tested whether vocalizations produced by English speakers could be understood by listeners from 28 languages from 12 language families. Listeners from each language were more accurate than chance at guessing the intended referent of the vocalizations for each of the meanings tested. Our findings challenge the often-cited idea that vocalizations have limited potential for iconic representation, demonstrating that in the absence of words people can use vocalizations to communicate a variety of meanings.

Metaphor and the Philosophical Implications of Embodied Mathematics.

Embodied approaches to cognition see abstract thought and language as grounded in interactions between mind, body, and world. A particularly important challenge for embodied approaches to cognition is mathematics, perhaps the most abstract domain of human knowledge. Conceptual metaphor theory, a branch of cognitive linguistics, describes how abstract mathematical concepts are grounded in concrete physical representations. In this paper, we consider the implications of this research for the metaphysics and epistemology of mathematics. In the case of metaphysics, we argue that embodied mathematics is neutral in the sense of being compatible with all existing accounts of what mathematical entities really are. However, embodied mathematics may be able to revive an older position known as psychologism and overcome the difficulties it faces. In the case of epistemology, we argue that the evidence collected in the embodied mathematics literature is inconclusive: It does not show that abstract mathematical thinking is constituted by metaphor; it may simply show that abstract thinking is facilitated by metaphor. Our arguments suggest that closer interaction between the philosophy and cognitive science of mathematics could yield a more precise, empirically informed account of what mathematics is and how we come to have knowledge of it.

'Tiny numbers' are actually tiny: Evidence from gestures in the TV News Archive.

We report a large-scale, quantitative investigation of manual gestures that speakers perform when speaking metaphorically about numerical quantities. We used the TV News Archive-an online database of over 2 million English language news broadcasts-to examine 681 videos in which 584 speakers used the phrase 'tiny number', 'small number', 'large number', or 'huge number', which metaphorically frame numerical quantity in terms of physical size. We found that the gestures speakers used reflect a number of different strategies to express the metaphoric size of quantities. When referring to greater versus lesser quantities, speakers were far more likely to gesture (1) with an open versus closed hand configuration, (2) with an outward versus inward movement, and (3) with a wider distance between the gesturing hands. These patterns were often more pronounced for the phrases containing more extreme adjectives ('tiny/huge number'). However, we did not find that speakers performed two-handed versus one-handed gestures. Nor did we find that speakers performed right-handed versus left-handed gestures, when referring to greater versus lesser quantities. Overall, this work supports the claim that metaphoric thought is involved in the production of verbal metaphors that describe numerical magnitudes. It demonstrates that size-based numerical associations observed in previous lab experiments are active in real-life communication outside the lab.

Can co-speech gestures alone carry the mental time line?

Time and space have been shown to be interlinked in people's minds. To what extent can co-speech gestures influence thinking about time, over and above spoken language? In this study, we use the ambiguous question "Next Wednesday's meeting has been moved forward two days, what day is it on now?" to show that people either respond "Monday" or "Friday," depending on gesture. We manipulated both language (using either the adverb "forward," or the adverb "backward") and gesture (forward and backward movement), thus creating matches and mismatches between speech and gesture. Results show that the speech manipulation exerts a stronger influence on people's temporal perspectives than gesture. Moreover, the effect of gesture disappears completely for certain hand shapes and if non-movement language is used ("changed by two days" as opposed to "moved by two days"). We additionally find that the strength of the gesture effect is moderated by likability: When people like the gesturer, they are more prone to assuming their perspective, which completely changes the meaning of forward and backward gestural movements. Altogether, our results suggest that gesture does play a role in thinking about time, but this role is auxiliary when compared with speech, and the degree to which gesture matters depends on one's social relation to the gesturer. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Intonation does aid serial recall after all.

A sequence of spoken digits is easier to recall if the digits are grouped into smaller chunks (e.g., through the insertion of pauses). It has been claimed that intonation does not facilitate recall over and above the effect achieved by pauses. This may be related to the fact that past research has used synthesized intonation contours. In this replication study, we show that intonation does provide benefits once more naturalistic intonation contours are used. This benefit is independent of response modality (spoken responses, keyboard responses, or handwritten responses in a grid). We furthermore show that intonation differentially affects specific positions within the sequence of digits. Crucially, our results suggest that researchers and clinicians need to pay attention to intonation when assessing working memory using spoken language.

Loudness Trumps Pitch in Politeness Judgments: Evidence from Korean Deferential Speech.

Social meaning is not conveyed through words alone, but also through how words are produced phonetically. This paper investigates the role of loudness and pitch in determining the perception of politeness-related judgments in Korean. It has been proposed that high pitch is universally associated with polite or deferential social meanings. In contrast to this, Experiment 1 examined the perceptual effect of pitch and found no effect. Experiment 2 tested the effect of loudness, and found that listeners associate quieter speech with deference. Finally, Experiment 3 investigated the simultaneous effects of loudness and pitch, and found again that loudness had a consistent effect, whereas pitch only had a weak effect. Analyses of individual differences suggest that in contrast to loudness, which is interpreted uniformly across Korean listeners, pitch has more variegated social meanings: Some listeners associate high pitch with deferential meaning, others associate low pitch with deferential meaning. Thus, we find loudness to be a more unambiguous indicator of deferential speech than pitch. These findings shed light on how different acoustic properties contribute to the indexing of social stances, and they suggest that the role of pitch in conveying politeness may have been overstated in past research.

The sound of soft alcohol: Crossmodal associations between interjections and liquor.

An increasing number of studies reveal crossmodal correspondences between speech sounds and perceptual features such as shape and size. In this study, we show that an interjection Koreans produce when downing a shot of liquor reliably triggers crossmodal associations in American English, German, Spanish, and Chinese listeners who do not speak Korean. Based on how this sound is used in advertising campaigns for the Korean liquor soju, we derive predictions for different crossmodal associations. Our experiments show that the same speech sound is reliably associated with various perceptual, affective, and social meanings. This demonstrates what we call the 'pluripotentiality' of iconicity, that is, the same speech sound is able to trigger a web of interrelated mental associations across different dimensions. We argue that the specific semantic associations evoked by iconic stimuli depend on the task, with iconic meanings having a 'latent' quality that becomes 'actual' in specific semantic contexts. We outline implications for theories of iconicity and advertising.

Decoding Gestural Iconicity.

Speakers frequently perform representational gestures to depict concepts in an iconic fashion. For example, a speaker may hold her index finger and thumb apart to indicate the size of a matchstick. However, the process by which a physical handshape is mentally transformed into abstract spatial information is not well understood. We present a series of experiments that investigate how people decode the physical form of an articulator to derive imaginary geometrical constructs, which we call "gesture form." We provide quantitative evidence for several key properties that play a role in this process. First, "profiling," the ability to focus on a structural subunit within the complex form of the physical hand. Second, "perspective," for which we show that one and the same handshape seen from different perspectives can lead to different spatial interpretations. Third, "selectivity," the fact that gestures focus on specific spatial features at the expense of others. Our results provide a first step toward mapping out the process of how representational gestures make the communication of spatial information possible.