Phrasal Synchronization of Gesture With Prosody and Information Structure.

This study investigates the synchronization of manual gestures with prosody and information structure using Turkish natural speech data. Prosody has long been linked to gesture as a key driver of gesture-speech synchronization. Gesture has a hierarchical phrasal structure similar to prosody. At the lowest level, gesture has been shown to be synchronized with prosody (e.g., apexes and pitch accents). However, less is known about higher levels. Even less is known about timing relationships with information structure, though this is signaled by prosody and linked to gesture. The present study analyzed phrase synchronization in 3 hr of narrations in Turkish annotated for gesture, prosody, and information structure-topics and foci. The analysis of 515 gesture phrases showed that there was no one-to-one synchronization with intermediate phrases, but their onsets and offsets were synchronized. Moreover, information structural units, topics, and foci were closely synchronized with gesture phrase medial stroke + post-hold combinations (i.e., apical areas). In addition, iconic and metaphoric gestures were more likely to be paired with foci, and deictics with topics. Overall, the results confirm synchronization of gesture and prosody at the phrasal level and provide evidence that gesture shows a direct sensitivity to information structure. These show that speech and gesture production are more connected than assumed in existing production models.

Focus Effects on Immediate and Delayed Recognition of Referents in Samoan.

This paper looks at the effect of focus-marking on the immediate and delayed recognition of referents in Samoan. Focus-marking on a word can imply the presence of alternatives to that word which are relevant to the interpretation of the utterance. Consistent with this, psycholinguistic evidence is growing that alternatives to focus-marked words are selectively activated in the immediate processing of an utterance and longer term memory. However, most of this research is on Western Germanic languages which primarily use prosodic prominence to mark focus. We explore this in two experiments using immediate and delayed probe recognition tasks in the under-studied language Samoan, which primarily uses syntactic focus-marking. Participants heard short narratives ending in a critical sentence in which the object word was either focused or not, using a cleft-like construction. In the first experiment, probe recognition, alternatives to the object word which were either mentioned or unmentioned in the narrative were responded to more slowly if the object was focus-marked. In the second experiment, delayed recognition, participants were faster to correctly recognize mentioned alternatives, and slower to reject unmentioned, if the object was focus-marked. Both results are consistent with immediate and longer-term activation of focus alternatives. There was no significant effect of focus-marking on recognition of the object word itself.

The Role of Prominence in Activating Focused Words and Their Alternatives in Mandarin: Evidence from Lexical Priming and Recognition Memory.

When a sentence is produced with contrastive prosodic prominence, the word that carries the prominence becomes more salient, and alternatives to that word are usually implied. In processing, this implies that focused words and their alternatives should be more strongly activated. Previous research on focus processing has primarily been confined to Germanic languages. The current paper reports on two experiments investigating the role of prosodic prominence in immediate (Experiment 1) and long-term processing (Experiment 2) of focused words and focus alternatives in Mandarin. Prosodic prominence was effective in activating focused words and their alternatives. In the memory task, this facilitation effect was only found toward the beginning of the experiment. We attribute this difference to task-related adaptive use of prosodic prominence in utterance processing. This research sheds light on whether, when, and how listeners use prosodic prominence to identify important information and to evoke alternatives during sentence comprehension.

Prosodic Prominence and Focus: Expectation Affects Interpretation in Samoan and English.

This paper looks at the perception of prosodic prominence and the interpretation of focus position in the unrelated languages, Samoan and English. In many languages, prosodic prominence is a key marker of focus, so it is expected that prosodic prominence would affect judgments of focus position. However, it is shown that focus position, in turn, influences the perception of prosodic prominence according to language-specific expectations about the alignment between focus position and nuclear accent placement. Two sets of parallel perception experiments in Samoan and English are reported. In the first, participants judged the most prosodically prominent word in sentences which varied in syntactic construction (cleft/canonical) and intended stress position (subject/object). In both languages, participants were more likely to choose the intended stressed word if it was in the focus position. However, this effect was much larger in Samoan, which fits with its relatively lower functionality of prosodic prominence. In the second experiment, participants were asked to choose which question had been asked, consistent with subject or object focus. It was found that in both languages, participants weighted syntactic and prosodic cues to focus in line with expectations from their language. These findings have implications for how we conceive the role of prosodic prominence in speech processing across languages.

Priming Effects of Focus in Mandarin Chinese.

Psycholinguistic research has long established that focus-marked words have a processing advantage over other words in an utterance, e.g., they are recognized more quickly and remembered better. More recently, studies have shown that listeners infer contextual alternatives to a focused word in a spoken utterance, when marked with a contrastive accent, even when the alternatives are not explicitly mentioned in the discourse. This has been shown by strengthened priming of contextual alternatives to the word, but not other non-contrastive semantic associates, when it is contrastively accented, e.g., after hearing "The customer opened the window," salesman is strongly primed, but not product. This is consistent with Rooth's (1992) theory that focus-marking signals the presence of alternatives to the focus. However, almost all of the research carried out in this area has been on Germanic languages. Further, most of this work has looked only at one kind of focus-marking, by contrastive accenting (prosody). This paper reports on a cross-modal lexical priming study in Mandarin Chinese, looking at whether focus-marking heightens activation, i.e., priming, of words and their alternatives. Two kinds of focus-marking were investigated: prosodic and syntactic. Prosodic prominence is an important means of focus-marking in Chinese, however, it is realized through pitch range expansion, rather than accenting. The results showed that focused words, as well as their alternatives, were primed when the subject prime word carried contrastive prosodic prominence. Syntactic focus-marking, however, did not enhance priming of focused words or their alternatives. Non-contrastive semantic associates were not primed with either kind of focus-marking. These results extend previous findings on focus and alternative priming for the first time to Chinese. They also suggest that the processing advantages of focus, including priming alternatives, are particularly related to prosodic prominence, at least in Chinese and Germanic languages. This research sheds light on what linguistic mechanisms listeners use to identify important information, generate alternatives, and understand implicature necessary for successful communication.