Syntax, morphosyntax, and serial recall: How language supports short-term memory.

In the classic view of verbal short-term memory, immediate recall is achieved by maintaining phonological representations, while the influence of other linguistic information is negligible. According to language-based accounts, short-term retention of verbal material is inherently bound to language production and comprehension, thus also influenced by semantic or syntactic factors. In line with this, serial recall is better when lists are presented in a canonical word order for English rather than in a noncanonical order (e.g., when adjectives precede nouns rather than vice versa; Perham et al., 2009, Quarterly Journal of Experimental Psychology, 62[7], 1285-1293). However, in many languages, grammaticality is not exclusively determined by word order. In German, an adjective-noun sequence is grammatical only if the adjective is inflected in congruence with the noun's person, number, and grammatical gender. Therefore, we investigated whether similar effects of syntactic word order occur in German. In two modified replications of Perham et al.'s study, we presented lists of three pairs of adjectives and nouns, presented in adjective-noun or in noun-adjective order. In addition, we manipulated morphosyntactic congruence between nouns and adjectives within pairs (Exp. 1: congruently inflected vs. uninflected adjectives; Exp. 2: congruently inflected vs. incongruently inflected adjectives). Both experiments show an interaction: Word order affected recall performance only when adjectives were inflected in congruence with the corresponding noun. These findings are in line with language-based models and indicate that, in a language that determines grammaticality in an interplay of syntactic and morphosyntactic factors, word order alone is not sufficient to improve verbal short-term memory.

Irrelevant music: How suprasegmental changes of a melody's tempo and mode affect the disruptive potential of music on serial recall.

On tests of verbal short-term memory, performance declines as a function of auditory distraction. The negative impact of to-be-ignored sound on serial recall is known as the irrelevant sound effect. It can occur with speech, sine tones, and music. Moreover, sound that changes acoustically from one token to the next (i.e., changing-state sound) is more disruptive to serial recall than repetitive, steady-state sound. We tested manipulations that resulted in changes in (higher levels of) perceptual organization for more complex tonal stimuli. Within a trial, the first two bars of a well-known melody were repeated (a) in the exact same manner, (b) with variations only in tempo, (c) with variations only in mode (e.g., Dorian or Phrygian), or (d) with variations in both tempo and mode. Participants serially recalled digits in each of the irrelevant sound conditions as well as in a silent control condition. In Experiment 1a, we tested non-music students and, to investigate whether musical expertise affected the findings, additionally tested students majoring in music in Experiment 1b. Across both samples, recall in the irrelevant sound conditions was significantly poorer than in the silent control condition, but only the tempo variation caused an additional harmful effect. The mode variation did not affect recall performance, in either music or non-music students. These findings indicate that, at least with music, changes are a matter of degree and not every additional variation impairs recall performance.

Open-Book Versus Closed-Book Tests in University Classes: A Field Experiment.

The present field study compared open-book testing and closed-book testing in two (parallel) introductory university courses in cognitive psychology. The critical manipulation concerned seven lessons. In these lessons, all students received two to three questions concerning the content of the respective lesson. Half the participants (open-book group) were allowed to use their notes and the course materials, which had been distributed at the beginning of each class; the other half was not allowed to use these materials (closed-book group). A surprise test conducted in the eighth week demonstrated better results for the closed-book group. Further 6 weeks later, the final module exam took place. A number of questions in this exam concerned the learning matters instructed during the critical seven lessons. Even with respect to these questions, the closed-book group performed better than the open-book group. We discuss these results with respect to two possible explanations, retrieval practice and motivational differences.

Talking emotions: vowel selection in fictional names depends on the emotional valence of the to-be-named faces and objects.

One prestudy based on a corpus analysis and four experiments in which participants had to invent novel names for persons or objects (N = 336 participants in total) investigated how the valence of a face or an object affects the phonological characteristics of the respective novel name. Based on the articulatory feedback hypothesis, we predicted that /i:/ is included more frequently in fictional names for faces or objects with a positive valence than for those with a negative valence. For /o:/, the pattern should reverse. An analysis of the Berlin Affective Word List - Reloaded (BAWL-R) yielded a higher number of occurrences of /o:/ in German words with negative valence than in words with positive valence; with /i:/ the situation is less clear. In Experiments 1 and 2, participants named persons showing a positive or a negative facial expression. Names for smiling persons included more /i:/s and fewer /o:/s than names for persons with a negative facial expression. In Experiments 3 and 4, participants heard a Swahili narration and invented pseudo-Swahili names for objects with positive, neutral, or negative valence. Names for positive objects included more /i:/s than names for neutral or negative objects, and names for negative objects included more /o:/s than names for neutral or positive objects. These finding indicate a stable vowel-emotion link.

Benchmarks for models of short-term and working memory.

Any mature field of research in psychology-such as short-term/working memory-is characterized by a wealth of empirical findings. It is currently unrealistic to expect a theory to explain them all; theorists must satisfice with explaining a subset of findings. The aim of the present article is to make the choice of that subset less arbitrary and idiosyncratic than is current practice. We propose criteria for identifying benchmark findings that every theory in a field should be able to explain: Benchmarks should be reproducible, generalize across materials and methodological variations, and be theoretically informative. We propose a set of benchmarks for theories and computational models of short-term and working memory. The benchmarks are described in as theory-neutral a way as possible, so that they can serve as empirical common ground for competing theoretical approaches. Benchmarks are rated on three levels according to their priority for explanation. Selection and ratings of the benchmarks is based on consensus among the authors, who jointly represent a broad range of theoretical perspectives on working memory, and they are supported by a survey among other experts on working memory. The article is accompanied by a web page providing an open forum for discussion and for submitting proposals for new benchmarks; and a repository for reference data sets for each benchmark. (PsycINFO Database Record

Benchmarks provide common ground for model development: Reply to Logie (2018) and Vandierendonck (2018).

We respond to the comments of Logie and Vandierendonck to our article proposing benchmark findings for evaluating theories and models of short-term and working memory. The response focuses on the two main points of criticism: (a) Logie and Vandierendonck argue that the scope of the set of benchmarks is too narrow. We explain why findings on how working memory is used in complex cognition, findings on executive functions, and findings from neuropsychological case studies are currently not included in the benchmarks, and why findings with visual and spatial materials are less prevalent among them. (b) The critics question the usefulness of the benchmarks and their ratings for advancing theory development. We explain why selecting and rating benchmarks is important and justifiable, and acknowledge that the present selection and rating decisions are in need of continuous updating. The usefulness of the benchmarks of all ratings is also enhanced by our concomitant online posting of data for many of these benchmarks. (PsycINFO Database Record

Is testing a more effective learning strategy than note-taking?

The testing effect is both robust and generalizable. However, most of the underlying studies compare testing to a rather ineffective control condition: massed repeated reading. This article therefore compares testing with note-taking, which has been shown to be more effective than repeated reading. Experiment 1 is based on a 3 × 3 between-participants design with the factors learning condition (repeated reading vs. repeated testing vs. repeated note-taking) and final test delay (5 min vs. 1 week vs. 2 weeks). It shows that in the immediate condition, learning performance is best after note-taking. After 1 week, both the note-taking and the testing groups outperform the rereading group, and after 2 weeks, testing is superior to both note-taking and rereading. Since repeated notetaking may not be the most effective (and common) operationalization of note-taking, Experiment 2 contrasts repeated testing with 2 other note-taking conditions: note-taking plus note-reading and note-taking plus testing (with only a 2-week final test delay). Both conditions that include a testing phase result in better long-term learning than note-taking plus note-reading. In summary, our findings indicate that-in the long run-testing is a powerful learning tool both in isolation and in combination with note-taking. (PsycINFO Database Record

Does verbatim sentence recall underestimate the language competence of near-native speakers?

Verbatim sentence recall is widely used to test the language competence of native and non-native speakers since it involves comprehension and production of connected speech. However, we assume that, to maintain surface information, sentence recall relies particularly on attentional resources, which differentially affects native and non-native speakers. Since even in near-natives language processing is less automatized than in native speakers, processing a sentence in a foreign language plus retaining its surface may result in a cognitive overload. We contrasted sentence recall performance of German native speakers with that of highly proficient non-natives. Non-natives recalled the sentences significantly poorer than the natives, but performed equally well on a cloze test. This implies that sentence recall underestimates the language competence of good non-native speakers in mixed groups with native speakers. The findings also suggest that theories of sentence recall need to consider both its linguistic and its attentional aspects.

Mood is linked to vowel type: the role of articulatory movements.

This study investigates the relation between vowel identity and emotional state. In Experiment 1, (pseudo)words were invented and articulated in a positive or negative mood condition. Subjects in a positive mood produced more words containing /i:/, a vowel involving the same muscle that is used in smiling--the zygomaticus major muscle (ZMM). Subjects in a negative mood produced more words containing /o:/, involving an antagonist of the ZMM--the orbicularis orbis muscle (OOM). We argue that the link between mood and vowel identity is related to orofacial muscle activity, which provides articulatory feedback to speakers on their emotional state. Experiment 2 tests this hypothesis more specifically. Participants rated the funniness of cartoons while repeatedly articulating either /i:/ (ZMM) or /o:/ (OOM). In line with our hypothesis, the cartoons were rated as funnier by subjects articulating /i:/ than by those articulating /o:/.

Two Modality Effects in Verbal Short-Term Memory: Evidence from Sentence Recall.

This paper investigates the mechanisms underlying the standard modality effect (i.e., better recall performance for auditorily presented than for visually presented materials), and the modality congruency effect (i.e., better memory performance if the mode of recall and presentation are congruent rather than incongruent, Rummer, Schweppe, & Martin, 2009). We tested the assumption that the standard modality effect is restricted to the most recent word(s) of the sentences but occurs in both verbatim and gist recall (Experiments 1 and 2), whereas the modality congruency effect should be evident for the rest of the sentence when using verbatim recall (Experiment 3) but not when using gist recall (Experiment 4). All experiments used the Potter-Lombardi intrusion paradigm (Potter & Lombardi, 1990). When the target word was the most recent word of the sentence, a standard modality effect was found with both verbatim recall and gist recall. When the target word was included in the middle of the sentences, a modality congruency effect was found with verbatim recall but not with gist recall.

The perceptual basis of the modality effect in multimedia learning.

Various studies have demonstrated an advantage of auditory over visual text modality when learning with texts and pictures. To explain this modality effect, two complementary assumptions are proposed by cognitive theories of multimedia learning: first, the visuospatial load hypothesis, which explains the modality effect in terms of visuospatial working memory overload in the visual text condition; and second, the temporal contiguity assumption, according to which the modality effect occurs because solely auditory texts and pictures can be attended to simultaneously. The latter explanation applies only to simultaneous presentation, the former to both simultaneous and sequential presentation. This paper introduces a third explanation, according to which parts of the modality effect are due to early, sensory processes. This account predicts that-for texts longer than one sentence-the modality effect with sequential presentation is restricted to the information presented most recently. Two multimedia experiments tested the influence of text modality across three different conditions: simultaneous presentation of texts and pictures versus sequential presentation versus presentation of text only. Text comprehension and picture recognition served as dependent variables. An advantage for auditory texts was restricted to the most recent text information and occurred under all presentation conditions. With picture recognition, the modality effect was restricted to the simultaneous condition. These findings clearly support the idea that the modality effect can be attributed to early processes in perception and sensory memory rather than to a working memory bottleneck.

Semantic and phonological information in sentence recall: converging psycholinguistic and neuropsychological evidence.

We present one experiment and a neuropsychological case study to investigate to what extent phonological and semantic representations contribute to short-term sentence recall. We modified Potter and Lombardi's (1990) intrusion paradigm, in which retention of a list interferes with sentence recall such that on the list a semantically related lure is presented, which is expected to intrude into sentence recall. In our version, lure words are either semantically related to target words in the sentence or semantically plus phonologically related. With healthy participants, intrusions are more frequent when lure and target overlap phonologically in addition to semantically than when they solely overlap semantically. When this paradigm is applied to a patient with a phonological short-term memory impairment, both lure types induce the same amount of intrusions. These findings indicate that usually phonological information is retained in sentence recall in addition to semantic information.

Beyond sentence boundaries: grammatical gender information in short-term recall of texts.

In the context of text recall it is often stated that surface representations are quickly forgotten. Jarvella (1971) and Sachs (1967) argued that what is retained beyond sentence boundaries is meaning information, whereas lexical and syntactic information is only available for the most recent constituent. We based a text recall experiment on Jarvella's paradigm, in order to demonstrate that both meaning and grammatical gender information contribute to the recall of short text passages. Although it is known that grammatical gender information is used in anaphor resolution, even if noun and pronoun do not belong to adjacent sentences, there is no direct evidence for a gender contribution to text memory so far. The present experiment demonstrates that grammatical gender information, even when of no semantic importance, is retained beyond sentence boundaries and can contribute to the memory representation of subsequent text. All materials and additional statistics may be downloaded from mc.psychonomic-journals.org/content/supplemental.

Evidence for a modality effect in sentence retention.

It is well known that an acoustic-sensory code supports retention of linguistic materials whose storage is particularly based on phonological information (e.g., unrelated word lists). The present study investigates whether such a code also contributes to the retention of sentences. It has been shown that short-term sentence recall particularly depends on propositional and lexicosemantic information, which are assumed to be supplied independently of modality influences. We employed the intrusion paradigm of Potter and Lombardi (1990) and manipulated the availability of acoustic-sensory information. Participants were instructed to read sentences either silently or aloud. Since these two reading conditions also differ with respect to articulatory information, a further condition that provided articulatory but not acoustic-sensory information was introduced (i.e., silent mouthing). Our data suggest that acoustic-sensory information is used, if available, even in sentence recall.