The effect of retrieval practice on vocabulary learning for DHH children.

On average, deaf and hard-of-hearing (DHH) children have difficulty developing expressive spoken vocabulary comparable to hearing peers. Yet, there are no evidence-based practices to guide classroom instruction for teachers of the deaf. Retrieval practice-a robust learning strategy-has been shown to improve children's retention of vocabulary, but it has not been investigated with DHH children who use listening and spoken language. The present study examined whether DHH children benefit from using retrieval practice to learn new vocabulary. Sixteen DHH children (in the age range of 5.0-8.11 years) were taught a set of new vocabulary words using retrieval practice or repeated exposure. A recall test was administered two days later. Results showed that DHH children were twice as likely to recall a word taught through retrieval practice than exposure (OR = 2.01, p = .02). Presence of an additional diagnosis and number of practice trials were also significant predicting factors of vocabulary learning.

Retrieving and applying knowledge to different examples promotes transfer of learning.

Introducing variability during learning often facilitates transfer to new contexts (i.e., generalization). The goal of the present study was to explore the concept of variability in an area of research where its effects have received little attention: learning through retrieval practice. In four experiments, we investigated whether retrieval practice with different examples of a concept promotes greater transfer than repeated retrieval practice with the same example. Participants watched video clips from a lecture about geological science and answered application questions about concepts: either the same question three times or three different questions. Experiments 3 and 4 also included conditions that involved repeatedly studying the information in the application questions (either the same example or three different examples). Two days later, participants took a final test with new application questions. All four experiments showed that variability during retrieval practice produced superior transfer of knowledge to new examples. Experiments 3 and 4 also showed a testing effect and a benefit from studying different examples. Overall, these findings suggest that repeatedly retrieving and applying knowledge to different examples is a powerful method for acquiring knowledge that will transfer to a variety of new contexts. (PsycINFO Database Record

Visual imagery in autobiographical memory: The role of repeated retrieval in shifting perspective.

Recent memories are generally recalled from a first-person perspective whereas older memories are often recalled from a third-person perspective. We investigated how repeated retrieval affects the availability of visual information, and whether it could explain the observed shift in perspective with time. In Experiment 1, participants performed mini-events and nominated memories of recent autobiographical events in response to cue words. Next, they described their memory for each event and rated its phenomenological characteristics. Over the following three weeks, they repeatedly retrieved half of the mini-event and cue-word memories. No instructions were given about how to retrieve the memories. In Experiment 2, participants were asked to adopt either a first- or third-person perspective during retrieval. One month later, participants retrieved all of the memories and again provided phenomenology ratings. When first-person visual details from the event were repeatedly retrieved, this information was retained better and the shift in perspective was slowed.

Effects of Team-Based Learning on short-term and long-term retention of factual knowledge.

PURPOSE: We investigated the effect of Team-Based Learning (TBL) on long-term retention of knowledge in comparison to a traditional curriculum. METHODS: As TBL was incorporated into our curriculum in the 2008-2009 academic year, students were compared with those who received the traditional curriculum the year prior. Students in both the groups completed multiple-choice knowledge test at four time points spanning two years. Test performance was compared at each time point to assess changes in knowledge retention as a function of time. RESULTS: Baseline knowledge did not differ significantly between the TBL and control groups [51% versus 46%; t(84) = 0.91, p = 0.37, d = 0.20]. Performance improved after the course for both the groups, but was significantly higher in the TBL group [79% versus 59%; t(84) = 4.96, p = 0.000004, d = 0.95]. However, when assessed prior to the pediatrics clerkship, learning gains from TBL had largely disappeared and the small difference in performance was not significant [57% versus 51%; t(84) = 1.51, p = 0.14, d = 0.32]. CONCLUSION: Incorporating TBL into the pre-clinical pediatrics curriculum led to large gains in knowledge over the short-term, but these gains did not persist. Further research should focus on extending the impact of TBL on long-term knowledge retention.

An open-label, single-arm, phase 1 study to assess biomarker effects, efficacy and safety of ofatumumab in patients with refractory chronic lymphocytic leukemia.

This open-label, phase 1 study evaluated the effects of ofatumumab on QTc intervals, safety, efficacy, B-cell and neutrophil counts, complement levels, and cytokine and chemokine concentrations. Fourteen patients with fludarabine-refractory chronic lymphocytic leukemia received 12 ofatumumab infusions. A higher maximum infusion rate of 400 mL/h was tested at the first two doses and was well tolerated. The 43% overall response rate was similar to previous data (42-51%). B-cell depletion was observed along with complement consumption; median C2 and CH50 levels appeared lower during monthly dosing in patients who responded. Responding patients appeared to have higher median levels of certain pro-inflammatory cytokines and lower median levels of certain immunotolerant cytokines than patients who did not respond. Ofatumumab-induced complement-dependent cytotoxicity activity can be detected clinically by measuring complement and may be associated with clinical activity. The potential relationship between changes in complement or cytokines and clinical response to ofatumumab warrants further study.

The effects of test-enhanced learning on long-term retention in AAN annual meeting courses.

OBJECTIVE: We measured the long-term retention of knowledge gained through selected American Academy of Neurology annual meeting courses and compared the effects of repeated quizzing (known as test-enhanced learning) and repeated studying on that retention. METHODS: Participants were recruited from 4 annual meeting courses. All participants took a pretest. This randomized, controlled trial utilized a within-subjects design in which each participant experienced 3 different postcourse activities with each activity performed on different material. Each key information point from the course was randomized in a counterbalanced fashion among participants to one of the 3 activities: repeated short-answer quizzing, repeated studying, and no further exposure to the materials. A final test covering all information points from the course was taken 5.5 months after the course. RESULTS: Thirty-five participants across the 4 courses completed the study. Average score on the pretest was 36%. Performance on the final test showed that repeated quizzing led to significantly greater long-term retention relative to both repeated studying (55% vs 46%; t[34] = 3.28, SEM = 0.03, p = 0.01, d = 0.49) and no further exposure (55% vs 44%; t[34] = 3.16, SEM = 0.03, p = 0.01, d = 0.58). Relative to the pretest baseline, repeated quizzing helped participants to retain almost twice as much of the knowledge acquired from the course compared to repeated studying or no further exposure. CONCLUSIONS: Whereas annual meeting continuing medical education (CME) courses lead to long-term gains in knowledge, when repeated quizzing is added, retention is significantly increased. CME planners may consider adding repeated quizzing to increase the impact of their courses.

Collective memories of three wars in United States history in younger and older adults.

A collective memory is a representation of the past that is shared by members of a group. We investigated similarities and differences in the collective memories of younger and older adults for three major wars in U.S. history (the Civil War, World War II, and the Iraq War). Both groups were alive during the recent Iraq War, but only the older subjects were alive during World War II, and both groups learned about the Civil War from historical sources. Subjects recalled the 10 most important events that occurred during each war and then evaluated the emotional valence, the relative importance, and their level of knowledge for each event. They also estimated the percentage of people that would share their memory of each event within their age group and the other age group. Although most historical events were recalled by fewer than 25 % of subjects, younger and older adults commonly recalled a core set of events for each war that conform to a narrative structure that may be fundamental to collective remembering. Younger adults showed greater consensus in the events that they recalled for all three wars, relative to older adults, but there was less consensus in both groups for the Iraq War. Whereas younger adults recalled more specific events of short duration, older adults recalled more extended and summarized events of long duration. Our study shows that collective memories can be studied empirically and can differ depending on whether the events are experienced personally or learned from historical sources.

Comparative effects of test-enhanced learning and self-explanation on long-term retention.

CONTEXT: Educators often encourage students to engage in active learning by generating explanations for the material being learned, a method called self-explanation. Studies have also demonstrated that repeated testing improves retention. However, no studies have directly compared the two learning methods. METHODS: Forty-seven Year 1 medical students completed the study. All students participated in a teaching session that covered four clinical topics and was followed by four weekly learning sessions. In the learning sessions, students were randomised to perform one of four learning activities for each topic: testing with self-generated explanations (TE); testing without explanations (T); studying a review sheet with self-generated explanations (SE), and studying a review sheet without explanations (S). Students repeated the same activity for each topic in all four sessions. Six months later, they took a free-recall clinical application test on all four topics. RESULTS: Repeated testing led to better long-term retention and application than repeatedly studying the material (p < 0.0001, η(2)  = 0.33). Repeated generation of self-explanations also improved long-term retention and application, but the effect was smaller (p < 0.0001, η(2)  = 0.08). When data were collapsed across topics, both testing conditions produced better final test performance than studying with self-explanation (TE = 40% > SE = 29% [p = 0.001, d = 0.70]; T = 36% > SE = 29% [p = 0.02, d = 0.48]). Studying with self-explanation led to better retention and application than studying without self-explanation (SE = 29% > S = 20%; p = 0.001, d = 0.68). Our analyses showed significant interaction by topic (p = 0.001, η(2)  = 0.06), indicating some variation in the effectiveness of the interventions among topics. CONCLUSIONS: Testing and generating self-explanations are both learning activities that can be used to produce superior long-term retention and application of knowledge, but testing is generally more effective than self-explanation alone.

The importance of seeing the patient: test-enhanced learning with standardized patients and written tests improves clinical application of knowledge.

Previous research has shown that repeated retrieval with written tests produces superior long-term retention compared to repeated study. However, the degree to which this increased retention transfers to clinical application has not been investigated. In addition, increased retention obtained through written testing has not been compared to other forms of testing, such as simulation testing with a standardized patient (SP). In our study, 41 medical students learned three clinical topics through three different learning activities: testing with SPs, testing using written tests, and studying a review sheet. Students were randomized in a counter-balanced fashion to engage in one learning activity per topic. They participated in four weekly testing/studying sessions to learn the material, engaging in the same activity for a given topic in each session. Six months after initial learning, they returned to take an SP test on each topic, followed by a written test on each topic 1 week later. On both forms of final testing, we found that learning through SP testing and written testing generally produced superior long-term retention compared to studying a review sheet. SP testing led to significantly better performance on the final SP test relative to written testing, but there was no significant difference between the two testing conditions on the final written test. Overall, our study shows that repeated retrieval practice with both SPs and written testing enhances long-term retention and transfer of knowledge to a simulated clinical application.

Inferring facts from fiction: reading correct and incorrect information affects memory for related information.

People can acquire both true and false knowledge about the world from fictional stories. The present study explored whether the benefits and costs of learning about the world from fictional stories extend beyond memory for directly stated pieces of information. Of interest was whether readers would use correct and incorrect story references to make deductive inferences about related information in the story, and then integrate those inferences into their knowledge bases. Participants read stories containing correct, neutral, and misleading references to facts about the world; each reference could be combined with another reference that occurred in a later sentence to make a deductive inference. Later they answered general knowledge questions that tested for these deductive inferences. The results showed that participants generated and retained the deductive inferences regardless of whether the inferences were consistent or inconsistent with world knowledge, and irrespective of whether the references were placed consecutively in the text or separated by many sentences. Readers learn more than what is directly stated in stories; they use references to the real world to make both correct and incorrect inferences that are integrated into their knowledge bases.

Beliefs and personality disorders: an overview of the personality beliefs questionnaire.

OBJECTIVE: This article presents an overview of the Personality Beliefs Questionnaire (PBQ)--a 126-item self-report measure of beliefs associated with 10 personality disorders. DESIGN: It consolidates the literature on the PBQ over the last 20 years to provide a summary of the psychometric status, revisions and applications of the PBQ scales. RESULTS: The PBQ scales are psychometrically reliable (α = 77-94, test-retest stability r=.57-.93) and discriminate between individuals with and without a specific personality disorder. Two revisions have been made to the measure: A 14-item subscale measuring beliefs central to borderline personality disorder has been identified, and a short form version of the PBQ has been validated. The PBQ has been used to measure cognitive mechanisms of treatment outcomes, and has been found to be sensitive to changes in beliefs. CONCLUSIONS: Given the proposed shift in the Diagnostic and Statistical Manual of Mental Disorders Fifth Edition (DSM-5) to a dimensional conceptualization of psychological components of personality dysfunction, the PBQ is likely to remain relevant and useful for identifying such components in individuals with personality disorders.

The hypercorrection effect persists over a week, but high-confidence errors return.

People's knowledge about the world often contains misconceptions that are well-learned and firmly believed. Although such misconceptions seem hard to correct, recent research has demonstrated that errors made with higher confidence are more likely to be corrected with feedback, a finding called the hypercorrection effect. We investigated whether this effect persists over a 1-week delay. Subjects answered general-knowledge questions about science, rated their confidence in each response, and received correct answer feedback. Half of the subjects reanswered the same questions immediately, while the other half reanswered them after a 1-week delay. The hypercorrection effect occurred on both the immediate and delayed final tests, but error correction decreased on the delayed test. When subjects failed to correct an error on the delayed test, they sometimes reproduced the same error from the initial test. Interestingly, high-confidence errors were more likely than low-confidence errors to be reproduced on the delayed test. These findings help to contextualize the hypercorrection effect within the broader memory literature by showing that high-confidence errors are more likely to be corrected, but they are also more likely to be reproduced if the correct answer is forgotten.

The critical role of retrieval practice in long-term retention.

Learning is usually thought to occur during episodes of studying, whereas retrieval of information on testing simply serves to assess what was learned. We review research that contradicts this traditional view by demonstrating that retrieval practice is actually a powerful mnemonic enhancer, often producing large gains in long-term retention relative to repeated studying. Retrieval practice is often effective even without feedback (i.e. giving the correct answer), but feedback enhances the benefits of testing. In addition, retrieval practice promotes the acquisition of knowledge that can be flexibly retrieved and transferred to different contexts. The power of retrieval practice in consolidating memories has important implications for both the study of memory and its application to educational practice.

Repeated testing produces superior transfer of learning relative to repeated studying.

The present research investigated whether test-enhanced learning can be used to promote transfer. More specifically, 4 experiments examined how repeated testing and repeated studying affected retention and transfer of facts and concepts. Subjects studied prose passages and then either repeatedly restudied or took tests on the material. One week later, they took a final test that had either the same questions (Experiment 1a), new inferential questions within the same knowledge domain (Experiments 1b and 2), or new inferential questions from different knowledge domains (Experiment 3). Repeated testing produced superior retention and transfer on the final test relative to repeated studying. This finding indicates that the mnemonic benefits of test-enhanced learning are not limited to the retention of the specific response tested during initial learning but rather extend to the transfer of knowledge in a variety of contexts.

Repeated testing improves long-term retention relative to repeated study: a randomised controlled trial.

CONTEXT: Laboratory studies in cognitive psychology with relatively brief final recall intervals suggest that repeated retrieval in the form of tests may result in better retention of information compared with repeated study. OBJECTIVES: Our study evaluates if repeated testing of material taught in a real-life educational setting (a didactic conference for paediatric and emergency medicine residents) replicates these findings when measured at a more educationally relevant final recall interval of 6 months. METHODS: Residents participated in an interactive teaching session on two topics: (i) status epilepticus, and (ii) myasthenia gravis. Residents were randomised to two counter-balanced groups which either took tests on status epilepticus and studied a review sheet on myasthenia gravis (SE-T/MG-S group) or took tests on myasthenia gravis and studied a review sheet on status epilepticus (MG-T/SE-S group). Testing and studying occurred immediately after teaching and then at two additional times at intervals of about 2 weeks. Residents received feedback after each test. Tests consisted of short-answer questions and the review sheets consisted of information identical to that on the answer sheets for the tests. At about 6 months residents took a final test on both topics. RESULTS: Nineteen residents in the SE-T/MG-S group and 21 residents in the MG-T/SE-S group completed the study. Collapsing across groups, repeated testing produced final test scores that were an average of 13% higher than those produced by repeated study (39% versus 26%) at > 6 months after the initial teaching session (t[78] = 3.93, standard error of the difference = 0.03, P < 0.001, d = 0.91). CONCLUSIONS: Repeated testing with feedback appears to result in significantly greater long-term retention of information taught in a didactic conference than repeated, spaced study. Testing should be considered for its potential impact on learning and not only as an assessment device.

Congruity effects between materials and processing tasks in the survival processing paradigm.

Nairne, Thompson, and Pandeirada (2007) reported a series of experiments in which processing unrelated words in terms of their relevance to a grasslands survival scenario led to better retention relative to other semantic processing tasks. The impetus for their study was the premise that human memory systems evolved under the selection pressures of our ancestral past. In 3 experiments, we extended this functional approach to investigate the congruity effect-the common finding that people remember items better if those items are congruent with the way in which they are processed. Experiment 1 was a replication of Nairne et al.'s (2007) experiment and showed congruity effects in the survival processing paradigm. To avoid potential item-selection artifacts from randomly selected words, we manipulated congruence between words and processing condition in Experiments 2 and 3. As expected, final recall was highest when the type of processing and the materials were congruent, indicating that people remember stimuli better if the stimuli are congruent with the goals associated with their processing. However, contrary to our predictions, no survival processing advantage emerged between the 2 congruent conditions or for a list of irrelevant words. When congruity was controlled in a mixed list design, the survival processing advantage disappeared.

Using popular films to enhance classroom learning: the good, the bad, and the interesting.

Popular history films sometimes contain major historical inaccuracies. Two experiments investigated how watching such films influences people's ability to remember associated texts. Subjects watched film clips and studied texts about various historical topics. Whereas the texts contained only correct information, the film clips contained both correct information (consistent with the text) and misinformation (contradicted by the text). Before watching each clip, subjects received a specific warning, a general warning, or no warning about the misinformation. One week later, they returned for a cued-recall test about the texts. Watching a film clip increased correct recall of consistent information relative to recall of the same information when subjects did not see the clip. However, when the information in the film contradicted the text, subjects often (falsely) recalled misinformation from the film. The specific warning substantially reduced this misinformation effect. Teachers should use popular history films with caution and should warn students about major inaccuracies in the films.

Metacognitive strategies in student learning: do students practise retrieval when they study on their own?

Basic research on human learning and memory has shown that practising retrieval of information (by testing the information) has powerful effects on learning and long-term retention. Repeated testing enhances learning more than repeated reading, which often confers limited benefit beyond that gained from the initial reading of the material. Laboratory research also suggests that students lack metacognitive awareness of the mnemonic benefits of testing. The implication is that in real-world educational settings students may not engage in retrieval practise to enhance learning. To investigate students' real-world study behaviours, we surveyed 177 college students and asked them (1) to list strategies they used when studying (an open-ended free report question) and (2) to choose whether they would reread or practise recall after studying a textbook chapter (a forced report question). The results of both questions point to the same conclusion: A majority of students repeatedly read their notes or textbook (despite the limited benefits of this strategy), but relatively few engage in self-testing or retrieval practise while studying. We propose that many students experience illusions of competence while studying and that these illusions have significant consequences for the strategies students select when they monitor and regulate their own learning.