From CREATE Workshop to Course Implementation: Examining Downstream Impacts on Teaching Practices and Student Learning at 4-Year Institutions.

The faculty workshop model has long been used for disseminating innovative methods in STEM education. Despite significant investments by researchers and funding agencies, there is a dearth of evidence regarding downstream impacts of faculty development. CREATE is an evidence-based strategy for teaching science using primary literature. In this study, we examined whether workshop-trained faculty applied CREATE methods effectively and whether their students achieved either cognitive or affective gains. We followed 10 workshop alumni at different 4-year institutions throughout the United States. External observations of the teaching indicated a high fidelity of CREATE implementation. The students made significant gains in cognitive (e.g., designing experiments) and affective (e.g., self-efficacy in science process skills) domains. Some student outcomes correlated with particular characteristics (e.g., class size) but not with others (e.g., teaching experience). These findings provide evidence for the robustness of the CREATE dissemination model and provide perspective on factors that may influence pedagogical reform efforts.

Investigating Undergraduates' Perceptions of Science in Courses Taught Using the CREATE Strategy.

Many science educators agree that 21st century students need to develop mature scientific thinking skills. Unsurprisingly, students' and experts' perceptions about the nature of scientific knowledge differ. Moreover, students' naïve and entrenched epistemologies can preclude their development toward "thinking like scientists." Novel teaching approaches that guide students toward more mature perceptions may be needed to support their development of scientific thinking skills. To address such issues, physics educators developed the Colorado Learning Attitudes About Science Survey (CLASS), subsequently adapted for chemistry and biology. These surveys are "designed to compare novice and expert perceptions about the content and structure of a specific discipline; the source of knowledge about that discipline, including connection of the discipline to the real world; and problem-solving approaches" (Semsar et al., CBE Life Sci. Educ. 10:268-278; p 269). We used CLASS-Bio to track students' perceptions of science in separate first-year and upper-level CREATE (Consider, Read, Elucidate hypotheses, Analyze and interpret the data, Think of the next Experiment) electives, hypothesizing that perceptions would become significantly more expert-like across a semester. Both first-year and upper-level cohorts made significant expert-like shifts. Students also made significant critical thinking gains in CREATE courses. Our findings of more mature, expert-like perceptions of science post-course contrast with those of previous studies, where students' thinking became significantly less expert-like across a term of introductory instruction and changed little in upper-level biology electives. Augmenting traditional biology curricula with CREATE courses could be an economical way to help undergraduates develop more mature views of science.

Inside the Literature: An Interview with Sally G. Hoskins, 2017 Recipient of the Elizabeth W. Jones Award for Excellence in Education.

The Genetics Society of America's Elizabeth W. Jones Award for Excellence in Education recognizes significant and sustained impact on genetics education. The 2017 recipient is Sally G. Hoskins, in recognition of her role in developing and promoting the transformative science education method CREATE (Consider, Read, Elucidate hypotheses, Analyze and interpret data, and Think of the next Experiment). This innovative approach uses primary literature to engage students, allowing them to experience for themselves the creativity and challenge of study design, analysis, interpretation, collaboration, and debate. Comprehensive evaluation of CREATE has consistently found that students improve in difficult-to-teach skills like critical thinking and experimental design, while showing improved attitudes and beliefs about science.This is an abridged version of the interview. The full interview is available on the Genes to Genomes blog, at genestogenomes.org/hoskins/.

CREATE Two-Year/Four-Year Faculty Workshops: A Focus on Practice, Reflection, and Novel Curricular Design Leads to Diverse Gains for Faculty at Two-Year and Four-Year Institutions.

Improving STEM education through the propagation of highly effective teaching strategies is a major goal of national reform movements. CREATE (Consider, Read, Elucidate the hypotheses, Analyze and interpret the data, and Think of the next Experiment) is a transformative teaching and learning strategy grounded in evidence-based science pedagogy. CREATE courses promote both cognitive (e.g., critical thinking) and affective (e.g., attitudinal and epistemological) student gains in diverse settings. In this study, we look more deeply into the faculty development workshop used to disseminate CREATE pedagogy to instructors at two-year and four-year institutions. We hypothesized that an immersive experience would positively shift faculty participants' views on teaching/learning, build their understanding of CREATE pedagogy and develop their confidence for course implementation. Internal and external assessments indicate that faculty participants did achieve gains within the timeframe of the CREATE workshop. We discuss the workshop training outcomes in the context of designing effective dissemination models for innovative practices.

Testing CREATE at Community Colleges: An Examination of Faculty Perspectives and Diverse Student Gains.

CREATE (Consider, Read, Elucidate the hypotheses, Analyze and interpret the data, and Think of the next Experiment) is an innovative pedagogy for teaching science through the intensive analysis of scientific literature. Initiated at the City College of New York, a minority-serving institution, and regionally expanded in the New York/New Jersey/Pennsylvania area, this methodology has had multiple positive impacts on faculty and students in science, technology, engineering, and mathematics courses. To determine whether the CREATE strategy is effective at the community college (2-yr) level, we prepared 2-yr faculty to use CREATE methodologies and investigated CREATE implementation at community colleges in seven regions of the United States. We used outside evaluation combined with pre/postcourse assessments of students to test related hypotheses: 1) workshop-trained 2-yr faculty teach effectively with the CREATE strategy in their first attempt, and 2) 2-yr students in CREATE courses make cognitive and affective gains during their CREATE quarter or semester. Community college students demonstrated positive shifts in experimental design and critical-thinking ability concurrent with gains in attitudes/self-rated learning and maturation of epistemological beliefs about science.

The CREATE Strategy for Intensive Analysis of Primary Literature Can Be Used Effectively by Newly Trained Faculty to Produce Multiple Gains in Diverse Students.

The CREATE (Consider Read, Elucidate the hypotheses, Analyze and interpret the data, and Think of the next Experiment) strategy aims to demystify scientific research and scientists while building critical thinking, reading/analytical skills, and improved science attitudes through intensive analysis of primary literature. CREATE was developed and piloted at the City College of New York (CCNY), a 4-yr, minority-serving institution, with both upper-level biology majors and first-year students interested in science, technology, engineering, and mathematics. To test the extent to which CREATE strategies are broadly applicable to students at private, public, research-intensive, and/or primarily undergraduate colleges/universities, we trained a cohort of faculty from the New York/New Jersey/Pennsylvania area in CREATE pedagogies, then followed a subset, the CREATE implementers (CIs), as they taught all or part of an existing course on their home campuses using CREATE approaches. Evaluation of the workshops, the CIs, and their students was carried out both by the principal investigators and by an outside evaluator working independently. Our data indicate that: intensive workshops change aspects of faculty attitudes about teaching/learning; workshop-trained faculty can effectively design and teach CREATE courses; and students taught by such faculty on multiple campuses make significant cognitive and affective gains that parallel the changes documented previously at CCNY.

CREATE cornerstone: introduction to scientific thinking, a new course for STEM-interested freshmen, demystifies scientific thinking through analysis of scientific literature.

The Consider, Read, Elucidate hypotheses, Analyze and interpret data, Think of the next Experiment (CREATE) strategy for teaching and learning uses intensive analysis of primary literature to improve students' critical-thinking and content integration abilities, as well as their self-rated science attitudes, understanding, and confidence. CREATE also supports maturation of undergraduates' epistemological beliefs about science. This approach, originally tested with upper-level students, has been adapted in Introduction to Scientific Thinking, a new course for freshmen. Results from this course's initial semesters indicate that freshmen in a one-semester introductory course that uses a narrowly focused set of readings to promote development of analytical skills made significant gains in critical-thinking and experimental design abilities. Students also reported significant gains in their ability to think scientifically and understand primary literature. Their perceptions and understanding of science improved, and multiple aspects of their epistemological beliefs about science gained sophistication. The course has no laboratory component, is relatively inexpensive to run, and could be adapted to any area of scientific study.

The C.R.E.A.T.E. approach to primary literature shifts undergraduates' self-assessed ability to read and analyze journal articles, attitudes about science, and epistemological beliefs.

The C.R.E.A.T.E. (Consider, Read, Elucidate hypotheses, Analyze and interpret data, Think of the next Experiment) method uses intensive analysis of primary literature in the undergraduate classroom to demystify and humanize science. We have reported previously that the method improves students' critical thinking and content integration abilities, while at the same time enhancing their self-reported understanding of "who does science, and why." We report here the results of an assessment that addressed C.R.E.A.T.E. students' attitudes about the nature of science, beliefs about learning, and confidence in their ability to read, analyze, and explain research articles. Using a Likert-style survey administered pre- and postcourse, we found significant changes in students' confidence in their ability to read and analyze primary literature, self-assessed understanding of the nature of science, and epistemological beliefs (e.g., their sense of whether knowledge is certain and scientific talent innate). Thus, within a single semester, the inexpensive C.R.E.A.T.E. method can shift not just students' analytical abilities and understanding of scientists as people, but can also positively affect students' confidence with analysis of primary literature, their insight into the processes of science, and their beliefs about learning.

Introductory biology textbooks under-represent scientific process.

Attrition of undergraduates from Biology majors is a long-standing problem. Introductory courses that fail to engage students or spark their curiosity by emphasizing the open-ended and creative nature of biological investigation and discovery could contribute to student detachment from the field. Our hypothesis was that introductory biology books devote relatively few figures to illustration of the design and interpretation of experiments or field studies, thereby de-emphasizing the scientific process. To investigate this possibility, we examined figures in six Introductory Biology textbooks published in 2008. On average, multistep scientific investigations were presented in fewer than 5% of the hundreds of figures in each book. Devoting such a small percentage of figures to the processes by which discoveries are made discourages an emphasis on scientific thinking. We suggest that by increasing significantly the illustration of scientific investigations, textbooks could support undergraduates' early interest in biology, stimulate the development of design and analytical skills, and inspire some students to participate in investigations of their own.

Learning our L.I.M.I.T.S.: less is more in teaching science.

The rapid and accelerating pace of change in physiology and cell biology, along with the easy access to huge amounts of content, have altered the playing field for science students, yet most students are still mainly taught from textbooks. Of necessity, textbooks are usually broad in scope, cover topics much more superficially than do journal articles, and present the scientific process as a linear string of successful experiments, largely ignoring the reality of rejected hypotheses, unanticipated discoveries, or surprising findings that may shift paradigms. We suggest that a more narrow focus on scientific thinking, using a new method for reading a series of journal articles that track the evolution of a single project over a period of years, can more realistically convey the excitement and challenges of research science and perhaps stimulate some students to consider research careers for themselves. Our approach, termed "CREATE" (for Consider, Read, Elucidate hypotheses, Analyze data, and Think of the next Experiment), has proven successful at both demystifying the scientific literature and humanizing science/scientists in undergraduate biology courses (8), and we suggest that it could be profitably expanded to physiology courses.

Using a Paradigm Shift to Teach Neurobiology and the Nature of Science-a C.R.E.A.T.E.-based Approach.

Decades ago, classic experiments established the phenomenon of "neural induction" (Spemann and Mangold, 1924; Holtfreter, 1933). It appeared clear that amphibian ectoderm was pre-programmed to form epidermis, and that the neural phenotype was induced by a chemical signal from mesoderm. The "ectoderm makes skin, unless induced to make nervous system" model appeared in many textbooks. This interpretation, however, was not simply incorrect but 180 degrees out of alignment with the actual situation. As subsequently demonstrated, the default state of amphibian ectoderm is neuronal, and the expression of the epidermal phenotype requires cell signaling (Hemmati-Brivanlou and Melton, 1992; 1994; 1997). In this activity, students are presented with key experiments in a stepwise fashion. At several points, they work in groups to devise models that explain particular experimental results. The stepwise presentation of results mirrors the history of discoveries in this experimental system. Eventually, faced with seemingly contradictory data, students must revise their models substantially and in doing so, experience the paradigm shift. The lesson also examines the history of this paradigm shift. Data inconsistent with the "epidermal default" model were published years before the "neural default" model was proposed, but the significance of the surprising new data was underemphasized by the scientists who made the discovery. Discussing this situation provides insight into how science works and highlights the possibility that working scientists may become entrenched in prevailing paradigms. Such "nature of science" discussions emphasize research as a human activity, and help to dispel student misconceptions about science and scientists.

Selective use of the primary literature transforms the classroom into a virtual laboratory.

CREATE (consider, read, elucidate hypotheses, analyze and interpret the data, and think of the next experiment) is a new method for teaching science and the nature of science through primary literature. CREATE uses a unique combination of novel pedagogical tools to guide undergraduates through analysis of journal articles, highlighting the evolution of scientific ideas by focusing on a module of four articles from the same laboratory. Students become fluent in the universal language of data analysis as they decipher the figures, interpret the findings, and propose and defend further experiments to test their own hypotheses about the system under study. At the end of the course students gain insight into the individual experiences of article authors by reading authors' responses to an e-mail questionnaire generated by CREATE students. Assessment data indicate that CREATE students gain in ability to read and critically analyze scientific data, as well as in their understanding of, and interest in, research and researchers. The CREATE approach demystifies the process of reading a scientific article and at the same time humanizes scientists. The positive response of students to this method suggests that it could make a significant contribution to retaining undergraduates as science majors.