Design and Implementation of a Tool to Assess Students' Understanding of Metabolic Pathways Dynamics and Regulation.

Metabolic systems form the very foundation of life and as such are broadly taught in the molecular life sciences. Here, we describe the biochemistry educator community-based development and use of an assessment instrument designed to evaluate students' ideas about metabolic pathway dynamics and regulation in undergraduate biochemistry courses. Analysis of student responses showed that most students were able to interpret visual representations in an unfamiliar metabolic pathway and that many could make basic predictions about how the system would be expected to respond to changes. However, fewer students generated nuanced responses that accounted for both microscopic changes at the protein level and macroscopic changes in pathway product outputs. These findings identify some of the challenges of meaningfully assessing students' understanding of metabolic pathways and could inform how instructors think about teaching and assessing metabolism in undergraduate biochemistry and beyond. The results also suggest future avenues for biochemistry education research.

Small Changes: Using Assessment to Direct Instructional Practices in Large-Enrollment Biochemistry Courses.

Multiple-choice assessments provide a straightforward way for instructors of large classes to collect data related to student understanding of key concepts at the beginning and end of a course. By tracking student performance over time, instructors receive formative feedback about their teaching and can assess the impact of instructional changes. The evidence of instructional effectiveness can in turn inform future instruction, and vice versa. In this study, we analyzed student responses on an optimized pretest and posttest administered during four different quarters in a large-enrollment biochemistry course. Student performance and the effect of instructional interventions related to three fundamental concepts-hydrogen bonding, bond energy, and pKa-were analyzed. After instructional interventions, a larger proportion of students demonstrated knowledge of these concepts compared with data collected before instructional interventions. Student responses trended from inconsistent to consistent and from incorrect to correct. The instructional effect was particularly remarkable for the later three quarters related to hydrogen bonding and bond energy. This study supports the use of multiple-choice instruments to assess the effectiveness of instructional interventions, especially in large classes, by providing instructors with quick and reliable feedback on student knowledge of each specific fundamental concept.

Design and testing of an assessment instrument to measure understanding of protein structure and enzyme inhibition in a new context.

Assessment instruments designed to measure student conceptual understanding and skills proficiency related to biochemistry are important to transform undergraduate biochemistry education. The purpose of this study was to develop an assessment instrument to measure student understanding of protein structure and enzyme inhibition in a new context, that of saturable binding. A community of biochemistry educators was involved in an iterative process of designing and testing of this assessment, which consists of true/false and open-ended questions that map to low and high levels in Bloom's taxonomy. A total of 188 students' responses were collected from seven different institutions and were graded by two independent raters using a rubric. Results from this administration indicate that most students were able to answer the questions related to lower-levels in Bloom's taxonomy; however for higher-level questions, students had more difficulty. The results from this assessment can give instructors insight into the ways in which persistent incorrect or incomplete ideas related to protein structure and binding events can hinder knowledge application. Also, the use of a community of practice to develop assessment instruments of this type and the format of the instrument itself could be a useful model for development of assessment instruments in the future.

Identification of threshold concepts for biochemistry.

Threshold concepts (TCs) are concepts that, when mastered, represent a transformed understanding of a discipline without which the learner cannot progress. We have undertaken a process involving more than 75 faculty members and 50 undergraduate students to identify a working list of TCs for biochemistry. The process of identifying TCs for biochemistry was modeled on extensive work related to TCs across a range of disciplines and included faculty workshops and student interviews. Using an iterative process, we prioritized five concepts on which to focus future development of instructional materials. Broadly defined, the concepts are steady state, biochemical pathway dynamics and regulation, the physical basis of interactions, thermodynamics of macromolecular structure formation, and free energy. The working list presented here is not intended to be exhaustive, but rather is meant to identify a subset of TCs for biochemistry for which instructional and assessment tools for undergraduate biochemistry will be developed.

Probing and improving student's understanding of protein α-helix structure using targeted assessment and classroom interventions in collaboration with a faculty community of practice.

The increasing availability of concept inventories and other assessment tools in the molecular life sciences provides instructors with myriad avenues to probe student understanding. For example, although molecular visualization is central to the study of biochemistry, a growing body of evidence suggests that students have substantial limitations in their ability to recognize and interpret basic features of biological macromolecules. In this study, a pre/posttest administered to students at diverse institutions nationwide revealed a robust incorrect idea about the location of the amino acid side chains in the protein α-helix structure. Because this incorrect idea was present even after a semester of biochemistry instruction at a range of institutions, an intervention was necessary. A community of expert biochemistry instructors collaborated to design two active learning classroom activities that systematically examine α-helix structure and function. Several participating faculty used one or both of the activities in their classrooms and some improvement of student understanding of this concept was observed. This study provides a model of how a community of instructors can work together using assessment data to inform targeted changes in instruction with the goal of improving student understanding of fundamental concepts.

Sustaining the development and implementation of student-centered teaching nationally: the importance of a community of practice.

Although the idea of using a workshop to educate potential users about a set of materials or techniques is not new, the workshops described here go beyond simple dissemination and create ongoing communities of practice that support widespread and sustained improvement in the biochemistry classroom. The degree to which pedagogical innovations improve student learning on a national level depends on how broadly they are disseminated and how they are implemented and sustained. Workshops can be effective in disseminating ideas and techniques, but they often fail to sustain implementation. This paper describes Core Collaborators Workshops (CCWs) that were specifically designed for biochemistry faculty to improve the quality of active learning materials, support faculty in transforming their classrooms, and disseminate these efforts nationally. This CCW model proved very effective to date as shown by the fact that, 8 months after the last CCW, all workshop participants reported using at least some of the instructional materials discussed during the workshop. In addition, participants remarked that the superior community building and direct mentoring available through the CCWs greatly increased their confidence in implementing this new curricular approach and has made them more likely to act as leaders themselves.

Development and analysis of an instrument to assess student understanding of foundational concepts before biochemistry coursework.

Biochemistry is a challenging subject because student learning depends on the application of previously learned concepts from general chemistry and biology to new, biological contexts. This article describes the development of a multiple-choice instrument intended to measure five concepts from general chemistry and three from biology that are considered prerequisite for biochemistry learning. This instrument is specifically designed with a factor structure that includes three multiple-choice items for each of the eight concepts and the most common incorrect ideas that students could have as distractors. It can be used as a pretest to identify students' incorrect ideas about those concepts and to determine if instruction helps students overcome those incorrect ideas when used as a posttest. Results from a confirmatory factor analysis support a very good fit for an eight-factor solution. This manuscript represents a report on the current state of instrument development. We seek to share our methods and instrument design principles with the broader community.

Pedagogies of engagement in science: A comparison of PBL, POGIL, and PLTL*

Problem-based learning, process-oriented guided inquiry learning, and peer-led team learning are student-centered, active-learning pedagogies commonly used in science education. The characteristic features of each are compared and contrasted to enable new practitioners to decide which approach or combination of approaches will suit their particular situation.

Lecture-free biochemistry: A Process Oriented Guided Inquiry Approach.

Biochemistry courses at Seattle University have been taught exclusively using process oriented guided inquiry learning (POGIL) without any traditional lecture component since 1997. In these courses, students participate in a structured learning environment, which includes a preparatory assignment, an in-class activity, and a follow-up skill exercise. Instructor-designed learning activities provide the content of the course while the cooperative learning structure provides the content-free procedures that promote development of critical process skills needed for learning. This format enables students to initially explore a topic independently, work together in groups to construct and refine knowledge, and eventually develop deep understanding of the essential concepts. These stages of exploration and concept development form the foundation for application to high level biochemical problems. At the end of this course, most students report feeling confident in their knowledge of biochemistry and report substantial gains in independence, critical thinking, and respect for others.