ABSTRACT
This article examines the validity of the Undergraduate Research Student Self-Assessment (URSSA), a survey used to evaluate undergraduate research (UR) programs. The underlying structure of the survey was assessed with confirmatory factor analysis; also examined were correlations between different average scores, score reliability, and matches between numerical and textual item responses. The study found that four components of the survey represent separate but related constructs for cognitive skills and affective learning gains derived from the UR experience. Average scores from item blocks formed reliable but moderate to highly correlated composite measures. Additionally, some questions about student learning gains (meant to assess individual learning) correlated to ratings of satisfaction with external aspects of the research experience. The pattern of correlation among individual items suggests that items asking students to rate external aspects of their environment were more like satisfaction ratings than items that directly ask about student skills attainment. Finally, survey items asking about student aspirations to attend graduate school in science reflected inflated estimates of the proportions of students who had actually decided on graduate education after their UR experiences. Recommendations for revisions to the survey include clarified item wording and increasing discrimination between item blocks through reorganization.
Subject(s)
Education/methods , Educational Measurement , Science/education , Self-Assessment , Canada , Humans , Internet , Learning , Program Evaluation , Reproducibility of Results , Research , Research Personnel , Students/psychology , United StatesABSTRACT
The Course-Based Undergraduate Research Experiences Network (CUREnet) was initiated in 2012 with funding from the National Science Foundation program for Research Coordination Networks in Undergraduate Biology Education. CUREnet aims to address topics, problems, and opportunities inherent to integrating research experiences into undergraduate courses. During CUREnet meetings and discussions, it became apparent that there is need for a clear definition of what constitutes a CURE and systematic exploration of what makes CUREs meaningful in terms of student learning. Thus, we assembled a small working group of people with expertise in CURE instruction and assessment to: 1) draft an operational definition of a CURE, with the aim of defining what makes a laboratory course or project a "research experience"; 2) summarize research on CUREs, as well as findings from studies of undergraduate research internships that would be useful for thinking about how students are influenced by participating in CUREs; and 3) identify areas of greatest need with respect to CURE assessment, and directions for future research on and evaluation of CUREs. This report summarizes the outcomes and recommendations of this meeting.
Subject(s)
Curriculum , Educational Measurement , Research/education , Universities , Humans , Models, Educational , StudentsABSTRACT
This mixed-methods study explores differences in novice and experienced undergraduate students' perceptions of their cognitive, personal, and professional gains from engaging in scientific research. The study was conducted in four different undergraduate research (UR) programs at two research-extensive universities; three of these programs had a focus on the biosciences. Seventy-three entry-level and experienced student researchers participated in in-depth, semi-structured interviews and completed the quantitative Undergraduate Research Student Self-Assessment (URSSA) instrument. Interviews and surveys assessed students' developmental outcomes from engaging in UR. Experienced students reported distinct personal, professional, and cognitive outcomes relative to their novice peers, including a more sophisticated understanding of the process of scientific research. Students also described the trajectories by which they developed not only the intellectual skills necessary to advance in science, but also the behaviors and temperament necessary to be a scientist. The findings suggest that students benefit from multi-year UR experiences. Implications for UR program design, advising practices, and funding structures are discussed.
