RESUMO
Calculus, the study of change in processes and systems, serves as the foundation for many STEM disciplines. Traditional, lecture-based calculus instruction may present a barrier for students seeking STEM degrees, limit their access to STEM professions, and block their potential to address society's challenges. A large-scale pragmatic trial with randomized student allocation was conducted to compare two calculus instruction styles: active student engagement (treatment condition) versus traditional, lecture-based instruction (control condition). A sample of 811 university students were studied across 32 sections taught by 19 instructors over three semesters at a large, US-based Hispanic-serving institution. Large effect sizes were consistently measured for student learning outcomes in the treatment condition, which demonstrates a new standard for calculus instruction and increased opportunities for completion of STEM degrees.
RESUMO
Background: Even though student-centered instruction leads to positive student outcomes, direct instruction methods are still prevalent. Multiple barriers prevent faculty from further adopting evidence-based student-centered practices and holistic approaches to faculty support are necessary to promote faculty change. The Collaborative for Institutionalizing Scientific Learning (CISL) is an HHMI-funded program to reform undergraduate science and mathematics education at a large Hispanic-Serving public research university. The program has established a Faculty Scholar support model to impact the number of science and mathematics faculty using evidence-based practices in their classrooms. Through this program, Scholars are selected to undertake a transformation of a course of their choice and conduct an assessment of the impact of the reform on students-while receiving multiple supports including summer salary, undergraduate Learning Assistants, professional development, course assessment and education research support, and opportunities to develop manuscripts on their course transformations. Results: CISL has supported over 40 Faculty Scholars in the transformation of both introductory and upper division biology, chemistry, physics and mathematics courses. Faculty are motivated to transform a course due to factors related to their own experiences and beliefs, their students' needs, the course structure, and/or departmental elements. Quantitative analysis of the impact of the project on student success show that, overall, students in CISL-supported courses have higher passing rates compared to students in traditional classrooms. Survey and interviews of Faculty Scholars identified that the most valuable elements of the program were the personnel support from undergraduate Learning Assistants during reform implementation and guidance from the program's Assistant Director during design, implementation and evaluation. Conclusions: The CISL program provides an example of significant effort sustained over several years to systematically improve the quality and culture of undergraduate education in a large research-intensive Hispanic Serving Institution. The program has had an overall positive impact on the professional development of Faculty Scholars and led to an increase in the number of STEM courses implementing evidence-based teaching practices, thus, taking a step towards solidifying a culture of evidence-based instructional strategies in STEM departments. Supplementary Information: The online version contains supplementary material available at 10.1186/s40594-022-00353-z.
RESUMO
Despite the widespread availability and increasing use of cyberlearning environments, there remains a need for more research about their usefulness in undergraduate education, particularly in STEM education. The process of evaluating the usefulness of a cyberlearning environment is an essential measure of its success and is useful in assisting the design process and ensuring user satisfaction. Unfortunately, there are relatively few empirical studies that provide a comprehensive test of the usefulness of cyberlearning in education. Additionally, there is a lack of standards upon whose usefulness evaluators agree. In this research, we present multiple user studies that can be used to assess the usefulness of a cyberlearning environment used in Computer Science and Software Engineering courses through testing its usability and measuring its utility using user interface and user experience evaluations. Based on these assessments, we propose an evaluation framework to evaluate cyberlearning environments. To help illustrate the framework utility and usability evaluations, we explain them through an example SEP-CyLE (Software Engineering and Programming Cyberlearning Environment). The evaluation techniques used are cognitive walkthroughs with a think-aloud protocol and a heuristic evaluation survey. We further use a network-based analysis to find the statistically significant correlated responses in the heuristic evaluation survey with regard to the students' perceptions of using SEP-CyLE. Our goal is to improve cyberlearning practice and to emphasize the need for evaluating cyberlearning environments with respect to its designated tasks and its users using UI/UX evaluations. Our experiments demonstrated participants were able to utilize SEP-CyLE efficiently to accomplish the tasks we posed to them and to enhance their software development concepts, specifically, software testing. We discovered areas of improvement in the visibility and navigation of SEP-CyLE's current design. We provide our recommendations for improving SEP-CyLE and provide guidance and possible directions for future research on designing cyberlearning environments for computer education.
RESUMO
We report on a study of the effect of peers' interest in high school biology, chemistry, and physics classes on students' STEM (science, technology, engineering, and mathematics)-related career intentions and course achievement. We define an interest quorum as a science class where students perceive a high level of interest for the subject matter from their classmates. We hypothesized that students who experience such an interest quorum are more likely to choose STEM careers. Using data from a national survey study of students' experiences in high school science, we compared the effect of five levels of peer interest reported in biology, chemistry, and physics courses on students' STEM career intentions. The results support our hypothesis, showing a strong, positive effect of an interest quorum even after controlling for differences between students that pose competing hypotheses such as previous STEM career interest, academic achievement, family support for mathematics and science, and gender. Smaller positive effects of interest quorums were observed for course performance in some cases, with no detrimental effects observed across the study. Last, significant effects persisted even after controlling for differences in teaching quality. This work emphasizes the likely importance of interest quorums for creating classroom environments that increase students' intentions toward STEM careers while enhancing or maintaining course performance.
