Development of a self-report instrument for measuring in-class student engagement reveals that pretending to engage is a significant unrecognized problem.

Student engagement during classes includes behavioural, cognitive and emotional components, and is a pre-requisite for successful active learning environments. A novel approach to measuring student engagement was developed, involving triangulation of real-time student-self report, observation by trained observers and heart rate measurement. The self-report instrument was evaluated in four separate cohorts (n = 123) at Monash University and the University of North Carolina. The six item self-report demonstrated good reliability (Cronbach's alpha values ranged from 0.7-0.81). The self-report showed predictive validity in that small group activities were rated as significantly more engaging than didactic lecturing. Additionally, there was significant inter-instructor variability and within-class variability, indicating good discrimination between classroom activities. This self-report may prove useful to academic teaching staff in evaluating and refining their active learning activities. Independent observation was not found to correlate with student self-report, due in part to students who were pretending to engage being rated as engaged by an observer. Strikingly, students reported that they were pretending to engage for 23% of class time, even for highly regarded instructors. Individual participants were rated as engaged for 42 of the 46 intervals for which they reported that they had "pretended to engage", indicating that the two observers were unable to detect disengagement during periods in which students pretended to engage. Instructors should be aware that student cues such as eye contact and nodding may indicate pretending to engage. One particular self-report item; "I tried a new approach or way of thinking about the content", correlated positively with heart rates, and a controlled study reproduced this finding during two activities that required students to try a new approach to understanding a concept. Agreement with this item also correlated with superior performance on two in-class written assessment tasks (n = 101, p<0.01). Further use of this tool and related educational research may be useful to identify in-class activities that are engaging and likely to lead to improved student attainment of learning outcomes.

Student Engagement with a Flipped Classroom Teaching Design Affects Pharmacology Examination Performance in a Manner Dependent on Question Type.

Objective: To investigate the relationship between student engagement with the key elements of a flipped classroom approach (preparation and attendance), their attitudes to learning, including strategy development, and their performance on two types of examination questions (knowledge recall and providing rational predictions when faced with novel scenarios). Methods. This study correlated student engagement with the flipped classroom and student disposition to learning with student ability to solve novel scenarios in examinations. Results. Students who both prepared for and attended classes performed significantly better on examination questions that required analysis of novel scenarios compared to students who did not prepare and missed classes. However, there was no difference for both groups of students on examination questions that required knowledge and comprehension. Student motivation and use of strategies correlated with higher examination scores on questions requiring novel scenario analysis. Conclusion. There is a synergistic relationship between class preparation and attendance. The combination of preparation and attendance was positively correlated to assessment type; the relationship was apparent for questions requiring students to solve novel problems but not for questions requiring knowledge or comprehension.

A Simulated Learning Environment for Teaching Medicine Dispensing Skills.

OBJECTIVE: To develop an authentic simulation of the professional practice dispensary context for students to develop their dispensing skills in a risk-free environment. DESIGN: A development team used an Agile software development method to create MyDispense, a web-based simulation. Modeled on virtual learning environments elements, the software employed widely available standards-based technologies to create a virtual community pharmacy environment. Assessment. First-year pharmacy students who used the software in their tutorials, were, at the end of the second semester, surveyed on their prior dispensing experience and their perceptions of MyDispense as a tool to learn dispensing skills. CONCLUSION: The dispensary simulation is an effective tool for helping students develop dispensing competency and knowledge in a safe environment.