Evaluation of peer-generated MCQs to assess and support learning in a problem-based learning programme.

PURPOSE: Problem-based learning (PBL) students report uncertainty on the depth and breadth of learning required, and this is a significant stressor and challenge. Student-generated MCQ questions were trialled and evaluated as a way to support depth and breadth of learning. METHODS: Students set MCQs relating to specified learning issues, and an analysis and evaluation of setting and answering the MCQs were performed. The Revised Study Process Questionnaire (R-SPQ-2F) and final written examination scores were correlated to question setting and answering. Students were asked to rate the impact of the MCQs on their learning in PBL. RESULTS: A total of 147 questions were created and 2373 answered. Students reported challenges with setting questions, although these made them think more deeply and helped their learning and affirming their learning progress. MCQs authored indicated significant associations with Understanding, and examination scores were associated with MCQs authored. Students reported a moderate response to how the MCQs supported their depth and breadth of learning. CONCLUSIONS: While MCQ setting was perceived as a useful learning exercise, students engaged to different levels and experienced challenges. Students were uncertain whether the MCQs helped clarify the depth and breadth of learning in PBL, as they were not clear whether the questions set by their peers were relevant to the required learning outcomes.

The revised two-factor Study Process Questionnaire: R-SPQ-2F.

AIM: To produce a revised two-factor version of the Study Process Questionnaire (R-SPQ-2F) suitable for use by teachers in evaluating the learning approaches of their students. The revised instrument assesses deep and surface approaches only, using fewer items. METHOD: A set of 43 items was drawn up for the initial tests. These were derived from: the original version of the SPQ, modified items from the SPQ, and new items. A process of testing and refinement eventuated in deep and surface motive and strategy scales each with 5 items, 10 items per approach score. The final version was tested using reliability procedures and confirmatory factor analysis. SAMPLE: The sample for the testing and refinement process consisted of 229 students from the health sciences faculty of a university in Hong Kong. A fresh sample of 495 undergraduate students from a variety of departments of the same university was used for the test of the final version. RESULTS: The final version of the questionnaire had acceptable Cronbach alpha values for scale reliability. Confirmatory factor analysis indicated a good fit to the intended two-factor structure. Both deep and surface approach scales had well identified motive and strategy subscales. CONCLUSION: The revision process has resulted in a simple questionnaire which teachers can use to evaluate their own teaching and the learning approaches of their students.

An action research study into the development of nurses as reflective practitioners.

This study adopted an action research approach in addressing the question: How could nurses be prepared to be reflective practitioners? The study took place among a group of registered nurses who enrolled in the first year of their degree studies at the Hong Kong Polytechnic University. The methods of data collection included observation, interview, students' written material, and teacher reflection. The experience of this study suggested that teachers and students should be partners in the promotion of reflective learning among students. As teachers reflected on their teaching arrangement and the progress of student learning, students could accordingly be offered appropriate guidance. Throughout the span of their studies, students learned to gradually develop different perspectives in viewing professional nursing practice. The reconceptualization of nursing practice helped students challenge taken-for-granted views and eventually reconstruct their conception of nursing.

Assessing the level of student reflection from reflective journals.

The concept of reflective learning has been widely adopted in many of the nursing curricula today. Reflective learning is of particular relevance to the education of professionals, as it encourages students to integrate theory with practice, appreciate the world on their own behalf, and turn every experience into a new potential learning experience. While nurse educators have widely accepted the educational benefits of reflection, research into reflective learning is hampered by the lack of reliable and widely accepted methods for assessing whether reflection takes place and the level of any reflection. This study attempted to develop and test coding systems for written reflective journals based on two well-known models of reflective thinking. The reflective journals submitted by the students were subjected to content analysis at two levels. The findings of this study suggest that student writing can be used as evidence for the presence or absence of reflective thinking. The process of allocating students to three categories of non-reflector, reflector and critical reflector was straightforward and reliable. Identifying textual elements within journals and allocating them to the finer levels of reflection within a more complex model of reflective thinking was, however, more problematic and considerably less reliable.