Peer learning in the UNSW Medicine program.

BACKGROUND: The UNSW Australia Medicine program explicitly structures peer learning in program wide mixing of students where students from two adjoining cohorts complete the same course together, including all learning activities and assessment. The purpose of this evaluation is to explore the student experience of peer learning and determine benefits and concerns for junior and senior students. METHODS: All medical students at UNSW Australia in 2012 (n = 1608) were invited to complete the Peer Learning Questionnaire consisting of 26 fixed-response items and 2 open-ended items exploring vertical integration and near-peer teaching. Assessment data from vertically integrated and non-vertically integrated courses were compared for the period 2011-2013. RESULTS: We received valid responses from 20 % of medical students (n = 328). Eighty percent of respondents were positive about their experience of vertical integration. Year 1 students reported that second year students provided guidance and reassurance (87.8 %), whilst year 2 students reported that the senior role helped them to improve their own understanding, communication and confidence (84 %). Vertical integration had little effect on examination performance and failure rates. CONCLUSIONS: This evaluation demonstrates that vertical integration of students who are one year apart and completing the same course leads to positive outcomes for the student experience of learning. Students benefit through deeper learning and the development of leadership qualities within teams. These results are relevant not only for medical education, but also for other professional higher education programs.

Predictive validity of a new integrated selection process for medical school admission.

BACKGROUND: This paper is an evaluation of an integrated selection process utilising previous academic achievement [Universities Admission Index (UAI)], a skills test [Undergraduate Medicine and Health Sciences Admission Test (UMAT)], and a structured interview, introduced (in its entirety) in 2004 as part of curriculum reform of the undergraduate Medicine Program at the University of New South Wales (UNSW), Australia. Demographic measures of gender, country of birth, educational background and rurality are considered. METHOD: Admission scores and program outcomes of 318 students enrolled in 2004 and 2005 were studied. Regression analyses were undertaken to determine whether selection scores predicted overall, knowledge-based and clinical-based learning outcomes after controlling for demographics. RESULTS: UAI attained the highest values in predicting overall and knowledge-based outcomes. The communication dimension of the interview achieved similar predictive values as UAI for clinical-based outcomes, although predictive values were relatively low. The UMAT did not predict any performance outcome. Female gender, European/European-derived country of birth and non-rurality were significant predictors independent of UAI scores. CONCLUSION: Results indicate promising validity for an integrated selection process introduced for the Medicine Program at UNSW, with UAI and interview predictive of learning outcomes. Although not predictive, UMAT may have other useful roles in an integrated selection process. Further longitudinal research is proposed to monitor and improve the validity of the integrated student selection process.

Improving the transition from medical school to internship - evaluation of a preparation for internship course.

BACKGROUND: This study evaluates the impact of a new 'Preparation for Internship' (PRINT) course, which was developed to facilitate the transition of University of New South Wales (UNSW) medical graduates from Medical School to Internship. METHODS: During a period of major curricular reform, the 2007 (old program) and 2009 (new program) cohorts of UNSW final year students completed the Clinical Capability Questionnaire (CCQ) prior to and after undertaking the PRINT course. Clinical supervisors' ratings and self-ratings of UNSW 2009 medical graduates were obtained from the Hospital-based Prevocational Progress Review Form. RESULTS: Prior to PRINT, students from both cohorts perceived they had good clinical skills, with lower ratings for capability in procedural skills, operational management, and administrative tasks. After completing PRINT, students from both cohorts perceived significant improvement in their capability in procedural skills, operational management, and administrative tasks. Although PRINT also improved student-perceived capability in confidence, interpersonal skills and collaboration in both cohorts, curriculum reform to a new outcomes-based program was far more influential in improving self-perceptions in these facets of preparedness for hospital practice than PRINT. CONCLUSIONS: The PRINT course was most effective in improving students' perceptions of their capability in procedural skills, operational management and administrative tasks, indicating that student-to-intern transition courses should be clinically orientated, address relevant skills, use experiential learning, and focus on practical tasks. Other aspects that are important in preparation of medical students for hospital practice cannot be addressed in a PRINT course, but major improvements are achievable by program-wide curriculum reform.

Clinical capabilities of graduates of an outcomes-based integrated medical program.

BACKGROUND: The University of New South Wales (UNSW) Faculty of Medicine replaced its old content-based curriculum with an innovative new 6-year undergraduate entry outcomes-based integrated program in 2004. This paper is an initial evaluation of the perceived and assessed clinical capabilities of recent graduates of the new outcomes-based integrated medical program compared to benchmarks from traditional content-based or process-based programs. METHOD: Self-perceived capability in a range of clinical tasks and assessment of medical education as preparation for hospital practice were evaluated in recent graduates after 3 months working as junior doctors. Responses of the 2009 graduates of the UNSW's new outcomes-based integrated medical education program were compared to those of the 2007 graduates of UNSW's previous content-based program, to published data from other Australian medical schools, and to hospital-based supervisor evaluations of their clinical competence. RESULTS: Three months into internship, graduates from UNSW's new outcomes-based integrated program rated themselves to have good clinical and procedural skills, with ratings that indicated significantly greater capability than graduates of the previous UNSW content-based program. New program graduates rated themselves significantly more prepared for hospital practice in the confidence (reflective practice), prevention (social aspects of health), interpersonal skills (communication), and collaboration (teamwork) subscales than old program students, and significantly better or equivalent to published benchmarks of graduates from other Australian medical schools. Clinical supervisors rated new program graduates highly capable for teamwork, reflective practice and communication. CONCLUSIONS: Medical students from an outcomes-based integrated program graduate with excellent self-rated and supervisor-evaluated capabilities in a range of clinically-relevant outcomes. The program-wide curriculum reform at UNSW has had a major impact in developing capabilities in new graduates that are important for 21st century medical practice.