Influence of Student Feedback on the Quality of Teaching among Clinical Teachers in Bahrain.

BACKGROUND: The effect of student feedback on teaching quality has been well-documented. However, only a few studies have examined the impact of feedback on clinical teachers delivering cross-border medical education in this geographical region. The aim of this study is to investigate (i) the quality of teaching among clinical teachers in a cross-border medical education setup, (ii) the impact of student feedback on teaching effectiveness, (iii) the differences in ratings among different groups of students, and (iv) factors that improve clinical teaching. METHODS: Fifty-seven clinical teachers and 140 students participated in this study. Teachers received feedback on their performance and were allowed to reflect on them. Six months later, the teachers received feedback again. Additionally, semi-structured individual interviews were conducted with 5 selected clinical teachers working in 2 different hospitals to explore the factors that influenced clinical teaching. RESULT: Overall, nearly half of the clinical teachers (n = 25) showed a trend of greater scores in the second assessment, while most of the remaining teachers (n = 24) continued to have more or less the same score or marginal fall in the second assessment. Even though few clinical teachers demonstrated significantly lesser scores, careful observation of data showed that the mean value of the second score either remained above (n = 5) or closer (n = 2) to the cut-off value of 3.74, except one teacher who recorded the least mean score of 3.17 in the second assessment. In qualitative analysis, teachers emphasised that the student feedback allowed them to develop more effective teaching approaches and strategies. CONCLUSION: The pattern of results suggests that the effect of student feedback on teaching quality can have multiple outcomes, mostly positive or neutral, and very rarely negative. This study also advocates that feedback can be more beneficial if strengthened by other interventions like faculty training.

Selecting graduates for the interns' award by using multisource feedback process: does it work?

BACKGROUND: The purpose of this study is to find a reliable method for choosing graduates for a higher-education award. One such method that has achieved notable popularity is known as multisource feedback. Multisource feedback is assessment tool that uses evaluations of different groups and includes both physicians and non-physicians. It is useful for assessing several domains, including professionalism, communication and collaboration, and therefore is a valuable tool for providing a well-rounded selection of the top interns for postsecondary awards. 16 graduates in Royal College of Surgeons in Ireland-Medical University of Bahrain (RCSI Bahrain) responded to an invitation to participate in the student award, which was conducted by the using the multisource feedback process. 5 individuals from different categories (physicians, nurses, and fellow students), rated each participant in this study. A total of 15 individuals were the proposed number for rating. The ratings were calculated using mean and standard deviation, and the award went to the one of the top score out of the 16 participants. Reliability and internal consistency was calculated using Cronbach's coefficient, and construct validity was evaluated using factor analysis. RESULTS: 16 graduates participated in the Royal College of Surgeons in Ireland-Bahrain interns' award based on the multisource feedback process, giving us a 16.5% response rate. The instrument was found to be suitable for factor analysis and showed 3 factor solutions representing 79.3% of the total variance. Reliability analysis using Cronbach's α reliability of internal consistency indicated that the full scale of the instrument had high internal consistency (Cronbach's α 0.98). CONCLUSION: This study confirmed our hypothesis, finding multisource feedback to be a process for choosing the most suitable graduates for interns' awards that is both reliable and valid. Unfortunately, there were low response rate, which could mean that multisource feedback is not a realistic way to bring most students into the process.

Analysis of psychometric properties of the modified SETQ tool in undergraduate medical education.

BACKGROUND: Effective clinical teaching is crucially important for the future of patient care. Robust clinical training therefore is essential to produce physicians capable of delivering high quality health care. Tools used to evaluate medical faculty teaching qualities should be reliable and valid. This study investigates the psychometric properties of modification of the System for Evaluation of Teaching Qualities (SETQ) instrument in the clinical years of undergraduate medical education. METHODS: This cross-sectional multicenter study was conducted in four teaching hospitals in the Kingdom of Bahrain. Two-hundred ninety-eight medical students were invited to evaluate 105 clinical teachers using the SETQ instrument between January 2015 and March 2015. Questionnaire feasibility was analyzed using average time required to complete the form and the number of raters required to produce reliable results. Instrument reliability (stability) was assessed by calculating the Cronbach's alpha coefficient for the total scale and for each sub-scale (factor). To provide evidence of construct validity, an exploratory factor analysis was conducted to identify which items on the survey belonged together, which were then grouped as factors. RESULTS: One-hundred twenty-five medical students completed 1161 evaluations of 105 clinical teachers. The response rates were 42% for student evaluations and 57% for clinical teacher self-evaluations. The factor analysis showed that the questionnaire was composed of six factors, explaining 76.7% of the total variance. Cronbach's alpha was 0.94 or higher for the six factors in the student survey; for the clinical teacher survey, Cronbach's alpha was 0.88. In both instruments, the item-total correlation was above 0.40 for all items within their respective scales. CONCLUSION: Our modified SETQ questionnaire was found to be both reliable and valid, and was implemented successfully across various departments and specialties in different hospitals in the Kingdom of Bahrain.

Feasibility and psychometric analysis of graduate satisfaction survey of medical students graduating from the Royal College of Surgeons in Ireland-Medical University of Bahrain (RCSI Bahrain).

To assess the satisfaction levels of graduates of the Royal College of Surgeons in Ireland University of Bahrain (RCSI Bahrain). The graduate survey was administered to four groups of graduates of the RCSI Bahrain who graduated between the years 2010 and 2014. The graduate survey assessed five major domains and comprised 41 items. The RCSI Bahrain opened its doors in 2004, with the first class graduating in 2010. The graduate cohorts used in this study were working in various countries at the time of survey completion. Out of 599 graduates, 153 responded to the graduate survey. The total mean response rate of the graduate survey was 26 %, including 102 females, 44 males, and 7 students who did not indicate their gender. 49 students graduated in 2012, and 53 students graduated in 2013. Of these graduates, 83 were working in Bahrain at the time of survey administration, 11 in the USA, 4 in Malta, and 3 in the UK; the total number of countries where graduates were working was 14. Reliability analysis found high internal consistency for the instrument (with a Cronbach's α of 0.97). The whole instrument was found to be suitable for factor analysis (KMO = 0.853; Bartlett test significant, p < 0.00). Factor analysis showed that the data on the questionnaire decomposed into five factors, which accounted for 72.3 % of the total variance: future performance, career development, skills development, graduate as collaborator, and communication skills. The survey results found that graduates of the RCSI Bahrain program who responded to this questionnaire are generally satisfied with their experience at the university, feel well prepared to join the field and feel ready to compete with graduates of competing universities. Furthermore, the graduate survey was found to be a reliable instrument and we provided some evidence to support the construct validity of the instrument.