Academic entitlement and Ratemyprofessors.com evaluations bias student teaching evaluations: Implications for faculty evaluation and policy-lenient professors' occupational health.

This study explored relationships between academic entitlement (AE) and Ratemyprofessors.com (RMP) use. It also investigated, while controlling for AE, if RMP evaluation positivity influences students' intentions to ask for policy exemptions, beliefs professors would provide them, intentions to reward and punish professors contingent upon provision of policy exemptions by improving or lowering their student teaching evaluations, and intentions to evaluate and reenroll with professors. Following exposure to RMP evaluations, participants (n = 320) rated their intentions and beliefs toward a fictional professor. They also completed an AE measure. AE was related to frequency of writing RMP evaluations as well as participants' intentions to ask for exemptions, beliefs they would receive them, and intentions to reward and punish professors. RMP evaluation positivity affected participants' intentions to ask for and beliefs they would receive policy exemptions as well as intention to evaluate and reenroll with professors. Effects did not differ by professor or student gender. Participants reported intention to improve the evaluation of professors who provide any policy exemption. This study's findings suggest that student attitudes related to AE and impacted by RMP evaluations have significant implications for professors' occupational health via requests for policy exemptions and the consequences of professors' responses to them. These findings also contribute to the body of evidence that student teaching evaluations do not exclusively measure teaching effectiveness. Similar to grade leniency, policy leniency may bias student teaching evaluations. These contribute to the ongoing discussion of the use of student teaching evaluations in faculty personnel decisions and underscore the need for robust approaches to professor evaluation.

Perceptions and Utility of Course Evaluations in US Pharmacy Schools.

OBJECTIVE: This study aimed to describe the purpose, implementation, and perceived utility of course evaluations in pharmacy programs. METHODS: After a literature review, a 34-item survey was developed, pretested, and sent to assessment administrators at accredited pharmacy programs (N = 139) with at least 3 follow-ups. Descriptive and inferential statistics were performed in IBM SPSS Statistics software. RESULTS: A total of 90 programs responded (64.7% response rate). Most students (94%) were offered the opportunity to complete course evaluations. Some students completed evaluations during the course (47%), while others did so within 1 week of completion of the course (49%). Whether or not class time was given for students to complete the survey was often dependent on faculty choice (52.2%). Results were typically released after final grades were posted (92%), in time to use for the next semester of teaching (77%). Faculty were chosen to be evaluated by the number of teaching hours (50%) followed by all instructors (45.6%). Programs used the results for performance reviews by chairs (91%), course coordinator reviews (84%), and committee continuous quality improvement efforts (72%). Most programs did not provide faculty guidance on using evaluations (78%) nor development/mentoring (57%); only 22% of programs offered student development in completing evaluations. CONCLUSION: While most programs invite feedback from all students via evaluations, most did not provide guidance to faculty on how to use this feedback for faculty or course development purposes. A more robust process to optimize the use of course evaluations should be developed.

The experiences of preparation and engagement of educators in teaching e-portfolio.

INTRODUCTION: A teaching e-portfolio is used to organize the collation and presentation of documents about teaching for the development and evaluation of educators. The current study was aimed at describing teaching e-portfolio components at Shahid Sadoughi University of Medical Sciences. As well, we examined the performance and experience of educators in engaging in the teaching e-portfolio. MATERIALS AND METHODS: This study was conducted at Shahid Sadoughi University in 2018-2022 in three main stages: (1) Development of the teaching e-portfolio; (2) Implementing teaching e-portfolio, and evaluating teaching documentation quantitatively; and (3) Exploration of educators' experiences by a conventional content analysis introduced by Graneheim and Lundman. The teaching e-portfolio was developed from the perspective of the components, domains, and criteria of scholarship of teaching and learning. The teaching e-portfolio documented the educational activities of educators in 12 areas, including philosophy of education (1 activity), curriculum planning (4 activities), evaluation (7 activities), teaching and learning (1 activity), e-learning (1 activity), professional development in education (1 activity), scholarly activities (2 activities), mentoring and counseling (3 activities), educational leadership (2 activities), education research (6 activities), education reform project (1 activity), and production of scholarship of teaching and learning (13 activities). The educators recorded the documentation of educational activities in their teaching e-portfolio. Their documentation was reviewed by two peers. The reviewers delivered constructive feedback to improve the educators' performance. The quantitative performance of educators in different activities in teaching e-portfolio was examined by descriptive tests (frequency and percentage). The experiences of educators were explored by the conventional content analysis approach which was introduced by Graneheim and Lundman. RESULTS: In the present study, 148 educators registered in the teaching e-portfolio. A total of 1488 documents of educational activities were registered in the e-portfolio from 2018 to 2022, and 55.24% of the activities received feedback in the peer review process. The experience of participants was categorized into a theme "fear and hope in utilizing teaching e-portfolio". This theme consisted of three categories: "motivational roadmap for personal and professional development in the future", "concern about the consequences of continuous monitoring", and "restriction of resources and capability as resistance sources". CONCLUSION: The current study showed that the participation of educators in a teaching e-portfolio was at an acceptable level. Support systems and educational policies played an effective role in guiding educators to participate in educational development activities. The educators perceived the teaching e-portfolio as a two-faceted tool. Teaching e-portfolio can provide a road map for their personal and professional development to achieve excellent teaching. As well, the teaching e-portfolio was recognized as a tool for continuous performance monitoring and detection of the inefficiency of teaching quality activities. This perception, along with limited resources such as time, weak technological literacy, and difficulty in working with electronic devices and systems, led to resistance from educators to involve in teaching e-portfolio.

Perceptions and attitudes of medical students towards student evaluation of teaching: A cross-sectional study.

BACKGROUND: Faculty evaluation surveys in the frame of student evaluation of teaching (SETs) are a widely utilized tool to assess faculty teaching. Although SETs are used regularly to evaluate teaching effectiveness, their sole use for making administrative decisions and as an indicator of teaching quality has been controversial. METHODS: A survey containing 22 items assessing demographics, perception, and factors for evaluating faculty was distributed to medical students at our institute. Statistical analyses were conducted using Microsoft Excel and R Software utilizing regression analysis and ANOVA test. RESULTS: The survey received 374 responses consisting of 191 (51.1%) male students and 183 (48.9%) female students. In all, 178 (47.5%) students considered the optimal time for providing faculty evaluation to be after the release of the exam results, compared to 127 (33.9%) students, who chose the after the exam but before the release of exam results option. When asked what happens whenever the tutor is aware about the SETs data, 273 (72.9%) and 254 (67.9%) students believed that it would influence the difficulty of the exam and grading/curving of the exam results, respectively. Better teaching skills (93%, 348), being responsive and open to student feedback and suggestions (84.7%, 317), being committed to class time and schedule (80.1%, 300), and an easier exam (68.6%, 257) were considered important factors to acquire a positive evaluation by a considerable proportion of students. Fewer lectures (P < 0.05), decreased number of slides per lecture (P < 0.01), easier exam (P < 0.05), and giving clues to students about the exam (P < 0.05) were found to be very important to obtain a positive tutor evaluation by students. CONCLUSIONS: Institutions ought to continue exploring areas of improvement in the faculty evaluation process while raising awareness among students about the importance and administrative implications of their feedback.

Peer-review of teaching materials in Canadian and Australian universities: A content analysis.

BACKGROUND: Peer-review of teaching materials (PRTM) has been considered a rigorous method to evaluate teaching performance to overcome the student evaluation's psychometric limitations and capture the complexity and multidimensionality of teaching. The current study aims to analyze the PRTM practices in Canadian and Australian universities in their faculty evaluation system. MATERIALS AND METHODS: This is a qualitative content analysis study in which all websites of Canadian and Australian universities (n = 46) were searched based on the experts> opinion. Data related to PRTM were extracted and analyzed employing an integrative content analysis, incorporating both inductive and deductive elements iteratively. Data were coded and then organized into subcategories and categories using a predetermined framework including the major design elements of a PRTM system. The number of universities for each subcategory was calculated. RESULTS: A total of 21 universities provided information on PRTM on their websites. The main features of PRTM programs were organized under the seven major design elements. Universities applied PRTM mostly (n = 11) as a summative evaluation. Between half to two-thirds of the universities did not provide information regarding the identification of the reviewers and candidates, preparation of reviewers, and logistics (how often and when) of the PRTM. Almost all universities (n = 20) defined the criteria for review in terms of teaching philosophy (n = 20), teaching activities (n = 20), teaching effectiveness (n = 19), educational leadership (n = 18), teaching scholarship (n = 17), and professional development (n = 14). CONCLUSION: The major design elements of PRTM, categories and subcategories offered in the current study provide a practical framework to design and implement a comprehensive and detailed PRTM system in the academic setting.

Are First-Year Emergency Medicine Residents Still Behind on Level 1 Care-Based Milestones?

Background The Accreditation Council for Graduate Medical Education defines Level 1 as "the resident demonstrates milestones expected of an incoming resident," yet a previous study of emergency medicine (EM) interns showed most were not meeting Level 1 milestones. In addition, previous research indicates that residents often provide more favorable self-assessments when compared to faculty assessments. Our study, performed in July 2022, aims to determine whether incoming EM residents remain behind on Level 1 care-based milestones and if resident self-assessments are consistent with faculty assessments. Methodology This is an observational study involving five distinct EM residency programs. Incoming interns were directly assessed by faculty for behaviors associated with the care-based milestones for EM using a standardized survey. Interns were asked to complete this same survey regarding their own performance. Results Faculty completed a total of 101 assessments on 49 residents. Of the 49 residents, 39 completed self-evaluations (80%). Achievement of Level 1 ranged from 25% to 82%. Residents had significantly higher self-assessments than faculty assessments on PC-1, PC-5a, and PC-6a. Faculty assessments were significantly higher than resident self-assessments on PC-6b. Conclusions Greater than 75% of incoming interns were able to meet Level 1 milestones in three of seven care-based milestones. However, there is a generalized trend toward overall improvement when compared to previous studies. Residents continue to demonstrate higher self-assessments than faculty in three separate care-based milestones and faculty rated residents significantly higher in one care-based milestone. This is consistent with previous studies.

Metrics to evaluate implementation scientists in the USA: what matters most?

BACKGROUND: Implementation science has grown rapidly as a discipline over the past two decades. An examination of how publication patterns and other scholarly activities of implementation scientists are weighted in the tenure and promotion process is needed given the unique and applied focus of the field. METHODS: We surveyed implementation scientists (mostly from the USA) to understand their perspectives on the following matters: (1) factors weighted in tenure and promotion for implementation scientists, (2) how important these factors are for success as an implementation scientist, (3) how impact is defined for implementation scientists, (4) top journals in implementation science, and (5) how these journals are perceived with regard to their prestige. We calculated univariate descriptive statistics for all quantitative data, and we used Wilcoxon signed-rank tests to compare the participants' ratings of various factors. We analyzed open-ended qualitative responses using content analysis. RESULTS: One hundred thirty-two implementation scientists completed the survey (response rate = 28.9%). Four factors were rated as more important for tenure and promotion decisions: number of publications, quality of publication outlets, success in obtaining external funding, and record of excellence in teaching. Six factors were rated as more important for overall success as an implementation scientist: presentations at professional meetings, involvement in professional service, impact of the implementation scientist's scholarship on the local community and/or state, impact of the implementation scientist's scholarship on the research community, the number and quality of the implementation scientist's community partnerships, and the implementation scientist's ability to disseminate their work to non-research audiences. Participants most frequently defined and described impact as changing practice and/or policy. This expert cohort identified Implementation Science as the top journal in the field. CONCLUSIONS: Overall, there was a significant mismatch between the factors experts identified as being important to academic success (e.g., tenure and promotion) and the factors needed to be a successful implementation scientist. Findings have important implications for capacity building, although they are largely reflective of the promotion and tenure process in the USA.

The persistence of neoliberal logics in faculty evaluations amidst Covid-19: Recalibrating toward equity.

In this paper, we theorize the intersectional gendered impacts of COVID-19 on faculty labor, with a particular focus on how institutions of higher education in the United States evaluate faculty labor amidst the COVID-19 transition and beyond. The pandemic has disrupted faculty research, teaching, and service in differential ways, having larger impacts on women faculty, faculty of color, and caregiving faculty in ways that further reflect the intersections of these groups. Universities have had to reconsider how evaluation occurs, given the impact of these disruptions on faculty careers. Through a case study of university pandemic responses in the United States, we summarize key components of how colleges and universities shifted evaluations of faculty labor in response to COVID-19, including suspending teaching evaluations, implementing tenure delays, and allowing for impact statements in faculty reviews. While most institutional responses recenter neoliberal principles of the ideal academic worker that is both gendered and racialized, a few universities have taken more innovative approaches to better attend to equity concerns. We conclude by suggesting a recalibration of the faculty evaluation system - one that maintains systematic faculty reviews and allows for academic freedom, but requires universities to take a more contextualized approach to evaluation in ways that center equity and inclusion for women faculty and faculty of color for the long term.

Viewpoint changes of medical sciences graduates in evaluating the performance of faculty members: a qualitative study.

BACKGROUND: This study aimed to identify which dimensions of faculty members' evaluation criteria changed from the viewpoint of students after their graduation, and to determine the effective factors in changing their viewpoints. METHODS: This study was carried out through the qualitative approach and with conventional content analysis method. The target population included all graduates who accomplished their job duty and had a working experience of 2-4 years. A purposive sampling technique with maximum variation used to recruit and interview. Twenty-eight in depth semi-structured interviews were conducted in Tabriz University of Medical Sciences (TBZMED), Iran. The data were analyzed using content analysis. RESULTS: The data analysis led to the development of two themes and 8 categories. The two types of changes in the viewpoint that were experienced by graduates in evaluating the performance of faculty members were: individual and environmental. Individual factors included the responsibility of graduates, social maturity, personal experience, intellectual maturity, understanding the causes of teachers' behaviors, and understanding the importance of evaluation. The environmental factors were applicability of learning experiences in the work environment and workplace conditions. CONCLUSION: From the perspective of graduates, the importance of some evaluation criteria in the educational, professional, and personal dimensions changed over their study period due to some factors, such as personal experience, experiences in the work environment, workplace conditions, and intellectual maturity.

Student evaluations of teaching and the development of a comprehensive measure of teaching effectiveness for medical schools.

The evaluation of courses and faculty is of vital importance in all higher education institutions including medical schools. Student Evaluations of Teaching (SETs) commonly take the form of completion of anonymous questionnaires and even though they were originally developed to evaluate courses and programmes, throughout the years they have also been used to measure teaching effectiveness and subsequently to guide important decisions related to the faculty's career progression. Nevertheless, certain factors and biases may influence SET rates and may not measure teaching effectiveness objectively. Although the literature on course and faculty evaluations is well-researched in general higher education, there are concerns with regards to the use of the same tools for evaluation of courses and teachers in medical programmes. Specifically, the SETs in general higher education cannot be directly applied to the structure of courses and delivery of curriculum in medical schools. This review provides an overview of how SETs can be improved at the levels of instrumentation, administration and interpretation. In addition, the paper supports that through the collection and triangulation of data from multiple sources, including students, peers, program administrators and self-awareness via the use of different methods such as peer reviews, focus groups and self-evaluations, it will be possible to develop a comprehensive evaluation system that will present an effective measure of teaching effectiveness, will support the professional development of medical teachers and will improve the quality of teaching in medical education.

Interdisciplinary Collaboration in Appointment, Reappointment, Promotion, and Tenure Criteria: Does It Matter?

University faculty are called upon to address complex, contemporary problems using interdisciplinary approaches. But do appointment, reappointment, promotion, and tenure (ARPT) criteria reflect and reward this fundamental change in the nature of scholarly inquiry? We conducted a content analysis of ARPT criteria at one university to determine how interdisciplinary work is valued across disciplines and over time. We found noteworthy differences between colleges and disciplines: generally, creative disciplines placed higher value on individual contributions while the sciences supported interdisciplinary work. The emphasis on interdisciplinary work over time increased in only a few disciplines, as criteria became more current.

Supporting Self-Directed Learning: Development of a Faculty Evaluation Scale.

Construct: We sought to assess medical education faculty members' ability to support students in the development of self-regulated learning skills. Background: It is broadly agreed that medical students should become self-directed lifelong learners to succeed as physicians. To that end, many instruments have been developed that measure student attributes of self-directed learning (SDL). By contrast, no such analogous valid instrument is available to assess faculty familiarity in pedagogical strategies to promote SDL among students. Approach: An item bank with 45 items was created and its content-related validity evaluated by a panel of twenty experts. The items were selected and validated in the framework of Item Response Theory (IRT). The unidimensionality of all items within four constructs was assessed by using modified parallel analysis and 2 parameter IRT model calibration. The final version of the Recognition of Learning-Oriented Teaching Strategies (RoLOTS) instrument was validated by using the IRT marginal reliability as well as 2PL model calibrations. Different Item Functioning (DIF) in student-educators and gender was examined. Findings: The final version of RoLOTS included 20 items, with five in each of four subdomains: building content knowledge; the emotional and motivational aspects of learning; leveraging the social nature of the learning process; and metacognitive processes that promote student regulation of the learning process. Construct validity and reliability of each of the four domains were well supported by the results. Significant DIF was not detected in student-educator and gender. Conclusions: The RoLOTS successfully evaluated whether a faculty member is familiar with pedagogical tools to promote medical students' self-directed learning, which can be used as a first step in needs-based professional development. Further research is needed to provide more validity and reliability evidence among groups with diverse SDL experience.

Structured simulations improves students' knowledge acquisition and perceptions of teaching effectiveness: A quasi-experimental study.

AIMS: To determine the effect of adding structured simulation to a traditional classroom lecture format on students' knowledge acquisition and their evaluation of faculty teaching effectiveness, compared to traditional classroom lectures alone. BACKGROUND: There is a critical lack of high-quality clinical placements/experiences in nursing education, particularly in clinical specialty populations, such as paediatrics. Simulation has been shown to help students practice in a safe environment. However, less is known about the outcomes of embedding simulation in didactic class sessions or classroom lectures. Additionally, data on the impact of simulation as a teaching pedagogy on faculty teaching effectiveness is limited. DESIGN: Post-test, nonequivalent control group quasi-experimental study. METHODS: Students in two prelicensure nursing programs participated in a 10-week term paediatric nursing course taught by the same faculty member on two different campuses. The students at one campus, designated as the control group (n = 43), received four hours of traditional, lecture-only, instructions. The group at a second campus, the intervention group (n = 44), received the same lectures with added structured simulations. Students' knowledge acquisition and their evaluation of faculty teaching effectiveness were measured in both groups using the same standardised assessment measures. The CONSORT checklist was followed. RESULTS: Students' knowledge acquisition scores and their evaluation scores of faculty teaching effectiveness were significantly higher in the intervention (simulation) group compared to the control group. A significantly higher number of students in the simulation group scored above the national average Nursing Care of Children score as compared to students in the control group. CONCLUSIONS: Integrating simulation with didactic instruction enhanced students' knowledge acquisition and improved their opinion of faculty teaching effectiveness. RELEVANCE TO CLINICAL PRACTICE: Augmenting lecture with simulation may provide students with learning experiences that they may not have during clinical rotation due to a lack of paediatric clinical placement sites and differences between sites.

Development and Implementation of a Clinical Dental Faculty Evaluation Instrument.

The aim of this study was to develop and test the reliability of an instrument to evaluate the quality of clinical teaching among dental school faculty. Fourth-year dental students' perspectives on effective clinical teaching were first collected in focus group meetings. An 11-item questionnaire to assess seven domains of clinical teaching was developed based on the collected student perspectives and a medical model. All 374 third- and fourth-year dental students at one U.S. dental school in 2015 were invited to evaluate four clinical instructors whom they felt were strong role models and four clinical instructors whom they felt would benefit from constructive criticism. The survey was completed by 139 students (37.2% response rate); they evaluated 96 dental instructors. The results showed that the survey demonstrated strong internal reliability, with Cronbach's alpha values of >0.95 for each of the seven domains. In addition, there was significant agreement between groups: the interclass correlation (ICC) ranged from 0.97 to 0.99. These results suggest that the clinical faculty evaluation instrument developed in this study is a reliable method that can be used to evaluate dental faculty members. This system can be a valuable guide for clinical faculty members and administrators in assessing and improving clinical teaching effectiveness.

Clinical Skills Evaluation in Neurology, Child Neurology and Psychiatry: Program Directors' Perspective and Future Opportunities.

BACKGROUND: When the American Board of Psychiatry and Neurology (ABPN) eliminated the oral segment of the board-certification examination, it began requiring in-training assessments termed Clinical Skill Evaluations (CSEs). OBJECTIVE: This study describes the experience of residency program directors (PDs) with CSEs and identifies opportunities for improvement. METHODS: A 23-question survey was administered electronically to neurology, child neurology, and psychiatry PDs assessing their CSE testing procedures in April 2019. Data from the ABPN preCERT® Credentialing System CSE was analyzed to corroborate the survey results. RESULTS: A total of 439 PDs were surveyed. The overall response rate was approximately 40% with a similar response across the 3 specialties. Overall, there was a strong enthusiasm for CSEs as they captured the essence of the physician-patient relationship. Most PDs encouraged trainees to attempt CSEs early in their training though the completion time frame varied by specialty. Approximately 57% of psychiatry residencies offered formal, in-person faculty training while less than one-fourth of neurology and child neurology programs offered such a program. Most PDs are interested in a faculty development course to ensure a standardized CSE testing process at their institution. CONCLUSIONS: This survey confirmed earlier findings that CSEs are usually implemented early in the course of residency training and that most PDs think it captures the essence of the physician-patient relationship. While few residencies offer a CSE training course, there is widespread support for a formal approach to faculty development and this offers a specific opportunity for CSE improvement in the future.

Publication Productivity of Nursing Faculty in Selected Schools of Nursing Across the United States.

PURPOSE: Faculty productivity related to research and scholarship is assessed in schools of nursing throughout the world. The purpose of this study was to examine the publication productivity of nursing faculty at each academic rank and in both tenure and nontenure tracks in selected schools of nursing across the United States. DESIGN: This was a descriptive study of publications and the h-index of nursing faculty. METHODS: Publication and citation data and the h-index for faculty (N = 1,354) in 18 schools of nursing were obtained from the Scopus database. FINDINGS: Overall, the number of publications and citations and the h-index of faculty increased at higher academic ranks. The median number of publications for tenure track faculty was 13 for assistant professors, 33 for associate professors, and 81 for full professors. Citation medians ranged from 80.5 for assistant professors, to 378 for associate professors, to 1,401 for full professors. The median h-index was 4 for assistant professors, 10 for associate professors, and 20 for full professors. Significant differences were found across academic ranks and between tenure and nontenure track faculty. CONCLUSIONS: The findings provide the first documentation of scholarly productivity of nursing faculty, as measured by number of publications and citations and by h-index, across schools of nursing in the United States. CLINICAL RELEVANCE: These findings can be used as benchmarks by appointment, promotion, and tenure committees and by faculty for self-assessment.

The trend of changes in the evaluation scores of faculty members from administrators' and students' perspectives at the medical school over 10 years.

AIM: To assess the trend of changes in the evaluation scores of faculty members and discrepancy between administrators' and students' perspectives in a medical school from 2006 to 2015. MATERIALS AND METHODS: This repeated cross-sectional study was conducted on the 10-year evaluation scores of all faculty members of a medical school (n=579) in an urban area of Iran. Data on evaluation scores given by students and administrators and the total of these scores were evaluated. Data were analyzed using descriptive and inferential statistics including linear mixed effect models for repeated measures via the SPSS software. RESULTS: There were statistically significant differences between the students' and administrators' perspectives over time (p<0.001). The mean of the total evaluation scores also showed a statistically significant change over time (p<0.001). Furthermore, the mean of changes over time in the total evaluation score between different departments was statistically significant (p<0.001). CONCLUSION: The trend of changes in the student's evaluations was clear and positive, but the trend of administrators' evaluation was unclear. Since the evaluation of faculty members is affected by many other factors, there is a need for more future studies.

Program & faculty evaluation.

Graduate medical education (GME) has shifted its curricula from process-oriented approach to outcomes-oriented models. Program and faculty evaluation are methods by which educational curricula may adjust the teaching and learning environment to meet the needs and fills the gaps in GME. The measurement of educational outcomes is an essential for assessing teaching effectiveness in a shifting health care environment. In addition to trainee, program, and faculty evaluations, annual program review (APR) and evaluation and navigational changes made by the program education committee are essential to maintain effectiveness of an educational curriculum in a contemporary graduate medical training program.

Influences of faculty evaluating system on educational performance of medical school faculty.

PURPOSE: The promotion of educators is challenged by the lack of accepted standards to evaluate the quality and impact of educational activities. Traditionally, promotion is related to research productivity. This study developed an evaluation tool for educational performance of medical school faculty using educator portfolios (EPs). METHODS: Design principles and quantitative items for EPs were developed in a consensus workshop. These principles were tested in a simulation and revised based on feedback. The changes of total educational activities following introduction of the system were analyzed. RESULTS: A total of 71% faculty members answered the simulation of the system and the score distributed widely (mean±standard deviation, 65.43±68.64). The introduction of new system significantly increased the total educational activities, especially in assistant professors. CONCLUSION: The authors offer comprehensive and practical tool for enhancing educational participation of faculty members. Further research for development of qualitative evaluation systems is needed.

Processes and Metrics to Evaluate Faculty Practice Activities at US Schools of Pharmacy.

Objective. To determine what processes and metrics are employed to measure and evaluate pharmacy practice faculty members at colleges and schools of pharmacy in the United States. Methods. A 23-item web-based questionnaire was distributed to pharmacy practice department chairs at schools of pharmacy fully accredited by the Accreditation Council for Pharmacy Education (ACPE) (n=114). Results. Ninety-three pharmacy practice chairs or designees from 92 institutions responded. Seventy-six percent reported that more than 60% of the department's faculty members were engaged in practice-related activities at least eight hours per week. Fewer than half (47%) had written policies and procedures for conducting practice evaluations. Institutions commonly collected data regarding committee service at practice sites, community service events, educational programs, and number of hours engaged in practice-related activities; however, only 24% used a tool to longitudinally collect practice-related data. Publicly funded institutions were more likely than private schools to have written procedures. Conclusion. Data collection tools and best practice recommendations for conducting faculty practice evaluations are needed.