Inter-rater Reliability of a Clinical Documentation Rubric Within Pharmacotherapy Problem-Based Learning Courses.

Objective. To evaluate a clinical documentation rubric for pharmacotherapy problem-based learning (PBL) courses using inter-rater reliability (IRR) among different evaluators. Methods. A rubric was adapted for use in grading student pharmacists' clinical documentation in pharmacotherapy PBL courses. Multiple faculty evaluators used the rubric to assess student pharmacists' clinical documentation. The mean rubric score given by the evaluators and the standard deviation were calculated. Intra-class correlation coefficients (ICC) were calculated to determine the inter-rater reliability (IRR) of the rubric. Results. Three hundred seventeen clinical documentation submissions were scored twice by multiple evaluators using the rubric. The mean initial evaluation score was 9.1 (SD=0.9) and the mean second evaluation score was 9.1 (SD=0.9), with no significant difference found between the two. The overall ICC was 0.7 across multiple graders, indicating good IRR. Conclusion. The clinical documentation rubric demonstrated overall good IRR between multiple evaluators when used in pharmacotherapy PBL courses. The rubric will undergo additional evaluation and continuous quality improvement to ensure that student pharmacists are provided with the formative feedback they need.

The Current Landscape of College-Sponsored Postgraduate Teaching and Learning Curriculum Programs.

Objective. To describe the landscape of teaching and learning curriculum (TLC) programs sponsored by US schools and colleges of pharmacy and evaluate their adoption of best practice recommendations. Methods. A 28-item electronic survey instrument was developed based on best practice recommendations published by the American Association of Colleges of Pharmacy (AACP), American Society of Health-System Pharmacists (ASHP), and American College of Clinical Pharmacy (ACCP) for the conduct of TLC programs. The survey instrument was electronically distributed to 137 accredited colleges and schools of pharmacy in the United States. Results. Eighty-eight institutions responded, resulting in a response rate of 64%. Sixty-one TLC programs were included in the final analysis. Seventy-five percent of TLC programs reported using best practice recommendations; however, 10% of respondents indicated they were not aware of the published recommendations. Inconsistencies among programs were noted in required teaching experiences, participant evaluation, and ongoing programmatic assessment. Conclusion. Most institutions offering TLC programs are aware of published best practice guidelines and have adopted a majority of the published best practices. However, considerable variability exists across the country. Development of a formal external validation process for TLC programs is necessary to ensure consistent quality.

Global collaboration to deliver a live pharmacy teaching and learning curriculum.

BACKGROUND AND PURPOSE: The Indiana Pharmacy Teaching Certificate Program (IPTeC) offered a live, two-day conference to pharmacy residents, fellows, and preceptors in Indiana, while simultaneously live-streaming to participants in Doha, Qatar. Participants engaged in longitudinal activities for a one-year period. The purpose is to evaluate this pilot extension of a teaching and learning curriculum (TLC) to experienced preceptors in a global partnership and determine whether global and local participants perceive similar quality of programming. EDUCATIONAL ACTIVITY AND SETTING: Upon completion of the two-day conference, all pharmacists from two years of the program were encouraged to complete the standard course evaluations, consisting of nine items, in order to obtain continuing education (CE) credit. Evaluations of the program were analyzed by location cohort. FINDINGS: A total of 206 eligible pharmacists attended the program, with 154 completing the course evaluations (response rate 75%). "Good" or "outstanding" median ratings were given to each learning objective by both location cohorts, with domestic participants more likely to give "outstanding" ratings (6/9 items versus 0/9 items). SUMMARY: This pilot extension was successful in providing educational content satisfying learning objectives from the perspective of domestic participants and remote participants in Qatar. This type of global collaboration can meet the needs of trainees and experienced preceptors to advance pharmacy education and training.

Perceived Value of Teaching and Learning Curriculum Programs Among Pharmacy Practice Department Chairs.

Objective. To determine the perceived value that pharmacy practice department chairs ascribe to pharmacy faculty candidates having completed a teaching and learning curriculum (TLC) program and related activities.Methods. An 18-item survey instrument was created that was intended to capture the overall impressions of pharmacy practice chairs regarding the value of TLC programs, relative importance compared to other accomplishments (eg, residency completion, board certification), and importance of specific activities. Following pilot testing and establishment of intra-rater reliability, invitations to complete the electronic survey instrument were sent to pharmacy practice chairs (or their equivalent) at accredited Doctor of Pharmacy (PharmD) programs in the United States.Results. Of the 127 pharmacy practice chairs invited, 53 completed the survey (response rate of 41.7%). The majority of respondents held a PharmD degree (90.6%), had been in their role of chair for zero to five years (60.4%), and represented a private institution (54.7%). The majority of respondents who answered the question (32 of 49) felt it was very important or important (16.3% and 49.0%, respectively) that teaching experiences be completed within a formal teaching and learning curriculum program. These programs were believed to be most important for candidates with less than five years of professional experience. Teaching and learning curriculum programs were not deemed to be more important than other accomplishments by most responders. The perceived most important TLC program activities were instruction on didactic and experiential teaching strategies, and experience developing learning objectives, developing examination items, evaluating examination results, and facilitating case conferences or practice laboratory activities.Conclusion. Teaching and learning curriculum programs may provide the foundational experiences needed for pharmacy graduates to stand out among other candidates, although department chairs' perceptions of the value of teaching and learning curriculum experiences varied.

Preceptor perceptions of block scheduling and institutional track programs to prepare APPE students for residency or hospital careers.

INTRODUCTION: Butler University College of Pharmacy and Health Sciences (BUCOPHS) and Purdue University College of Pharmacy (PUCOP) created Block Scheduling and Institutional Track programs with the goal of better preparing students interested in pursuing postgraduate residency and/or a career in institutional practice. While informal feedback has been positive from both students and preceptors, more formalized feedback was sought. The objective of this study was to determine whether preceptors perceived additional benefits in precepting students selected through Block Scheduling and Institutional Track programs compared to students scheduled on rotations through a traditional preference or optimization process. METHODS: A 12-item electronic survey instrument was sent to BUCOPHS and PUCOP preceptors who had precepted block-scheduled and/or institutional track students in the 2014-15 and 2015-16 academic years. RESULTS: The majority of preceptors (71.4%) felt that the time they spent orienting block and institutional track students was less or significantly less when compared to orienting traditionally scheduled students. Seventy-three percent (73.2%) of preceptors reported that block-scheduled and institutional track students were more or significantly more prepared for residency positions than traditional students. The majority of preceptors (93%) indicated they would recommend block scheduling or an institutional track to other practice sites. Reported benefits to the preceptor included additional time to dedicate to patient care, additional time to complete projects and initiatives for the pharmacy department, and publishable research produced from student projects mentored. CONCLUSION: Preceptors perceived benefits in precepting block-scheduled and institutional track students compared to traditionally scheduled rotation students.

Factors associated with mentor satisfaction among teaching and learning curriculum program participants.

OBJECTIVES: To evaluate participants' satisfaction with their teaching mentor relationship in a teaching and learning curriculum (TLC) and determine characteristics that are associated with high mentee satisfaction. METHODS: A 31-item survey instrument was administered to all 2015-2016 participants of the Teaching Certificate Program. RESULTS: Seventy percent of program participants (n = 60/86) responded to the survey. Overall, 80% of program participants were satisfied or very satisfied with their mentor relationship. Characteristics associated with participants reporting that they were very satisfied with their teaching mentor relationship included mentor availability for face-to-face contact and affiliation with the same institution. Mentor actions associated with high mentee satisfaction included reviewing lecture slides, providing midpoint feedback, providing career advice, and attending mentee lectures. CONCLUSIONS: Teaching certificate program participants perceive increased mentor accessibility and frequent interaction as key factors to a satisfying mentor-mentee relationship. Optimizing and standardizing mentorship programs are essential to the success of postgraduate teaching curriculums.

Hybrid Online Delivery of a Pharmacy Residency and Fellowship Elective Course.

OBJECTIVE: To describe and evaluate the transition of a pharmacy residency and fellowship (PRF) elective course to a hybrid online platform. INNOVATION: In 2016, the 1-credit hour PRF elective was transitioned from a live, synchronous course to a hybrid online platform. Over the course of the semester, students completed eight modules along with assignments that pertained to a different component of PRF. Course grades and evaluations, as well as PRF placement rates, were compared between 2015 (live, synchronous course) and 2016 (hybrid online course). There were no differences in overall course grades or student evaluations of individual relevant course objectives between the two course formats. However, more students rated the course as excellent during the 2015 live, synchronous course. Placement rates were similar between students who took the course in 2015 and 2016. CRITICAL ANALYSIS: Following the transition of a PRF elective to a hybrid online platform, course grades, evaluation of individual relevant course objectives, and PRF placement rates remained similar to previous years. Creative educational venues can help meet the student demand while simultaneously allowing faculty to manage their time. However, instructors should balance this with desire of students to have more face-to-face in class time.

Teaching Certificate Program Participants' Perceptions of Mentor-Mentee Relationships.

Objective. To assess teaching certificate program (TCP) participants' perceptions of mentor-mentee relationships. Methods. A 15-item survey instrument was administered to all 2014-2015 participants of the Indiana Pharmacy Teaching Certificate (IPTeC) program. Results. One hundred percent of IPTeC program participants (83/83) responded to the survey. The majority of participants indicated that having a professional mentor was either very important (52%) or important (47%) to their professional development and preferred to choose their own professional mentor (53%). Mentor characteristics rated as highly important by mentees included having similar clinical practice interests (82%), having similar research interests (66%), and being available to meet face-to-face (90%). Age, race, and gender of the mentor were not rated by mentees as important. Conclusion. Teaching certificate program participants place high importance on having a professional mentor. Mentorship of pharmacists completing TCPs should be a priority for current pharmacy faculty members so adequate guidance is available to future pharmacy educators.

Using institutional track programs and block scheduling to help students prepare for postgraduate residency training.

PURPOSE: The development and implementation of institutional track programs and block scheduling to help students prepare for postgraduate residency training are described. SUMMARY: Institutional track and block scheduling models were implemented into advanced pharmacy practice experience rotations to provide students with several of these experiences at the same practice site. Students at Purdue University College of Pharmacy (PUCOP) and Butler University College of Pharmacy and Health Sciences (BUCOPHS) can apply for an institutional track or block schedule. The application process for the institutional track and block scheduling programs provides students with an opportunity to refine written and oral skills that are necessary for residency applications and interviews, since the process mimics that of the ASHP Resident Matching Program. Students are frequently provided with mentors to assist in the residency or fellowship preparation, curriculum vitae or cover letter design, and career planning. Students at the site may also be paired with pharmacy residents enrolled in blocked rotations to serve as mentors. The top students are matched with a practice site and then assigned to five consecutive patient care rotations. Since 2011, a total of 71 students have participated in institutional tracks at PUCOP or block scheduling at BUCOPHS. Most institutional track students (83%) and block scheduling students (81%) were successful in matching to residency programs or hospital pharmacy positions after graduation. CONCLUSION: Block scheduling and institutional track programs were offered to students at two colleges of pharmacy interested in pursuing postgraduate residency training. Most institutional track students and block scheduling students successfully matched to residency programs or hospital pharmacy positions after graduation.

Redesign of a statewide teaching certificate program for pharmacy residents.

OBJECTIVES: To identify and assess changes made to the Indiana Pharmacy Resident Teaching Certificate program over 10 years to adapt to the growing number and changing needs of pharmacy educators in the next generation. DESIGN: In 2011, all resident program participants and directors were sent an electronic survey instrument designed to assess the perceived value of each program component. ASSESSMENT: Since 2003, the number of program participants has tripled, and the program has expanded to include additional core requirements and continuing education. Participants generally agreed that the speakers, seminar topics, seminar video recordings, and seminar offerings during the fall semester were program strengths. The program redesign included availability of online registration; a 2-day conference format; retention of those seminars perceived to be most important, according to survey results; implementation of a registration fee; electronic teaching portfolio submission; and establishment of teaching mentors. CONCLUSION: With the growing number of residents and residency programs, pharmacy teaching certificate programs must accommodate more participants while continuing to provide quality instruction, faculty mentorship, and opportunities for classroom presentations and student precepting. The Indiana Pharmacy Resident Teaching Certificate program has successfully evolved over the last 10 years to meet these challenges by implementing successful programmatic changes in response to residency program director and past program participant feedback.