Tuesday's Teaching Tips-Evaluation and Feedback: A Spaced Education Strategy for Faculty Development.

Introduction: The AGGME requires faculty to participate annually in faculty development sessions. Barriers to this requirement include faculty having a lack of time and not perceiving benefits to participating. Effective evaluation and feedback are integral to resident training. Faculty often feel ill prepared to deliver feedback, and residents find accepting and recognizing feedback challenging. We provided faculty with a spaced education program via email that used cognitive theory of multimedia learning solutions in instructional design. Methods: The 14-week program consisted of one microlecture and 13 skills-based teaching tips. One tip reinforcing knowledge and skills from the microlecture was emailed each week for faculty to practice in the clinical environment with trainees. Participants completed a short quiz, course evaluation, and self-reflection. The new world Kirkpatrick model was used for program evaluation. Results: Fifty-two physician participants received credit for participating; 34 completed the entire course. Of the 34, 32 (94%) identified at least one effective feedback technique, and 27 (79%) were able to define evaluation and recognize observation as the cornerstone of evaluation. Out of the 15 effective feedback characteristics taught, 13 (87%) were identified. Fifty-one participants (98%) rated the program as good/excellent, 52 (100%) wanted more Tuesday's Teaching Tips programs, and the majority recognized change in knowledge and/or skills. Discussion: Participants rated the spaced education program as good/excellent and were able to meet the course objectives. This teaching strategy for faculty development was well received, as it was easily accessible and implemented in the clinical learning environment with trainees.

Planning and Presenting Workshops That Work: A Faculty Development Workshop.

Introduction: Workshops are commonly used in higher education, although faculty often have little or no training in how to develop and deliver this type of teaching methodology. This publication can be used to deliver a 1-hour active learning session to faculty utilizing experiential learning as a framework. Methods: An hour-long workshop on developing and implementing effective workshops was given to five cohorts of participants in the Academic Pediatric Association's Educational Scholars Program (ESP) between 2010 and 2018, following a 2008 pilot. After a brief didactic presentation, participants developed their own workshop plans. A unique reflection in action was utilized to model effective workshop facilitation techniques. Written surveys were used to evaluate the effectiveness of the workshop. Data from the ESP graduates were used to report the percentage of respondents who conducted their own workshop postgraduation. Results: A total of 116 faculty participated in this workshop over the course of 5 years. One hundred and fourteen participants stated they found the session to be useful. The role modeling/reflection by the facilitators and the opportunity to work with others on a workshop plan were described as the most valuable aspects. Approximately 70% of scholars who responded to postgraduation surveys had conducted at least one regional, national, or international workshop. Discussion: This faculty development session implements active and adult learning principles to model and teach participants how to develop and lead an effective workshop. It also provides a mechanism for collaboration among participants to develop a workshop based on shared interests.

Academic General Pediatrics Hiring Practices and Completion of Academic General Pediatrics Fellowships.

OBJECTIVE: Academic General Pediatrics (AGP) is a pediatric subspecialty with substantial faculty contributions in clinical care, research, education, and advocacy. However, AGP fellowship recruitment challenges exist. We aimed to describe AGP hiring practices from 2014 to 2019 and the role of fellowship training in hiring decisions. METHODS: We conducted a cross-sectional survey study of AGP Division Directors (DDs) and Fellowship Program Directors (PDs) from US-based academic institutions. Survey questions were developed iteratively and pilot-tested for content validity. Participants were identified from the Association of American Medical Colleges' directory of pediatric departments, Academic Pediatric Association's AGP Accreditation Committee's list of fellowship programs, and institutional websites. Descriptive analysis was used for close ended survey questions. Narrative responses were reviewed for trends. RESULTS: Forty-nine DDs (57%) and 22 PDs (73%) responded. All DDs reported at least one available faculty position and 73% reported filling a position with protected time. PDs reported 89 graduating fellows, 88% of whom secured an academic position with protected time. Seventy-percent of DDs and 100% of PDs reported that AGP fellows could secure an academic position with protected time, while only 22% and 1%, respectively, reported a graduating pediatric resident could secure a similar position. DDs indicated AGP fellowship trained candidates are preferable for enhancing research and education programs. CONCLUSION: AGP remains an active subspecialty and the majority of graduating fellows secured faculty positions with protected time. Further studies are needed to understand ways to improve visibility of AGP fellowships.

How Full Is Your Tank? A Qualitative Exploration of Faculty Volunteerism in a National Professional Development Program.

OBJECTIVE: Professional development programs (PDPs) within academic professional organizations rely on faculty volunteers, but little is known about the volunteering process and experience. Our aim was to gain insights into the initial decision to volunteer, the experience of volunteering and the decision to re-volunteer or not (ie, remain or leave as a volunteer). The study setting was a PDP of the Academic Pediatric Association, the Educational Scholars Program. METHODS: In 2014, 13 Educational Scholars Program faculty members participated in semistructured phone interviews. The authors performed a general inductive analysis of the data, inductively created codes, and analyzed coded data for emergent themes that led to the creation of a model for recruiting and sustaining volunteers. RESULTS: Four themes related to the initial volunteer decision and the decision to re-volunteer or not (self-interest and altruism, reputation of the program, relevant skill set, and doability), and 4 themes related to the experience of volunteering (emotional impact, career advancement and professional recognition, professional growth, and doability) emerged. The relationship among the themes led to the creation of a model of volunteering, involving a metaphorical volunteerism "tank" that is full when faculty initially volunteer and subsequently fills or empties as a result of dynamic interplay between the themes for each individual. CONCLUSIONS: Leaders of PDPs may find our model of volunteering beneficial for enhancing the emotional and tangible benefits and minimizing the logistical issues of volunteering. This information should contribute to success in recruiting and retaining the volunteers who are essential for developing and sustaining PDPs.

Peer review: a tool to enhance clinical teaching.

BACKGROUND: The system used by academic health centres to evaluate teaching must be valued by the large number of faculty staff that teach in clinical settings. Peer review can be used to evaluate and enhance clinical teaching. The objective of this study was to determine the perceptions of clinical faculty about the effects of participating in peer review. METHODS: Faculty members were observed teaching in a clinical setting by trained peer observers. Feedback was provided using a checklist of behaviours and descriptive comments. Afterwards, semi-structured interviews were conducted to assess the faculty member's perception about the process. Notes from the interviews were analysed using a grounded theory approach. The study was approved by the institutional review boards of all the institutions involved. RESULTS: Three themes emerged from the interviews with faculty members: (1) they found the process to be valuable - they received information that affirmed "good" teaching behaviours, and were prompted to be more focused on their teaching; (2) they were motivated to enhance their teaching by being more deliberate, interactive and learner-centred; and (3) they were inspired to explore other opportunities to improve their teaching skills. DISCUSSION: Peer review is a process that promotes the open discussion and exchange of ideas. This conversation advances clinical teaching skills and allows high-quality teaching behaviours to be strengthened.

Graduate medical education leadership development curriculum for program directors.

OBJECTIVE: Program director (PD) orientation to roles and responsibilities takes on many forms and processes. This article describes one institution's innovative arm of faculty development directed specifically toward PDs and associate PDs to provide institutional resources and information for those in graduate medical education leadership roles. METHODS: The designated institutional official created a separate faculty development curriculum for leadership development of PDs and associate PDs, modeled on the Association of American Medical Colleges-GRA (Group on Resident Affairs) graduate medical education leadership development course for designated institutional officials. It consists of monthly 90-minute sessions at the end of a working day, for new and experienced PDs alike, with mentoring provided by experienced PDs. We describe 2 iterations of the curriculum. To provide ongoing support a longitudinal curriculum of special topics has followed in the interval between core curriculum offerings. RESULTS: Communication between PDs across disciplines has improved. The broad, inclusive nature allowed for experienced PDs to take advantage of the learning opportunity while providing exchange and mentorship through sharing of lessons learned. The participants rated the course highly and education process and outcome measures for the programs have been positive, including increased accreditation cycle lengths. CONCLUSION: It is important and valuable to provide PDs and associate PDs with administrative leadership development and resources, separate from general faculty development, to meet their role-specific needs for orientation and development and to better equip them to meet graduate medical education leadership challenges. This endeavor provides a foundational platform for designated institutional official and PD interactions to work on program building and improvement.

Evaluating the performance of medical educators: a novel analysis tool to demonstrate the quality and impact of educational activities.

PURPOSE: Traditional promotion standards rely heavily on quantification of research grants and publications in the curriculum vitae. The promotion and retention of educators is challenged by the lack of accepted standards to evaluate the depth, breadth, quality, and impact of educational activities. The authors sought to develop a practical analysis tool for the evaluation of educator portfolios (EPs), based on measurable outcomes that allow reproducible analysis of the quality and impact of educational activities. METHOD: The authors, 10 veteran educators and an external expert evaluator, used a scholarly, iterative consensus-building process to develop the tool and test it using real EPs from educational scholars who followed an EP template. They revised the template in parallel with the analysis tool to ensure that EP data enabled valid and reliable evaluation. The authors created the EP template and analysis tool for scholar and program evaluation in the Educational Scholars Program, a three-year national certification program of the Academic Pediatric Association. RESULTS: The analysis tool combines 18 quantitative and 25 qualitative items, with specifications, for objective evaluation of educational activities and scholarship. CONCLUSIONS: The authors offer this comprehensive, yet practical tool as a method to enhance opportunities for faculty promotions and advancement, based on well-defined and documented educational outcome measures. It is relevant for clinical educators across disciplines and across institutions. Future studies will test the interrater reliability of the tool, using data from EPs written using the revised template.

A model to begin to use clinical outcomes in medical education.

The latest phase of the Accreditation Council for Graduate Medical Education (ACGME) Outcome Project challenges graduate medical education (GME) programs to select meaningful clinical quality indicators by which to measure trainee performance and progress, as well as to assess and improve educational effectiveness of programs. The authors describe efforts to measure educational quality, incorporating measurable patient-care outcomes to guide improvement. University of Florida College of Medicine-Jacksonville education leaders developed a tiered framework for selecting clinical indicators whose outcomes would illustrate integration of the ACGME competencies and their assessment with learning and clinical care. In order of preference, indicators selected should align with a specialty's (1) national benchmarked consensus standards, (2) national specialty society standards, (3) standards of local, institutional, or regional quality initiatives, or (4) top-priority diagnostic and/or therapeutic categories for the specialty, based on areas of high frequency, impact, or cost. All programs successfully applied the tiered process to clinical indicator selection and then identified data sources to track clinical outcomes. Using clinical outcomes in resident evaluation assesses the resident's performance as reflective of his or her participation in the health care delivery team. Programmatic improvements are driven by clinical outcomes that are shown to be below benchmark across the residents. Selecting appropriate clinical indicators-representative of quality of care and of graduate medical education-is the first step toward tracking educational outcomes using clinical data as the basis for evaluation and improvement. This effort is an important aspect of orienting trainees to using data for monitoring and improving care processes and outcomes throughout their careers.

USMLE step 1 scores as a significant predictor of future board passage in pediatrics.

PURPOSE: To explore the relationship(s) between USMLE, In-Training Exam, and American Board of Pediatrics (ABP) board-certifying exam scores within a Pediatric residency-training program. METHODS: Data were abstracted from records of graduating residents from the Pediatric residency program at the University of Florida College of Medicine Jacksonville from 1999 to 2005. Seventy (70) residents were identified and their files reviewed for the following information: USMLE Step 1 and 2 scores, in-training exam results and eventual board scores as reported by the ABP. Correlation and regression analyses were performed and compared across all tests. RESULTS: The correlation coefficients between the three types of tests were all statistically significant. Using logistic regression, however, only USMLE Step 1 scores (compared to Step 2) had a statistically significant association with board performance. Interestingly, none of the three in-training exam scores had any additional impact on predicting board performance given one's USMLE Step 1 score. USMLE Step 1 scores greater than 220 were associated with nearly a 95 per cent passage rate on the board-certifying exam. CONCLUSIONS: The data suggests that performance on USMLE Step 1 is an important predictor of a resident's chances of passing the pediatric boards. This information, which is available when a resident initiates training, can be used to identify those at risk of not passing the boards. While Step 1 scores should not be used as a sole determinant in the recruiting process, individual learning plans can be developed and implemented early in training to maximize one's ability to pass the certifying exam.

A walk in the patients' shoes: a step toward competency development in systems-based practice.

OBJECTIVES: To implement and evaluate the effectiveness of scenario-based learning as a method for teaching systems-based practice to pediatric residents. METHODS: Twelve pediatric residents at the University of Florida/Jacksonville participated in an active learning scenario experience during their 1-month community pediatrics block rotation from January 2003 to April 2004. A scenario, developed in partnership with community-based organizations, required the residents to assume the role of a parent faced with multiproblem life situations requiring skills in prioritizing problems and identifying and accessing community resources to address them. Residents documented their assessment of the experience as they went through it by making entries into a learning portfolio and at the end of the experience through written evaluations and exit interviews. A case study design was used to assess resident-perceived impact of this experience. Qualitative methods were used to analyze data from resident portfolio entries, resident written evaluation surveys, and resident exit interviews. RESULTS: Five themes, some of which reflect competencies in systems-based practice, emerged from the data: development of empathy and compassion, increased understanding of the barriers facing patients and families, increased appreciation of social determinants of health, self-perceived increased ability to serve patients, and advantages of active learning. CONCLUSIONS: Active learning experiences that simulate patient situations can be incorporated into community pediatrics training for residents, increasing perceived competence in systems-based practice.

Teaching community pediatrics to pediatric residents: strategic approaches and successful models for education in community health and child advocacy.

To improve child health at a community level, pediatricians require knowledge and skills that have not been traditionally included in residency training. Recent policy statements from the American Academy of Pediatrics and requirements from Accreditation Council for Graduate Medical Education Residency Review committees emphasizing the importance of community pediatrics training have provided additional incentive for pediatric residency programs to actively explore methods of teaching the principles and promoting the practice of community pediatrics to resident trainees. With a growing number of diverse educational models in various stages of practice or development, common themes and approaches to promote successful teaching of community health and child advocacy can be described. This article defines strategies for 2 critical elements of community pediatrics training, engaging residents and building strong community partnerships, then highlights a number of educational models that illustrate key curricular components and methods. Published results from evaluations of some programs suggest that community pediatrics training of this caliber will cultivate a cadre of pediatricians (academic and community based, generalists and subspecialists, researchers and practitioners) who understand child health in the context of community and have the leadership and collaborative skills to improve the health of children in their communities.