Development of Health Professions Education Competencies for a National Fellowship Program: A Group Consensus Process.

ABSTRACT: Health professions educators need knowledge, skills, and attitudes to provide high-quality education within dynamic clinical learning environments. Although postgraduate training opportunities in health professions education (HPE) have increased significantly, no shared competencies exist across the field. This article describes the systematic development of postgraduate HPE competencies for the Health Professions Education, Evaluation, and Research (HPEER) Advanced Fellowship, a 2-year, interprofessional, post-master's degree and postdoctoral HPE training program funded through the Department of Veterans Affairs' Office of Academic Affiliations. Using a modified RAND/University of California at Los Angeles Appropriateness Method, the authors developed competencies from March 2021 to August 2021 that were informed by current practices and standards in HPE. Literature reviews were conducted of published literature from November 2020 to February 2021 and gray literature from February to March 2021, identifying 78 and 274 HPE training competencies, respectively. These competencies were combined with 71 competencies submitted by program faculty from 6 HPEER fellowship sites, resulting in 423 initial competencies. Competencies were organized into 6 primary domains and condensed by deleting redundant items and combining overlapping concepts. Eight subject matter experts completed 3 Delphi surveys and met during 2 nominal group technique meetings. The final 25 competencies spanned 6 domains: teaching methods and learning theories; educational assessment and program evaluation; educational research methods; diversity, equity, and inclusion; interprofessional practice and team science; and leadership and management. In addition to informing the national HPEER curriculum, program evaluation, and learner assessment, these advanced competencies describe the knowledge, skills, and attitudes health professions educators need to provide high-quality education with an emphasis on the global and societal impact of HPE. These competencies represent a step toward leveraging HPE expertise to establish competencies to drive HPE program changes. Other programs should report their competencies and competency development processes to spur further dialog and progress.

Bringing Reproductive Health Guidelines Into Fellowship Training: A National Survey of Adult and Pediatric Rheumatology Fellows and Program Directors.

OBJECTIVE: This study seeks to assess rheumatology fellows' (RFs') and program directors' (PDs') interests in different educational tools and methods and to facilitate curriculum development for reproductive health related to rheumatic disease. METHODS: Constructs were conceptualized in four dimensions: 1) RF and PD confidence in their current curriculum relating to the American College of Rheumatology (ACR) Reproductive Health Guidelines (RHGs), 2) personal interest in this topic, 3) opinions of the importance of this topic, and 4) interest in a range of learning materials and educational experiences. The final survey was distributed to 753 RFs and 179 PDs in the United States using the ACR Committee on Training and Workforce email list. RESULTS: Response rates were 13% (n = 98) for RFs and 25% (n = 44) for PDs. Both groups indicated more interest in the topic than confidence in their curriculum and rated summary sheets, question banks, didactics, and online modules higher than nine other educational tools or methods. Despite interest in the topic, 38% of RF respondents and 24% of PD respondents were unaware of the recently published ACR RHGs. CONCLUSION: RFs and PDs consider reproductive health very important and report high personal interest in this topic. In contrast, both groups indicated lower confidence in current curricula, and substantial proportions of both groups were unaware of recently published guidelines. RFs' and PDs' interests in specific educational modalities are aligned. Curriculum development efforts should prioritize summary sheets, question banks, didactics, and online modules. Efforts are needed to address the educational needs of practicing rheumatologists and other professionals caring for patients with rheumatic disease.

Impact of a Musculoskeletal "Mini-Residency" Professional Development Program on Knee Magnetic Resonance Imaging Orders by Primary Care Providers.

BACKGROUND: The US Department of Veterans Affairs has created a portfolio of educational programs to train primary care providers (PCPs) in the evaluation and management of common musculoskeletal (MSK) conditions. Appropriate resource utilization for evaluation of knee pain, including limiting unnecessary magnetic resonance imaging (MRI) studies, is an important theme of these initiatives. The objective of this study was to report the utilization of knee MRI by PCP providers before and after the MSK education program and to determine the appropriateness of these MRI orders. METHODS: Twenty-six PCPs participated in the MSK Mini-Residency educational program held in Salt Lake City between April 2012 and October 2014. Knee MRI orders submitted by these providers 12 months before and 12 months after their participation were reviewed. Magnetic resonance imaging orders were categorized as "inappropriate," "probably inappropriate," or "possibly appropriate," based on accepted guidelines for knee MRI utilization. Differences in the numbers of precourse and postcourse MRI orders for each of these categories were compared using Student t test. RESULTS: Following our program, MRI orders decreased from 130 (precourse) to 93 (postcourse), a reduction of 28% ( p = 0.04). This reduction was observed entirely within the "inappropriate" and "probably inappropriate" categories; the number of orders categorized as "possibly appropriate" increased, but not significantly. CONCLUSIONS: The MSK Mini-Residency training program was a successful educational intervention and was associated with a reduction in inappropriate knee MRI utilization for some participants, while keeping appropriate MRI utilization stable.

Rheumatology Milestones 2.0: A Roadmap for Competency-Based Medical Training of Rheumatology Fellows in the 21st Century.

OBJECTIVE: Since 2014, rheumatology fellows have been assessed not only based on their ability to provide patient care and possession of medical knowledge but also on their skill in serving as patient advocates, navigators of health systems, and members of a health care team. Such assessments have been carried out through the use of competency-based milestones from the Accreditation Council of Graduate Medical Education (ACGME). However, a needs assessment has demonstrated interest in more context validity and subspecialty relevance since the development of the ACGME internal medicine (IM) subspecialty reporting milestones. The ACGME thus created a milestones working group, and the present study was undertaken to develop Rheumatology Milestones 2.0 as well as a supplemental guide to assist with implementation. METHODS: The working group, consisting of 7 rheumatology program directors, 2 division directors, a community practice rheumatologist, a rheumatology fellow in training, and a public member who is a rheumatology patient, was overseen by the ACGME vice president for milestones development and met through three 12-hour, in-person meetings to compose the rheumatology specialty milestones and supplemental guide within the ACGME Milestones 2.0 project. RESULTS: Informed by the needs assessment data and stakeholders, the working group revised and adapted the ACGME IM subspecialty reporting milestones to create a rheumatology-specific set of milestones and a supplemental guide for their implementation. CONCLUSION: The Rheumatology Milestones 2.0 provides a specialty-specific, competency-based evaluation tool that can be used by program directors, clinical competency committees, and others to assess the competencies of rheumatology fellows during training and help measure readiness for independent practice.

Implementing an established musculoskeletal educational curriculum in a new context: a study of effectiveness and feasibility.

Background: Musculoskeletal (MSK) problems are common, yet many primary care (PC) providers feel inadequately trained to manage these conditions. Previous studies describe successful MSK educational innovations at single sites, but none have reported on subsequent attempts to replicate or adapt these innovations to new contexts. This article presents a study of a national Veterans Affairs MSK training program modified to fit an existing PC educational program.Objectives: (1) To evaluate the effectiveness and feasibility of an adapted MSK curriculum in a new context. (2) To provide a model for adaptation studies in health professions education.Design: A national MSK shoulder and knee curriculum was adapted for San Francisco VA PC trainees, which included a small-group workshop and workplace learning within a newly-created MSK clinic. Effectiveness was evaluated by assessments of trainee confidence in exam and injection skills (via 5-point Likert scale) and faculty-observed performance of knee and shoulder exams (reported as percent of maximum possible score). Feasibility was evaluated by determining acceptability of the program to PC trainees (via 5-point Likert scale) and ability to implement the curriculum using local resources.Results: 52 trainees completed the training during a 2-year period. Trainees' confidence in MSK exam skills improved from 3.3 to 4.5 for shoulder, and from 3.5 to 4.6 for knee. Confidence performing joint injections improved from 2.6 to 4.2 (shoulder) and 2.5 to 4.5 (knee) (p < 0.001 for all). Observed performance improved markedly - from 50% to 92% for shoulder, and 57% to 90% for knee. Feasibility was evident in high acceptability (5.0 for MSK clinic, and 4.9 for workshops), and successful and sustained implementation.Conclusions: Adapting an established MSK curriculum to a new context was effective and feasible. This may serve as a more efficient model for improving trainee education than de novo curriculum design at individual sites.

SimLEARN Musculoskeletal Training for VHA Primary Care Providers and Health Professions Educators.

A simulation-based training curricula applied to the primary care evaluation and management of shoulder and knee pain resulted in improved access to care for veterans and cost savings for the health care system.

Interprofessional Musculoskeletal Education: A Review of National Initiatives from the Department of Veterans Affairs.

This article reviews several national programs in musculoskeletal education initiated by the Department of Veterans Affairs over the past decade. These programs have become sustained interprofessional opportunities for learners across disciplines and along the continuum of health professions education (HPE) and training pathways. This article also describes opportunities for leaders in rheumatology and other HPE programs to join these efforts and to collaborate in the scholarship that will be necessary in constructing educational programs fit for the purpose of ensuring a well-trained, competent workforce of health care providers.

The impact of a musculoskeletal training program on residents' recognition and treatment of osteoporosis.

BACKGROUND: Osteoporosis is inadequately treated in primary care settings. Under-recognition of the condition among male Veterans may contribute to this problem. In order to improve understanding of bone health in older male patients, we developed the "Musculoskeletal (MSK) Education Week", a multidisciplinary clinical training initiative within a primary care ambulatory rotation for internal medicine (IM) residents at the Salt Lake City VA Medical Center. The objective of this study was to evaluate the impact of this program on trainees' recognition of osteoporosis or treatment of this condition following the training experience. METHODS: We examined several clinical behaviors of post-graduate year 1 (PGY-1) IM trainees following their participation in the MSK Education Week between July 1-April 30, 2014. To determine the prevalence of these clinical behaviors, we conducted an observational study of patients age 50 and older enrolled at the Salt Lake City VA Healthcare System from July 1, 2013 to May 31, 2014. We used time-dependent multivariable Cox proportional hazard models to evaluate the impact of the training program on 4 osteoporosis-related outcomes: (1) completion of dual energy X-ray absorptiometry (DXA) scan, (2) diagnosis of osteopenia, (3) diagnosis of osteoporosis, and (4) initiation of osteoporosis medications. RESULTS: Twenty-six PGY-1 IM residents participated in the MSK Education Week, and 43,678 Veterans were identified over these periods of observation. In the Veterans cohort, 1154 had an encounter with a provider who had completed the training (and were therefore "exposed" to the training) and 42,524 Veterans did not. After adjusting for confounders, the effect of the provider training program was significant for DXA (HR = 1.78, 95% CI: 1.11, 2.87), osteoporosis diagnosis (HR = 3.90, 95% CI: 2.09, 7.29), and initiation of medications (HR = 2.87, 95% CI: 2.02, 4.09) outcomes. CONCLUSIONS: We have shown that IM residents' participation in the MSK Education Week was associated with significantly improvements in their completion of DXA scans, diagnosis of osteoporosis, and initiation of fracture-reducing medications in a population of US Veterans. Long-term follow up is needed to determine whether these initial results are followed by actual reductions in osteoporotic fractures.

Validity evidence for two objective structured clinical examination stations to evaluate core skills of the shoulder and knee assessment.

BACKGROUND: We developed two objective structured clinical examinations (OSCEs) to educate and evaluate trainees in the evaluation and management of shoulder and knee pain. Our objective was to examine the evidence for validity of these OSCEs. METHODS: A multidisciplinary team of content experts developed checklists of exam maneuvers and criteria to guide rater observations. Content was proposed by faculty, supplemented by literature review, and finalized using a Delphi process. One faculty simulated the patient, another rated examinee performance. Two faculty independently rated a portion of cases. Percent agreement was calculated and Cohen's kappa corrected for chance agreement on binary outcomes. Examinees' self-assessment was explored by written surveys. Responses were stratified into 3 categories and compared with similarly stratified OSCE scores using Pearson's coefficient. RESULTS: A multi-disciplinary cohort of 69 examinees participated. Examinees correctly identified rotator cuff and meniscal disease 88% and 89% of the time, respectively. Inter-rater agreement was moderate for the knee (87%; k = 0.61) and near perfect for the shoulder (97%; k = 0.88). No correlation between stratified self-assessment and OSCE scores were found for either shoulder (0.02) or knee (-0.07). CONCLUSIONS: Validity evidence supports the continuing use of these OSCEs in educational programs addressing the evaluation and management of shoulder and knee pain. Evidence for validity includes the systematic development of content, rigorous control of the response process, and demonstration of acceptable interrater agreement. Lack of correlation with self-assessment suggests that these OSCEs measure a construct different from learners' self-confidence.

Effectiveness of an Interprofessional and Multidisciplinary Musculoskeletal Training Program.

BACKGROUND: Musculoskeletal (MSK) problems are common, and a recent US Bone and Joint Initiative calls for new models of education and professional collaboration. Evidence of feasibility and acceptability of innovative methods are needed. OBJECTIVE: We assessed if an experimental immersion interdisciplinary MSK curriculum would be acceptable to residents from different specialties, be feasible within existing rotations, and be effective in strengthening clinical skills. METHODS: Through funding from the Veterans Affairs Office of Academic Affiliations and the Office of Specialty Care, we developed a Center of Excellence in MSK Care and Education. A core element is the monthly MSK Education Week, which teaches skills and provides opportunities to apply these in clinical settings. Participants include internal medicine, physical medicine and rehabilitation, and orthopaedic surgery residents, as well as students and residents from other health professions programs. All were assigned to the MSK week in lieu of other clinical experiences. Faculty encompassed primary care, rheumatology, endocrinology, orthopaedics, and physical medicine and rehabilitation. Assessments include surveys and a 2-station objective structured clinical examination (OSCE). RESULTS: Since 2012, a total of 176 trainees have participated. Percentage of trainees reporting ability to evaluate and manage MSK complaints increased (9% to 87% for shoulder; 18% to 86% for knee), and confidence performing MSK injections increased from 10% to 70%. Competency in evaluation of shoulder and knee pain was confirmed by OSCEs. CONCLUSIONS: The MSK week program was accepted by residents from the 3 specialties, with learners reporting improved ability to perform shoulder and knee examinations, as demonstrated by OSCEs.

"Mini-Residency" in Musculoskeletal Care: a National Continuing Professional Development Program for Primary Care Providers.

INTRODUCTION: A cost-effective professional development program enhancing musculoskeletal (MSK) skills of physicians and allied health providers working in primary care settings has been reported at a single site. This article describes the first 2 years of the national expansion and implementation of a 3-day "MSK Mini-residency." METHODS: Faculty from Veterans Affairs (VA) medical centers worked in partnership with national program faculty from the Salt Lake City VA to present an intensive, integrated, multidisciplinary program to strengthen the skills of primary care providers in evaluating and managing MSK conditions common in primary care. Course assessments included written surveys and a two-station observed structured clinical examination (OSCE) evaluating the physical examination of the shoulder and knee. RESULTS: In the first 2 years of the program, 13 VA facilities participated. Two hundred twenty-seven health care providers, including 135 physicians, were trained. Two hundred seven participants (91 %) completed all pre- and post-course written assessments and the two-station OSCE. DISCUSSION: The MSK Mini-residency program is an effective and well-received mixed-method educational initiative to strengthen the skills of primary care physicians and other health care providers in evaluating and managing patients with MSK complaints and to document their competence in performing physical examinations of the shoulder and knee. The 2-year experience in implementation suggests that this model of educational partnerships is a feasible approach to disseminating innovative educational programs in a way that preserves curricular consistency yet is adaptable to local needs.

Rheumatology Research Foundation Clinician Scholar Educator Award: Fifteen Years Promoting Rheumatology Educators and Education.

OBJECTIVE: The Rheumatology Research Foundation's Clinician Scholar Educator (CSE) award is a 3-year career development award supporting medical education research while providing opportunities for mentorship and collaboration. Our objective was to document the individual and institutional impact of the award since its inception, as well as its promise to strengthen the subspecialty of rheumatology. METHODS: All 60 CSE Award recipients were surveyed periodically. Fifty-six of those 60 awardees (90%) responded to requests for survey information that included post-award activities, promotions, and further funding. Data were also collected from yearly written progress reports for each grant. RESULTS: Of the total CSE recipients to date, 48 of 60 (80%) are adult rheumatologists, 11 of 60 (18%) are pediatric rheumatologists, and 1 is an adult and pediatric rheumatologist. Two-thirds of survey respondents spend up to 30% of their total time in educational activities, and one-third spend greater than 30%. Thirty-one of the 60 CSE recipients (52%) have published a total of 86 medical education papers. Twenty-six of 52 (50%) had received an academic promotion following the award. Eleven awardees earned advanced degrees. CONCLUSION: We describe the creation and evolution of a grant program from a medical subspecialty society foundation and the impact on producing education research, individual identity formation, and ongoing support for educators. This community of rheumatology scholar educators now serves as an important resource at the national level for the American College of Rheumatology and its membership. We believe that this grant may serve as a model for other medical societies that want to promote education scholarship and leadership within their specialties.

Mini-Residency in Musculoskeletal Care: An Interprofessional, Mixed-Methods Educational Initiative for Primary Care Providers.

OBJECTIVE: A structured educational effort to train primary care providers (PCPs) to perform joint injections has been projected to be cost effective. The US Department of Veterans Affairs (VA) is developing a national continuing professional development program to train PCPs in the evaluation and management of patients with common musculoskeletal conditions. The objective of this pilot project was to confirm initial projections of cost effectiveness and to inform further efforts to develop this program on a national scale. METHODS: The Salt Lake City VA served as the national hub for this pilot project. The initial phase included 19 providers, who participated in a weeklong mixed-methods course. Evaluation was conducted by the VA Employee Education System. Assessments included anonymous surveys, structured telephone interviews, and a review of de-identified procedure codes. RESULTS: The survey response rate was 100%, with uniformly positive results. All participants recommended the expansion of this program. The mean number of joint injections performed each month increased from 0.3 (precourse) to 3.5 (postcourse), congruent with prior analyses projecting program cost effectiveness. CONCLUSION: The musculoskeletal mini-residency is a well-received program, with early evidence of cost effectiveness and impact aligned with course objectives. This pilot program is a foundation for efforts in the national dissemination of this initiative.

Cost effectiveness of training rural providers to perform joint injections.

OBJECTIVE: Community-based outpatient clinics (CBOCs) have been established by the Department of Veterans Affairs (VA) to provide primary care services to veterans living in remote and rural regions. The objective of this study was to evaluate the cost effectiveness of training rural primary care providers to perform knee injections in CBOCs, thereby avoiding referring the patient to an urban medical center for an injection by rheumatology or orthopedic specialists. METHODS: We developed a decision-analysis model to compare costs and outcomes between rural providers who are trained to perform knee injections versus those who are not trained, therefore requiring a referral to a specialist to provide the injections. The model was run separately using costs from the perspective of the VA as well from the patient's perspective. The effectiveness outcome was quality-adjusted life years (QALYs). Probabilistic sensitivity analyses were performed using 10,000 second-order Monte Carlo simulations. RESULTS: In our base-case analyses, the incremental cost-effectiveness ratio for trained rural providers was $21,190/QALY using costs from the perspective of the VA and $205/QALY using costs from the patient's perspective. Training rural providers was cost effective in 74.4% and 93.6% of 10,000 Monte Carlo simulations at a willingness-to-pay threshold of $50,000/QALY from the perspectives of the VA and the patient, respectively. CONCLUSION: Training rural providers to perform knee injections for patients with knee pain secondary to osteoarthritis appears cost effective using the commonly used threshold of $50,000/QALY if more than 20 such patients per year are seen at rural primary care clinics. These results provide support for our ongoing efforts to implement such a training program.

Peripheral neuropathy: a complication of systemic sclerosis.

We performed bedside testing for peripheral neuropathy in our systemic sclerosis (SSc) population to determine whether foot care guidelines should be developed for SSc. Twenty consecutive SSc patients and 20 healthy control (HC) patients were evaluated for peripheral neuropathy in both feet using the 10-g Semmes-Weinstein monofilament examination (SWME) and 128 Hz vibration sensation using the on-off method. Independent, blinded, vibratory sensation, and SWME evaluations were performed on each subject by two investigators who had completed a training session to standardize each exam. An additional consecutive 20 patients with type 2 diabetes mellitus (DM) were examined by a diabetologist to compare with peripheral neuropathy prevalence in SSc patients. We examined the inter-rater variability using Cohen's kappa. We compared SWME and vibratory sensation in SSc to HC using Fisher's exact. The t test was used to compare duration of disease and modified Rodnan skin score (mRSS) for those with abnormal SWME or vibratory sensation. Two of 20 SSc patients reported sensory foot symptoms consistent with peripheral neuropathy prior to the examination. Inter-rater agreement for both SWME and vibratory sensation was strong (kappa: 0.72 and 0.83, respectively). Two HC and 12 SSc patients demonstrated abnormal vibratory sense (one-sided Fishers' exact, p < 0.002). No HC and four SSc patients had abnormal monofilament exams (one-sided Fisher's exact, p = 0.053). Neither mRSS (p = 0.28) nor duration of non-Raynauds (p = 0.07) symptoms differed between those with peripheral neuropathy and those without. Duration of Raynaud's symptoms were clinically significantly associated with presence of peripheral neuropathy (p = 0.04). The prevalence of sensory loss to monofilament in SSc was identical to DM patients (4/20). SSc patients have a considerable prevalence of pedal peripheral neuropathy as detected by loss of vibratory sensation or inability to sense the 10-g SWME. Further studies are indicated to determine if routine screening for neuropathy and subsequent podiatric care for SSc patients with abnormalities can reduce pedal complications.

The prevalence and clinical correlates of an auscultatory gap in systemic sclerosis patients.

Introduction. Accurate blood pressure (BP) measurement is essential to the diagnosis and management of hypertension in patients with systemic sclerosis (SSc) to help prevent renal and cardiovascular complications. The presence of an auscultatory gap during manual BP measurement-the temporary disappearance of the Korotkoff sounds during cuff deflation-leads to a potentially important underestimate of systolic BP if undetected. Objectives. Since the presence of an auscultatory gap is frequently associated with increased vascular stiffness, we investigated its presence and correlates in 50 consecutive SSc patients. Methods. For each patient, BP was measured sequentially using three different approaches performed in the same order. Results. Sixteen of 50 patients (32%) had an auscultatory gap which if undetected would have resulted in clinically important underestimates of systolic BP in 4 patients. The presence of an auscultatory gap was statistically associated with the presence of antibodies to RNA polymerase III (P<0.0068) and SSc diagnosis type (P<0.01). Conclusions. Our study demonstrates that auscultatory gaps are relatively common in SSc and correlate with markers for SSc vasculopathy. If undetected auscultatory gaps may result in clinically important underestimation of BP. Thus, electronic oscillometric BP may be preferred in SSc patients.

Spouses of Persian Gulf War I veterans: medical evaluation of a U.S. cohort.

Ten years after the 1991 Persian Gulf War (GW I), a comprehensive evaluation of a national cohort of deployed veterans (DV) demonstrated a higher prevalence of several medical conditions, in comparison to a similarly identified cohort of nondeployed veterans (NDV). The present study determined the prevalence of medical conditions among nonveteran spouses of these GW I DV and NDV. A cohort of 490 spouses of GW I DV and 537 spouses of GW I NDV underwent comprehensive face-to-face examinations. No significant differences in health were detected except that spouses of DV were less likely to have one or more of a group of six common skin conditions. We conclude that, 10 years after GW I, the general physical health of spouses of GW I DV is similar to that of spouses of NDV.