Australian and New Zealand Society of Respiratory Science position statement for arterial blood gas sampling.

The assessment of gas exchange under varying ambient and metabolic conditions is an important and fundamental investigation of respiratory function. The gold standard is an arterial blood gas (ABG) sample; however, the procedure is not universally performed by medical scientists, is not standardised, and is typically taught by a subjective Halsted 'see one, do one' approach. The Australian and New Zealand Society of Respiratory Science recognised the need to create an ABG position statement that includes the required pre-requisite education, an evidence-based procedure and the minimum reporting and competency assessment requirements. This position statement aims to minimise patient discomfort, to improve puncture success rate and reduce the potential for sample handling and analysis error. Importantly, this position statement translates to all relevant health professionals, including medical officers, scientists, nursing staff and allied health.

Assessment and Implementation of WOAH Day 1 Competencies (AID-1C): a cyclical methodology for curriculum harmonization with international standards.

Introduction: The World Organisation for Animal Health (WOAH) Day 1 Competencies for Graduating Veterinarians provide a standard framework to guide Veterinary Educational Establishments (VEEs) in improving their veterinary public health and population medicine curricula. However, pursuing a curriculum revision to incorporate these standards may be daunting, especially for institutions with limited resources or experience. This manuscript describes a methodology for targeted curriculum revision specifically focused on the WOAH Day 1 Competencies. Phases of the AID-1 process: The Assessment and Implementation of WOAH Day 1 Competencies (AID-1C) is a six-step, cyclical, collaborative methodology that encompasses a series of tools and processes that help a VEE to evaluate their curriculum, identify and prioritize gaps, and develop and implement an action plan based on the results. The six phases of the AID-1C process include: (1) Assessment of the proficiency of the VEE's graduates in Day 1 Competencies using a structured Evaluation Tool; (2) A systematic curricular review and evaluation; (3) Identification and prioritization of interventions through a group problem-solving and prioritization exercise called Focus Forward; (4) Design and development of interventions to address identified gaps; (5) Curricular implementation; and (6) Monitoring and evaluation. The AID-1C methodology relies upon active involvement of senior students, recent graduates, faculty, instructional staff, and employers throughout the process. Conclusion: The AID-1C methodology provides a systematic, participatory, collaborative approach that simplifies the planning and execution of the curricular revision, making a complex process more manageable. This enables VEEs to improve their curricula, while moving toward harmonization with WOAH standards. The result is a curriculum that allows a VEE to train well-rounded and competent veterinarians, with the requisite skills to support the veterinary services in their country.

Assessing the Competence of Nursing Students in Clinical Practice: The Clinical Preceptors' Perspective.

Nursing students' integration of theoretical knowledge and practical abilities is facilitated by their practice of nursing skills in a clinical environment. A key role of preceptors is to assess the learning goals that nursing students must meet while participating in clinical practice. Consequently, the purpose of this study was to explore the current evidence in relation to competency assessment and assessment approaches, and the willingness of preceptors for assessing nursing students' competency in a clinical setting. The scoping review used the five-stage methodological framework that was developed by Arksey and O'Malley, as well as the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews. Relevant studies were searched by applying a comprehensive literature search strategy up to April 2024 across the following databases: CINAHL, OVID MEDLINE, EMBASE, and PUBMED. A total of 11,297 studies published between 2000 and April 2024 were revealed, and 38 were eligible for inclusion, which the research team categorised into three main themes: definitions of competence, tools for assessing competence and preceptors' and mentors' viewpoints in relation to the assessment of nursing students' competence. This review established that there are a multitude of quantitative instruments available to assess clinical competence; however, a lack of consistency among assessment instruments and approaches between countries and higher education institutions is prevalent. Existing research evidence suggests that the preceptors carried out the assessment process clinically and they found difficulties in documenting assessment. The assessing of nursing students' competency and the complexity of assessment is a concern for educators and mentors worldwide. The main concern centers around issues such as the interpretation of competence and complex measurement tools.

Entrustable professional activities-based objective structured clinical examinations in a pharmacy curriculum.

BACKGROUND: The integration of Objective Structured Clinical Examinations (OSCEs) within the professional pharmacy program, contributes to assessing the readiness of pharmacy students for Advanced Pharmacy Practice Experiences (APPEs) and real-world practice. METHODS: In a study conducted at an Accreditation Council for Pharmacy Education (ACPE)-accredited Doctor of Pharmacy professional degree program, 69 students in their second professional year (P2) were engaged in OSCEs. These comprised 3 stations: best possible medication history, patient education, and healthcare provider communication. These stations were aligned with Entrustable Professional Activities (EPAs) and Ability Statements (AS). The assessment aimed to evaluate pharmacy students' competencies in key areas such as ethical and legal behaviors, general communication skills, and interprofessional collaboration. RESULTS: The formulation of the OSCE stations highlighted the importance of aligning the learning objectives of the different stations with EPAs and AS. The evaluation of students' ethical and legal behaviors, the interprofessional general communication, and collaboration showed average scores of 82.6%, 88.3%, 89.3%, respectively. Student performance on communication-related statements exceeded 80% in all 3 stations. A significant difference (p < 0.0001) was found between the scores of the observer and the SP evaluator in stations 1 and 2 while comparable results (p = 0.426) were shown between the observer and the HCP evaluator in station 3. Additionally, a discrepancy among the observers' assessments was detected across the 3 stations. The study shed light on challenges encountered during OSCEs implementation, including faculty involvement, resource constraints, and the necessity for consistent evaluation criteria. CONCLUSIONS: This study highlights the importance of refining OSCEs to align with EPAs and AS, ensuring a reliable assessment of pharmacy students' clinical competencies and their preparedness for professional practice. It emphasizes the ongoing efforts needed to enhance the structure, content, and delivery of OSCEs in pharmacy education. The findings serve as a catalyst for addressing identified challenges and advancing the effectiveness of OSCEs in accurately evaluating students' clinical readiness.

A Comparative Review of Oral Board Delivery Across Procedural Disciplines.

OBJECTIVE: Despite its ubiquity in the certification process among surgical specialties, there is little data regarding oral board delivery across various procedural fields. In this study we sought to determine the specifics of oral board exam administration across surgical disciplines with the goal of highlighting common practices, differences, and areas of innovation. This comparative analysis might further serve to identify unifying principles that undergird the oral board examination process across specialties. DESIGN: A standardized questionnaire was developed that included domains of exam structure/administration, content development, exam prerequisites, information about examiners, scoring, pass/failure rates, and emerging technologies. Between December 2022 and February 2023 structured interviews were conducted to discuss specifics of various oral board exams. Interview answers were compared between various specialties to extrapolate themes and to highlight innovative or emerging techniques among individual boards. SETTING: Interviews were conducted virtually. PARTICIPANTS: Executive members of 9 procedural medical boards including anesthesiology, neurosurgery, obstetrics, and gynecology, ophthalmology, orthopaedic surgery, otolaryngology-head and neck surgery, plastic surgery, general surgery, and urology RESULTS: Common themes include assessment of pre-, intra- and postoperative care; all testing involved candidate examination by multiple examiners and psychometricians were used by all organizations. Important differences included virtual versus in person administration (3 out of 9), inclusion and discussion of candidates' case logs as part of the exam (4 out of 9), formal assessment of professionalism (4 out of 9), and inclusion of an objective structured clinical examination (2 out of 9). CONCLUSIONS: While there are common themes and practices in the oral board delivery process between various surgical fields, and important differences continue to exist. Ongoing efforts to standardize exam administration and determine best practices are needed to ensure oral board exams continue to effectively establish that candidates meet the qualifications required for board certification.

Using neuroimaging to assess brain activity and areas associated with surgical skills: a systematic review.

BACKGROUND: Surgical skills acquisition is under continuous development due to the emergence of new technologies, and there is a need for assessment tools to develop along with these. A range of neuroimaging modalities has been used to map the functional activation of brain networks while surgeons acquire novel surgical skills. These have been proposed as a method to provide a deeper understanding of surgical expertise and offer new possibilities for the personalized training of future surgeons. With studies differing in modalities, outcomes, and surgical skills there is a need for a systematic review of the evidence. This systematic review aims to summarize the current knowledge on the topic and evaluate the potential use of neuroimaging in surgical education. METHODS: We conducted a systematic review of neuroimaging studies that mapped functional brain activation while surgeons with different levels of expertise learned and performed technical and non-technical surgical tasks. We included all studies published before July 1st, 2023, in MEDLINE, EMBASE and WEB OF SCIENCE. RESULTS: 38 task-based brain mapping studies were identified, consisting of randomized controlled trials, case-control studies, and observational cohort or cross-sectional studies. The studies employed a wide range of brain mapping modalities, including electroencephalography, functional magnetic resonance imaging, positron emission tomography, and functional near-infrared spectroscopy, activating brain areas involved in the execution and sensorimotor or cognitive control of surgical skills, especially the prefrontal cortex, supplementary motor area, and primary motor area, showing significant changes between novices and experts. CONCLUSION: Functional neuroimaging can reveal how task-related brain activity reflects technical and non-technical surgical skills. The existing body of work highlights the potential of neuroimaging to link task-related brain activity patterns with the individual level of competency or improvement in performance after training surgical skills. More research is needed to establish its validity and usefulness as an assessment tool.

Competency of malaria laboratory diagnosis at national and provincial levels at the beginning of malaria post-elimination phase, China.

BACKGROUND: Qualified malaria diagnosis competency has contributed to the great achievement of malaria elimination in China. After eliminating malaria, it is still critical to the prevention of re-establishment of malaria transmission in China. This study was aimed to assess the malaria detection competency at national and provincial levels in China at the beginning of malaria post-elimination phase. METHODS: In the present study, different competency assessment activities on the laboratory malaria diagnosis were carried out for national and provincial malaria diagnostic laboratories based on the WHO scoring schedules, including malaria microscopy or nucleic acid amplification tests (NAAT), at the beginning of malaria post-elimination phase (2021-2022) in China. RESULTS: A total of 60 slides for malaria microscopy and 10 specimen for NAAT were included into the WHO External Quality Assessments of malaria parasite qualitative detection and species identification, and the scoring rate was 96.6% (microscopy: 171/177) and 85.0% (NAAT: 17/20), respectively. Moreover, 124 samples were included into the national NAAT quality assessment, and an accuracy of 87.9% (109/124) was found without significance among reference laboratories and non-reference laboratories. CONCLUSIONS: The findings suggest that there is still a need for sustained strengthening of malaria detection competency, particularly in the areas of parasite counting and detection of low-density parasitemia, to ensure prompt detection of the sources of infection and accurate identification of Plasmodium species, and contribute to case management and focus disposal, thereby effectively preventing the malaria re-establishment.

Assessment of learning health system science competency in the equity and justice domain.

Seven knowledge domains were originally defined for the learning health system (LHS) scientist. To assess proficiency in each of these domains, we developed and published an assessment tool for use by emerging LHS scientists and training programs. (LHS, October 2022). In mid-2022, the AHRQ adopted an eighth LHS knowledge domain, Equity and Justice. The addition of this eighth domain emphasizes the importance and centrality of equity in the LHS and improvement science. To extend our prior LHS competency assessment, we developed a proficiency assessment for the new equity and justice domain. Content experts and trainees iteratively defined, reviewed, and edited the assessment criteria. The items were developed by trainees and experts at one LHS training center with experience conducting research focused on healthcare inequities among marginalized populations. The proficiency assessment criteria for the Equity domain apply the same four levels of mastery: "no exposure," "foundational awareness," "emerging," and "proficient" as were used for original competencies. LHS training programs can use these proficiency criteria to monitor skills among emerging scientists across the eight domains, with particular attention to equity and justice.

Can my surgeon scope? Trends in endoscopy training volume and experience among general surgery residents in the United States: a nationwide analysis.

INTRODUCTION: Endoscopy is a major part of surgical training. Accreditation Council for Graduate Medical Education (ACGME) has set standards regarding the minimum volume of endoscopy cases required for graduation. However, there is paucity of high-quality data on the number of cases that most surgical graduates perform. METHODS: We conducted a retrospective analysis of operative case logs of all general surgery residents graduating from ACGME-accredited programs from 2010 to 2023. Data on mean number of endoscopy cases, including mean in each subcategory, were retrieved. Mann-Kendall trend test was used to investigate trends in endoscopy experience. RESULTS: Between 2010 and 2023, the mean overall endoscopy procedures per resident remained stable, with 129.5 in 2010 and 132.1 in 2023 (t = 0.429; p-value = 0.037). The majority of these cases were performed as surgeon junior (76.6% in 2010; 80.9% in 2023), while the remaining cases were logged as surgeon chief. The most substantial contribution to the overall volume was from flexible colonoscopy (mean: 64.1 in 2010 and 67.2 in 2023). The volume for colonoscopy remained fairly stable (t = 0.429; p-value = 0.036). This was followed by esophagogastroduodenoscopy (mean: 35.3 in 2010 and 35.5 in 2023), which saw a significant increase in volume (t = 0.890; p-value ≤ 0.001). There was a significant increase in the number of overall upper endoscopic procedures (t = 0.791; p-value ≤ 0.001), while lower endoscopic procedures did not change significantly (t = 0.319; p-value = 0.125). The procedural volume for endoscopic retrograde cholangiography, sigmoidoscopy, cystoscopy/ureteroscopy, laryngoscopy, and bronchoscopy decreased significantly (p-value < 0.05 for all). CONCLUSION: The overall endoscopy volume for general surgery residents has largely remained stable, with a minor increase in esophagogastroduodenoscopy and no change in colonoscopy. Future research should investigate whether simulation-based exercises can bridge the gap between procedural volume and learning curve requirements for endoscopy.

Multi-center, pragmatic, cluster-randomized, controlled trial of standardized peritoneal dialysis (PD) training versus usual care on PD-related infections (the TEACH-PD trial): trial protocol.

BACKGROUND: Peritoneal dialysis (PD)-related infections, such as peritonitis, exit site, and tunnel infections, substantially impair the sustainability of PD. Accordingly, PD-related infection is the top-priority research outcome for patients and caregivers. While PD nurse trainers teach patients to perform their own PD, PD training curricula are not standardized or informed by an evidentiary base and may offer a potential approach to prevent PD infections. The Targeted Education ApproaCH to improve Peritoneal Dialysis outcomes (TEACH-PD) trial evaluates whether a standardized training curriculum for PD nurse trainers and incident PD patients based on the International Society for Peritoneal Dialysis (ISPD) guidelines reduces PD-related infections compared to usual training practices. METHODS: The TEACH-PD trial is a registry-based, pragmatic, open-label, multi-center, binational, cluster-randomized controlled trial. TEACH-PD will recruit adults aged 18 years or older who have not previously undergone PD training at 42 PD treatment units (clusters) in Australia and New Zealand (ANZ) between July 2019 and June 2023. Clusters will be randomized 1:1 to standardized TEACH-PD training curriculum or usual training practice. The primary trial outcome is the time to the first occurrence of any PD-related infection (exit site infection, tunnel infection, or peritonitis). The secondary trial outcomes are the individual components of the primary outcome, infection-associated catheter removal, transfer to hemodialysis (greater than 30 days and 180 days), quality of life, hospitalization, all-cause death, a composite of transfer to hemodialysis or all-cause death, and cost-effectiveness. Participants are followed for a minimum of 12 months with a targeted average follow-up period of 2 years. Participant and outcome data are collected from the ANZ Dialysis and Transplant Registry (ANZDATA) and the New Zealand Peritoneal Dialysis (NZPD) Registry. This protocol follows the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) guidelines. DISCUSSION: TEACH-PD is a registry-based, cluster-randomized pragmatic trial that aims to provide high-certainty evidence about whether an ISPD guideline-informed standardized PD training curriculum for PD nurse trainers and adult patients prevents PD-related infections. TRIAL REGISTRATION: ClinicalTrials.gov NCT03816111. Registered on 24 January 2019.

Supervisor versus self-assessment of trainee competence: Differences across developmental stages and competency domains.

OBJECTIVES: This research aimed to systematically examine supervisor-trainee differences in assessments of trainee competencies across domains and developmental stages. METHODS: Trainees and supervisors (N = 141 dyads) independently rated trainee performance at the end of placements using the Clinical Psychology Competencies Rating Scale. Based on the number of placement hours completed at the time competence was assessed, the 141 trainees were assigned to three developmental levels (61, 42, and 31 in the groups, respectively). Trajectories of 10 different competencies and trainee-supervisor differences for these competencies were examined across three developmental levels. RESULTS: Compared to their supervisor ratings, trainees underestimated their competence during early stages of training, with this discrepancy reducing at Level 2 and reversing into an overestimation at Level 3. Compared to their own ratings for overall competence, trainees rated Relational and Communication, Reflective Practice, and Professionalism domains as relative strengths, and rated their competence on assessment and intervention domains as relative weaknesses. CONCLUSION: Growth trajectories derived from supervisor assessments were much flatter than trajectories derived from trainee assessments. As predicted by the impostor theory of practitioner development, trainees significantly underestimated their competence early in training. The trend for trainees to overestimate their competence toward the end of their training is a potential concern that warrants further research.

Evaluation of an emergency medicine point-of-care ultrasound curriculum adapted for a resource-limited setting in Guyana.

BACKGROUND: This is a cohort pilot study of senior emergency medicine residents and residency-trained emergency medicine registrars practicing in an urban tertiary academic hospital in Guyana in South America. The primary aim was to assess the effectiveness of the current adapted residency ultrasound training curriculum and guide future ultrasound-specific continuing medical education. Ultrasound image acquisition, interpretation, and integration of ultrasound findings into clinical medical decision-making competency were assessed in a multimodal fashion: a written assessment and a practical assessment. METHODS: This was a cross-sectional cohort pilot study of senior emergency medicine residents and registrars (residency graduates) practicing in Guyana, a low-middle-income country. Ultrasound image acquisition and interpretation competency were assessed in a multimodal fashion: a written assessment and a practical assessment. The results will be reported as simple percentages. Participants will be deemed competent if the combined score is greater than 80% on the assessment. RESULTS: All senior residents and graduates of the residency program were competent in the core point-of-care ultrasound applications. The senior residents averaged 89% proficiency, and the residency graduates subdivided based on years since graduation averaged 87-100% proficiency. The more experienced providers performed better on the practical portion of the evaluation. Evaluating the composite analysis of all the participants revealed the Extended Focused Assessment with Sonography in Trauma (EFAST) exam (96%) and cardiac exam (93%) were done with the most proficiency. CONCLUSION: The assessment results of this pilot study suggest that the current residency ultrasound training curriculum adapted to the resources available is associated with sustained competency after graduation. There was minor attrition of knowledge amongst the senior physicians, but all senior residents and all participating residency graduates were competent in the core ultrasound applications.

Competency-based assessment in neonatal simulation-based training.

Simulation is a cornerstone of training in neonatal clinical care, allowing learners to practice skills in a safe and controlled environment. Competency-based assessment provides a systematic approach to evaluating technical and behavioral skills observed in the simulation environment to ensure the learner is prepared to safely perform the skill in a clinical setting. Accurate assessment of competency requires the creation of tools with evidence of validity and reliability. There has been considerable work on the use of competency-based assessment in the field of neonatology. In this chapter, we review neonatal simulation-based training, examine competency-based assessment tools, explore methods to gather evidence of the validity and reliability, and review an evidence-based approach to competency-based assessment using simulation.

Developing content for American Board of Pediatric Dentistry certification examinations using practice analysis.

BACKGROUND: The American Board of Pediatric Dentistry (ABPD) conducted a practice analysis to guide the development of its certification examination outlines for assessing the knowledge, skills, and abilities of pediatric dentists. This article describes the systematic approach used by the ABPD. METHODS: The ABPD conducted its practice analysis in 4 phases: (1) preparation, (2) focus group meetings, (3) survey, and (4) examination blueprint development. RESULTS: Phase 2 resulted in 150 job tasks relevant to entry-level pediatric dental practice, organized into 10 domains. In Phase 3, 8,730 pediatric dentists received an electronic survey, with 10% returning a completed survey. Respondents rated tasks in terms of frequency and risk, which were analyzed to determine the combined relevance of each task. Phase 4 organized a final list of tasks within each domain and the recommended weighting of domains by certifying examination. CONCLUSIONS: The ABPD practice analysis created a comprehensive outline of the job tasks an entry-level pediatric dentist is expected to perform. The ABPD plans to use the results to help develop the examination content for continuing certification and will use a similar process every 5 through 7 years to update the examination content blueprints to ensure their continued relevance to the practice of pediatric dentistry. PRACTICAL IMPLICATIONS: The ABPD used a process known as practice analysis to ensure that its examinations and continued competency assessments measure the knowledge, skills, and abilities required for safe and effective clinical practice.

Crowd-sourced and expert video assessment in minimally invasive esophagectomy.

BACKGROUND: Video-based assessment by experts may structurally measure surgical performance using procedure-specific competency assessment tools (CATs). A CAT for minimally invasive esophagectomy (MIE-CAT) was developed and validated previously. However, surgeon's time is scarce and video assessment is time-consuming and labor intensive. This study investigated non-procedure-specific assessment of MIE video clips by MIE experts and crowdsourcing, collective surgical performance evaluation by anonymous and untrained laypeople, to assist procedure-specific expert review. METHODS: Two surgical performance scoring frameworks were used to assess eight MIE videos. First, global performance was assessed with the non-procedure-specific Global Operative Assessment of Laparoscopic Skills (GOALS) of 64 procedural phase-based video clips < 10 min. Each clip was assessed by two MIE experts and > 30 crowd workers. Second, the same experts assessed procedure-specific performance with the MIE-CAT of the corresponding full-length video. Reliability and convergent validity of GOALS for MIE were investigated using hypothesis testing with correlations (experience, blood loss, operative time, and MIE-CAT). RESULTS: Less than 75% of hypothesized correlations between GOALS scores and experience of the surgical team (r < 0.3), blood loss (r = - 0.82 to 0.02), operative time (r = - 0.42 to 0.07), and the MIE-CAT scores (r = - 0.04 to 0.76) were met for both crowd workers and experts. Interestingly, experts' GOALS and MIE-CAT scores correlated strongly (r = 0.40 to 0.79), while crowd workers' GOALS and experts' MIE-CAT scores correlations were weak (r = - 0.04 to 0.49). Expert and crowd worker GOALS scores correlated poorly (ICC ≤ 0.42). CONCLUSION: GOALS assessments by crowd workers lacked convergent validity and showed poor reliability. It is likely that MIE is technically too difficult to assess for laypeople. Convergent validity of GOALS assessments by experts could also not be established. GOALS might not be comprehensive enough to assess detailed MIE performance. However, expert's GOALS and MIE-CAT scores strongly correlated indicating video clip (instead of full-length video) assessments could be useful to shorten assessment time.

Development and validation of a simulation-based assessment tool in colonoscopy.

BACKGROUND: Colonoscopy is difficult to learn. Virtual reality simulation training is helpful, but how and when novices should progress to patient-based training has yet to be established. To date, there is no assessment tool for credentialing novice endoscopists prior to clinical practice. The aim of this study was to develop such an assessment tool based on metrics provided by the simulator. The metrics used for the assessment tool should be able to discriminate between novices, intermediates, and experts and include essential checklist items for patient safety. METHODS: The validation process was conducted based on the Standards for Educational and Psychological Testing. An expert panel decided upon three essential checklist items for patient safety based on Lawshe's method: perforation, hazardous tension to the bowel wall, and cecal intubation. A power calculation was performed. In this study, the Simbionix GI Mentor II simulator was used. Metrics with discriminatory ability were identified with variance analysis and combined to form an aggregate score. Based on this score and the essential items, pass/fail standards were set and reliability was tested. RESULTS: Twenty-four participants (eight novices, eight intermediates, and eight expert endoscopists) performed two simulated colonoscopies. Four metrics with discriminatory ability were identified. The aggregate score ranged from 4.2 to 51.2 points. Novices had a mean score of 10.00 (SD 5.13), intermediates 24.63 (SD 7.91), and experts 30.72 (SD 11.98). The difference in score between novices and the other two groups was statistically significant (p<0.01). Although expert endoscopists had a higher score, the difference was not statistically significant (p=0.40). Reliability was good (Cronbach's alpha=0.86). A pass/fail score was defined at 17.1 points with correct completion of three essential checklist items, resulting in three experts and three intermediates failing and one novice passing the assessment. CONCLUSION: We established a valid and reliable assessment tool with a pass/fail standard on the simulator. We suggest using the assessment after simulation-based training before commencing work-based learning.

Comparison of the clinical competency of nurses trained in competency-based and object-based approaches in the Democratic Republic of the Congo: A cross-sectional study.

In the Democratic Republic of the Congo (DRC), the object-based approach (OBA) still remains mainstream in the basic nursing education program, despite the intention of the Ministry of Public Health to expand the competency-based approach (CBA) nationwide. This study aimed to compare the clinical competency of nurses trained with CBA and OBA. A cross-sectional, mixed study was conducted. We developed a self-assessment questionnaire consisting of an individual demographic information, a clinical competency assessment scale and the General Self-efficacy Scale. Nurses trained with CBA or OBA and currently working in health facilities with two to five years of clinical experience were purposively selected from ten cities across nine provinces in the DRC. We also conducted key informant interviews with the clinical supervisors at health facilities. In a comparison of 160 nurses trained with CBA and 153 with OBA, 3 competency domains ("establishing professional communication", "making decisions about health problems", and "performing nursing interventions") of the 5 domains required for nurses had significantly higher scores in the CBA group. The key informant interviews supported these results while revealing various issues in the basic nursing education program. The results support the strategic direction of the Ministry of Public Health in the DRC to expand CBA. Collaboration among education institutions, health facilities, and administrative bodies is crucial for clinical nurses to fully engage their competencies for the population. Other low- and middle-income countries with scarce resources can refer to the developed and implemented competency assessment method applied in this study.

Peer mentoring to support career advancement among underrepresented minority faculty in the programs to increase diversity among individuals engaged in health-related research (PRIDE).

Although mentoring is critical for career advancement, underrepresented minority (URM) faculty often lack access to mentoring opportunities. We sought to evaluate the impact of peer mentoring on career development success of URM early career faculty in the National Heart Lung and Blood Institute-sponsored, Programs to Increase Diversity Among Individuals Engaged in Health-Related Research-Functional and Translational Genomics of Blood Disorders (PRIDE-FTG). The outcome of peer mentoring was evaluated using the Mentoring Competency Assessment (MCA), a brief open-ended qualitative survey, and a semi-structured exit interview. Surveys were completed at baseline (Time 1), 6 months, and at the end of PRIDE-FTG participation (Time 2). The following results were obtained. Between Time 1 and Time 2, mentees' self-assessment scores increased for the MCA (p < 0.01) with significant increases in effective communication (p < 0.001), aligning expectations (p < 0.05), assessing understanding (p < 0.01), and addressing diversity (p < 0.002). Mentees rated their peer mentors higher in the MCA with significant differences noted for promoting development (p < 0.027). These data suggest that PRIDE-FTG peer mentoring approaches successfully improved MCA competencies among URM junior faculty participants with faculty ranking peer mentors higher than themselves. Among URM faculty, peer mentoring initiatives should be investigated as a key strategy to support early career scholar development.

Prompt identification of struggling candidates in near peer-led basic life support training: piloting an online performance scoring system.

BACKGROUND: Bristol Medical School has adopted a near peer-led teaching approach to deliver Basic Life Support training to first year undergraduate medical students. Challenges arose when trying to identify early in the course which candidates were struggling with their learning, in sessions delivered to large cohorts. We developed and piloted a novel, online performance scoring system to better track and highlight candidate progress. METHODS: During this pilot, a 10-point scale was used to evaluate candidate performance at six time-points during their training. The scores were collated and entered on an anonymised secure spreadsheet, which was conditionally formatted to provide a visual representation of the score. A One-Way ANOVA was performed on the scores and trends analysed during each course to review candidate trajectory. Descriptive statistics were assessed. Values are presented as mean scores with standard deviation (x̄±SD). RESULTS: A significant linear trend was demonstrated (P < 0.001) for the progression of candidates over the course. The average session score increased from 4.61 ± 1.78 at the start to 7.92 ± 1.22 at the end of the final session. A threshold of less than 1SD below the mean was used to identify struggling candidates at any of the six given timepoints. This threshold enabled efficient highlighting of struggling candidates in real time. CONCLUSIONS: Although the system will be subject to further validation, our pilot has shown the use of a simple 10-point scoring system in combination with a visual representation of performance helps to identify struggling candidates earlier across large cohorts of students undertaking skills training such as Basic Life Support. This early identification enables effective and efficient remedial support.

Objective structured clinical examination as a competency assessment tool of students' readiness for advanced pharmacy practice experiences in South Korea: a pilot study.

BACKGROUND: The assessment of pharmacy students' readiness to begin the education of an advanced pharmacy practice experience (APPE) in clinical pharmacy settings continues to gain increasing attention. This study aimed to develop an objective structured clinical examination (OSCE) in the core domains acquired through an introductory pharmacy practice experience (IPPE), for evaluating its appropriateness as a tool of assessing clinical pharmacist competency for APPEs in Korean pharmacy students throughout a pilot study. METHODS: OSCE's core competency domains and case scenarios were developed through a literature review, ideation by researchers, and external experts' consensus by a Delphi method. A prospective single-arm pilot test was conducted to implement the OSCE for Korean pharmacy students who completed a 60-h course of in-class simulation IPPE. Their competencies were assessed by four assessors in each OSCE station with a pass-fail grading system accompanied by a scoring rubric. RESULTS: OSCE competency areas including patient counseling, provision of drug information, over-the-counter (OTC) counseling, and pharmaceutical care services were developed with four interactive and one non-interactive cases. Twenty pharmacy students participated in the OSCE pilot test, and their competencies were evaluated by 20 assessors. The performance rate was the lowest in the area of patient counseling for a respiratory inhaler (32.1%) and the highest (79.7%) in OTC counseling for constipation. The students had an average performance rate of 60.4% in their communication skills. Most participants agreed on the appropriateness, necessity, and effectiveness of the OSCE in evaluating pharmacy students' clinical performance and communication skills. CONCLUSIONS: The OSCE model can be used to assess pharmacy students' readiness for off-campus clinical pharmacy practice experience. Our pilot study suggests the necessity of conducting an OSCE domain-based adjustment of difficulty levels, and strengthening simulation-based IPPE education.