Longitudinal Assessment to Evaluate Continued Certification and Lifelong Learning in Healthcare Professionals: A Scoping Review.

The balance of lifelong learning with assessment for continued certification is a challenge faced by healthcare professions. The value of single-point-in-time assessments has been questioned, and a shift to longitudinal assessments (LA) has been undertaken to assess lifelong learning over-time. This scoping review was conducted to inform healthcare certifying organizations who are considering LA as an assessment tool of competence and lifelong learning in healthcare professionals. A search of 6 databases and grey literature yielded 957 articles. After screening and removal of duplicates, 14 articles were included. Most articles were background studies informing the underpinnings of LA in the form of progress testing, pilot studies, and process of implementation. Progress testing is used in educational settings. Pilot studies reported satisfaction with LA's ease of use, online format, and provision of lifelong learning. Implementation processes reveal that key aspects of success include stakeholder participation, phased rollout, and a publicly available content outline. Initial outcomes data affirm that LA addresses knowledge gaps, and results in improved performance on maintenance of certification exams. Future research is needed to substantiate validity evidence of LA and its correlation with high-stakes exam performance when assessing lifelong learning and continued competence of healthcare professionals over time.

Translation of Credentialing Examination for Providers with English as a Second Language: An Exploratory Study.

Racial and ethnic minorities disproportionately suffer the burden of adverse health outcomes in the United States. Increasing the diversity of healthcare providers may help decrease disparities in outcomes. Unfortunately, language barriers may affect performance in nursing school and credentialing examinations. The purpose of this exploratory study was to identify current practices and trends affecting the translation of credentialing examinations. Commissioned by the National Board of Certification and Recertification for Nurse Anesthetists, a survey was sent to the credentialing organizations soliciting information about their exam translation practices and considerations. Among the 27 credentialing organizations (two licensure and 25 certification organizations) that completed the survey, 63% were from healthcare. All the organizations offered their credentialing examinations in English. Some offered their examination in Chinese/Mandarin (15%), Spanish (11%), French (7%), and Arabic (7%). The majority (78%) do not translate their examinations into another language. Among the six credentialing organizations translating their examinations, 67% translate one, and 17% translate two examinations. Most use the forward and back-translation techniques. For organizations embarking on a multilingual credentialing program, it is imperative to ensure psychometric equivalence of their examinations. Translation can help ensure that candidates are tested on their intended competencies, not their language proficiency.

Longitudinal assessment: A strategy to improve continuing professional certification.

Healthcare certification organizations carefully balance a commitment to bring value to their membership through programs that support lifelong learning and professional growth, while protecting the public by ensuring competent certified practitioners. These certifying bodies are challenged with remaining current with their maintenance of certification programs while keeping pace with the growing breadth of knowledge, industry standards and guidelines, innovative advances, and rapid technological gains in testing and assessment. Within the context of process innovation, the National Board of Certification and Recertification for Nurse Anesthetists (NBCRNA) evaluated the current landscape of Longitudinal Assessment (LA) as a potential strategy for the assessment of core knowledge as part of their Continued Professional Certification Program for Certified Registered Nurse Anesthetists. This manuscript details the evaluation of LA using a Logic Model as the tool to scaffold inquiry, a review of LA literature, an environmental scan of current LA programs with identification of LA program elements available, and the results of a LA feasibility study. The findings substantiate that continued professional certification which incorporates a LA strategy can augment lifelong learning, but is not an assessment strategy that can be implemented without thoughtful planning, customization and continuous maintenance.

Development and Initial Validation of a New Practice Context Assessment Tool for Ambulatory Practices Engaged in Quality Improvement.

Variable success with quality improvement (QI) efforts in ambulatory care is often attributed to differences in local contexts. Identifying and addressing patient-, practice-, or community-level contextual factors might improve implementation of QI projects. The authors developed and validated a framework for a Practice Context Assessment (PCA), and then created the PCA instrument to glean insights from staff on contextual factors and distributed it at 10 ambulatory practice sites. The PCA framework showed acceptable expert-assessed content validity, with content validity index scores ranging from 0.74 (community engagement) to 0.97 (leadership). The PCA instrument comprised several scales grouped into 7 domains with Cronbach α scores from 0.83 (leadership) to 0.95 (patient and family engagement). The PCA framework provides a valid construct to help ambulatory practices understand contextual issues that might influence QI projects. A revised version of the PCA instrument is now ready for further testing.

A public-private partnership develops and externally validates a 30-day hospital readmission risk prediction model.

INTRODUCTION: Preventing the occurrence of hospital readmissions is needed to improve quality of care and foster population health across the care continuum. Hospitals are being held accountable for improving transitions of care to avert unnecessary readmissions. Advocate Health Care in Chicago and Cerner (ACC) collaborated to develop all-cause, 30-day hospital readmission risk prediction models to identify patients that need interventional resources. Ideally, prediction models should encompass several qualities: they should have high predictive ability; use reliable and clinically relevant data; use vigorous performance metrics to assess the models; be validated in populations where they are applied; and be scalable in heterogeneous populations. However, a systematic review of prediction models for hospital readmission risk determined that most performed poorly (average C-statistic of 0.66) and efforts to improve their performance are needed for widespread usage. METHODS: The ACC team incorporated electronic health record data, utilized a mixed-method approach to evaluate risk factors, and externally validated their prediction models for generalizability. Inclusion and exclusion criteria were applied on the patient cohort and then split for derivation and internal validation. Stepwise logistic regression was performed to develop two predictive models: one for admission and one for discharge. The prediction models were assessed for discrimination ability, calibration, overall performance, and then externally validated. RESULTS: The ACC Admission and Discharge Models demonstrated modest discrimination ability during derivation, internal and external validation post-recalibration (C-statistic of 0.76 and 0.78, respectively), and reasonable model fit during external validation for utility in heterogeneous populations. CONCLUSIONS: The ACC Admission and Discharge Models embody the design qualities of ideal prediction models. The ACC plans to continue its partnership to further improve and develop valuable clinical models.