Assessing Student Performance in a Dedicated Education Unit: Validity of the Creighton Competency Evaluation Instrument.

ABSTRACT: In dedicated education units (DEUs), nurses serving as clinical teaching partners (CTPs) provide formative feedback about student performance. The Creighton Competency Evaluation Instrument (C-CEI) has demonstrated validity and reliability by faculty in both the simulated and clinical environments. The purpose of this pilot study was to determine the content validity of the C-CEI in the direct patient care environment when used by staff nurses functioning as CTPs in the DEU setting. Results indicate that the items of the C-CEI demonstrated necessity, fittingness, and understanding. CTPs reported the C-CEI is a valid instrument for use in the DEU setting.

Reliability and internal consistency findings from the C-SEI.

Human patient simulation (HPS) is increasingly being used as both a teaching and an evaluation strategy in nursing education. To meaningfully evaluate student performance in HPS activities, nurse educators must be equipped with valid and reliable instruments for measuring student performance. This study used a novel method, including leveled, video-archived simulation scenarios, a virtual classroom, and webinar and e-mail communication, to assess the reliability and internal consistency of data produced using the Creighton Simulation Evaluation Instrument. The interrater reliability, calculated using intraclass correlation (2,1) and 95% confidence interval, was 0.952 (0.697, 0.993). The intrarater reliability, calculated using intraclass correlation (3,1) and 95% confidence interval, was 0.883 (-0.001, 0.992), and the internal consistency, calculated using Cronbach's alpha, was α = 0.979. This article includes a sample of the instrument and provides valuable resources and reliability data for nurse educators and researchers interested in measuring student performance in HPS activities.

The development of a quantitative evaluation tool for simulations in nursing education.

In a complex healthcare environment, educating nursing students to safely care for clients is a challenging endeavor. As the use of high fidelity simulations increases, the ability to evaluate students is essential. A review of the literature identified a lack of tested simulation evaluation instruments to accurately measure student performance. A simulation evaluation tool was developed and tested with senior nursing students. Content validity was established from the literature and from the review of the tool by an expert panel. Reliability was established using sixteen simulation sessions, with two trained evaluators at each session. Percent agreement by evaluators ranged from 84.4% to 89.1%. Additional research needs to verify these results with different evaluators, varying levels of students, and additional scenarios. A valid, reliable tool to evaluate simulation experiences improves student assessment skills and ultimately clinical performance.