Deliberate practice using validated metrics improves skill acquisition in performance of ultrasound-guided peripheral nerve block in a simulated setting.

STUDY OBJECTIVES: The aim of this study was to compare the effects of deliberate vs. self-guided practices (both using validated metrics) on the acquisition of needling skills by novice learners. DESIGN: Randomized Controlled Study. SETTING: Simulation lab, Department of Anesthesia, St.Vincent's Hospital, Dublin. SUBJECTS: Eighteen medical students. INTERVENTIONS: Students were assigned to either (i) deliberate practice (n = 10) or (ii) self-guided practice (n = 8) groups. After completion of a 'learning phase', subjects attempted to perform a predefined task, which entailed advancing a needle towards a target on a phantom gel under ultrasound guidance. Subsequently, all subjects practiced this task using predefined metrics. Only subjects in the deliberate practice group had an expert anesthesiologist during practice. Immediately after completing 'practice phase', all subjects attempted to perform the same task, and, on the following day, made two further attempts in succession. Two trained consultant anesthesiologists assessed a video of each performance independently using the pre-defined metrics. MEASUREMENTS: Number of procedural steps completed and number of errors made. MAIN RESULTS: Compared with novices who self-guided their practice using metrics, those who undertook expert-supervised deliberate practice using metrics completed more steps (performance metrics) immediately after practice (median [range], 14.5 [12-15] vs. 3 [1-10], p < 0.0001) and 24 h later (15 [12-15] vs. 4.5 [1-11], p < 0.0001 and 15 [11-15] vs. 4 [2-14], p < 0.0001). They also made fewer errors immediately after practice (median [range], 0 [0-0] vs. 5 [3-8], p < 0.0001) and 24 h later, (0 [0-3] vs. 6.5 [3-8], p < 0.0001 and 0 [0-3] vs. 4 [2-7], p < 0.0001). CONCLUSION: Combining deliberate practice with metrics improved acquisition of needling skills.

Development of performance and error metrics for ultrasound-guided axillary brachial plexus block.

PURPOSE: Change in the landscape of medical education coupled with a paradigm shift toward outcome-based training mandates the trainee to demonstrate specific predefined performance benchmarks in order to progress through training. A valid and reliable assessment tool is a prerequisite for this process. The objective of this study was to characterize ultrasound-guided axillary brachial plexus block to develop performance and error metrics and to verify face and content validity using a modified Delphi method. METHODS: A metric group (MG) was established, which comprised three expert regional anesthesiologists, an experimental psychologist and a trained facilitator. The MG deconstructed ultrasound-guided axillary brachial plexus block to identify and define performance and error metrics. Experts reviewed five video recordings of the procedure performed by anesthesiologists with different levels of expertise to aid task deconstruction. Subsequently, the MG subjected the metrics to "stress testing", a process to ascertain the extent to which the performance and error metrics could be scored objectively, either occurring or not occurring with a high degree of reliability. Ten experienced regional anesthesiologists used a modified Delphi method to reach consensus on the metrics. RESULTS: Fifty-four performance metrics, organized in six procedural phases and characterizing ultrasound-guided axillary brachial plexus block and 32 error metrics (nine categorized as critical) were identified and defined. Based on the Delphi panel consensus, one performance metric was modified, six deleted and three added. CONCLUSION: In this study, we characterized ultrasound-guided axillary brachial plexus block to develop performance and error metrics as a prerequisite for outcome-based training and assessment. Delphi consensus verified face and content validity.