ABSTRACT
Introduction Ultrasound-guided peripheral venous catheter placement (UG-PVCP) is a key skill for establishing intravenous access, especially in patients with anatomical challenges. Ultrasound is highly operator-dependent, and it is essential to ensure a sufficient level of competence when educating healthcare professionals. Competence can be acquired through simulation-based training (SBT) using phantoms or simulators. We developed a phantom for SBT, and in this study, we explore the phantom's usability and technical fidelity. Methods Novices with no experience in UG-PVCP and experts who routinely performed the procedure were asked to perform three ultrasound-guided catheter placement attempts on the phantom. Afterward, they were asked to complete a usability questionnaire consisting of 14 questions exploring the usability and fidelity of the phantom. Results Fifty-seven participants were included in the study: 29 novices and 28 experts. When assessing positive questions about the frequency of use, ease of use, integration of functionality, quickness to learn, and confidence level, the study showed a median score of 4 to 5 out of 5 in the two groups. The median was 1 to 2 out of 5 for negative questions assessing cumbersomeness, unnecessary complexity, and model inconsistency. In an additional comment textbox, one participant mentioned that the cannulation did not feel realistic but that it was good for cannulation practice. Conclusions We believe the phantom is suitable for an educational curriculum since it shows a high level of usability, scoring high on positive questions while scoring low on negative questions, and having high functional fidelity.
ABSTRACT
INTRODUCTION: Although there is substantial evidence supporting the benefits of simulation-based education (SBE), its widespread and effective implementation remains challenging. The aim of this study was to explore the perceptions of top-level health care leaders regarding SBE and the barriers and facilitators that influence its wide implementation as part of the postgraduate surgical curricula in Denmark. METHODS: We conducted semi-structured interviews with top-level health care leaders who were chosen based on their roles in ensuring high-quality patient care delivery and developing strategies to achieve the goals of the entire health care system. The interview transcripts were translated into English, and a thematic approach was used to code and inductively analyse the data. We used the Consolidated Framework for Implementation Research to identify and understand the determinants to a successful implementation of SBE. RESULTS: We interviewed 13 participants from different political and administrative levels. We found that the participants had limited knowledge about SBE, which highlighted a disconnection between these leaders and the educational environment. This was further compounded by a lack of effective communication and inadequate information dissemination between simulation centres and higher-level organisations. While participants recognised the benefits of SBE for doctors in training, they expressed concerns about the implementation given the already strained health care system and limited resources. The need for evidence, particularly in the context of patient safety, was emphasised to facilitate SBE implementation. Although participants supported the implementation of SBE, it was unclear who should initiate action. DISCUSSION: This study highlighted the perspectives of top-level health care leaders regarding SBE and identified the determinant factors for a successful implementation. Effective communication channels are crucial to enhance collaborations and reduce the disconnection between the different health care organisational levels. Strategic implementation processes, including the roles and responsibilities, should be defined and established. These will inform decisions regarding the implementation strategies to effectively integrate SBE into the residency training curricula.
Subject(s)
Curriculum , Internship and Residency , Humans , Delivery of Health Care , Educational Status , Leadership , Qualitative ResearchABSTRACT
Haematocolpos, caused by imperforate hymen, is a rare condition where menstrual blood accumulates in the vagina. Adolescent girls presenting with amenorrhoea, cyclical abdominal pain, and pelvis mass should be evaluated for this condition. Diagnosis requires a gynaecological examination. However, myths surrounding the hymen may impede proper medical care. Addressing these misconceptions is essential for promoting gynaecological care and ensuring timely evaluation and treatment. This case report emphasises the significance of effective communication in preventing misdiagnoses and care delays.
Subject(s)
Hematocolpos , Hymen , Female , Adolescent , Humans , Hymen/surgery , Gynecological Examination/adverse effects , Vagina , Hematocolpos/etiology , Abdominal Pain/diagnosis , Abdominal Pain/etiologyABSTRACT
BACKGROUND: Surgical residents need structured and objective feedback to develop their skills and become capable of performing surgical procedures autonomously. A shortage of experienced surgical staff has prompted residents to seek feedback from self-assessment and peer assessments. OBJECTIVES: We investigated whether surgical residents can reliably rate their own and their peers' basic surgical skills using the Global Rating Scale (GRS) from the Objective Structured Assessment of Technical Skills. METHODS: The study was a prospective and descriptive study conducted using gap analysis at the Copenhagen Academy for Medical Education and Simulation (Copenhagen, Denmark) from 2016 to 2017. Surgical residents were recruited during a course in basic open surgical skills. Among 102 course participants, 53 met the inclusion criteria and 22 participated in the study. RESULTS: We recruited surgical residents based in the Capital Region and Zealand Region of Demark, and 42% of eligible residents participated in the study. Surgical residents underestimated their own surgical performance (median, 17 [range, 15-18] vs. 20 [range, 19.75-22]; P < 0.001). They also rated their peers lower than an experienced rater did (median 10 [range, 8.75-14] vs. 15 and median 20.5 [range, 19-22] vs. 23; both P < 0.001). Gap analysis revealed residents had unrecognized strengths (ie, self-underappraisal) in most GRS domains. CONCLUSIONS: Ratings are unreliable when surgical residents assess their own and their peers' performances using GRS. A gap analysis revealed unrecognized strengths in time and motion, instrument handling, knowledge of instruments and sutures, and knowledge of specific procedure as well as unrecognized weaknesses in flow of operation and forward planning.
Subject(s)
General Surgery , Internship and Residency , Humans , Self-Assessment , Prospective Studies , Clinical Competence , General Surgery/educationABSTRACT
SUMMARY STATEMENT: Simulation-based training using virtual reality head-mounted displays (VR-HMD) is increasingly being used within the field of medical education. This article systematically reviews and appraises the quality of the literature on the use of VR-HMDs in medical education. A search in the databases PubMed/MEDLINE, Embase, ERIC, Scopus, Web of Science, Cochrane Library, and PsychINFO was carried out. Studies were screened according to predefined exclusion criteria, and quality was assessed using the Medical Education Research Study Quality Instrument. In total, 41 articles were included and thematically divided into 5 groups: anatomy, procedural skills, surgical procedures, communication skills, and clinical decision making. Participants highly appreciated using VR-HMD and rated it better than most other training methods. Virtual reality head-mounted display outperformed traditional methods of learning surgical procedures. Although VR-HMD showed promising results when learning anatomy, it was not considered better than other available study materials. No conclusive findings could be synthesized regarding the remaining 3 groups.
Subject(s)
Simulation Training , Virtual Reality , HumansABSTRACT
INTRODUCTION: Asking participants to rate their own performance during unsupervised training in laparoscopy is reliable and may be cost-effective. The objective of the study was to explore the reliability of self-rated examinations where participants rate their own performance and decide themselves when they have passed tasks in basic laparoscopic skills. METHODS: This prospective observational study was conducted at the Copenhagen Academy for Medical Education and Simulation where simulation-based laparoscopic skill training is offered. Here, participants taking part in a basic laparoscopic skills course were asked to rate their own performance and decide when they had passed the Training and Assessment of Basic Laparoscopic Techniques test. To explore reliability, all examinations were video recorded and rated by a blinded rater after the end of the course. RESULTS: Thirty-two surgical trainees participated in the course, and 28 completed the study. We found a high reliability when comparing self-rated scores and blinded ratings with an intraclass correlation coefficient of 0.89 ( P < 0.001); self-rated scores compared with blinded ratings were not significantly different (mean = 451 vs. 455, P = 0.28), and the participants did not underestimate nor overestimate their performance. CONCLUSIONS: Ratings from self-rated examinations in a basic laparoscopic skills course are reliable, and participants neither underestimate nor overestimate their performance. Self-rated examinations may also be beneficial because they also can offer a cost-effective approach to assessment of surgical trainees.
Subject(s)
Laparoscopy , Simulation Training , Clinical Competence , Computer Simulation , Humans , Laparoscopy/education , Reproducibility of Results , Simulation Training/methodsABSTRACT
INTRODUCTION: Simulation training at home improves access to training, but motivation can be difficult to maintain. Dyad training could keep trainees motivated. This study aimed to examine the effect of self-regulated training of basic surgical skills in pairs versus individually. METHODS: One hundred one medical doctors were included in this prospective, mixed-method, simulation-based study. Participants were randomized to train individually or in pairs during a 6-week course in open surgical skills, consisting of didactic instructions and self-directed training at home. Trainees kept a training log and filled in a questionnaire. Skills were tested before and after the course. Tests were rated by an expert using the Objective Structured Assessment of Technical Skills Global Rating Scale. RESULTS: Ninety-seven doctors completed the study. We found no differences in test score between dyad and individual trainees. Dyad trainees compared with individual trainees improved by 7.23 points (intercept estimate) versus 6.94 points, respectively (P = 0.881). Dyad trainees trained less frequently [7.3 times (intercept estimate) vs. 12.1 times, P < 0.001, but for longer intervals compared with individual trainees (68 minutes vs. 38 minutes)]. Dyad trainees reported benefits such as having a sparring partner, receiving feedback, corrections, increased motivation, having fun, and more structured training sessions. However, the coordination of training sessions was difficult. CONCLUSIONS: No differences were found between dyad trainees and individual trainees in improvement of surgical skills. Off-site dyad training led to fewer, but longer training sessions, which may have negatively impacted the effectiveness of training. Dyad trainees perceived dyad training beneficial.
Subject(s)
Clinical Competence , Simulation Training , Computer Simulation , Humans , Motivation , Prospective StudiesABSTRACT
PURPOSE: Teaching technical skills through the use of guided discovery learning (GDL) is an ongoing topic of research. In this approach, learners practice and struggle before receiving formal instruction. This has shown promise in other domains of learning, yet in the realm of procedural skills, clarity is still needed. This study seeks to address these gaps by investigating efficacy and mechanisms relating to application for a GDL approach in teaching basic surgical skills. METHOD: In 2018, young surgical trainees (N = 16) undertook a 6-week open surgical course applying the principles of GDL, each lesson beginning with a discovery phase before subsequent instruction and practice. A concurrent triangulation mixed-methods approach was used with direct observation and collection of semistructured interviews using a framework designed from productive failure literature. At the end of the course, all participants took a conceptual knowledge test and a performance-based skills test. Performance on the skills test was rated using global ratings and checklists. RESULTS: The GDL cohort outperformed the historical cohort on the written exam (F [1,65] = 4.96, P = .029, d = .62), as well as on the summative suturing test (F [1,65] = 6.23, P = .015, d = .68). Furthermore, 3 main themes that highlight the mechanisms and mediators of efficient GDL were: (1) building conceptual knowledge, (2) motivating self-regulated learning, and (3) the type of skill and psychological safety. CONCLUSIONS: GDL can be an efficient approach to teaching procedural skills. Implications for future research and curricular design are discussed.
Subject(s)
Clinical Competence , Education, Medical, Graduate/methods , General Surgery/education , Learning , Adult , Cohort Studies , Female , Humans , MaleABSTRACT
STATEMENT: This study is a scoping review that reviews the existing literature on educational strategies in training of cesarean section. A systematic search was carried out in relevant databases, identifying 28 studies for inclusion. Thematic analysis revealed the following training strategies: simulation-based training (team training, in situ training, technical training), simulators (low-fidelity simulators, high-fidelity simulators), clinical training, e-learning or videos, classroom-based learning (lectures, small groups), and assessment (assessment programs/interventions, assessment of learners). Simulation-based training provides a unique milieu for training in a safe and controlled environment. Simulation-based team training is widely accepted and used in obstetrics and improves nontechnical skills, which are important in emergency cesarean section. High-fidelity simulators are advanced and realistic, but because of the expense, low-fidelity simulators may provide a reasonable method for training surgical skills. The literature in training and assessment of surgical skills in relation to cesarean section is sparse, and more studies are warranted.
Subject(s)
Cesarean Section/education , Clinical Competence , Computer-Assisted Instruction/methods , Humans , Manikins , Simulation Training/organization & administrationABSTRACT
INTRODUCTION: Simulation-based training in surgery helps trainees master laparoscopic skills, and training at home on mobile box trainers may allow trainees to reach proficiency faster. The aim of this study was to examine the added effects of training at home. METHODS: Participants were trainees from departments of surgery, gynaecology and urology who were recruited while taking part in a laparoscopic training course. The interven-tion consisted of added access to a mobile box trainer allowing participants to train at home. RESULTS: During a one-year study period, 36 participants completed the trial. There was no statistically significant difference in the number of days it took to complete the course (86 days versus 89 days, p = 0.89) or in the final test scores of the two groups (493 versus 460, p = 0.07). A sig-nificant difference in the number of training sessions at-tended was found (5.8 versus 2.3, p < 0.001). Participants were able to reliably rate their own performance; the intraclass correlation coefficient was 0.86, p < 0.001. CONCLUSIONS: Trainees who had access to training at home did not pass a test earlier or achieve a higher score at the end of a course than trainees who had no such access. Improved access to training at home allowed for shorter and more frequent sessions; however, testing and mandatory training requirements apparently determine training patterns. Trainees were able to reliably rate their own performance. FUNDING: Equipment for the study was provided by the Copenhagen Academy for Medical Education and Simulation, Capital Region of Denmark, Copenhagen, Denmark. TRIAL REGISTRATION: The study was exempt from ethical approval according to Danish legislation (H-3-2014-FSP31). The trial protocol was registered with www.clinicaltrials.gov prior to commencing the trial (NCT02243215).
Subject(s)
Internship and Residency , Laparoscopy/education , Simulation Training/methods , Adult , Female , General Surgery/education , Gynecology/education , Humans , Male , Middle Aged , Time Factors , Urology/educationABSTRACT
This review summarises the knowledge of drawing as a learning tool. Drawing is a skill, which can be used by doctors in communicating with their patients. It also seems, that drawing supplements traditional learning methods and improves learning and retention of knowledge. Drawing is used by some doctors for planning of operations and as a visual tool to explain procedures and improve communication with patients. New visual technologies like augmented reality, virtual reality and 3D printing seem promising when used for training surgical skills and anatomy or planning operations.
Subject(s)
Anatomy , Virtual Reality , Anatomy/education , Communication , Humans , Learning , Printing, Three-DimensionalABSTRACT
Competency-based medical education relies on the use of assessment tools, which can describe and/or measure medical competencies and are supported by validity evidence. The exploration of validity evidence ensures, that the assessment tool not only measures what is intended, but also that the interpretation and decisions made are fair and just. In this review, we have described a contemporary approach to validity used in Kane's framework. We have also used an example to illuminate, how the exploration of validity evidence can be done in a scientific and systematic manner.
Subject(s)
Clinical Competence , Educational Measurement/standards , Physicians/standards , Validation Studies as Topic , Competency-Based Education , Humans , Reproducibility of ResultsABSTRACT
In this case report, a 40-year-old woman with a history of a uterine leiomyoma presented with abdominal pain and fever. Initially, her symptoms were associated with a bleeding from an ovarian cyst seen on a CT scan of the abdomen showing free intraperitoneal fluid surrounding the internal genitals. Meanwhile, her blood cultures came out positive for Clostridium perfringens, and her condition deteriorated despite intravenous antibiotics. A new CT scan revealed intrauterine gas development. A laparotomy was performed with removal of the internal genitals, and the patient improved on continuous antibiotics.
Subject(s)
Clostridium perfringens/isolation & purification , Gas Gangrene , Uterine Diseases , Adult , Anti-Bacterial Agents/therapeutic use , Female , Gas Gangrene/diagnostic imaging , Gas Gangrene/drug therapy , Gas Gangrene/microbiology , Gas Gangrene/surgery , Humans , Leiomyoma/diagnostic imaging , Leiomyoma/microbiology , Tomography, X-Ray Computed , Uterine Diseases/diagnostic imaging , Uterine Diseases/drug therapy , Uterine Diseases/microbiology , Uterine Diseases/surgery , Uterine Neoplasms/diagnostic imaging , Uterine Neoplasms/microbiologyABSTRACT
The increasing mobility of patients and healthcare professionals across the countries of Europe has highlighted the wide variations in both medical training, and provision of medical competency and skills. The maintenance of the standards defining competency and skills have national and international implications and have proved challenging for national regulatory bodies. Thus each nation has introduced different types of Continuing Professional Development (CPD), recertification and relicensing systems. At the Symposium entitled: " 'Certified now what?' On the Challenges of Lifelong Learning" in August 2017 at the Association for Medical Education in Europe (AMEE) annual conference, we reviewed differing European national relicensing systems were reviewed. The review highlighted various lifelong learning and competence assessment approaches using examples from different medical specialties across several European countries.
ABSTRACT
When laparoscopy was first introduced, skills were primarily taught using the apprenticeship model. A limitation of this method when compared to open surgery, was that it requires more time to practise and more frequent learning opportunities in clinical practice. The unique set of skills required in laparoscopy highlighted the need for new training methods that reduce the need for supervision and do not put the patient at risk. Simulation training was developed to meet this need. The overall purpose of this thesis was to explore simulation-based laparoscopic training at home. The thesis consists of five papers: a review, a validation study, a study of methodology, a randomised controlled trial and a mixed-methods study. Our aims were to review the current knowledge on training off-site, to develop and explore validity for a training and assessment system, to investigate the effect of take-home training in a simulation-based laparoscopic training programme, and to explore the use of take-home training. The first paper in this thesis is a scoping review. The aim of the review was to explore the current knowledge on off-site laparoscopic skills training. We found that off-site training was feasible but that changes were required in order for it to become an effective method of training. Furthermore, the select-ed instructional design varied and training programmes were designed using a variety of educational theories. Based on our findings, we recommended that courses and training curricula should follow established education theories such as proficiency-based learning and deliberate practice. Principles of directed self-regulated learning could be used to improve off-site laparoscopic training programmes. In the second study, we set out to develop and explore validity evidence of the TABLT test. The TABLT test was developed for basic laparoscopic skills training in a cross-specialty curriculum. We found validity evidence to support the TABLT test as a summative test in a basic laparoscopic training programme. We also established a credible pass/fail level using the contrasting groups method. We concluded that the TABTL test could be used to assess novice laparoscopic trainees across different specialties and help trainees acquire basic laparoscopic competencies prior to supervised surgery. In the third study, we aimed to explore the consequences of the choice of standard setting method and whether there is a difference in terms of how high a score experienced and novice laparoscopic surgeons expect that novices should achieve during training. We used three different standard setting methods and found that pass/fail levels vary depending on the choice of standard setting method. We also asked experienced and novice laparoscopic surgeons how high a score they expected a novice laparoscopic surgeon should achieve on a test during training. We found a significant difference, with experienced surgeons setting a lower pass/fail level. We concluded that an established standard setting method supported by evidence should be used when setting a pass/fail level. In the first and second papers of this thesis, we found that off-site training is feasible and explored validity for the TABLT test. We used this knowledge in the fourth study to design a randomised controlled trial. The aim of the trial was to investigate the effect of take-home training in a simulation-based laparoscopic course. We hypothesised that training at home could help trainees plan their training according to their own schedule and thereby increase the effect of training. We found that participants had a distributed training pattern; they trained more frequently and in shorter sessions. We also found that participants were able to rate their own performance during unsupervised training and that selfrating was reliable. The fifth and final study of the thesis was a mixed-methods study that aimed to explore the use of take-home training. To meet this aim, we recruited participants from the intervention arm in our randomised controlled trial. All participants had access to the simulation centre and were given a port-able trainer to train on at home. Participants were asked to use a logbook during training. At the end of the course, they were invited to take part in focus group interviews and individual interviews. Based on data from logbooks, a descriptive statistical analysis was conducted and data from interviews were analysed using a content analysis. We found that participants took an individualised approach to training when training at home. They structured their training according to their needs and external requirements. We concluded that mandatory training requirements and testing help determine when and how much participants train. We also found that self-rating can guide unsupervised training by giving clear goals to be reached during training. From the papers included in the thesis, we found that the literature describes training at home as a feasible method of acquiring laparoscopic skills. Nonetheless, changes to current training programmes are needed in order to make this method effective. We then developed and explored validity evidence for the TABLT test. We also established a reasonable pass/fail level and went on to explore the immediate consequences of the pass/fail level. Using our knowledge from the review, we conducted a randomised controlled trial and a mixed-method study. Based on these studies we found that training at home allows for distributed learning, that self-rating guides unsupervised training, and that mandatory training requirements and testing strongly influence training patterns. Access to training, guidance during training, and mandatory training requirements will make take-home training not just feasible but also effective.
Subject(s)
Curriculum , Education, Medical/methods , Laparoscopy/education , Program Development , Program Evaluation , Clinical Competence , Computer Simulation , Humans , Models, EducationalABSTRACT
BACKGROUND: During laparoscopy, the surgeon's loss of depth perception and spatial orientation is problematic. Laser visual guidance (LVG) is an innovative technology that improves depth perception to enhance the visual field. In this trial, we examined the effect of LVG on surgical novices' motor skills, quality of task performance, and cognitive workload. METHODS: We designed a randomized controlled trial following the CONSORT statement. Thirty-two surgical novices completed the Training and Assessment of Basic Laparoscopic Techniques (TABLT) test. The first attempt allowed participants to familiarize themselves with the exercises. We then randomized the participants, and they completed a test session using either LVG or conventional two-dimensional vision. RESULTS: We found no significant difference between using the LVG tool and conventional 2D vision; however, both the mean completion time and movements used were less in the LVG group: Mean time used in the LVG group was 1288 s (95 % CI 1188-1388) versus 1354 s (95 % CI 1190-1518) (p = 0.45); mean angular path length used in the LVG group was 24,049° (95 % CI 20,761-27,336) versus 26,014° (95 % CI 22,059-29,970) (p = 0.42); mean path length in the LVG group was 4560 cm (95 % CI 3971-5,149 cm) versus 5062 cm (95 % CI 4328-5797), (p = 0.26). Moreover, the mean TABLT performance score was higher in the LVG group compared with the 2D group, although not significant: 379 (95 % CI 352-405) versus 338 (95 % CI 288-387) (p = 0.14). No significant difference was found between the groups' cognitive workloads. CONCLUSION: We found no significant improvement of laparoscopic motor skills when using LVG, although a tendency toward improved performance was seen. LVG could have the potential to help novice surgeons acquire basic laparoscopic; however, further development of the concept and validation is needed to confirm this.
Subject(s)
Laparoscopy/education , Laparoscopy/methods , Lasers , Simulation Training , Adult , Clinical Competence , Depth Perception , Female , Humans , Male , Motor Skills , Orientation, Spatial , Young AdultABSTRACT
BACKGROUND: Simulation training can prepare trainees for clinical practice in laparoscopic surgery. Training on box trainers allows for simulation training at home, which studies have shown to be a feasible method of training. However, little research has been conducted into how to make it a more efficient method of training. Our aim was to investigate how box trainers are used in take-home training to help guide the design of take-home training courses. METHODS: This study was designed using a mixed methods approach. Junior doctors participating in a laparoscopy curriculum, which included practising at home on box trainers, were invited. Quantitative data on training patterns was collected from logbooks. Qualitative data on the use of box trainers was retrieved from focus groups and individual interviews. RESULTS: From logbooks, we found that 14 out of 18 junior doctors mixed their training modalities, and four practised first on box trainers then on virtual reality simulators. Twelve practised only at home, while five practised at both places and one practised solely at the simulation centre. After a delayed start, most practised for some time, then had a period without training and then started training again towards the end of the course. We found that the themes of the interviews were: training method, training pattern, feedback and self-regulation. Participants identified the lack of feedback as challenging but described how self-rating provided direction during unsupervised training. Mandatory training elements affected when and how much participants practised. CONCLUSIONS: When participants practised at home, they took an individualised approach to training. They mixed their training at home with training at the simulation centre. Participants practised at the beginning and towards the end of the course. Self-rating helped to guide unsupervised training where feedback was not accessible. Curricular requirements and testing determined when and how much participants practised.
Subject(s)
Laparoscopy/education , Simulation Training/methods , Adult , Clinical Competence , Curriculum , Denmark , Female , Humans , Male , Qualitative Research , Self-AssessmentABSTRACT
OBJECTIVE: Simulation-based assessment tools have been developed to allow for proficiency-based simulator training in laparoscopy. However, few studies have examined the consequences of different standard setting methods or examined what level of proficiency is considered adequate for trainees. The objectives of the present study were to explore the consequences of different standard setting methods and to examine the proficiency level that surgical trainees are expected to reach, before performing supervised surgery on patients. DESIGN: Study participants undertook the Training and Assessment of Basic Laparoscopic Techniques test. The tests were video-recorded and rated using a simple scoring system based on number of errors and time. Participants were then asked to assess how high a score a novice should reach before performing supervised surgery on a patient. We then compared 3 methods of standard setting: expert performance level, contrasting groups method, and a modified Angoff method. SETTING: The study was conducted at the Copenhagen Academy for Medical Education and Simulation. The academy provides surgical simulation training in laparoscopy for trainees at the hospitals in the Capital Region and the Zealand Region of Denmark. PARTICIPANTS: Participants were recruited among surgical trainees in their first year of specialty training from surgery, gynecology, and urology departments. A total of 40 participants were included and completed the trial. RESULTS: The different standard setting methods resulted in different pass/fail levels. At the expert performance level, the pass/fail level was 474 points-the contrasting groups method resulted in 358 points and the modified Angoff method resulted in 311 points among experienced surgeons, and 386 points among trainees. The different proficiency levels resulted in a failure rate of 0% to 50% of experienced surgeons and a pass rate of 0% to 25% of novices. Novice laparoscopic surgeons set a higher pass/fail level than experienced surgeons did (p = 0.008). CONCLUSION: Required proficiency levels varies depending on the standard setting method used, which highlights the importance of using an established standard setting method to set the pass/fail level.
Subject(s)
Clinical Competence , Education, Medical, Graduate/methods , Laparoscopy/education , Simulation Training/methods , Specialties, Surgical/education , User-Computer Interface , Adult , Computer Simulation , Denmark , Educational Measurement/methods , Female , Humans , Male , Video RecordingABSTRACT
BACKGROUND: The focus of research in simulation-based laparoscopic training has changed from examining whether simulation training works to examining how best to implement it. In laparoscopic skills training, portable and affordable box trainers allow for off-site training. Training outside simulation centers and hospitals can increase access to training, but also poses new challenges to implementation. This review aims to guide implementation of off-site training of laparoscopic skills by critically reviewing the existing literature. METHODS: An iterative systematic search was carried out in MEDLINE, EMBASE, ERIC, Scopus, and PsychINFO, following a scoping review methodology. The included literature was analyzed iteratively using a thematic analysis approach. The study was reported in accordance with the STructured apprOach to the Reporting In healthcare education of Evidence Synthesis statement. RESULTS: From the search, 22 records were identified and included for analysis. A thematic analysis revealed the themes: access to training, protected training time, distribution of training, goal setting and testing, task design, and unsupervised training. The identified themes were based on learning theories including proficiency-based learning, deliberate practice, and self-regulated learning. CONCLUSIONS: Methods of instructional design vary widely in off-site training of laparoscopic skills. Implementation can be facilitated by organizing courses and training curricula following sound education theories such as proficiency-based learning and deliberate practice. Directed self-regulated learning has the potential to improve off-site laparoscopic skills training; however, further studies are needed to demonstrate the effect of this type of instructional design.