Examining the application of the IDEAL framework in the reporting and evaluation of innovative invasive procedures: secondary qualitative analysis of a systematic review.

OBJECTIVES: The development of new surgical procedures is fundamental to advancing patient care. The Idea, Developments, Exploration, Assessment and Long-term (IDEAL) framework describes study designs for stages of innovation. It can be difficult to apply due to challenges in defining and identifying innovative procedures. This study examined how the IDEAL framework is operationalised in real-world settings; specifically, the types of innovations evaluated using the framework and how authors justify their choice of IDEAL study design. DESIGN: Secondary qualitative analysis of a systematic review. DATA SOURCES: Citation searches (Web of Science and Scopus) identified studies following the IDEAL framework and citing any of the ten key IDEAL/IDEAL_D papers. ELIGIBILITY CRITERIA: Studies of invasive procedures/devices of any design citing any of the ten key IDEAL/IDEAL_D papers. DATA EXTRACTION AND SYNTHESIS: All relevant text was extracted. Three frameworks were developed, namely: (1) type of innovation under evaluation; (2) terminology used to describe stage of innovation and (3) reported rationale for IDEAL stage. RESULTS: 48 articles were included. 19/48 described entirely new procedures, including those used for the first time in a different clinical context (n=15/48), reported as IDEAL stage 2a (n=8, 53%). Terminology describing stage of innovation was varied, inconsistent and ambiguous and was not defined. Authors justified their choice of IDEAL study design based on limitations in published evidence (n=36) and unknown feasibility and safety (n=32) outcomes. CONCLUSION: Identifying stage of innovation is crucial to inform appropriate study design and governance decisions. Authors' rationale for choice of IDEAL stage related to the existing evidence base or lack of sufficient outcome data for procedures. Stage of innovation was poorly defined with inconsistent descriptions. Further work is needed to develop methods to identify innovation to inform practical application of the IDEAL framework. Defining the concept of innovation in terms of uncertainty, risk and degree of evidence may help to inform decision-making.

How surgical Trainee Research Collaboratives achieve success: a mixed methods study to develop trainee engagement strategies.

OBJECTIVES: This study aimed to understand the role of surgical Trainee Research Collaboratives (TRCs) in conducting randomised controlled trials and identify strategies to enhance trainee engagement in trials. DESIGN: This is a mixed methods study. We used observation of TRC meetings, semi-structured interviews and an online survey to explore trainees' motivations for engagement in trials and TRCs, including barriers and facilitators. Interviews were analysed thematically, alongside observation field notes. Survey responses were analysed using descriptive statistics. Strategies to enhance TRCs were developed at a workshop by 13 trial methodologists, surgical trainees, consultants and research nurses. SETTING: This study was conducted within a secondary care setting in the UK. PARTICIPANTS: The survey was sent to registered UK surgical trainees. TRC members and linked stakeholders across surgical specialties and UK regions were purposefully sampled for interviews. RESULTS: We observed 5 TRC meetings, conducted 32 semi-structured interviews and analysed 73 survey responses. TRCs can mobilise trainees thus gaining wider access to patients. Trainees engaged with TRCs to improve patient care, surgical evidence and to help progress their careers. Trainees valued the TRC infrastructure, research expertise and mentoring. Challenges for trainees included clinical and other priorities, limited time and confidence, and recognition, especially by authorship. Key TRC strategies were consultant support, initial simple rapid studies, transparency of involvement and recognition for trainees (including authorship policies) and working with Clinical Trials Units and research nurses. A 6 min digital story on YouTube disseminated these strategies. CONCLUSION: Trainee surgeons are mostly motivated to engage with trials and TRCs. Trainee engagement in TRCs can be enhanced through building relationships with key stakeholders, maximising multi-disciplinary working and offering training and career development opportunities.

A systematic scoping review protocol to summarise and appraise the use of artificial intelligence in the analysis of digital videos of invasive general surgical procedures.

Background: Intraoperative video recordings are a valuable addition to operative written documentation. However, the review of these videos often requires surgical expertise and takes considerable time. While a large amount of work has been undertaken to understand the role of artificial intelligence (AI) in healthcare more generally, the application of these techniques to automate the analysis of surgical videos is currently unclear. In this systematic scoping review, we sought to give a contemporary overview of the use of AI research in the analysis of digital videos of invasive general surgical procedures. We will describe and summarise the study characteristics, purpose of the applications and stage of development, to ascertain how these techniques might be applied in future research and to identify gaps in current knowledge (e.g. uncertainties about the study methods). Methods: Systematic searches will be conducted in OVID Medline and Embase, using terms related to 'artificial intelligence', 'surgery' and 'video' to identify all potentially relevant studies published since 1st January 2012. All primary studies where AI has been applied to the analysis of videos (recorded by conventional digital cameras or laparoscopic or robotic-assisted technology) of general surgical procedures will be included. Data extraction will include study characteristics, governance, details of video datasets and AI models, measures of accuracy, validation and any reported limitations. Ethics and dissemination: No ethical approval is required as primary data will not be collected. The results will be disseminated at relevant conferences, on social media and published in a peer-reviewed journal.

How do pilot and feasibility studies inform randomised placebo-controlled trials in surgery? A systematic review.

INTRODUCTION: Randomised controlled trials (RCTs) with a placebo comparator are considered the gold standard study design when evaluating healthcare interventions. These are challenging to design and deliver in surgery. Guidance recommends pilot and feasibility work to optimise main trial design and conduct; however, the extent to which this occurs in surgery is unknown. METHOD: A systematic review identified randomised placebo-controlled surgical trials. Articles published from database inception to 31 December 2020 were retrieved from Ovid-MEDLINE, Ovid-EMBASE and CENTRAL electronic databases, hand-searching and expert knowledge. Pilot/feasibility work conducted prior to the RCTs was then identified from examining citations and reference lists. Where studies explicitly stated their intent to inform the design and/or conduct of the future main placebo-controlled surgical trial, they were included. Publication type, clinical area, treatment intervention, number of centres, sample size, comparators, aims and text about the invasive placebo intervention were extracted. RESULTS: From 131 placebo surgical RCTs included in the systematic review, 47 potentially eligible pilot/feasibility studies were identified. Of these, four were included as true pilot/feasibility work. Three were original articles, one a conference abstract; three were conducted in orthopaedic surgery and one in oral and maxillofacial surgery. All four included pilot RCTs, with an invasive surgical placebo intervention, randomising 9-49 participants in 1 or 2 centres. They explored the acceptability of recruitment and the invasive placebo intervention to patients and trial personnel, and whether blinding was possible. One study examined the characteristics of the proposed invasive placebo intervention using in-depth interviews. CONCLUSION: Published studies reporting feasibility/pilot work undertaken to inform main placebo surgical trials are scarce. In view of the difficulties of undertaking placebo surgical trials, it is recommended that pilot/feasibility studies are conducted, and more are reported to share key findings and optimise the design of main RCTs. PROSPERO REGISTRATION NUMBER: CRD42021287371.

Results of the ARROW survey of anti-reflux practice in the United Kingdom.

Gastro-esophageal reflux disease (GERD) is a common, significant health burden. United Kingdom guidance states that surgery should be considered for patients with a diagnosis of GERD not suitable for long-term acid suppression. There is no consensus on many aspects of patient pathways and optimal surgical technique, and an absence of information on how patients are currently selected for surgery. Further detail on the delivery of anti-reflux surgery (ARS) is required. A United Kingdom-wide survey was designed to gather surgeon opinion regarding pre-, peri- and post-operative practice of ARS. Responses were received from 155 surgeons at 57 institutions. Most agreed that endoscopy (99%), 24-hour pH monitoring (83%) and esophageal manometry (83%) were essential investigations prior to surgery. Of 57 units, 30 (53%) had access to a multidisciplinary team to discuss cases; case-loads were higher in those units (median 50 vs. 30, P < 0.024). The most popular form of fundoplication was a Nissen posterior 360° (75% of surgeons), followed by a posterior 270° Toupet (48%). Only seven surgeons stated they had no upper limit of body mass index prior to surgery. A total of 46% of respondents maintain a database of their practice and less than a fifth routinely record quality of life scores before (19%) or after (14%) surgery. While there are areas of consensus, a lack of evidence to support workup, intervention and outcome evaluation is reflected in the variability of practice. ARS patients are not receiving the same level of evidence-based care as other patient groups.

Artificial intelligence as a diagnostic aid in cross-sectional radiological imaging of surgical pathology in the abdominopelvic cavity: a systematic review.

OBJECTIVES: There is emerging use of artificial intelligence (AI) models to aid diagnostic imaging. This review examined and critically appraised the application of AI models to identify surgical pathology from radiological images of the abdominopelvic cavity, to identify current limitations and inform future research. DESIGN: Systematic review. DATA SOURCES: Systematic database searches (Medline, EMBASE, Cochrane Central Register of Controlled Trials) were performed. Date limitations (January 2012 to July 2021) were applied. ELIGIBILITY CRITERIA: Primary research studies were considered for eligibility using the PIRT (participants, index test(s), reference standard and target condition) framework. Only publications in the English language were eligible for inclusion in the review. DATA EXTRACTION AND SYNTHESIS: Study characteristics, descriptions of AI models and outcomes assessing diagnostic performance were extracted by independent reviewers. A narrative synthesis was performed in accordance with the Synthesis Without Meta-analysis guidelines. Risk of bias was assessed (Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2)). RESULTS: Fifteen retrospective studies were included. Studies were diverse in surgical specialty, the intention of the AI applications and the models used. AI training and test sets comprised a median of 130 (range: 5-2440) and 37 (range: 10-1045) patients, respectively. Diagnostic performance of models varied (range: 70%-95% sensitivity, 53%-98% specificity). Only four studies compared the AI model with human performance. Reporting of studies was unstandardised and often lacking in detail. Most studies (n=14) were judged as having overall high risk of bias with concerns regarding applicability. CONCLUSIONS: AI application in this field is diverse. Adherence to reporting guidelines is warranted. With finite healthcare resources, future endeavours may benefit from targeting areas where radiological expertise is in high demand to provide greater efficiency in clinical care. Translation to clinical practice and adoption of a multidisciplinary approach should be of high priority. PROSPERO REGISTRATION NUMBER: CRD42021237249.

A systematic review of robot-assisted anti-reflux surgery to examine reporting standards.

Robot-assisted anti-reflux surgery (RA-ARS) is increasingly being used to treat refractory gastro-oesophageal reflux disease. The IDEAL (Idea, Development, Exploration, Assessment, Long-term follow up) Collaboration's framework aims to improve the evaluation of surgical innovation, but the extent to which the evolution of RA-ARS has followed this model is unclear. This study aims to evaluate the standard to which RA-ARS has been reported during its evolution, in relation to the IDEAL framework. A systematic review from inception to June 2020 was undertaken to identify all primary English language studies pertaining to RA-ARS. Studies of paraoesophageal or giant hernias were excluded. Data extraction was informed by IDEAL guidelines and summarised by narrative synthesis. Twenty-three studies were included: two case reports, five case series, ten cohort studies and six randomised controlled trials. The majority were single-centre studies comparing RA-ARS and laparoscopic Nissen fundoplication. Eleven (48%) studies reported patient selection criteria, with high variability between studies. Few studies reported conflicts of interest (30%), funding arrangements (26%), or surgeons' prior robotic experience (13%). Outcome reporting was heterogeneous; 157 distinct outcomes were identified. No single outcome was reported in all studies.The under-reporting of important aspects of study design and high degree of outcome heterogeneity impedes the ability to draw meaningful conclusions from the body of evidence. There is a need for further well-designed prospective studies and randomised trials, alongside agreement about outcome selection, measurement and reporting for future RA-ARS studies.

What Are Patients Told About Innovative Surgical Procedures? A Qualitative Synthesis of 7 Case Studies in the United Kingdom.

OBJECTIVES: To investigate how information about innovative surgical procedures is communicated to patients. BACKGROUND: Despite the national and international guidance that patients should be informed whether a procedure is innovative and has uncertain outcomes, little is known about current practice. METHODS: This qualitative study followed 7 "case studies" of surgical innovation in hospitals across the United Kingdom. Preoperative interviews were conducted with clinician innovators (n=9), preoperative real-time consultations between clinicians and patients were audio-recorded (n=37). Patients were interviewed postoperatively (n=30). Data were synthesized using thematic analytical methods. RESULTS: Interviews with clinicians demonstrated strong intentions to inform patients about the innovative nature of the procedure in a neutral manner, although tensions between fully informing patients and not distressing them were raised. In the consultations, only a minority of clinicians actually made explicit statements about, (1) the procedure being innovative, (2) their limited clinical experience with it, (3) the paucity of evidence, and (4) uncertainty/unknown outcomes. Discussions about risks were generalized and often did not relate to the innovative component. Instead, all clinicians optimistically presented potential benefits and many disclosed their own positive beliefs. Postoperative patient interviews revealed that many believed that the procedure was more established than it was and were unaware of the unknown risks. CONCLUSIONS: There were contradictions between clinicians' intentions to inform patients about the uncertain outcomes of innovative and their actual discussions with patients. There is a need for communication interventions and training to support clinicians to provide transparent data and shared decision-making for innovative procedures.

Qualitative documentary analysis of guidance on information provision and consent for the introduction of innovative invasive procedures including surgeries within NHS organisations' policies in England and Wales.

OBJECTIVE: To review guidance, included in written local UK National Health Service (NHS) organisation policies, on information provision and consent for the introduction of new invasive procedures- including surgeries, and devices (IPs/Ds). DESIGN: A qualitative documentary analysis of data on patient information provision and consent extracted from policies for the introduction of IP/Ds from NHS organisations in England and Wales. SETTING: NHS trusts in England and health boards in Wales, UK. PARTICIPANTS: Between December 2017 and July 2018, 150 acute trusts in England and 7 health boards in Wales were approached for their policies for the introduction of new IP/Ds. In total, 123 policies were received, 11 did not fit the inclusion criteria and a further policy was included from a trust website resulting in 113 policies included for review. RESULTS: From the 113 policies, 22 did not include any statements on informed consent/information provision or lacked guidance on the information to be provided to patients and were hence excluded. Consequently, 91 written local NHS policies were included in the final dataset. Within the guidance obtained, variation existed on disclosure of the procedure's novelty, potential risks, benefits, uncertainties, alternative treatments and surgeon's experience. Few policies stated that clinicians should discuss the existing evidence associated with a procedure. Additionally, while the majority of policies referred to patients needing written information, this was often not mandated and few policies specified the information to be included. CONCLUSIONS: Nearly a fifth of all the policies lacked guidance on information to be provided to patients. There was variability in the policy documents regarding what patients should be told about innovative procedures. Further research is needed to ascertain the information and level of detail appropriate for patients when considering innovative procedures. A core information set including patients' and clinicians' views is required to address variability around information provision/consent for innovative procedures.

What should be included in case report forms? Development and application of novel methods to inform surgical study design: a mixed methods case study in parastomal hernia prevention.

OBJECTIVES: To describe the development and application of methods to optimise the design of case report forms (CRFs) for clinical studies evaluating surgical procedures, illustrated with an example of abdominal stoma formation. DESIGN: (1) Literature reviews, to identify reported variations in surgical components of stoma formation, were supplemented by (2) intraoperative qualitative research (observations, videos and interviews), to identify unreported variations used in practice to generate (3) a 'long list' of items, which were rationalised using (4) consensus methods, providing a pragmatic list of CRF items to be captured in the Cohort study to Investigate the Prevention of parastomal HERnias (CIPHER) study. SETTING: Two secondary care surgical centres in England. PARTICIPANTS: Patients undergoing stoma formation, surgeons undertaking stoma formation and stoma nurses. OUTCOME MEASURES: Successful identification of key CRF items to be captured in the CIPHER study. RESULTS: 59 data items relating to stoma formation were identified and categorised within six themes: (1) surgical approach to stoma formation; (2) trephine formation; (3) reinforcing the stoma trephine with mesh; (4) use of the stoma as a specimen extraction site; (5) closure of other wounds during the procedure; and (6) spouting the stoma. CONCLUSIONS: This study used multimodal data collection to understand and capture the technical variations in stoma formation and design bespoke CRFs for a multicentre cohort study. The CIPHER study will use the CRFs to examine associations between the technical variations in stoma formation and risks of developing a parastomal hernia. TRIAL REGISTRATION NUMBER: ISRCTN17573805.

A systematic review of robot-assisted cholecystectomy to examine the quality of reporting in relation to the IDEAL recommendations: systematic review.

INTRODUCTION: Robotic cholecystectomy (RC) is a recent innovation in minimally invasive gallbladder surgery. The IDEAL (idea, development, exploration, assessment, long-term study) framework aims to provide a safe method for evaluating innovative procedures. This study aimed to understand how RC was introduced, in accordance with IDEAL guidelines. METHODS: Systematic searches were used to identify studies reporting RC. Eligible studies were classified according to IDEAL stage and data were collected on general study characteristics, patient selection, governance procedures, surgeon/centre expertise, and outcome reporting. RESULTS: Of 1425 abstracts screened, 90 studies were included (5 case reports, 38 case series, 44 non-randomized comparative studies, and 3 randomized clinical trials). Sixty-four were single-centre and 15 were prospective. No authors described their work in the context of IDEAL. One study was classified as IDEAL stage 1, 43 as IDEAL 2a, 43 as IDEAL 2b, and three as IDEAL 3. Sixty-four and 51 provided inclusion and exclusion criteria respectively. Ethical approval was reported in 51 and conflicts of interest in 34. Only 21 reported provision of training for surgeons in RC. A total of 864 outcomes were reported; 198 were used in only one study. Only 30 reported a follow-up interval which, in 13, was 1 month or less. CONCLUSION: The IDEAL framework was not followed during the adoption of RC. Few studies were conducted within a research setting, many were retrospective, and outcomes were heterogeneous. There is a need to implement appropriate tools to facilitate the incremental evaluation and reporting of surgical innovation.

Healthcare organization policy recommendations for the governance of surgical innovation: review of NHS policies.

BACKGROUND: The governance for introducing innovative surgical procedures/devices differs from the research requirements needed for new drugs. New invasive procedures/devices may be offered to patients outside of research protocols with local organization oversight alone. Such institutional arrangements exist in many countries and written policies provide guidance for their use, but little is known about their scope or standards. METHODS: One hundred and fifty acute NHS trusts in England and seven health boards in Wales were systematically approached for information about their policies. A modified framework approach was used to analyse when policies considered new procedures/devices to be within local organization remit and/or requiring research ethics committee (REC) approval. RESULTS: Of 113 policies obtained, 109 and 34 described when local organization and REC approval was required, respectively. Procedures/devices being used for the first time in the organization (n = 69) or by a clinician (n = 67) were commonly within local remit, and only 36 stated that evidence was required. Others stated limited evidence as a rationale for needing REC approval (n = 13). External guidance categorizing procedures as 'research only' was the most common reason for gaining REC approval (n = 15). Procedures/devices with uncertain outcomes (n = 28), requiring additional training (n = 26), and not previously used (n = 6) were within the remit of policies, while others recommended REC application in these situations (n = 5, 2 and 7, respectively). CONCLUSION: This study on NHS policies for surgical innovation shows variability in the introduction of procedures/devices in terms of local oversight and/or need for REC approval. Current NHS standards allow untested innovations to occur without the safety of research oversight and thus a standard approach is urgently needed.

Novel device for assisted vaginal birth: using integrated qualitative case study methodology to optimise Odon Device use within a feasibility study in a maternity unit in the Southwest of England.

OBJECTIVE: When novel devices are used 'in human' for the first time, their optimal use is uncertain because clinicians only have experience from preclinical studies. This study aimed to investigate factors that might optimise use of the Odon Device for assisted vaginal birth. DESIGN: We undertook qualitative case studies within the ASSIST Study, a feasibility study of the Odon Device. Each 'case' was defined as one use of the device and included at least one of the following: observation of the attempted assisted birth, and an interview with the obstetrician, midwife or woman. Data collection and thematic analysis ran iteratively and in parallel. SETTING: Tertiary referral National Health Service maternity unit in the Southwest of England. PARTICIPANTS: Women requiring a clinically indicated assisted vaginal birth. INTERVENTION: The Odon Device, an innovative device for assisted vaginal birth. PRIMARY AND SECONDARY OUTCOME MEASURES: Determining the optimal device technique, device design and defining clinical parameters for use. RESULTS: Thirty-nine cases involving an attempted Odon-assisted birth were included in this study, of which 19 resulted in a successful birth with the device. Factors that improved use included optimisation of device technique, device design and clinical parameters for use. Technique adaptations included: applying the device during, rather than between, contractions; having a flexible approach to the application angle; and deflating the air cuff sooner than originally proposed. Three design modifications were proposed involving the deflation button and sleeve. Although use of the device was found to be appropriate in all fetal positions, it was considered contraindicated when the fetal station was at the ischial spines. CONCLUSIONS: Case study methodology facilitated the acquisition of rapid insights into device function in clinical practice, providing key insights regarding use, design and key clinical parameters for success. This methodology should be considered whenever innovative devices are introduced into clinical practice. TRIAL REGISTRATION NUMBER: ISRCTN10203171.

Identification of outcomes to inform the development of a core outcome set for surgical innovation: a targeted review of case studies of novel surgical devices.

OBJECTIVE: Outcome selection and reporting in studies of novel surgical procedures and devices lacks standardisation, hindering safe and effective evaluation. A core outcome set (COS) to measure and report in all studies of surgical innovation is needed. We explored outcomes in a specific sample of innovative surgical device case studies to identify outcome domains specifically relevant to innovation to inform the development of a COS. DESIGN: A targeted review of 11 purposive selected case studies of innovative surgical devices. METHODS: Electronic database searches in PubMed (July 2018) identified publications reporting the introduction and evaluation of each device. Outcomes were extracted and categorised into domains until no new domains were conceptualised. Outcomes specifically relevant to evaluating innovation were further scrutinised. RESULTS: 112 relevant publications were identified, and 5926 outcomes extracted. Heterogeneity in study type, outcome selection and reporting was observed across surgical devices. Categorisation of outcomes was performed for 2689 (45.4%) outcomes into five broad outcome domains. Outcomes considered key to the evaluation of innovation (n=66; 2.5%) were further categorised as surgeon/operator experience (n=40; 1.5%), unanticipated events (n=15, 0.6%) and modifications (n=11; 0.4%). CONCLUSION: Outcome domains unique to evaluating innovative surgical devices have been identified. Findings have been combined with multiple other data sources relevant to the evaluation of surgical innovation to inform the development of a COS to measure and report in all studies evaluating novel surgical procedures/devices.

Understanding stage of innovation of invasive procedures and devices: protocol for a systematic review and thematic analysis.

INTRODUCTION: Surgical innovation has generally occurred in an unstandardised manner. This has led to unnecessary exposure of patients to harm, research waste and inadequate evidence. The IDEAL (Idea, Development, Exploration, Assessment, Long-term follow-up) Collaboration provided a set of recommendations for evaluating surgical innovations based on their stage of innovation. Despite further refinements and guidance, adoption of the IDEAL recommendations has been slow; an important reason may be that determining the stage of innovation is often difficult. To facilitate evaluation of surgical innovations, there is a need for a detailed insight into what stage of innovation means, and how it can be determined. The aim of this study is to understand the concept of stage of innovation as reported in the literature. METHODS AND ANALYSIS: A systematic review is being conducted. Ovid MEDLINE and Embase databases were searched from their inception until July 2021 using an iteratively developed strategy based on the concepts of stage of innovation, invasive procedures or devices and guidance. Articles were included if they described an approach to evaluating surgical innovations in stages, described a method for determining stage of innovation, described indicators of stage of innovation, defined stages or described potential sources of stage-related information. Conference abstracts and non-English language articles were excluded. Other articles were detected from citations within included articles and suggestions from experts in surgical innovation. Data will be extracted regarding approaches to evaluating surgical innovations, methods for determining stage of innovation, indicators of stage of innovation, definitions of stages and potential sources of stage-related information. A thematic analysis will be conducted, and findings summarised in a narrative report. ETHICS AND DISSEMINATION: Ethical approval will not be required. This systematic review will be published in a peer-reviewed journal and presented at appropriate conferences. PROSPERO REGISTRATION NUMBER: CRD42021270812.

Development of a Reliable Surgical Quality Assurance System for 2-stage Esophagectomy in Randomized Controlled Trials.

OBJECTIVE: The aim was to develop a reliable surgical quality assurance system for 2-stage esophagectomy. This development was conducted during the pilot phase of the multicenter ROMIO trial, collaborating with international experts. SUMMARY OF BACKGROUND DATA: There is evidence that the quality of surgical performance in randomized controlled trials influences clinical outcomes, quality of lymphadenectomy and loco-regional recurrence. METHODS: Standardization of 2-stage esophagectomy was based on structured observations, semi-structured interviews, hierarchical task analysis, and a Delphi consensus process. This standardization provided the structure for the operation manual and video and photographic assessment tools. Reliability was examined using generalizability theory. RESULTS: Hierarchical task analysis for 2-stage esophagectomy comprised fifty-four steps. Consensus (75%) agreement was reached on thirty-nine steps, whereas fifteen steps had a majority decision. An operation manual and record were created. A thirty five-item video assessment tool was developed that assessed the process (safety and efficiency) and quality of the end product (anatomy exposed and lymphadenectomy performed) of the operation. The quality of the end product section was used as a twenty seven-item photographic assessment tool. Thirty-one videos and fifty-three photographic series were submitted from the ROMIO pilot phase for assessment. The overall G-coefficient for the video assessment tool was 0.744, and for the photographic assessment tool was 0.700. CONCLUSIONS: A reliable surgical quality assurance system for 2-stage esophagectomy has been developed for surgical oncology randomized controlled trials. ETHICAL APPROVAL: 11/NW/0895 and confirmed locally as appropriate, 12/SW/0161, 16/SW/0098.Trial registration number: ISRCTN59036820, ISRCTN10386621.

Interim Foundation Year One (FiY1) and preparedness for foundation year 1: A national survey of UK foundation doctors.

BACKGROUND: Induction programmes aim to ease the transition from medical student to doctor. The interim foundation year 1 (FiY1) placement, introduced in the first COVID-19 wave, provided experience in advance of the Foundation Year 1 (FY1) start in August; providing more time and enhanced responsibilities than traditional induction programmes. This study examines the effects of the FiY1 placement on anxiety levels and preparedness for FY1. METHODS: This was a descriptive cross-sectional study using data from four cohorts of FY1s who completed the online National FY1 induction survey from 2017 to 2020 (n = 4766). Questions evaluated self-reported preparedness and anxiety levels. Differences in preparedness and anxiety levels of FiY1 and non-FiY1 participants in 2020, and the 2017-2019 participants (non-FiY1 controls), were evaluated. RESULTS: FiY1s in 2020 reported higher self-reported preparedness (79%) than non-FiY1s (54%) in 2020 (p = <0.001) and the control 2017-2019 cohort (63.8%) (p < 0.001). Fewer FiY1s experienced pathological anxiety (29.3% versus 40.8% for non-FiY1s; p = 0.001). CONCLUSION: Time spent in an FiY1 role is associated with an increase in self-perceptions of preparedness and a reduction in anxiety. These data indicate that time spent in an FiY1 role may have utility in further improving the transition period from medical school to FY1.

Women's experiences of the Odon Device to assist vaginal birth and participation in intrapartum research: a qualitative study in a maternity unit in the Southwest of England.

OBJECTIVE: To investigate women's experiences of having a birth assisted by the Odon Device (an innovative device for assisted vaginal birth) and participation in intrapartum research. DESIGN: Qualitative semistructured interviews and observations undertaken in the context of case study work embedded in the ASSIST feasibility study. SETTING: A tertiary referral National Health Service (NHS) maternity unit in the Southwest of England, between 8 October 2018 and 26 January 2019. PARTICIPANTS: Eight women, four operators and 11 midwives participated with eight observations of the assisted vaginal birth, eight interviews with women in the postnatal period, 39 interviews/reflections with operators and 19 interviews with midwives. Women in the case study research were recruited from participants in the main ASSIST Study. INTERVENTION: The Odon Device, an innovative device for assisted vaginal birth. RESULTS: Thirty-nine case studies were undertaken. Triangulation of data sources (participant observation, interviews with women, operators and midwives) enabled the exploration of women's experiences of the Odon Device and recruitment in the intrapartum trial. Experiences were overwhelmingly positive. Women were motivated to take part by a wish for a kinder birth, and because they perceived both the recruitment and research processes (including observation) to be highly acceptable, regardless of whether the Odon-assisted birth was successful or not. CONCLUSIONS: Interviews and observations from multiple stakeholders enabled insight into women's experiences of an innovative device for assisted vaginal birth. Applying these qualitative methods more broadly may illuminate perspectives of key stakeholders in future intrapartum intervention research and beyond. TRIAL REGISTRATION NUMBER: ISRCTN10203171; ASSIST Study registration; https://doi.org/10.1186/ISRCTN10203171.

Using qualitative research methods to understand how surgical procedures and devices are introduced into NHS hospitals: the Lotus study protocol.

INTRODUCTION: The development of innovative invasive procedures and devices are essential to improving outcomes in healthcare. However, how these are introduced into practice has not been studied in detail. The Lotus study will follow a wide range of 'case studies' of new procedures and/or devices being introduced into NHS trusts to explore what information is communicated to patients, how procedures are modified over time and how outcomes are selected and reported. METHODS AND ANALYSIS: This qualitative study will use ethnographic approaches to investigate how new invasive procedures and/or devices are introduced. Consultations in which the innovation is discussed will be audio-recorded to understand information provision practice. To understand if and how procedures evolve, they will be video recorded and non-participant observations will be conducted. Post-operative interviews will be conducted with the innovating team and patients who are eligible for the intervention. Audio-recordings will be audio-recorded, transcribed verbatim and analysed thematically using constant comparison techniques. Video-recordings will be reviewed to deconstruct procedures into key components and document how the procedure evolves. Comparisons will be made between the different data sources. ETHICS AND DISSEMINATION: The study protocol has Health Research Authority (HRA) and Health and Care Research Wales approval (Ref 18/SW/0277). Results will be disseminated at appropriate conferences and will be published in peer-reviewed journals. The findings of this study will provide a better understanding of how innovative invasive procedures and/or devices are introduced into practice.