The "quality" of JBI qualitative research synthesis: a methodological investigation into the adherence of meta-aggregative systematic reviews to reporting standards and methodological guidance.

INTRODUCTION: Approaches to the synthesis of qualitative research have existed for more than 20 years and have evolved significantly during that time. One common approach is meta-aggregation, as advocated by JBI. There is now a considerable number of published reviews that claim to follow the JBI approach to meta-aggregation. This methodological review sought to determine the extent to which a selection of these reviews follow the available guidance, with a view to establishing compliance and identifying potential areas for improvement. METHODS: The JBI Database of Systematic Reviews and Implementation Reports (JBISRIR) was searched from 2015 to 2017 to identify all qualitative systematic reviews following the JBI approach. Citations were screened by two independent reviewers, and data extraction was conducted independently by at least two reviewers. Eligible reviews were then assessed against the JBI methodological guidance and ENTREQ statement to determine compliance. RESULTS: From the search, 33 health care-related reviews that met the inclusion criteria were identified. Several areas were identified where reviewers consistently made errors or did not clearly report their findings, including study screening and selection issues (particularly how this was done and by whom), transparent rationale for study exclusion, who performed data extraction and how, processes for developing synthesized findings, and the development and presentation of recommendations. CONCLUSION: Although qualitative synthesis has come a long way, there are still some areas for improvement in conduct and reporting. This has implications for those who develop guidance and provide education to systematic reviewers.

The ripple effect of evidence implementation: a descriptive evaluation of JBI's Evidence-based Clinical Fellowship Program.

BACKGROUND: Across healthcare there are acknowledged gaps in the translation of evidence into clinical practice. Undertaking a structured implementation program may assist clinicians to achieve this in their clinical practice setting. AIMS/METHODS: The current study descriptively evaluates and analyzes the impact of JBI's (formerly known as the Joanna Briggs Institute) Evidence-based Clinical Fellowship program, since its inception in 2005. RESULTS: Since its inception the JBI Evidence-based Clinical Fellowship Program has trained over 560 Clinical Fellows. The program consists of two 1-week intensive training workshops at JBI, collaborating with a JBI Research Fellow facilitator, with each participant then conducting a workplace evidence implementation project over the intervening 6 months in their own clinical setting. A 'train-the-trainer' program was established to provide accredited trainers to run the program through established JBI Collaborating Entities. CONCLUSION: Implementation of research evidence into the clinical setting is challenging for health professionals. A pragmatic approach adopted through the JBI Evidence-based Clinical Fellowship Program ensures that the Clinical Fellow remains central as the program leader, but has direction and support from their team of various stakeholders, and ongoing collaboration with a JBI facilitator. This ensures increased capacity for engagement and ongoing sustainability of future implementation programs.

The development of software to support multiple systematic review types: the Joanna Briggs Institute System for the Unified Management, Assessment and Review of Information (JBI SUMARI).

AIM: Systematic reviews play an important role in ensuring trustworthy recommendations in healthcare. However, systematic reviews can be laborious to undertake and as such software has been developed to assist in the conduct and reporting of systematic reviews. The Joanna Briggs Institute and its collaborating centres consist of thousands of researchers, academics and clinicians across the globe conducting systematic reviews of various types. To support them in their work, modern software and online tools are required. Our aim was to develop a software program to support systematic reviewers across the globe. METHODS: A working party was formed with extensive consultation with members of the Joanna Briggs Collaboration focusing on ideal features of a software program to support systematic reviews. The new systematic review software was built using an agile methodology and designed to be a modern web application. RESULTS: The new systematic review software, the Joanna Briggs Institute System for the Unified Management, Assessment and Review of Information (JBI SUMARI), was successfully developed through an iterative process of development, feedback, testing and review. The software is now available (https://www.jbisumari.org/) and supports the entire systematic review process for different types of systematic reviews. CONCLUSIONS: An agile software development approach combined with wide consultation and user testing can facilitate systematic review software design and development. This new software can support systematic reviews and guideline developers to create systematic reviews for a diverse range of questions.

Adherence of meta-aggregative systematic reviews to reporting standards and methodological guidance: a methodological review protocol.

REVIEW OBJECTIVE: The objective of the review is to examine Joanna Briggs Institute (JBI) qualitative meta-aggregative reviews to determine.

The SPOT GRADE: A New Method for Reproducibly Quantifying Surgical Wound Bleeding.

STUDY DESIGN: Benchtop model with prospective surgeon video testing. OBJECTIVE: To create a surface bleeding severity scale, the SPOT GRADE (SG), for quantitative assessment of target bleeding site (TBS) blood loss. This is of particular interest for spinal surgery due to epidural bleeding and an inability to use diathermy and radiofrequency cautery close to nerve roots. SUMMARY OF BACKGROUND DATA: A novel apparatus perfusable at known flow rates and simulating different sized wounds was used to create movies to educate surgeons on specific degrees of bleeding. METHODS: Training (36) and testing (108) videos were created using a benchtop apparatus employing different bleeding severities based on the six-level SG (none, minimal, mild, moderate, severe, and extreme) and TBS sizes (1, 10, and 50 cm). Fourteen surgeons in four specialties (cardiothoracic, abdominal, spine, and orthopedic lower extremity) were trained and tested to evaluate SG characteristics including inter-rater and intrarater reliability. RESULTS: The interclass correlation coefficient was estimated to be 0.89840 (95% confidence interval [CI]: 0.85771, 1), whereas the intraclass correlation coefficient was estimated to be 0.93673 (95% CI: 0.89603, 1). In 98% of cases (95% CI: 0.9736, 0.9927), surgeons correctly identified eligible bleeds for a future clinical trial (scores = 1, 2, or 3) and in 91% of cases (95% CI: 0.8895, 0.9344), surgeons correctly identified noneligible bleeds (scores = 4 or 5). In 98.6% of cases (95% CI: 0.9777, 0.9945), physicians correctly identified true hemostasis (score = 0). Based upon these data the probability of a physician rating a bleed incorrectly as hemostasis (score = 0) is estimated to be 1.51% (95% CI: 0.0061, 0.0363). CONCLUSION: This SG is reproducible and reliable providing a basis for educating surgeons on TBS blood loss. It appears to be a new standard for evaluating wound blood loss. LEVEL OF EVIDENCE: 2.

Mixed methods study on the use of and attitudes towards safety checklists in interventional radiology.

INTRODUCTION: The use of safety checklists in interventional radiology is an intervention aimed at reducing mortality and morbidity. Currently there is little known about their practical use in Australian radiology departments. The primary aim of this mixed methods study was to evaluate how safety checklists (SC) are used and completed in radiology departments within Australian hospitals, and attitudes towards their use as described by Australian radiologists. METHODS: A mixed methods approach employing both quantitative and qualitative techniques was used for this study. Direct observations of checklist use during radiological procedures were performed to determine compliance. Medical records were also audited to investigate whether there was any discrepancy between practice (actual care measured by direct observation) and documentation (documented care measured by an audit of records). A focus group with Australian radiologists was conducted to determine attitudes towards the use of checklists. RESULTS: Among the four participating radiology departments, overall observed mean completion of the components of the checklist was 38%. The checklist items most commonly observed to be addressed by the operating theatre staff as noted during observations were correct patient (80%) and procedure (60%). Findings from the direct observations conflicted with the medical record audit, where there was a higher percentage of completion (64% completion) in comparison to the 38% observed. The focus group participants spoke of barriers to the use of checklists, including the culture of radiology departments. CONCLUSION: This is the first study of safety checklist use in radiology within Australia. Overall completion was low across the sites included in this study. Compliance data collected from observations differed markedly from reported compliance in medical records. There remain significant barriers to the proper use of safety checklists in Australian radiology departments.

Use of surgical safety checklists in Australian operating theatres: an observational study.

INTRODUCTION: The use of surgical safety checklists (SSC) is an intervention aimed at reducing mortality and morbidity. Although the effectiveness of their use in surgery has been studied extensively, little is known about their practical use in Australian hospitals. The aim of this study was to observe and document the use of SSC in Australia. METHODS: This study employed direct observations of checklist use for surgical procedures by trained observers. Medical records were also audited to determine compliance with checklist use and to investigate whether there was any discrepancy between practice (actual care measured by direct observation) and documentation (documented care measured by an audit of records). RESULTS: Among the 11 participating hospitals, overall observed mean completion of the components of the checklist was 27%. Only one hospital used the original World Health Organization checklist. The checklist items most commonly observed to be addressed by the operating theatre staff as noted during observations were: correct patient (99%) and procedure (97%), whether the patient had any allergies (80%), and whether the instrument counts were performed correctly (56%). Findings from the direct observations conflicted with the medical record audit, where there was a higher percentage of completion (86% completion) in comparison to the 27% observed. CONCLUSION: This is the first study of surgical checklist use within Australia. Overall completion was low across the sites included in this study. Compliance data collected from observations differed markedly from reported compliance in medical records.

Prevention of falls in acute hospital settings: a multi-site audit and best practice implementation project.

OBJECTIVE: To assess falls prevention practices in Australian hospitals and implement interventions to promote best practice. DESIGN: A multi-site audit using eight evidence-based audit criteria. Following a baseline audit, barriers to compliance were identified and targeted. Two follow-up audit cycles assessed the sustainability of practice change. SETTING: Nine acute care hospitals around Australia, including a mix of public and private. One medical ward and one surgical ward from each hospital were involved. PARTICIPANTS: A clinical leader from each hospital, trained in evidence implementation, conducted the audits and implementation strategies in their setting. INTERVENTIONS: Multi-component falls prevention interventions were utilized, designed to target specific barriers to compliance identified at each hospital. Common interventions involved staff and patient education. MAIN OUTCOME MEASURE: Percentage compliance with falls prevention audit criteria and change in compliance between baseline and follow-up audits. Fall rate data were also analysed. RESULTS: Mean overall compliance at baseline across all hospitals was 50.4% (range 30.8-76.6%). At the first follow-up, this had increased to 74.5% (range 59.4-87.4%), which was sustained at the second follow-up (74.1%, range 48.6-84.4%). There were no statistically significant differences between compliance rates in medical versus surgical wards or in private versus public hospitals. Despite sustained practice improvement, reported fall rates remained unchanged. The focus on staff education possibly led to improved reporting of falls, which may explain the apparent lack of effect on fall rates. CONCLUSIONS: Clinical audit and feedback is an effective strategy to promote quality improvement in falls prevention practices in acute hospital settings.

Addressing the Patient Experience in a Magnetic Resonance Imaging Department: Final Results from an Action Research Study.

INTRODUCTION: Patients undergoing magnetic resonance imaging (MRI) can experience anxiety and claustrophobia. A multimethod action research study was conducted to determine how patient care was currently being delivered in an MRI department and to determine whether this could be improved. METHODS: This action research study used both quantitative and qualitative methods. Changes were introduced into the department after baseline data collection to address areas for improvement. A survey was conducted of patients to establish their level of satisfaction and/or anxiety and to determine whether this improved during the course of the project. Staff practice was qualitatively observed over the course of the project and observations recorded in a field diary. Finally, focus groups were held with staff. RESULTS: The project resulted in improved satisfaction and lower anxiety for patients, and increased the amount of patients receiving information compared with the results of a baseline survey. However, these findings were not statistically significant. Among staff, qualitative observations portrayed a renewed focus on the patient in MRI including changes in their actions such as increased use of touch, improved communication, and focused efforts to maintain privacy. CONCLUSIONS: This study was able to achieve a change in practice through an action research cycle in a MRI department. Over the course of the project, improvements were made to the department, and radiographers changed the way they acted and interacted with patients.

A mixed-methods approach to systematic reviews.

There are an increasing number of published single-method systematic reviews that focus on different types of evidence related to a particular topic. As policy makers and practitioners seek clear directions for decision-making from systematic reviews, it is likely that it will be increasingly difficult for them to identify 'what to do' if they are required to find and understand a plethora of syntheses related to a particular topic.Mixed-methods systematic reviews are designed to address this issue and have the potential to produce systematic reviews of direct relevance to policy makers and practitioners.On the basis of the recommendations of the Joanna Briggs Institute International Mixed Methods Reviews Methodology Group in 2012, the Institute adopted a segregated approach to mixed-methods synthesis as described by Sandelowski et al., which consists of separate syntheses of each component method of the review. Joanna Briggs Institute's mixed-methods synthesis of the findings of the separate syntheses uses a Bayesian approach to translate the findings of the initial quantitative synthesis into qualitative themes and pooling these with the findings of the initial qualitative synthesis.

Patient Anxiety and Satisfaction in a Magnetic Resonance Imaging Department: Initial Results from an Action Research Study.

PURPOSE: The way patients experience health care is largely dependent on the attitudes and actions of the health care professionals they encounter. In medical imaging, the radiographer is often the biggest provider of patient care. Patients undergoing magnetic resonance imaging (MRI) can experience anxiety and claustrophobia. The aim of this study was to determine current levels of anxiety and satisfaction within an MRI unit. METHODS: An action research study was conducted in an MRI unit in a large metropolitan hospital. The focus of this study was on improving patient care within the department. The initial phase of this study focused on determining current levels of anxiety and satisfaction within the department. To achieve this, a survey was conducted of patients attending the department for imaging. RESULTS: Surveys were returned from 120 patients. Overall, the mean anxiety was 2.617 on a 10-point scale (0 = no anxiety, 10 = maximum anxiety; 95% confidence interval, 2.075-3.159; standard deviation, 3). Overall, the mean satisfaction was 8.86 (95% confidence interval, 8.459-9.254; standard deviation, 2.15). There was a statistically significant difference between anxiety for patients who received information and those who did not (information = 2.29, no information = 4.0, P = .045). CONCLUSIONS: Although the vast majority of patients are satisfied with the care they receive during MRI, anxiety is still an issue. The provision of information has been linked to lower levels of anxiety with these patients. The findings from this survey provide insight as to how patients perceive the MRI department and can be used as a benchmark for future surveys to determine if any changes can be made to further improve satisfaction and anxiety during MRI.

Cost-effectiveness of noninvasive central blood pressure monitoring in the diagnosis of hypertension.

BACKGROUND: Central blood pressure (CBP) betters conventional clinical BP (cuff BP) in predicting cardiovascular outcomes. Noninvasive CBP monitoring has emerged as a new technology for management of hypertension. This study aimed to analyze the cost-effectiveness of noninvasive CBP compared to cuff BP monitoring for confirming a diagnosis of hypertension. METHODS: Lifetime costs and quality-adjusted life years (QALYs) were estimated for CBP and cuff BP monitoring using a cohort Markov model. We applied model calibration and probabilistic sensitivity analysis on populations representative of the general population, in 10-year age brackets, from age 35 years to over 75 years of age. RESULTS: The CBP strategy was more cost-effective than cuff BP for men and women across all age subgroups, with mean incremental cost-effectiveness ratios ranging from £226 to £2,750 per QALY gained. The cost-effectiveness was mainly driven by improved patient outcomes, represented by the QALY gains (0.09-0.88), at an acceptable incremental cost (£116-£371). Deterministic and probabilistic sensitivity analyses demonstrated the consistency and robustness of the cost-effectiveness of the CBP strategy. CONCLUSIONS: Early evidence on the diagnostic accuracy of noninvasive CBP monitoring suggests significant improvements in the confirmation of suspected hypertension, compared to cuff BP. This paper suggests that the long-term benefits of improved diagnostic performance justify the supplementary purchase costs of new, noninvasive CBP monitors. The results highlight the potential value of CBP, and hence the value of further research to confirm the diagnostic and prognostic role of CBP for the management of hypertension.

Notions of quality and standards for qualitative research reporting.

The utility of qualitative research findings in the health sciences has been the subject of considerable debate, particularly with the advent of qualitative systematic reviews in recent years. There has been a significant investment in the production of guidance to improve the reporting of quantitative research; however, comparatively little time has been spent on developing the same for qualitative research reporting. This paper sets out to examine the possibility of developing a framework for refereed journals to utilize when guiding authors on how to report the results of qualitative studies in the hope that this will improve the quality of reports and subsequently their inclusion in qualitative syntheses and guidelines to inform practice at the point of care.

Improving communication between health-care professionals and patients with limited English proficiency in the general practice setting.

Quality service provision and patient safety and satisfaction in encounters with health-care professionals relies on effective communication between the practitioner and patient. This study aimed to identify effective practices for improving communication between clinical staff in general practice and patients with limited English proficiency, and to promote their implementation in general practice. Effective interventions and strategies were identified from a review of international research. Experiences with their use in practice were explored via focus group discussions with general practitioners and practice nurses. The results suggest that, wherever possible, communication in the patient's primary language is preferable; use of a qualified medical interpreter should be promoted, and practices should have a standardised and documented procedure for accessing interpreter services. General practice staff must increase their awareness about services that are available to facilitate communication with patients with limited English proficiency, and also develop attitudes, both individual and organisational, that will maximise the effectiveness of these strategies. These findings were used to develop brief, evidence-based practice guidelines that were disseminated to focus group participants for evaluation of utility and general feedback. This evidence-based guidance is now available to assist clinical and administrative general practice staff across regional and metropolitan South Australia.