Assessing unknown potential-quality and limitations of different large language models in the field of otorhinolaryngology.

BACKGROUND: Large Language Models (LLMs) might offer a solution for the lack of trained health personnel, particularly in low- and middle-income countries. However, their strengths and weaknesses remain unclear. AIMS/OBJECTIVES: Here we benchmark different LLMs (Bard 2023.07.13, Claude 2, ChatGPT 4) against six consultants in otorhinolaryngology (ORL). MATERIAL AND METHODS: Case-based questions were extracted from literature and German state examinations. Answers from Bard 2023.07.13, Claude 2, ChatGPT 4, and six ORL consultants were rated blindly on a 6-point Likert-scale for medical adequacy, comprehensibility, coherence, and conciseness. Given answers were compared to validated answers and evaluated for hazards. A modified Turing test was performed and character counts were compared. RESULTS: LLMs answers ranked inferior to consultants in all categories. Yet, the difference between consultants and LLMs was marginal, with the clearest disparity in conciseness and the smallest in comprehensibility. Among LLMs Claude 2 was rated best in medical adequacy and conciseness. Consultants' answers matched the validated solution in 93% (228/246), ChatGPT 4 in 85% (35/41), Claude 2 in 78% (32/41), and Bard 2023.07.13 in 59% (24/41). Answers were rated as potentially hazardous in 10% (24/246) for ChatGPT 4, 14% (34/246) for Claude 2, 19% (46/264) for Bard 2023.07.13, and 6% (71/1230) for consultants. CONCLUSIONS AND SIGNIFICANCE: Despite consultants superior performance, LLMs show potential for clinical application in ORL. Future studies should assess their performance on larger scale.

Urology consultants versus large language models: Potentials and hazards for medical advice in urology.

Background: Current interest surrounding large language models (LLMs) will lead to an increase in their use for medical advice. Although LLMs offer huge potential, they also pose potential misinformation hazards. Objective: This study evaluates three LLMs answering urology-themed clinical case-based questions by comparing the quality of answers to those provided by urology consultants. Methods: Forty-five case-based questions were answered by consultants and LLMs (ChatGPT 3.5, ChatGPT 4, Bard). Answers were blindly rated using a six-step Likert scale by four consultants in the categories: 'medical adequacy', 'conciseness', 'coherence' and 'comprehensibility'. Possible misinformation hazards were identified; a modified Turing test was included, and the character count was matched. Results: Higher ratings in every category were recorded for the consultants. LLMs' overall performance in language-focused categories (coherence and comprehensibility) was relatively high. Medical adequacy was significantly poorer compared with the consultants. Possible misinformation hazards were identified in 2.8% to 18.9% of answers generated by LLMs compared with <1% of consultant's answers. Poorer conciseness rates and a higher character count were provided by LLMs. Among individual LLMs, ChatGPT 4 performed best in medical accuracy (p < 0.0001) and coherence (p = 0.001), whereas Bard received the lowest scores. Generated responses were accurately associated with their source with 98% accuracy in LLMs and 99% with consultants. Conclusions: The quality of consultant answers was superior to LLMs in all categories. High semantic scores for LLM answers were found; however, the lack of medical accuracy led to potential misinformation hazards from LLM 'consultations'. Further investigations are necessary for new generations.

The status and outcomes of interprofessional health education in sub-Saharan Africa: A systematic review.

The increasing burden of chronic diseases, and shortage of health care workers especially in Low and Middle Income countries (LMICs) requires greater collaborative working between health professions. There is a growing body of evidence that interprofessional education (IPE) and interprofessional continuous education (IPCE) can improve collaborative practice thus strengthening health care delivery in low resource settings. The World Health Organization (WHO) promotes this educational strategy in these regions as part of wider programs to improve health care. The purpose of this systematic review was to summarize IPE and IPCE activities in sub-Saharan Africa (SSA) and its outcomes; including practice, service and patient outcomes. Standard guidelines for conducting and reporting systematic reviews were followed. The online databases searched included MEDLINE, Embase, Education Resources Information Centre (ERIC), the Cumulative Index of Nursing and Allied Health Literature (CINAHL) and Science Direct. The Kirkpatrick model was used to classify IPE outcomes reported from literature. Following full text screening, 41 articles were selected for data extraction. It was found that IPE/IPCE is still a relatively new concept in SSA with 93% of studies published after 2012. Furthermore, IPE is concentrated predominantly in undergraduate institutions and mainly implemented to improve collaborative practice and address important public health concerns. Positive reaction and outcomes of IPE/IPCE were reported in terms of change of attitude and perception toward collaborative practice as well as knowledge and skills acquisition. Few studies in SSA sought to understand and measure the outcomes of IPE/IPCE relating to health care practice. More work in this important potential outcome of IPE/IPCE is recommended.

ChatGPT Versus Consultants: Blinded Evaluation on Answering Otorhinolaryngology Case-Based Questions.

BACKGROUND: Large language models (LLMs), such as ChatGPT (Open AI), are increasingly used in medicine and supplement standard search engines as information sources. This leads to more "consultations" of LLMs about personal medical symptoms. OBJECTIVE: This study aims to evaluate ChatGPT's performance in answering clinical case-based questions in otorhinolaryngology (ORL) in comparison to ORL consultants' answers. METHODS: We used 41 case-based questions from established ORL study books and past German state examinations for doctors. The questions were answered by both ORL consultants and ChatGPT 3. ORL consultants rated all responses, except their own, on medical adequacy, conciseness, coherence, and comprehensibility using a 6-point Likert scale. They also identified (in a blinded setting) if the answer was created by an ORL consultant or ChatGPT. Additionally, the character count was compared. Due to the rapidly evolving pace of technology, a comparison between responses generated by ChatGPT 3 and ChatGPT 4 was included to give an insight into the evolving potential of LLMs. RESULTS: Ratings in all categories were significantly higher for ORL consultants (P<.001). Although inferior to the scores of the ORL consultants, ChatGPT's scores were relatively higher in semantic categories (conciseness, coherence, and comprehensibility) compared to medical adequacy. ORL consultants identified ChatGPT as the source correctly in 98.4% (121/123) of cases. ChatGPT's answers had a significantly higher character count compared to ORL consultants (P<.001). Comparison between responses generated by ChatGPT 3 and ChatGPT 4 showed a slight improvement in medical accuracy as well as a better coherence of the answers provided. Contrarily, neither the conciseness (P=.06) nor the comprehensibility (P=.08) improved significantly despite the significant increase in the mean amount of characters by 52.5% (n= (1470-964)/964; P<.001). CONCLUSIONS: While ChatGPT provided longer answers to medical problems, medical adequacy and conciseness were significantly lower compared to ORL consultants' answers. LLMs have potential as augmentative tools for medical care, but their "consultation" for medical problems carries a high risk of misinformation as their high semantic quality may mask contextual deficits.

Coupled Nanomechanical Graphene Resonators: A Promising Platform for Scalable NEMS Networks.

Arrays of coupled nanoelectromechanical resonators are a promising foundation for implementing large-scale network applications, such as mechanical-based information processing and computing, but their practical realization remains an outstanding challenge. In this work, we demonstrate a scalable platform of suspended graphene resonators, such that neighboring resonators are persistently coupled mechanically. We provide evidence of strong coupling between neighboring resonators using two different tuning methods. Additionally, we provide evidence of inter-resonator coupling of higher-order modes, demonstrating the rich dynamics that can be accessed with this platform. Our results establish this platform as a viable option for realizing large-scale programmable networks, enabling applications such as phononic circuits, tunable waveguides, and reconfigurable metamaterials.

Interprofessional ArclightTM eye health workshop: impact on students' clinical identification and ophthalmic skills.

Visual impairment and blindness affect an estimated 2.2 billion people worldwide. Accessible low-cost diagnostic tools and interprofessional education and collaborative practice are part of ongoing strategies to improve eye care services. This study evaluated the impact of an interprofessional Arclight workshop on undergraduate healthcare students' clinical identification skills related to eye health, and self-reported confidence in ophthalmic skills. Undergraduate students from clinical medical officer, ophthalmic clinical officer, Bachelors and Diploma nursing, and medical programs at the University of Rwanda participated in a pilot interprofessional eye health workshop. The Arclight device, a low-cost ophthalmoscope and simulation eyes were used to enable students to practice ophthalmic skills and thereafter equip them. Clinical identification skills related to common eye conditions, and self-reported confidence in ophthalmic skills were assessed pre and post workshop. Overall, students' ability to identify common eye conditions, and self-reported confidence in relation to all skills statistically improved post workshop, with some differences between professional groups in relation to eye health skills. This IPE experience used the Arclight package as a vehicle for IPE, enabling healthcare students to share and acquire new skills and confidence in relation to recognizing common eye conditions and assessing eye health.

Comparative evaluation of a new frugal binocular indirect ophthalmoscope.

OBJECTIVES: We compare the optical quality and design characteristic a new low cost solar powered binocular indirect ophthalmoscope (BIO), Holo, to Keeler BIO. METHODS: Twenty-four participants each examined 10 simulation eyes using both the Holo and the Keeler BIO with a 30-diopter condensing lens. Number of Lea symbols printed on the retina of simulation eyes seen and time taken to identify them was recorded. Stereoacuity of 12 participants was tested while using the BIOs. Using 7-point Likert scale, participants gave feedback on design characteristic of both BIOs. RESULTS: There was no statistical difference in number of Lea symbols correctly identified (15.63/20 for Holo vs. 15/20 for Keeler BIO, p = 0.366, paired t test) or time taken to correctly identify each symbol (Holo 0.39 s faster; 95% confidence interval -2.24 to 3.03 s, p = 0.763) using each device. 12 out of 12 participants achieved stereoacuity of 60 arcsec using the Holo while with the Keeler BIO 11 achieved 60 arcsec and one 90 arcsec. There was no statistically significant difference in the scores for clarity of view, quality of illumination, field of view, binocularity, eye strain and robustness between the two devices. The Holo, scored higher for ease of use (6.5 vs. 6, p = 0.00488, Wilcoxon signed-rank test), comfort of wear (6 vs. 5, p = 0.000337) and portability (7 vs. 6, p = 0.000148). CONCLUSION: The Holo has the potential to be a clinically useful yet affordable diagnostic tool suitable for the first time of equipping eye care workers in low resource settings with a BIO at volume.

Comparative evaluation of a low-cost solar powered otoscope with a traditional device among health care workers in Malawi.

OBJECTIVES: To comparatively evaluate a low-cost otoscope with a traditional device among health care workers in Malawi. METHODS: The study is a prospective, comparative, qualitative observational survey of health care worker's opinions using 5-point Likert rating scales and tick box categories in a 10-item survey questionnaire. Twenty-five mixed cadre health care workers from the Ear, Nose, and Throat Department of the Queen Elizabeth Hospital, Blantyre in Malawi were recruited. Outcomes measures used were ease of speculum attachment, handling, insertion, stability, the quality of view, color, build, brightness, overall ease of use, and their suitability for local work. RESULTS: The low-cost otoscope scored statistically higher in overall combined performance, as well as in the remaining four out of the nine attributes. Notably, 54.2% of users rated the low-cost device more suitable than the traditional device for use in low-middle income countries, 25% were equivocal, and 20.8% preferred the traditional device. CONCLUSION: This study found the Arclight otoscope to be an appropriate and practical substitute for more expensive traditional otoscopes for the delivery of ENT services in low resource settings. LEVEL OF EVIDENCE: N/A.

Cataract Surgery Redesign: Meeting Increasing Demand, Training, Audit and Patient-Centered Care.

OBJECTIVE: The demand for cataract surgery in Fife (a well-defined region in southeast Scotland) was steadily increasing over 15 years. Cataract surgery was therefore being outsourced to meet demand with consequences on list mix, training needs, patient experience and staff morale. We aimed to redesign our services to meet local demand, retain a patient-centered service and continue to fulfil training needs. METHODS: We quantified cataract surgery delivery over an 18-month period: before, during and after redesign of services. We studied numbers of operations, trainee cases and number of outsourced cases. We also considered the economic implications of the redesign. RESULTS: We studied three periods (each of six months duration): before redesign (BR), redesign period (RP) and post-redesign (PR). Data were collected on total operation numbers, number of cases performed by trainees, and numbers performed out with normal working hours (weekend lists) and external providers. An economic analysis examined the cost of outsourcing cataracts during BR and RP and the costs of the redesign, including building, equipment and additional nursing staff. CONCLUSION: Regional fulfilment of cataract surgery provision remains a continuous challenge within the NHS. We show that with minimal investment, smart redesign process and collaborative working, increased local provision is possible while fulfilling trainee needs and achieving the necessary clinical audits and national standards.

Cataract risk stratification and prioritisation protocol in the COVID-19 era.

BACKGROUND: The COVID-19 pandemic halted non-emergency surgery across Scotland. Measures to mitigate the risks of transmitting COVID-19 are creating significant challenges to restarting all surgical services safely. We describe the development of a risk stratification tool to prioritise patients for cataract surgery taking account both specific risk factors for poor outcome from COVID-19 infection as well as surgical 'need'. In addition we report the demographics and comorbidities of patients on our waiting list. METHODS: A prospective case review of electronic records was performed. A risk stratification tool was developed based on review of available literature on systemic risk factors for poor outcome from COVID-19 infection as well as a surgical 'need' score. Scores derived from the tool were used to generate 6 risk profile groups to allow prioritised allocation of surgery. RESULTS: There were 744 patients awaiting cataract surgery of which 66 (8.9 %) patients were 'shielding'. One hundred and thirty-two (19.5 %) patients had no systemic comorbidities, 218 (32.1 %) patients had 1 relevant systemic comorbidity and 316 (46.5 %) patients had 2 or more comorbidities. Five hundred and ninety patients (88.7 %) did not have significant ocular comorbidities. Using the risk stratification tool, 171 (23 %) patients were allocated in the highest 3 priority stages. Given an aging cohort with associated increase in number of systemic comorbidities, the majority of patients were in the lower priority stages 4 to 6. CONCLUSIONS: COVID-19 has created an urgent challenge to deal safely with cataract surgery waiting lists. This has driven the need for a prompt and pragmatic change to the way we assess risks and benefits of a previously regarded as low-risk intervention. This is further complicated by the majority of patients awaiting cataract surgery being elderly with comorbidities and at higher risk of mortality related to COVID-19. We present a pragmatic method of risk stratifying patients on waiting lists, blending an evidence-based objective assessment of risk and patient need combined with an element of shared decision-making. This has facilitated safe and successful restarting of our cataract service.

Identification of amblyogenic risk factors with the Brückner reflex test using the low-cost Arclight direct ophthalmoscope.

BACKGROUND/OBJECTIVES: The Arclight is a novel, low-cost, solar-powered direct ophthalmoscope developed for low resource settings as an alternative to more expensive, conventional devices. The Brückner reflex test (BRT) is a quick and effective means to screen for eye disease and amblyogenic risk factors. This test is however rarely performed in low resource settings due to the lack of access to ophthalmoscopes and trained health care workers. Our aim was to establish the sensitivity and specificity of the BRT when performed by a non-expert using an Arclight and compare to an expert as well as the results of a full clinic workup. SUBJECTS/METHODS: In this prospective, blinded study, 64 patients referred to a paediatric ophthalmology clinic had the BRT performed by a 'non-expert' observer (medical student) then an 'expert' observer (consultant ophthalmologist). These results were then compared against the 'gold standard' outcomes of a full clinical workup. RESULTS: BRT screening by the expert observer led to a sensitivity of 75.0% [95% CI: 57.9-86.8%] and a specificity of 90.6% [95% CI: 75.8-96.8%] in picking up media opacity, strabismus, refractive error or a combination of the above. For the non-expert, the sensitivity and specificity were 71.9% [95% CI: 54.6-84.4%] and 84.4% [95% CI: 68.3-93.1%], respectively. CONCLUSIONS: The Arclight can be effectively used to perform the BRT and identify eye disease and common amblyogenic risk factors. Even when performed by a non-expert the results are highly specific and moderately sensitive. This study consequently offers support for the use of this low-cost ophthalmoscope in the expansion of eye screening by health care workers in low resource settings.

Evaluation of a pilot interprofessional Arclight™ workshop for healthcare students in Rwanda: promoting collaborative practice in eye health.

Preventable and treatable visual impairment affects more than 1 billion people worldwide. Rwanda has an estimated visual impairment prevalence of 3.7% amongst the 12 million inhabitants. Around one third of this demand could be addressed through a more integrated and collaborative approach, particularly in primary eye care services. Healthcare students, therefore, need to be prepared for collaborative practice in eye health through interprofessional learning. Interprofessional workshops were piloted with ophthalmic clinical officer, medical clinical officer, nursing and medical students from the University of Rwanda. The aim was to promote collaborative practice by teaching students how to assess and recognize common eye conditions using the Arclight; a low cost, solar powered, portable ophthalmoscope designed for use in low resource settings. Students reported that the workshop content was relevant to all professional groups. They valued the opportunity to learn interprofessionally, share their knowledge and perspectives, and acquire new knowledge and skills together. This pilot helped to identify the most relevant skills and knowledge for future interprofessional eye health training. It enabled the facilitators to reflect on how best to maintain a balance between a quality interprofessional experience and the more specific eye health related learning objectives.

Nonvolatile Rewritable Frequency Tuning of a Nanoelectromechanical Resonator Using Photoinduced Doping.

Arrays of nanoelectromechanical resonators (NEMS) have shown promise for a suite of applications, from nanomechanical information processing technologies to mass spectrometry. A fundamental challenge toward broader adoption of NEMS arrays is a lack of viable frequency tuning methods, which must simultaneously allow for persistent and reversible control of single resonators while also being scalable to large arrays of devices. In this work, we demonstrate an electro-optic tuning method for graphene-based NEMS where locally photoionized charge tensions a suspended membrane and tunes its resonance frequency. The tuned frequency state persists unchanged for several days in the absence of any external power, and the state can be repeatedly written and erased with a high degree of precision. We show the scalability of this technique by aligning the frequencies of several NEMS devices on the same chip, and we discuss implications of this tuning method for both single devices and programmable NEMS networks.

A fast and sensitive room-temperature graphene nanomechanical bolometer.

Bolometers are a powerful means of detecting light. Emerging applications demand that bolometers work at room temperature, while maintaining high speed and sensitivity, properties which are inherently limited by the heat capacity of the detector. To this end, graphene has generated interest, because it has the lowest mass per unit area of any material, while also possessing extreme thermal stability and an unmatched spectral absorbance. Yet, due to its weakly temperature-dependent electrical resistivity, graphene has failed to challenge the state-of-the-art at room temperature. Here, in a departure from conventional bolometry, we use a graphene nanoelectromechanical system to detect light via resonant sensing. In our approach, absorbed light heats and thermally tensions a suspended graphene resonator, thereby shifting its resonant frequency. Using the resonant frequency as a readout for photodetection, we achieve a room-temperature noise-equivalent power (2 pW Hz-1/2) and bandwidth (from 10 kHz up to 1.3 MHz), challenging the state-of-the-art.

The incidence of idiopathic intracranial hypertension in Scotland: a SOSU study.

BACKGROUND: Idiopathic intracranial hypertension most commonly affects women of childbearing age and usually causes headache and intermittent visual obscurations. Some patients suffer permanent visual loss. The major modifiable risk factor associated with IIH is obesity. Scotland has one of the poorest records for obesity in the western world, with a prevalence in 2016 of 29% in the adult population. We aimed to establish the incidence of idiopathic intracranial hypertension (IIH) in Scotland. METHODS: All new cases of IIH seen in Scotland were collected over a 1-year period. Cases were reported by ophthalmologists through the Scottish Ophthalmic Surveillance Unit (SOSU) and by neurologists directly to the investigators using encrypted NHS emails. An open dialogue was maintained between the investigators and specialist neuro-ophthalmology clinics throughout the year to minimise the risk of under-reporting. Cases were defined using the Modified Dandy Diagnostic Criteria. RESULTS: One hundred and forty-four confirmed cases of IIH were reported. One hundred and ten out of 144 patients were female and aged 15-44. The mean BMI in this group was 38.9. CONCLUSIONS: The incidence of IIH in Scotland is at least 2.65/100,000. This figure rises to 37.9/100,000 in obese females aged 15-44. This figure is higher than previously published and is probably a result of increasing levels of obesity across the nation. The significant morbidity caused by IIH, in this young population raises the question of whether enough is being done to prevent and treat Scotland's obesity crisis.

Deterministic Quantum Emitter Formation in Hexagonal Boron Nitride via Controlled Edge Creation.

Quantum emitters (QEs) in 2D hexagonal boron nitride (hBN) are extremely bright and are stable at high temperature and under harsh chemical conditions. Because they reside within an atomically thin 2D material, these QEs have a unique potential to couple strongly to hybrid optoelectromechanical and quantum devices. However, this potential for coupling has been underexplored because of challenges in nanofabrication and patterning of hBN QEs. Motivated by recent studies showing that QEs in hBN tend to form at edges, we use a focused ion beam (FIB) to mill an array of patterned holes into hBN. Using optical confocal microscopy, we find arrays of bright, localized photoluminescence that match the geometry of the patterned holes. Furthermore, second-order photon correlation measurements on these bright spots reveal that they contain single and multiple QEs. By optimizing the FIB parameters, we create patterned single QEs with a yield of 31%, a value close to Poissonian limit. Using atomic force microscopy to study the morphology near emission sites, we find that single QE yield is highest with smoothly milled holes on unwrinkled hBN. This technique dramatically broadens the utility and convenience of hBN QEs and achieves a vital step toward the facile integration of the QEs into large-scale photonic, plasmonic, nanomechanical, or optoelectronic devices.