Expert assessment of ChatGPT's ability to generate illness scripts: an evaluative study.

BACKGROUND: An illness script is a specific script format geared to represent patient-oriented clinical knowledge organized around enabling conditions, faults (i.e., pathophysiological process), and consequences. Generative artificial intelligence (AI) stands out as an educational aid in continuing medical education. The effortless creation of a typical illness script by generative AI could help the comprehension of key features of diseases and increase diagnostic accuracy. No systematic summary of specific examples of illness scripts has been reported since illness scripts are unique to each physician. OBJECTIVE: This study investigated whether generative AI can generate illness scripts. METHODS: We utilized ChatGPT-4, a generative AI, to create illness scripts for 184 diseases based on the diseases and conditions integral to the National Model Core Curriculum in Japan for undergraduate medical education (2022 revised edition) and primary care specialist training in Japan. Three physicians applied a three-tier grading scale: "A" denotes that the content of each disease's illness script proves sufficient for training medical students, "B" denotes that it is partially lacking but acceptable, and "C" denotes that it is deficient in multiple respects. RESULTS: By leveraging ChatGPT-4, we successfully generated each component of the illness script for 184 diseases without any omission. The illness scripts received "A," "B," and "C" ratings of 56.0% (103/184), 28.3% (52/184), and 15.8% (29/184), respectively. CONCLUSION: Useful illness scripts were seamlessly and instantaneously created using ChatGPT-4 by employing prompts appropriate for medical students. The technology-driven illness script is a valuable tool for introducing medical students to key features of diseases.

Importance of Patient History in Artificial Intelligence-Assisted Medical Diagnosis: Comparison Study.

Background: Medical history contributes approximately 80% to a diagnosis, although physical examinations and laboratory investigations increase a physician's confidence in the medical diagnosis. The concept of artificial intelligence (AI) was first proposed more than 70 years ago. Recently, its role in various fields of medicine has grown remarkably. However, no studies have evaluated the importance of patient history in AI-assisted medical diagnosis. Objective: This study explored the contribution of patient history to AI-assisted medical diagnoses and assessed the accuracy of ChatGPT in reaching a clinical diagnosis based on the medical history provided. Methods: Using clinical vignettes of 30 cases identified in The BMJ, we evaluated the accuracy of diagnoses generated by ChatGPT. We compared the diagnoses made by ChatGPT based solely on medical history with the correct diagnoses. We also compared the diagnoses made by ChatGPT after incorporating additional physical examination findings and laboratory data alongside history with the correct diagnoses. Results: ChatGPT accurately diagnosed 76.6% (23/30) of the cases with only the medical history, consistent with previous research targeting physicians. We also found that this rate was 93.3% (28/30) when additional information was included. Conclusions: Although adding additional information improves diagnostic accuracy, patient history remains a significant factor in AI-assisted medical diagnosis. Thus, when using AI in medical diagnosis, it is crucial to include pertinent and correct patient histories for an accurate diagnosis. Our findings emphasize the continued significance of patient history in clinical diagnoses in this age and highlight the need for its integration into AI-assisted medical diagnosis systems.

Glypican-1-targeted antibody-drug conjugate inhibits the growth of glypican-1-positive glioblastoma.

Glioblastoma is the deadliest form of brain tumor. The presence of the blood-brain barrier (BBB) significantly hinders chemotherapy, necessitating the development of innovative treatment options for this tumor. This report presents the in vitro and in vivo efficacy of an antibody-drug conjugate (ADC) that targets glypican-1 (GPC1) in glioblastoma. The GPC1-ADC was created by conjugating a humanized anti-GPC1 antibody (clone T2) with monomethyl auristatin E (MMAE) via maleimidocaproyl-valine-citrulline-p-aminobenzyloxycarbonyl linkers. Immunohistochemical staining analysis of a glioblastoma tissue microarray revealed that GPC1 expression was elevated in more than half of the cases. GPC1-ADC, when bound to GPC1, was efficiently and rapidly internalized in glioblastoma cell lines. It inhibited the growth of GPC1-positive glioma cell lines by inducing cell cycle arrest in the G2/M phase and triggering apoptosis in vitro. We established a heterotopic xenograft model by subcutaneously implanting KALS-1 and administered GPC1-ADC intravenously. GPC1-ADC significantly inhibited tumor growth and increased the number of mitotic cells. We also established an orthotopic xenograft model by intracranially implanting luciferase-transfected KS-1-Luc#19. After injecting Evans blue and resecting brain tissues, dye leakage was observed in the implantation area, confirming BBB disruption. We administered GPC1-ADC intravenously and measured the luciferase activity using an in vivo imaging system. GPC1-ADC significantly inhibited tumor growth and extended survival. In conclusion, GPC1-ADC demonstrated potent intracranial activity against GPC1-positive glioblastoma in an orthotopic xenograft model. These results indicate that GPC1-ADC could represent a groundbreaking new therapy for treating glioblastoma beyond the BBB.

Accuracy of ChatGPT on Medical Questions in the National Medical Licensing Examination in Japan: Evaluation Study.

BACKGROUND: ChatGPT (OpenAI) has gained considerable attention because of its natural and intuitive responses. ChatGPT sometimes writes plausible-sounding but incorrect or nonsensical answers, as stated by OpenAI as a limitation. However, considering that ChatGPT is an interactive AI that has been trained to reduce the output of unethical sentences, the reliability of the training data is high and the usefulness of the output content is promising. Fortunately, in March 2023, a new version of ChatGPT, GPT-4, was released, which, according to internal evaluations, was expected to increase the likelihood of producing factual responses by 40% compared with its predecessor, GPT-3.5. The usefulness of this version of ChatGPT in English is widely appreciated. It is also increasingly being evaluated as a system for obtaining medical information in languages other than English. Although it does not reach a passing score on the national medical examination in Chinese, its accuracy is expected to gradually improve. Evaluation of ChatGPT with Japanese input is limited, although there have been reports on the accuracy of ChatGPT's answers to clinical questions regarding the Japanese Society of Hypertension guidelines and on the performance of the National Nursing Examination. OBJECTIVE: The objective of this study is to evaluate whether ChatGPT can provide accurate diagnoses and medical knowledge for Japanese input. METHODS: Questions from the National Medical Licensing Examination (NMLE) in Japan, administered by the Japanese Ministry of Health, Labour and Welfare in 2022, were used. All 400 questions were included. Exclusion criteria were figures and tables that ChatGPT could not recognize; only text questions were extracted. We instructed GPT-3.5 and GPT-4 to input the Japanese questions as they were and to output the correct answers for each question. The output of ChatGPT was verified by 2 general practice physicians. In case of discrepancies, they were checked by another physician to make a final decision. The overall performance was evaluated by calculating the percentage of correct answers output by GPT-3.5 and GPT-4. RESULTS: Of the 400 questions, 292 were analyzed. Questions containing charts, which are not supported by ChatGPT, were excluded. The correct response rate for GPT-4 was 81.5% (237/292), which was significantly higher than the rate for GPT-3.5, 42.8% (125/292). Moreover, GPT-4 surpassed the passing standard (>72%) for the NMLE, indicating its potential as a diagnostic and therapeutic decision aid for physicians. CONCLUSIONS: GPT-4 reached the passing standard for the NMLE in Japan, entered in Japanese, although it is limited to written questions. As the accelerated progress in the past few months has shown, the performance of the AI will improve as the large language model continues to learn more, and it may well become a decision support system for medical professionals by providing more accurate information.

A qualitative study examining the critical differences in the experience of and response to formative feedback by undergraduate medical students in Japan and the UK.

BACKGROUND: Formative feedback plays a critical role in guiding learners to gain competence, serving as an opportunity for reflection and feedback on their learning progress and needs. Medical education in Japan has historically been dominated by a summative paradigm within assessment, as opposed to countries such as the UK where there are greater opportunities for formative feedback. How this difference affects students' interaction with feedback has not been studied. We aim to explore the difference in students' perception of feedback in Japan and the UK. METHODS: The study is designed and analysed with a constructivist grounded theory lens. Medical students in Japan and the UK were interviewed on the topic of formative assessment and feedback they received during clinical placements. We undertook purposeful sampling and concurrent data collection. Data analysis through open and axial coding with iterative discussion among research group members was conducted to develop a theoretical framework. RESULTS: Japanese students perceived feedback as a model answer provided by tutors which they should not critically question, which contrasted with the views of UK students. Japanese students viewed formative assessment as an opportunity to gauge whether they are achieving the pass mark, while UK students used the experience for reflective learning. CONCLUSIONS: The Japanese student experience of formative assessment and feedback supports the view that medical education and examination systems in Japan are focused on summative assessment, which operates alongside culturally derived social pressures including the expectation to correct mistakes. These findings provide new insights in supporting students to learn from formative feedback in both Japanese and UK contexts.

Improving decision accuracy using a clinical decision support system for medical students during history-taking: a randomized clinical trial.

BACKGROUND: A clinical diagnostic support system (CDSS) can support medical students and physicians in providing evidence-based care. In this study, we investigate diagnostic accuracy based on the history of present illness between groups of medical students using a CDSS, Google, and neither (control). Further, the degree of diagnostic accuracy of medical students using a CDSS is compared with that of residents using neither a CDSS nor Google. METHODS: This study is a randomized educational trial. The participants comprised 64 medical students and 13 residents who rotated in the Department of General Medicine at Chiba University Hospital from May to December 2020. The medical students were randomly divided into the CDSS group (n = 22), Google group (n = 22), and control group (n = 20). Participants were asked to provide the three most likely diagnoses for 20 cases, mainly a history of a present illness (10 common and 10 emergent diseases). Each correct diagnosis was awarded 1 point (maximum 20 points). The mean scores of the three medical student groups were compared using a one-way analysis of variance. Furthermore, the mean scores of the CDSS, Google, and residents' (without CDSS or Google) groups were compared. RESULTS: The mean scores of the CDSS (12.0 ± 1.3) and Google (11.9 ± 1.1) groups were significantly higher than those of the control group (9.5 ± 1.7; p = 0.02 and p = 0.03, respectively). The residents' group's mean score (14.7 ± 1.4) was higher than the mean scores of the CDSS and Google groups (p = 0.01). Regarding common disease cases, the mean scores were 7.4 ± 0.7, 7.1 ± 0.7, and 8.2 ± 0.7 for the CDSS, Google, and residents' groups, respectively. There were no significant differences in mean scores (p = 0.1). CONCLUSIONS: Medical students who used the CDSS and Google were able to list differential diagnoses more accurately than those using neither. Furthermore, they could make the same level of differential diagnoses as residents in the context of common diseases. TRIAL REGISTRATION: This study was retrospectively registered with the University Hospital Medical Information Network Clinical Trials Registry on 24/12/2020 (unique trial number: UMIN000042831).

Hybrid PBL and Pure PBL: Which one is more effective in developing clinical reasoning skills for general medicine clerkship?-A mixed-method study.

This study aims to compare the effectiveness of Hybrid and Pure problem-based learning (PBL) in teaching clinical reasoning skills to medical students. The study sample consisted of 99 medical students participating in a clerkship rotation at the Department of General Medicine, Chiba University Hospital. They were randomly assigned to Hybrid PBL (intervention group, n = 52) or Pure PBL group (control group, n = 47). The quantitative outcomes were measured with the students' perceived competence in PBL, satisfaction with sessions, and self-evaluation of competency in clinical reasoning. The qualitative component consisted of a content analysis on the benefits of learning clinical reasoning using Hybrid PBL. There was no significant difference between intervention and control groups in the five students' perceived competence and satisfaction with sessions. In two-way repeated measure analysis of variance, self-evaluation of competency in clinical reasoning was significantly improved in the intervention group in "recalling appropriate differential diagnosis from patient's chief complaint" (F(1,97) = 5.295, p = 0.024) and "practicing the appropriate clinical reasoning process" (F(1,97) = 4.016, p = 0.038). According to multiple comparisons, the scores of "recalling appropriate history, physical examination, and tests on clinical hypothesis generation" (F(1,97) = 6.796, p = 0.011), "verbalizing and reflecting appropriately on own mistakes," (F(1,97) = 4.352, p = 0.040) "selecting keywords from the whole aspect of the patient," (F(1,97) = 5.607, p = 0.020) and "examining the patient while visualizing his/her daily life" (F(1,97) = 7.120, p = 0.009) were significantly higher in the control group. In the content analysis, 13 advantage categories of Hybrid PBL were extracted. In the subcategories, "acquisition of knowledge" was the most frequent subcategory, followed by "leading the discussion," "smooth discussion," "getting feedback," "timely feedback," and "supporting the clinical reasoning process." Hybrid PBL can help acquire practical knowledge and deepen understanding of clinical reasoning, whereas Pure PBL can improve several important skills such as verbalizing and reflecting on one's own errors and selecting appropriate keywords from the whole aspect of the patient.

Association Between Physician Empathy and Difficult Patient Encounters: a Cross-Sectional Study.

BACKGROUND: Physicians frequently experience patients as difficult. Our study explores whether more empathetic physicians experience fewer patient encounters as difficult. OBJECTIVE: To investigate the association between physician empathy and difficult patient encounters (DPEs). DESIGN: Cross-sectional study. PARTICIPANTS: Participants were 18 generalist physicians with 3-8 years of experience. The investigation was conducted from August-September 2018 and April-May 2019 at six healthcare facilities. MAIN MEASURES: Based on the Jefferson Scale of Empathy (JSE) scores, we classified physicians into low and high empathy groups. The physicians completed the Difficult Doctor-Patient Relationship Questionnaire-10 (DDPRQ-10) after each patient visit. Scores ≥ 31 on the DDPRQ-10 indicated DPEs. We implemented multilevel mixed-effects logistic regression models to examine the association between physicians' empathy and DPE, adjusting for patient-level covariates (age, sex, history of mental disorders) and with physician-level clustering. KEY RESULTS: The median JSE score was 114 (range: 96-126), and physicians with JSE scores 96-113 and 114-126 were assigned to low and high empathy groups, respectively (n = 8 and 10 each); 240 and 344 patients were examined by physicians in the low and high empathy groups, respectively. Among low empathy physicians, 23% of encounters were considered difficulty, compared to 11% among high empathy groups (OR: 0.37; 95% CI = 0.19-0.72, p = 0.004). JSE scores and DDPRQ-10 scores were negatively correlated (r = -0.22, p < 0.01). CONCLUSION: Empathetic physicians were less likely to experience encounters as difficult. Empathy appears to be an important component of physician perception of encounter difficulty.

Changes in periventricular anastomosis after indirect revascularization surgery alone for adult patients with misery perfusion due to ischemic moyamoya disease.

Periventricular anastomosis in moyamoya disease (MMD) is an unusual angiographic finding that arises from perforating arteries such as the lenticulostriate artery (LSA), thalamic artery (THA), and anterior choroidal artery (AChA). This anastomosis is associated with increased hemorrhagic risk in MMD and can be corrected by direct revascularization surgery. The present supplementary analysis on a prospective cohort aimed to elucidate changes in periventricular anastomosis after indirect revascularization surgery alone for adult patients with misery perfusion due to ischemic MMD. Twenty-two patients with misery perfusion in the symptomatic cerebral hemisphere who underwent indirect revascularization surgery alone also underwent six-vessel cerebral angiography via arterial catheterization before and at 6 months after surgery. Before surgery, two patients (9%) had positive periventricular anastomosis from the LSA and another (5%) from the AChA; all three of these periventricular anastomoses regressed after surgery, but these changes were not statistically significant (p = 0.0833). The degree of formation of collateral vessels from the LSA significantly decreased after surgery (p = 0.0143), but the degree of collateral vessels from the THA or AChA did not differ between pre- and postoperative conditions. Eight patients with postoperative regression of the collateral vessels from any perforating artery exhibited postoperative rich collateral flow from indirect revascularization. Periventricular anastomosis tended to regress after indirect revascularization surgery alone for adult patients with misery perfusion due to ischemic MMD. Collateral vessels formed from the LSA likely regressed after indirect revascularization surgery alone for such patients, but those vessels from the THA or AChA seldom changed.

Outcomes of Medical Management Alone for Adult Patients with Cerebral Misery Perfusion Due to Ischemic Moyamoya Disease.

OBJECTIVES: Although revascularization surgery is recommended for adult patients with moyamoya disease (MMD) who present with ischemic symptoms due to hemodynamic compromise, the clinical course of such patients who are treated with medical management alone remains unclear. Here, we report outcomes of adult patients with cerebral misery perfusion due to ischemic MMD who received medical management alone. MATERIALS AND METHODS: We prospectively followed up patients who showed misery perfusion in the symptomatic cerebral hemisphere on 15O gas positron emission tomography (PET) and received strict medical management alone after refusing revascularization surgery. RESULTS: Of 57 patients who showed symptomatic misery perfusion on 15O gas PET, three (5%) were included into the present study. Two of these patients suffered further ischemic events at 7 and 8 months after inclusion, after which, their modified Rankin disability scale scores deteriorated. In the remaining patient, fatal intracerebral hemorrhage developed at 10 months after inclusion. CONCLUSIONS: These findings suggest that receiving medical management alone is associated with considerably poor outcomes for adult patients with cerebral misery perfusion due to ischemic MMD.

The flipped classroom is effective for medical students to improve deep tendon reflex examination skills: A mixed-method study.

Deep tendon reflexes (DTR) are a prerequisite skill in clinical clerkships. However, many medical students are not confident in their technique and need to be effectively trained. We evaluated the effectiveness of a flipped classroom for teaching DTR skills. We recruited 83 fifth-year medical students who participated in a clinical clerkship at the Department of General Medicine, Chiba University Hospital, from November 2018 to July 2019. They were allocated to the flipped classroom technique (intervention group, n = 39) or the traditional technique instruction group (control group, n = 44). Before procedural teaching, while the intervention group learned about DTR by e-learning, the control group did so face-to-face. A 5-point Likert scale was used to evaluate self-confidence in DTR examination before and after the procedural teaching (1 = no confidence, 5 = confidence). We evaluated the mastery of techniques after procedural teaching using the Direct Observation of Procedural Skills (DOPS). Unpaired t-test was used to analyze the difference between the two groups on the 5-point Likert scale and DOPS. We assessed self-confidence in DTR examination before and after procedural teaching using a free description questionnaire in the two groups. Additionally, in the intervention group, focus group interviews (FGI) (7 groups, n = 39) were conducted to assess the effectiveness of the flipped classroom after procedural teaching. Pre-test self-confidence in the DTR examination was significantly higher in the intervention group than in the control group (2.8 vs. 2.3, P = 0.005). Post-test self-confidence in the DTR examination was not significantly different between the two groups (3.9 vs. 4.1, P = 0.31), and so was mastery (4.3 vs. 4.1, P = 0.68). The questionnaires before the procedural teaching revealed themes common to the two groups, including "lack of knowledge" and "lack of self-confidence." Themes about prior learning, including "acquisition of knowledge" and "promoting understanding," were specific in the intervention group. The FGI revealed themes including "application of knowledge," "improvement in DTR technique," and "increased self-confidence." Based on these results, teaching DTR skills to medical students in flipped classrooms improves readiness for learning and increases self-confidence in performing the procedure at a point before procedural teaching.

Long-Term Cognitive Changes after Revascularization Surgery in Adult Patients with Ischemic Moyamoya Disease.

INTRODUCTION: Revascularization surgery for adult moyamoya disease (MMD) with ischemic presentation changes cognitive function and prevents further cerebral ischemic events. Most studies however repeated neuropsychological evaluation within 1 year after surgery. Our previous prospective cohort study of adult patients with MMD with misery perfusion who underwent direct revascularization surgery showed cognitive improvement and decline in 31% and 44%, respectively, of the patients 2 months after surgery. The present prospective study aimed to elucidate the 5-year cognitive changes after direct revascularization surgery in adult patients with cerebral misery perfusion due to ischemic MMD by following the same patients. METHODS: In total, 31 patients were prospectively followed up for 5 years after direct revascularization surgery. Five types of neuropsychological tests were performed preoperatively, 2 months after surgery, and at the end of the 5-year follow-up. Cerebral blood flow (CBF) in the symptomatic cerebral hemisphere relative to that in the ipsilateral cerebellar hemisphere (hemispheric relative CBF [RCBF]) was measured using brain perfusion single-photon emission computed tomography preoperatively and at the end of the 5-year follow-up. RESULTS: Based on results of pre- and postoperative neuropsychological tests, 11, 10, and 10 patients showed cognitive improvement, no change in cognitive function, and cognitive decline, respectively, at the end of the 5-year follow-up. These ratios were not significantly different compared with those 2 months after surgery (cognitive improvement, no change in cognitive function, and cognitive decline in 10, 8, and 13 patients, respectively). Although hemispheric RCBF was significantly greater at the end of the 5-year follow-up than before surgery in patients with cognitive improvement (80.7 ± 6.1% vs. 92.9 ± 5.5%; p = 0.0033) and in those showing no change in cognitive function (85.6 ± 3.5 vs. 91.5 ± 5.2%; p = 0.0093), this value was significantly lower at the end of the 5-year follow-up than before surgery in patients with cognitive decline (83.8 ± 3.7 vs. 81.0 ± 5.8%; p = 0.0367). CONCLUSION: One-third of adult patients with cerebral misery perfusion due to ischemic MMD who underwent direct revascularization surgery exhibited cognitive improvement, and one-third exhibited decline at the end of the 5-year follow-up. The former and latter patients had increased and decreased CBF, respectively, in the affected cerebral hemisphere at the end of the 5-year follow-up compared with preoperative brain perfusion.

Peripheral Ulcerative Keratitis Associated With Large Vessel Vasculitis.

Peripheral ulcerative keratitis (PUK) is a non-infectious ulcer at the peripheral corneal stroma. Autoimmune diseases can cause PUK, but PUK caused by large vessel vasculitis (LVV) has rarely been reported. We report the case of a 71-year-old woman with complaints of low-grade fever and left eye pain. Ophthalmologic examination revealed PUK in the left eye, and we diagnosed LVV by 18F-fluorodeoxyglucose-positron emission tomography (FDG-PET) findings. The patient was treated with topical betamethasone eye drops for PUK and oral prednisolone for LVV. This case suggests that LVV can cause PUK.