Evaluating ChatGPT's effectiveness and tendencies in Japanese internal medicine.

INTRODUCTION: ChatGPT, a large-scale language model, is a notable example of AI's potential in health care. However, its effectiveness in clinical settings, especially when compared to human physicians, is not fully understood. This study evaluates ChatGPT's capabilities and limitations in answering questions for Japanese internal medicine specialists, aiming to clarify its accuracy and tendencies in both correct and incorrect responses. METHODS: We utilized ChatGPT's answers on four sets of self-training questions for internal medicine specialists in Japan from 2020 to 2023. We ran three trials for each set to evaluate its overall accuracy and performance on nonimage questions. Subsequently, we categorized the questions into two groups: those ChatGPT consistently answered correctly (Confirmed Correct Answer, CCA) and those it consistently answered incorrectly (Confirmed Incorrect Answer, CIA). For these groups, we calculated the average accuracy rates and 95% confidence intervals based on the actual performance of internal medicine physicians on each question and analyzed the statistical significance between the two groups. This process was then similarly applied to the subset of nonimage CCA and CIA questions. RESULTS: ChatGPT's overall accuracy rate was 59.05%, increasing to 65.76% for nonimage questions. 24.87% of the questions had answers that varied between correct and incorrect in the three trials. Despite surpassing the passing threshold for nonimage questions, ChatGPT's accuracy was lower than that of human specialists. There was a significant variance in accuracy between CCA and CIA groups, with ChatGPT mirroring human physician patterns in responding to different question types. CONCLUSION: This study underscores ChatGPT's potential utility and limitations in internal medicine. While effective in some aspects, its dependence on question type and context suggests that it should supplement, not replace, professional medical judgment. Further research is needed to integrate Artificial Intelligence tools like ChatGPT more effectively into specialized medical practices.

Association Between Gender and Payments Received From Pharmaceutical Companies Among Medical Professors and Associate Professors in Japan.

Introduction While prior research showed gender gaps in industry payments for medical professionals in the United States, there are limited data in Japan. So, this study seeks to investigate the potential gender gap in the receipt of pharmaceutical companies (PFCs) across all medical fields in Japan. Based on the results of previous studies, we developed a hypothesis that male doctors get more PFC than female doctors. Materials and methods Data from 92 pharmaceutical companies in Japan, covering 2016 to 2019, were analyzed. The analysis was conducted on professors and associate professors at all national and public medical universities in Japan, with gender as a factor variable and payments as an outcome variable, and variables that may have influenced the factor or outcome variables in previous studies, such as specialization, university type, region, rank and years since graduation, as control variables. Payments were converted to US dollars using the December 31, 2021, rate of 115 yen to the dollar for comparison purposes. Results Out of 1,825 subjects, 1,755 were males and 70 females. Males consistently received higher median payments from pharmaceutical companies (PFCs) than females across categories. In particular, among physicians specializing in internal medicine, the median PFC for men was $25 compared to $8 for women. For physicians affiliated with former imperial universities (the seven former imperial universities founded before World War II), the median PFC for men was $32 compared to $5 for women. Multivariate analysis confirmed significantly higher total benefits for males from 2016 to 2019, with the gender gap widening during this period (incidence rate ratio (IRR) for 2016: 0.51, IRR for 2019: 0.44). Conclusions Japanese male professors and associate professors received significantly higher PFCs than their female counterparts, and this gender gap expanded from 2016 to 2019, highlighting persistent gender inequality in the medical field in Japan, similar to trends observed in the United States.

Nature and Trend of Pharmaceutical Payments to Japanese Board-Certified Neurologists Between 2016 and 2019: A Pre-emergence Analysis Amidst the Development of Next-Generation Alzheimer's Disease Drugs.

OBJECTIVE: There is insufficient data on the financial relationships between Japanese neurologists and pharmaceutical companies prior to the advent of new-generation Alzheimer's disease drugs. The purpose of this study is to evaluate the magnitude, prevalence, and trend of the financial relationship between Japanese neurologists and pharmaceutical companies between 2016 and 2019. METHODS: A cross-sectional study was undertaken to evaluate the financial relationships between all board-certified neurology specialists and pharmaceutical companies in Japan from 2016 and 2019. Descriptive statistics were applied to measure the magnitude and prevalence of payments among specialists, as well as their trends during the study periods. RESULTS: In a four-year analysis, 77 pharmaceutical companies disbursed a total of USD 36,869,204 across 50,050 payments to 2,696 neurologists in Japan, revealing a mean payment of USD 10,809 per specialist. Notably, the Gini index of 0.997 indicated a high inequality in payment distribution, with a minority of specialists receiving a substantial proportion of payments. Trends displayed irregularities, but an overall increase in total payments from 2016 to 2019, with a significant contribution from the top 10 pharmaceutical companies accounting for 74.2% of total payments, with Takeda Pharmaceutical and Eisai Company notably increasing payments in 2019. There were notable geographical variations in neurologist and payment distribution across 47 prefectures. CONCLUSION: Our analysis of neurologist payments from pharmaceutical companies in Japan showed a substantial financial relationship with overall increases, yearly varied increments, and payment inequality. Caution is warranted as financial ties may intensify with the continued development of next-generation Alzheimer's disease drugs.

Intramuscular vs. Subcutaneous: Rethinking Influenza Vaccination Strategy in Japan.

In Japan, inactivated vaccines, including the influenza vaccine, are administered subcutaneously, which is contrary to global recommendations for intramuscular injections. This practice is attributed to historical medical incidents and unchallenged conventions. However, this outdated method, which differs from that of international standards and is linked with less immunogenicity and more adverse reactions, may contribute to vaccination hesitancy. Therefore, with the adoption of intramuscular vaccination administration, which was widely adopted in the coronavirus disease 2019 vaccination, a shift in the Japanese health policy to conform to international standards potentially improves vaccine acceptance and effectiveness.

Characteristics of Japanese physician influencers on Twitter during the COVID-19 pandemic and fact-checking their tweets on COVID-19-related drugs.

BACKGROUND: During the coronavirus disease-2019 (COVID-19) pandemic, segments of the public relied on social media platforms such as Twitter for medical information shared by medical personnel. Although physicians are likely to disseminate more accurate information on Twitter than non-medical individuals, it cannot be taken for granted. As such, tweets written by physicians in Japan should also be scrutinized for accuracy. PURPOSE: The purpose of this study was to create a profile of the most popular physician influencers on Twitter in Japan, and to do a fact-check of their tweets regarding COVID-19-related drugs. DESIGN: This is a retrospective observational study. METHODS: We purchased Twitter data for Japan for the initial 9 months of the COVID-19 pandemic (from January 2020 to September 2020), and extracted tweets with keywords related to COVID-19 at a sampling rate of 3%. The most popular physicians were identified and selected consecutively by searching for the top 1000 accounts using Twitter's search function. These top accounts were considered influencers and their tweets and retweets concerning COVID-19-related drugs were fact-checked against scientific literature. RESULTS: We identified 21 physician influencers with real names: most were male in their 40s and 50s working at private medical facilities. The contents of their tweets were mainly sourced from scientific publications that were current at that time. The fact-check revealed that only one of 50 tweets was not correct while the others had no identifiable inaccuracies. CONCLUSIONS: Except for one tweet, tweets written and retweeted by Japanese physician influencers concerning the COVID-19-related drugs contained predominantly accurate information.

Long-term Experience on Breast Cancer-related Lymphedema in the Coastal Area of Fukushima, Japan After the 2011 Triple Disaster.

BACKGROUND/AIM: Disasters can jeopardize breast cancer care and Japan's triple disaster in 2011 (earthquake, tsunami, and nuclear accident) is no exception. However, detailed information is lacking regarding the care of breast cancer related lymphedema (BCRL) following the disaster. We aimed to explore the process by which local patients become aware of BCRL, the problems faced, and the support they require. We also aimed to clarify the effects of the 2011 disaster on experiences related to lymphedema in the target population. PATIENTS AND METHODS: Patients who developed BCRL after breast cancer treatment were recruited from Iwaki city, a municipality located in the southern coastal region of Fukushima (N=16). In-depth, semi-structured, face-to-face interviews were conducted, and the obtained data were appraised using thematic analysis. RESULTS: Five themes related to BCRL were identified: 1) the process of becoming aware of BCRL, 2) troubles or worries/concerns due to BCRL, 3) information sources regarding BCRL management, 4) strategies to cope with BCRL, and 5) the adverse impacts of the 2011 disaster on BCRL management. CONCLUSION: Except for the disaster context, the themes are in line with those of previous studies conducted in the non-disaster context. Nonetheless, there were limited but non-negligible adverse effects of the 2011 disaster on long-term local BCRL management. The findings of this study demonstrate the necessity for individualizing coping strategies against BCRL among healthcare professionals in the Fukushima coastal area and beyond.

ChatGPT's Potential in Enhancing Physician Efficiency: A Japanese Case Study.

Artificial intelligence (AI), particularly ChatGPT, developed by OpenAI (San Francisco, CA, USA), is making significant strides in the medical field. In a simulated case study, a 66-year-old Japanese female patient's dialogue with a physician was transcribed and inputted into ChatGPT to assess its efficacy in drafting medical records, formulating differential diagnoses, and establishing treatment plans. The results showed a high similarity between the medical summaries generated by ChatGPT and those of the attending physician. This suggests that ChatGPT has the potential to assist physicians in clinical reasoning and reduce the administrative burden, allowing them to spend more time with patients. However, there are limitations, such as the system's reliance on linguistic data and occasional inaccuracies. Despite its potential, the ethical implications of using patient data and the risk of AI replacing clinicians emphasize the need for continuous evaluation, rigorous oversight, and the establishment of comprehensive guidelines. As AI continues to integrate into healthcare, it is crucial for physicians to ensure that technology complements, rather than replaces, human expertise, with the primary focus remaining on delivering high-quality patient care.

Association between Conflicts of Interest Disclosure and Quality of Clinical Practice Guidelines in Japan: A Meta-Epidemiological Study.

Accurate disclosure of financial conflicts of interest (COI) among clinical practice guideline (CPG) developers is critical to ensure the quality of CPGs. However, there is limited evidence on the impact of underreporting COIs on the quality of CPGs. This study aimed to examine the proportion of underreported COI disclosures in the development of Japanese CPGs and to estimate the association between underreported COIs and CPG quality using the Appraisal of Guidelines for Research & Evaluation (AGREE) II. Twenty-three Japanese CPGs published in 2019 and their 1114 developers were included in the study. The results show that underreporting of COIs occurred in 52% of the included CPGs and 8% of all CPG developers. Underreporting COI disclosures was negatively associated with low-quality CPG (Odds ratio [OR], 0.57; 95% confidence interval [CI]: 0.11, 3.04). On the other hand, CPGs that had more than 13% of CPG developers with voting rights on recommendation decisions and underreporting of COI disclosures were positively associated with low quality (OR, 1.78; 95% CI: 0.25, 12.45). For individual CPG developers with voting rights for recommendation decisions, the presence of a COI was positively associated with low quality (OR, 1.11; 95% CI: 0.71, 1.75). This study demonstrates that the involvement and underreporting of COIs did not seriously distort the CPG development process. However, the COI-related factors of CPG developers with voting rights for recommendation decisions may be associated with low CPG quality.

Characteristics of Top-Searched Individuals in Japan's Yen for Docs Conflicts of Interest Database During the COVID-19 Pandemic.

Purpose Transparency in healthcare has led to increased public disclosure of doctors' conflicts of interest, with the "Yen for Docs Database" in Japan emerging as a pivotal source. Nevertheless, there remains ambiguity regarding the backgrounds and influence of highly-searched persons, especially during the COVID-19 pandemic. The primary objective of this study was to examine if the database was utilized for its intended purpose in 2021, a year marked by the introduction of vaccines and treatments, the addition of new COVID-19-related data, and the frequent appearances of expert statements in various media outlets. Methods We conducted a descriptive analysis on the 10 most frequently searched individuals in the "Yen for Docs Database" between August 27 and September 23, 2021, and determined the amount of money they received from pharmaceutical companies and other organizations over the four-year period between 2016 and 2019. To characterize frequently searched individuals' academic profiles and appearances in the mass media, we identified their h-index and affiliation, their activity on Twitter, and the number of TV appearances. Results There were 72,904 searches during the study period, with the top person accounting for 4,905 of those searches. All top 10 were male, mostly affiliated with universities and specialists in infectious diseases or related fields. Their median number of COVID-19 articles was five, and the median h-index was 34. Four of these top 10 had Twitter accounts, with followers ranging from 12,000 to 195,000. The median amount received from pharmaceutical entities over four years was $154,930, ranging from $809 to $705,502. Conclusions In the Yen for Docs Database, a significant portion of searches during the COVID-19 pandemic was concentrated on a selected group of healthcare professionals with considerable payments over the years, and they exhibited prominent academic and media profiles. These observations highlight the need for more transparent conflicts of interest disclosure among physicians with public visibility.

Characteristics of Vulnerable Foreigners in Need of Emergency Care Support in Japan: A Case Study of Thai Nationals from 2004 to 2020.

In Japan, a considerable number of foreigners encounter challenges in accessing appropriate healthcare services due to the lack of insurance coverage. However, the absence of a public database on these individuals makes it difficult to assess their health problems and healthcare access status. This study aims to investigate the characteristics of vulnerable Thai patients in Japan and to shed light on the specific challenges they face within Japan's healthcare system. A retrospective analysis was conducted using records of patients who required emergency healthcare support from the Royal Thai Embassy in Tokyo between 2004 and 2020. Descriptive statistical analyses were performed to examine the general characteristics, insurance status, and diseases of the patients. Additionally, patients were classified as either prolonged residents or brief residents based on their duration of stay in Japan until hospital admission (1 year or more or less than 1 year). A total of 74 patients were identified, with the majority (91.9%) lacking insurance coverage. Notably, there was an increase in the number of brief residents, including tourists, during the 2010s. Prolonged residents were more likely to experience chronic diseases, whereas brief residents were more prone to sustaining injuries. The patient records from the Thai Embassy consistently highlight the urgent requirement for emergency healthcare support within this population. However, the existing policies in Japan fall short in adequately addressing the healthcare access needs of this vulnerable population. Therefore, it is crucial to provide additional support and interventions to enhance their healthcare access.