ABSTRACT
Background: ChatGPT is an artificial intelligence-based large language model (LLM). ChatGPT has been widely applied in medicine, but its application in occupational therapy has been lacking. Objective: This study examined the accuracy of ChatGPT on the National Korean Occupational Therapy Licensing Examination (NKOTLE) and investigated its potential for application in the field of occupational therapy. Methods: ChatGPT 3.5 was used during the five years of the NKOTLE with Korean prompts. Multiple choice questions were entered manually by three dependent encoders, and scored according to the number of correct answers. Results: During the most recent five years, ChatGPT did not achieve a passing score of 60% accuracy and exhibited interrater agreement of 0.6 or higher. Conclusion: ChatGPT could not pass the NKOTLE but demonstrated a high level of agreement between raters. Even though the potential of ChatGPT to pass the NKOTLE is currently inadequate, it performed very close to the passing level even with only Korean prompts.
ABSTRACT
The widespread use of mobile devices and laptops has replaced traditional paper-based learning and the question of how the brain efficiency of digital tablet-based learning differs from that of paper-based learning remains unclear. The purpose of this study was to investigate the difference in brain efficiency for learning between paper-based and digital tablet-based learning by measuring activity in the prefrontal cortex (PFC) using functional near-infrared spectroscopy. Thirty-two subjects were randomly assigned to the paper-based learning or the digital tablet-based learning group. Subjects in each group performed a memory task that required memorizing a three-minute novel (encoding phase) on a paper or digital tablet, followed by a test in which they answered four multiple-choice questions based on the novel's content. To compare both groups, behavioral performance on the test (retrieval phase) and activity in the PFC were measured. As a result, no significant difference in behavioral performance between both groups was observed (p > 0.05). However, the paper-based learning group showed significantly lower activity in the PFC in the encoding phase than the digital tablet-based learning group (p < 0.05) but not in the retrieval phase. The current study demonstrated that brain efficiency in encoding is higher in subjects with paper-based learning than those with digital tablet-based learning. This finding has important implications for education, particularly in terms of the pros and cons of electronic document-based learning.
ABSTRACT
To date, budget management in virtual shopping training has not been given much importance. The main objective of this study was to investigate the effects of virtual shopping budget-management training on executive functions and brain activation. Sixteen participants were randomly assigned to the experimental group that received virtual shopping budget-management training or the waitlist control group for a total of 16 sessions. To examine the effects of virtual shopping budget-management training on brain activation, HbO2 was measured in the prefrontal cortex via functional near-infrared spectroscopy (fNIRS) during the Trail Making Test Part B (TMT-B) and Stroop test. Mann-Whitney and Wilcoxon signed-rank tests were used to compare outcomes between and within the two groups. The virtual shopping budget-management training showed no significant difference in all outcomes between both groups (p > 0.05). No significant differences were observed in HbO2 levels during both TMT-B (p > 0.05) and the Stroop test (p > 0.05). However, in the pre-post comparisons, there was a significant difference in the TMT-B (p < 0.05) and Stroop test (p < 0.05) in the experimental group. In this study, although we did not find a distinct advantage in training, it confirmed its potential for clinical benefits in healthy young adults through training.
