The Performance of ChatGPT on the American Society for Surgery of the Hand Self-Assessment Examination.

BACKGROUND: This study aims to compare the performance of ChatGPT-3.5 (GPT-3.5) and ChatGPT-4 (GPT-4) on the American Society for Surgery of the Hand (ASSH) Self-Assessment Examination (SAE) to determine their potential as educational tools. METHODS: This study assessed the proportion of correct answers to text-based questions on the 2021 and 2022 ASSH SAE between untrained ChatGPT versions. Secondary analyses assessed the performance of ChatGPT based on question difficulty and question category. The outcomes of ChatGPT were compared with the performance of actual examinees on the ASSH SAE. RESULTS: A total of 238 questions were included in the analysis. Compared with GPT-3.5, GPT-4 provided significantly more correct answers overall (58.0% versus 68.9%, respectively; P = 0.013), on the 2022 SAE (55.9% versus 72.9%; P = 0.007), and more difficult questions (48.8% versus 63.6%; P = 0.02). In a multivariable logistic regression analysis, correct answers were predicted by GPT-4 (odds ratio [OR], 1.66; P = 0.011), increased question difficulty (OR, 0.59; P = 0.009), Bone and Joint questions (OR, 0.18; P < 0.001), and Soft Tissue questions (OR, 0.30; P = 0.013). Actual examinees scored a mean of 21.6% above GPT-3.5 and 10.7% above GPT-4. The mean percentage of correct answers by actual examinees was significantly higher for correct (versus incorrect) ChatGPT answers. CONCLUSIONS: GPT-4 demonstrated improved performance over GPT-3.5 on the ASSH SAE, especially on more difficult questions. Actual examinees scored higher than both versions of ChatGPT, but the margin was cut in half by GPT-4.

Isolated Scaphoid Dislocation From Low-Energy Wrist Trauma.

Isolated scaphoid dislocation is an extremely rare injury typically caused by high-energy trauma. We present the first observed case of isolated scaphoid dislocation resulting from a non-traumatic injury of the wrist in power-grip tension in a patient with a questionable history of Marfan Syndrome. A 20-year-old right-hand dominant man presented to the emergency department with right wrist pain and deformation after carrying a table. The patient reported a possible history of Marfan Syndrome, but it had never been definitively diagnosed. Imaging revealed radial dislocation of the scaphoid. Bedside closed reduction was performed followed by outpatient ligament reconstruction with return to normal activities at 6 months. Early diagnosis and management lead to an improved prognosis for isolated scaphoid dislocation. Regardless of patient history or mechanism of injury, treatment options include closed reduction, percutaneous fixation, and/or open reduction with internal fixation and ligamentous reconstruction.