Exploring Capabilities of Large Language Models such as ChatGPT in Radiation Oncology.

Purpose: Technological progress of machine learning and natural language processing has led to the development of large language models (LLMs), capable of producing well-formed text responses and providing natural language access to knowledge. Modern conversational LLMs such as ChatGPT have shown remarkable capabilities across a variety of fields, including medicine. These models may assess even highly specialized medical knowledge within specific disciplines, such as radiation therapy. We conducted an exploratory study to examine the capabilities of ChatGPT to answer questions in radiation therapy. Methods and Materials: A set of multiple-choice questions about clinical, physics, and biology general knowledge in radiation oncology as well as a set of open-ended questions were created. These were given as prompts to the LLM ChatGPT, and the answers were collected and analyzed. For the multiple-choice questions, it was checked how many of the answers of the model could be clearly assigned to one of the allowed multiple-choice-answers, and the proportion of correct answers was determined. For the open-ended questions, independent blinded radiation oncologists evaluated the quality of the answers regarding correctness and usefulness on a 5-point Likert scale. Furthermore, the evaluators were asked to provide suggestions for improving the quality of the answers. Results: For 70 multiple-choice questions, ChatGPT gave valid answers in 66 cases (94.3%). In 60.61% of the valid answers, the selected answer was correct (50.0% of clinical questions, 78.6% of physics questions, and 58.3% of biology questions). For 25 open-ended questions, 12 answers of ChatGPT were considered as "acceptable," "good," or "very good" regarding both correctness and helpfulness by all 6 participating radiation oncologists. Overall, the answers were considered "very good" in 29.3% and 28%, "good" in 28% and 29.3%, "acceptable" in 19.3% and 19.3%, "bad" in 9.3% and 9.3%, and "very bad" in 14% and 14% regarding correctness/helpfulness. Conclusions: Modern conversational LLMs such as ChatGPT can provide satisfying answers to many relevant questions in radiation therapy. As they still fall short of consistently providing correct information, it is problematic to use them for obtaining medical information. As LLMs will further improve in the future, they are expected to have an increasing impact not only on general society, but also on clinical practice, including radiation oncology.

Postoperative radiotherapy for meningiomas - a decision-making analysis.

BACKGROUND: The management of meningiomas is challenging, and the role of postoperative radiotherapy is not standardized. METHODS: Radiation oncology experts in Swiss centres were asked to participate in this decision-making analysis on the use of postoperative radiotherapy (RT) for meningiomas. Experts from ten Swiss centres agreed to participate and provided their treatment algorithms. Their input was converted into decision trees based on the objective consensus methodology. The decision trees were used as a basis to identify consensus and discrepancies in clinical routine. RESULTS: Several criteria used for decision-making in postoperative RT in meningiomas were identified: histological grading, resection status, recurrence, location of the tumour, zugzwang (therapeutic need to treat and/or severity of symptoms), size, and cell division rate. Postoperative RT is recommended by all experts for WHO grade III tumours as well as for incompletely resected WHO grade II tumours. While most centres do not recommend adjuvant irradiation for WHO grade I meningiomas, some offer this treatment in recurrent situations or routinely for symptomatic tumours in critical locations. The recommendations for postoperative RT for recurrent or incompletely resected WHO grade I and II meningiomas were surprisingly heterogeneous. CONCLUSIONS: Due to limited evidence on the utility of postoperative RT for meningiomas, treatment strategies vary considerably among clinical experts depending on the clinical setting, even in a small country like Switzerland. Clear majorities were identified for postoperative RT in WHO grade III meningiomas and against RT for hemispheric grade I meningiomas outside critical locations. The limited data and variations in clinical recommendations are in contrast with the high prevalence of meningiomas, especially in elderly individuals.

Role of Adjuvant Radiotherapy in Non-Small Cell Lung Cancer-A Review.

BACKGROUND: For patients with completely resected non-small cell lung cancer (NSCLC) with ipsilateral mediastinal lymph node involvement (pN2), the administration of adjuvant chemotherapy is the standard of care. The role of postoperative radiation therapy (PORT) is controversial. METHODS: We describe the current literature focusing on the role of PORT in completely resected NSCLC patients with pN2 involvement and reflect on its role in current guidelines. RESULTS: Based on the results of the recent Lung ART and PORT-C trials, the authors conclude that PORT cannot be generally recommended for all resected pN2 NSCLC patients. A substantial decrease in the locoregional relapse rate without translating into a survival benefit suggests that some patients with risk factors might benefit from PORT. This must be balanced against the risk of cardiopulmonary toxicity with potentially associated mortality. Lung ART has already changed the decision making for the use of PORT in daily practice for many European lung cancer experts, with lower rates of recommendations for PORT overall. CONCLUSIONS: PORT is still used, albeit decreasingly, for completely resected NSCLC with pN2 involvement. High-level evidence for its routine use is lacking. Further analyses are required to identify patients who would potentially benefit from PORT.

Variations in Radioiodine Therapy in Europe: Decision-Making after Total Thyroidectomy.

The role of radioiodine therapy (RIT) (used as ablation therapy or adjuvant therapy) following total thyroidectomy for differentiated thyroid cancer (DTC) changed. Major revisions of the American Thyroid Association (ATA) Guidelines in 2015 resulted in significant differences in treatment recommendations in comparison to the European Association of Nuclear Medicine (EANM) 2008 guidelines. Recently, we presented the effects on daily practice for RIT among Swiss Nuclear Medicine centres. We now performed a study at the European level and hypothesized that there is also considerable variability among European experts. We performed a decision-tree-based analysis of management strategies from all members of the EANM thyroid committee to map current practice among experts. We collected data on whether or not RIT is administered, on which criteria these decisions are based and collected details on treatment activities and patient preparation. Our study shows discrepancies for low-risk DTC, where "follow-up only" is recommended by some experts, while RIT with significant doses is used by other experts. E.g., for pT1b tumours without evidence of metastases, the level of agreement for the use of RIT is as low as 50%. If RIT is administered, activities of I-131 range from 1.1 GBq to 3.0 GBq. In other constellations (e.g., pT1a), experts diverge from current clinical guidelines as up to 75% administer RIT in certain cases. For intermediate and high-risk patients, RIT is generally recommended. However, dosing and treatment preparation (rhTSH vs. thyroid hormone withdrawal) vary distinctly. In comparison to the Swiss study, the general level of agreement is higher among the European experts. The recently proposed approach on the use of RIT, based on integrated post-surgery assessment (Martinique article) and results of ongoing prospective randomized studies are likely to reduce uncertainty in approaching RIT treatment. In certain constellations, consensus identified among European experts might be helpful in formulating future guidelines.

Radiotherapy for thymic epithelial tumours: a review.

Thymic epithelial tumours (TETs) represent a rare disease, yet they are the most common tumours of the anterior mediastinum. Due to the rare occurrence of TETs, evidence on optimal treatment is limited. Surgery is the treatment of choice in the management of TETs, while the role of postoperative radiotherapy (PORT) remains unresolved. PORT remains debated for thymomas, especially in completely resected stage II tumours, for which PORT may be more likely to benefit in the presence of aggressive histology (WHO subtype B2, B3) or extensive transcapsular invasion (Masaoka-Koga stage IIB). For stage III thymoma, evidence suggests an overall survival (OS) benefit for PORT after complete resection. For incompletely resected thymomas stage II or higher PORT is recommended. Thymic carcinomas at any stage with positive resection margins should be offered PORT. Radiotherapy plays an important role in the management of unresectable locally advanced TETs. Induction therapy (chemotherapy or chemoradiation) followed by surgery may be useful for locally advanced thymic malignancies initially considered as unresectable. Chemotherapy only is offered in patients with unresectable, metastatic tumours in palliative intent, checkpoint inhibitors may be promising for refractory diseases. Due to the lack of high-level evidence and the importance of a multidisciplinary approach, TETs should be discussed within a multidisciplinary team and the final recommendation should reflect individual patient preferences.

Insular Decision Criteria in Clinical Practice: Analysis of Decision-Making in Oncology.

BACKGROUND: Medical decision-making is complex and involves a variety of decision criteria, many of which are universally recognised. However, decision-making analyses have demonstrated that certain decision criteria are not used uniformly among clinicians. AIM: We describe decision criteria, which for various contexts are only used by a minority of decision makers. For these, we introduce and define the term "insular criteria". METHODS: 19 studies analysing clinical decision-making based on decision trees were included in our study. All studies were screened for decision-making criteria that were mentioned by less than three local decision makers in studies involving 8-26 participants. RESULTS: 14 out of the 19 included studies reported insular criteria. We identified 42 individual insular criteria. They could be intuitively allocated to seven major groups, these were: comorbidities, treatment, patients' characteristics/preferences, caretaker, scores, laboratory and tumour properties/staging. CONCLUSION: Insular criteria are commonly used in clinical decision-making, yet, the individual decision makers may not be aware of them. With this analysis, we demonstrate the existence of insular criteria and their variety. In daily practice and clinical studies, awareness of insular criteria is important.

Pre- and Postoperative Chemotherapy in Localized Extremity Soft Tissue Sarcoma: A European Organization for Research and Treatment of Cancer Expert Survey.

BACKGROUND: The management of localized extremity soft tissue sarcomas (STS) is challenging and the role of pre- and postoperative chemotherapy is unclear and debated among experts. MATERIALS AND METHODS: Medical oncology experts of the European Organization for Research and Treatment of Cancer Soft Tissue and Bone Sarcoma Group were asked to participate in this survey on the use of pre- and postoperative chemotherapy in STS. Experts from 12 centers in Belgium, France, Germany, Great Britain, Italy, Switzerland, and The Netherlands agreed to participate and provided their treatment algorithm. Answers were converted into decision trees based on the objective consensus methodology. The decision trees were used as a basis to identify consensus and discrepancies. RESULTS: Several criteria used for decision-making in extremity STS were identified: chemosensitivity, fitness, grading, location, and size. In addition, resectability and resection status were relevant in the pre- and postoperative setting, respectively. Preoperative chemotherapy is considered in most centers for marginally resectable tumors only. Yet, in some centers, neoadjuvant chemotherapy is used routinely and partially combined with hyperthermia. Although most centers do not recommend postoperative chemotherapy, some offer this treatment on a regular basis. Radiotherapy is an undisputed treatment modality in extremity STS. CONCLUSION: Due to lacking evidence on the utility of pre- and postoperative chemotherapy in localized extremity STS, treatment strategies vary considerably among European experts. The majority recommended neoadjuvant chemotherapy for marginally resectable grade 2-3 tumors; the majority did not recommend postoperative chemotherapy in any setting. IMPLICATIONS FOR PRACTICE: The management of localized extremity soft tissue sarcomas (STS) is challenging and the role of pre- and postoperative chemotherapy is unclear and debated among experts. This study analyzed the decision-making process among 12 European experts on systemic therapy for STS. A wide range of recommendations among experts regarding the use of perioperative chemotherapy was discovered. Discrepancies in the use of decision criteria were also uncovered, including the definition of what constitutes high-risk cancer, which is a basis for many to recommend chemotherapy. Before any standardization is possible, a common use of decision criteria is necessary.