Implementation of a knowledge-based decision support system for treatment plan auditing through automation.

BACKGROUND: Independent auditing is a necessary component of a comprehensive quality assurance (QA) program and can also be utilized for continuous quality improvement (QI) in various radiotherapy processes. Two senior physicists at our institution have been performing a time intensive manual audit of cross-campus treatment plans annually, with the aim of further standardizing our planning procedures, updating policies and guidelines, and providing training opportunities of all staff members. PURPOSE: A knowledge-based automated anomaly-detection algorithm to provide decision support and strengthen our manual retrospective plan auditing process was developed. This standardized and improved the efficiency of the assessment of our external beam radiotherapy (EBRT) treatment planning across all eight campuses of our institution. METHODS: A total of 843 external beam radiotherapy plans for 721 lung patients from January 2020 to March 2021 were automatically acquired from our clinical treatment planning and management systems. From each plan, 44 parameters were automatically extracted and pre-processed. A knowledge-based anomaly detection algorithm, namely, "isolation forest" (iForest), was then applied to the plan dataset. An anomaly score was determined for each plan using recursive partitioning mechanism. Top 20 plans ranked with the highest anomaly scores for each treatment technique (2D/3D/IMRT/VMAT/SBRT) including auto-populated parameters were used to guide the manual auditing process and validated by two plan auditors. RESULTS: The two auditors verified that 75.6% plans with the highest iForest anomaly scores have similar concerning qualities that may lead to actionable recommendations for our planning procedures and staff training materials. The time to audit a chart was approximately 20.8 min on average when done manually and 14.0 min when done with the iForest guidance. Approximately 6.8 min were saved per chart with the iForest method. For our typical internal audit review of 250 charts annually, the total time savings are approximately 30 hr per year. CONCLUSION: iForest effectively detects anomalous plans and strengthens our cross-campus manual plan auditing procedure by adding decision support and further improve standardization. Due to the use of automation, this method was efficient and will be used to establish a standard plan auditing procedure, which could occur more frequently.

Application of a novel T1 retrospective quantification using internal references (T1-REQUIRE) algorithm to derive quantitative T1 relaxation maps of the brain.

Most MRI sequences used clinically are qualitative or weighted. While such images provide useful information for clinicians to diagnose and monitor disease progression, they lack the ability to quantify tissue damage for more objective assessment. In this study, an algorithm referred to as the T1-REQUIRE is presented as a proof-of-concept which uses nonlinear transformations to retrospectively estimate T1 relaxation times in the brain using T1-weighted MRIs, the appropriate signal equation, and internal, healthy tissues as references. T1-REQUIRE was applied to two T1-weighted MR sequences, a spin-echo and a MPRAGE, and validated with a reference standard T1 mapping algorithm in vivo. In addition, a multiscanner study was run using MPRAGE images to determine the effectiveness of T1-REQUIRE in conforming the data from different scanners into a more uniform way of analyzing T1-relaxation maps. The T1-REQUIRE algorithm shows good agreement with the reference standard (Lin's concordance correlation coefficients of 0.884 for the spin-echo and 0.838 for the MPRAGE) and with each other (Lin's concordance correlation coefficient of 0.887). The interscanner studies showed improved alignment of cumulative distribution functions after T1-REQUIRE was performed. T1-REQUIRE was validated with a reference standard and shown to be an effective estimate of T1 over a clinically relevant range of T1 values. In addition, T1-REQUIRE showed excellent data conformity across different scanners, providing evidence that T1-REQUIRE could be a useful addition to big data pipelines.

Optimizing efficiency and safety in external beam radiotherapy using automated plan check (APC) tool and six sigma methodology.

PURPOSE: To develop and implement an automated plan check (APC) tool using a Six Sigma methodology with the aim of improving safety and efficiency in external beam radiotherapy. METHODS: The Six Sigma define-measure-analyze-improve-control (DMAIC) framework was used by measuring defects stemming from treatment planning that were reported to the departmental incidence learning system (ILS). The common error pathways observed in the reported data were combined with our departmental physics plan check list, and AAPM TG-275 identified items. Prioritized by risk priority number (RPN) and severity values, the check items were added to the APC tool developed using Varian Eclipse Scripting Application Programming Interface (ESAPI). At 9 months post-APC implementation, the tool encompassed 89 check items, and its effectiveness was evaluated by comparing RPN values and rates of reported errors. To test the efficiency gains, physics plan check time and reported error rate were prospectively compared for 20 treatment plans. RESULTS: The APC tool was successfully implemented for external beam plan checking. FMEA RPN ranking re-evaluation at 9 months post-APC demonstrated a statistically significant average decrease in RPN values from 129.2 to 83.7 (P < .05). After the introduction of APC, the average frequency of reported treatment-planning errors was reduced from 16.1% to 4.1%. For high-severity errors, the reduction was 82.7% for prescription/plan mismatches and 84.4% for incorrect shift note. The process shifted from 4σ to 5σ quality for isocenter-shift errors. The efficiency study showed a statistically significant decrease in plan check time (10.1 ± 7.3 min, P = .005) and decrease in errors propagating to physics plan check (80%). CONCLUSIONS: Incorporation of APC tool has significantly reduced the error rate. The DMAIC framework can provide an iterative and robust workflow to improve the efficiency and quality of treatment planning procedure enabling a safer radiotherapy process.