Improving patient outcomes with a mobile digital health platform for patients undergoing transcatheter aortic valve replacement.

PURPOSE: ManageMySurgery (MMS) is a digital health application (app) for patients undergoing surgery, including Transcatheter Aortic Valve Replacement (TAVR). Patients using MMS review procedure-specific education, view FAQs, and report patient-reported outcomes. This study assessed the impact of app use on postoperative outcomes. METHODS: Patients who underwent TAVR and invited to use MMS between March 2019 and November 2021 were identified. Patients received standard perioperative care and were defined as App users if they signed into the app at least once and engaged with at least one task or FAQ. Demographics and postoperative outcomes were collected via medical record review. Multivariable logistic regression models were used to determine odds of 90-day readmission, Emergency Room (ER) visits, and complications. RESULTS: 388 patients met inclusion criteria, of which 238 used the app. The average age at surgery was 76.4±7.7 years for users and 78.1±7.6 for non-users. 63.0% of users and 59.3% of non-users were male. App users had significantly lower 90-day readmission rates, (8.8% vs 16.0%, OR=0.51, p=0.0373), ER visit rates (12.6% vs 27.3%, OR=0.36, p=0.0003), and complication rates (Minor: 12.2% vs 20.7%, OR=0.48, P=0.0126; Major: 8.8% vs. 16%, OR=0.47, P=0.0235). CONCLUSIONS: In this non-randomized, retrospective study, we found significant decreases in 90-day readmissions, ER visits, and complications in TAVR patients using an app compared to traditional care. By engaging patients throughout their interventional journey with structured education and tasks, mobile health platforms may mitigate unnecessary use of emergency and inpatient care, thereby improving patient well-being and lowering the burden on healthcare resources.

Quantifying the Opportunity Cost of Neurosurgical Resident Education.

BACKGROUND/OBJECTIVE: Education is at the core of neurosurgical residency, but little research in to the cost of neurosurgical education exists. This study aimed to quantify costs of resident education in an academic neurosurgery program using traditional teaching methods and the Surgical Autonomy Program (SAP), a structured training program. METHODS: SAP assesses autonomy by categorizing cases into zones of proximal development (opening, exposure, key section, and closing). All first-time, 1-level to 4-level anterior cervical discectomy and fusion (ACDF) cases between March 2014 and March 2022 from 1 attending surgeon were divided into 3 groups: independent cases, cases with traditional resident teaching, and cases with SAP teaching. Surgical times for all cases were collected and compared within levels of surgery between groups. RESULTS: The study found 2140 ACDF cases, with 1758 independent, 223 with traditional teaching, and 159 with SAP. For 1-level to 4-level ACDFs, teaching took longer than it did with independent cases, with SAP teaching adding additional time. A 1-level ACDF performed with a resident (100.1 ± 24.3 minutes) took about as long as a 3-level ACDF performed independently (97.1 ± 8.9 minutes). The average time for 2-level cases was 72.0 ± 18.2 minutes independently, 121.7 ± 33.7 minutes traditional, and 143.4 ± 34.9 minutes SAP, with significant differences among all groups. CONCLUSIONS: Teaching takes significant time compared with operating independently. There is also a financial cost to educating residents, because operating room time is expensive. Because attending neurosurgeons lose time to perform more surgeries when teaching residents, there is a need to acknowledge surgeons who devote time to training the next generation of neurosurgeons.

From Their Eyes: What Constitutes Quality Formative Written Feedback for Neurosurgery Residents.

BACKGROUND: The characteristics of quality feedback from the neurosurgery resident's perspective are not fully elucidated. The Surgical Autonomy Program is an intraoperative assessment tool based on Vygotsky's Zone of Proximal Development (ZPD). SAP facilitates assessment of a resident's operative performance accompanied by written feedback. OBJECTIVE: The goal of this study was twofold: to identify themes from the written feedback of SAP operative assessments and to examine if these themes influenced the neurosurgery residents' perception of feedback quality. METHODS: In 2021, SAP data from 2019-2021 at two neurosurgery programs were reviewed. Feedback quality from the SAP was determined by the resident at the time of their assessment. Using a constant comparative technique, the feedback was coded using a thematic analysis. The quality of feedback within each code was analyzed. RESULTS: There were 2968 SAP entries evaluated. When the ZPD concept was fully used, residents reported high quality feedback 91.4% of the time compared to 58.6% when ZPD was not used (p < 0.001). Qualitative analysis of the written feedback revealed five themes: Non-Specific, Specific General Observations, Key Points, Next Steps, and Independent Practice. Feedback in the Specific General Observations, Key Points, and Independent Practice categories were associated with higher level feedback than leaving the space blank (p < 0.001) or writing Non-Specific comments (p < 0.001). CONCLUSIONS: Providing comments that discuss the resident's specific performance in the case, key learning points, or their progress towards independence, results in high quality feedback. Utilizing a theory-based tool such as the SAP can provide meaningful feedback to neurosurgical residents.

Construct validity of the Surgical Autonomy Program for the training of neurosurgical residents.

OBJECTIVE: There is no standard way in which physicians teach or evaluate surgical residents intraoperatively, and residents are proving to not be fully competent at core surgical procedures upon graduating. The Surgical Autonomy Program (SAP) is a novel educational model that combines a modified version of the Zwisch scale with Vygotsky's social learning theory. The objective of this study was to establish preliminary validity evidence that SAP is a reliable measure of autonomy and a useful tool for tracking competency over time. METHODS: The SAP breaks each surgical case into 4 parts, or zones of proximal development (ZPDs). Residents are evaluated on a 4-tier autonomy scale (TAGS scale) for each ZPD in every surgical case. Attendings were provided with a teaching session about SAP and identified appropriate ZPDs for surgical cases under their area of expertise. All neurosurgery residents at Duke University Hospital from July 2017 to July 2021 participated in this study. Chi-square tests and ordinal logistic regression were used for the analyses. RESULTS: Between 2017 and 2021, there were 4885 cases logged by 27 residents. There were 30 attendings who evaluated residents using SAP. Faculty completed evaluations on 91% of cases. The ZPD of focus directly correlated with year of residency (postgraduate year) (χ2 = 1221.1, df = 15, p < 0.001). The autonomy level increased with year of residency (χ2 = 3553.5, df = 15, p < 0.001). An ordinal regression analysis showed that for every year increase in postgraduate year, the odds of operating at a higher level of independence was 2.16 times greater (95% CI 2.11-2.21, p < 0.001). The odds of residents performing with greater autonomy was lowest for the most complex portion of the case (ZPD3) (OR 0.18, 95% CI 0.17-0.20, p < 0.001). Residents have less autonomy with increased case complexity (χ2 = 160.28, df = 6, p < 0.001). Compared with average cases, residents were more likely to operate with greater autonomy on easy cases (OR 1.44, 95% CI 1.29-1.61, p < 0.001) and less likely to do so on difficult cases (OR 0.72, 95% CI 0.67-0.77, p < 0.001). CONCLUSIONS: This study demonstrates preliminary evidence supporting the construct validity of the SAP. This tool successfully tracks resident autonomy and progress over time. The authors' smartphone application was widely used among surgical faculty and residents, supporting integration into the perioperative workflow. Wide implementation of SAP across multiple surgical centers will aid in the movement toward a competency-based residency education system.

Machine Learning to Predict Successful Opioid Dose Reduction or Stabilization After Spinal Cord Stimulation.

BACKGROUND: Spinal cord stimulation (SCS) effectively reduces opioid usage in some patients, but preoperatively, there is no objective measure to predict who will most benefit. OBJECTIVE: To predict successful reduction or stabilization of opioid usage after SCS using machine learning models we developed and to assess if deep learning provides a significant benefit over logistic regression (LR). METHODS: We used the IBM MarketScan national databases to identify patients undergoing SCS from 2010 to 2015. Our models predict surgical success as defined by opioid dose stability or reduction 1 year after SCS. We incorporated 30 predictors, primarily regarding medication patterns and comorbidities. Two machine learning algorithms were applied: LR with recursive feature elimination and deep neural networks (DNNs). To compare model performances, we used nested 5-fold cross-validation to calculate area under the receiver operating characteristic curve (AUROC). RESULTS: The final cohort included 7022 patients, of whom 66.9% had successful surgery. Our 5-variable LR performed comparably with the full 30-variable version (AUROC difference <0.01). The DNN and 5-variable LR models demonstrated similar AUROCs of 0.740 (95% CI, 0.727-0.753) and 0.737 (95% CI, 0.728-0.746) ( P = .25), respectively. The simplified model can be accessed at SurgicalML.com . CONCLUSION: We present the first machine learning-based models for predicting reduction or stabilization of opioid usage after SCS. The DNN and 5-variable LR models demonstrated comparable performances, with the latter revealing significant associations with patients' pre-SCS pharmacologic patterns. This simplified, interpretable LR model may augment patient and surgeon decision making regarding SCS.

Mobile Health Application for Patients Undergoing Breast Cancer Surgery: Feasibility Study.

PURPOSE: Contemporary breast cancer surgery often requires hospital stays of 1 day or less, presenting challenges to delivery of high-quality care. Without sufficient time for proper education and guidance, patients may delay seeking care, experience anxiety, or seek unnecessary care, leading to poorer outcomes and increased costs. To address this, we evaluated the feasibility of a planning-, outcomes-, and analytics-based mobile health application called Manage My Surgery (MMS) for patients undergoing elective breast cancer surgery. METHODS: Patients undergoing breast cancer surgery at an academic health center were invited to use MMS. Those who used the application received pre- and postoperative surveys, which recorded and reported patient satisfaction and outcomes related to the application. RESULTS: Thirty-three female patients undergoing elective breast cancer surgery used MMS. The median age was 58 years. Nineteen patients underwent lumpectomy, and 14 underwent mastectomy. Users logged on to the application an average of 3.5 times. The median number of questions viewed was 12 (range 2-35). Of 17 patients who completed the feedback survey, 100% said that MMS was helpful during preparation for surgery, 82.3% said that MMS was helpful postoperatively, and 94.1% would recommend MMS to others. Preliminary data on patient-reported outcomes collected by MMS suggest improvements in anxiety and depression over time. CONCLUSION: Implementation of a digital care navigation tool in breast cancer surgery patients is feasible. Patients found the tool helpful in both the pre- and postoperative period. Additional ongoing work will focus on patients' self-management skills, long-term outcomes, and health system costs.

The Surgical Autonomy Program: A Pilot Study of Social Learning Theory Applied to Competency-Based Neurosurgical Education.

Over the last decade, strict duty hour policies, pressure for increased work related value units from faculty, and the apprenticeship model of education have coalesced to make opportunities for intraoperative teaching more challenging. Evidence is emerging that graduating residents are not exhibiting competence by failing to recognize major complications, and perform routine operations independently. In this pilot study, we combine Vygotsky's social learning theory with a modified version of the competency-based scale called TAGS to study 1 single operation, anterior cervical discectomy and fusion, with 3 individual residents taught by a single faculty member. In order for the 3 residents to achieve "Solo and Observe" in all 4 zones of proximal development, the number of cases required was 10 cases for postgraduate year (PGY)-3a, 19 cases for PGY 3b, and 22 cases for the PGY 2. In this pilot study, the time required to complete an independent 2-level anterior cervical discectomy and fusion by the residents correlated with the number of cases to reach competence. We demonstrate the Surgical Autonomy Program's ability to track neurosurgical resident's educational progress and the feasibility of using the Surgical Autonomy Program (SAP) to teach residents in the operating room and provide immediate formative feedback. Ultimately, the SAP represents a paradigm shift towards a modern, scalable competency-focused subspecialty teaching, evaluation and assessment tool that provides increases in resident's autonomy and metacognitive skills, as well as immediate formative feedback.

A Smartphone App With a Digital Care Pathway for Patients Undergoing Spine Surgery: Development and Feasibility Study.

BACKGROUND: There is a great unmet clinical need to provide patients undergoing spinal surgery and their caregivers with ongoing, high-quality care before and after surgery in an efficiency-focused health care environment. OBJECTIVE: The objective of this study is to design, develop, and evaluate the acceptability and feasibility of a novel planning-, outcomes-, and analytics-based smartphone app called ManageMySurgery (MMS) in patients undergoing elective spine surgery (MMS-Spine). METHODS: The development process of the MMS app was conducted over 2 sequential stages: (1) an evidence-based intervention design with refinement from surgeon and patient feedback and (2) feasibility testing in a clinical pilot study. We developed a novel, mobile-based, Health Insurance Portability and Accountability Act-compliant platform for interventional and surgical procedures. It is a patient-centric mobile health app that streamlines patients' interactions with their care team. MMS divides the patient journey into phases, making it feasible to provide customized care pathways that meet patients' unique needs. Patient-reported outcomes are easily collected and conform to the National Institutes of Health Patient-Reported Outcomes Measurement Information System (PROMIS) standard. RESULTS: We tested the feasibility of the MMS-Spine app with patients undergoing elective spine surgery at a large academic health system. A total of 47 patients undergoing elective spine surgery (26 cervical spine and 21 lumbar spine surgeries) downloaded and used MMS-Spine to navigate their surgical journey, quantify their baseline characteristics and postoperative outcomes, and provide feedback on the utility of the app in preparing for and recovering from their spinal surgery. The median age was 59.0 (range 33-77) years, 22 of the 47 patients (47%) were women, and 26 patients (55%) had commercial insurance. Of the 47 patients, a total of 33 (70%) logged in on an iOS device, 11 (23%) on an Android device, and 3 (6%) on a computer or tablet. A total of 17 of the 47 patients (36%) added a caregiver, of which 7 (41%) logged in. The median number of sign-ins was 2. A total of 38 of 47 patients (81%) completed their baseline preoperative PROMIS-29 outcomes, and 14 patients (30%) completed at least one PROMIS-29 survey during the postoperative period. Of the 24 patients who completed the MMS survey, 21 (88%) said it was helpful during preparation for their procedure, 16 (67%) said it was helpful during the postoperative period, and 23 (96%) said that they would recommend MMS to a friend or family member. CONCLUSIONS: We used a patient-centered approach based on proven behavior change techniques to develop a comprehensive smartphone app for patients undergoing elective spine surgery. The optimized version of the app is ready for formal testing in a larger randomized clinical study to establish its cost-effectiveness and effect on patients' self-management skills and long-term outcomes.