Quality appraisal of clinical practice guidelines for the evaluation and management of primary hyperparathyroidism.

PURPOSE: Multiple groups have created clinical practice guidelines (CPGs) for the management of primary hyperparathyroidism (PHPT). This report provides a rigorous quality assessment using the Appraisal of Guidelines for Research & Evaluation Instrument (AGREE II) to identify high-performing guidelines and areas for improvement. METHODS: A systematic review was conducted to isolate CPGs addressing the management of PHPT. Guideline data was extracted and quality ratings were assigned by four independent reviewers. Intraclass correlation coefficients (ICC) were calculated to ensure interrater reliability. RESULTS: Twelve guidelines were assessed. The American Association of Endocrine Surgeons (AAES) guideline had the highest mean scaled score across all domains (73.6 ± 31.4%). No other published guideline achieved a "high" quality designation. The highest scoring domain was "clarity of presentation" (mean 60.5 ± 26.5%). The lowest scoring domain was "applicability" (mean 19.8 ± 18.2%). Scoring reliability was excellent, with ICC ≥ 0.89 for all AGREE II 6 domains. CONCLUSION: Although several working groups have developed guidelines to address PHPT management, only those published by the AAES meet all methodologic quality criteria necessary to ensure incorporation of recommendations into clinical practice. Future guidelines would benefit from the development of tools, resources, monitoring criteria that enhance applicability.

Taste and smell function in Wilson's disease.

OBJECTIVE: Wilson's disease (WD) is a metabolic disorder associated with abnormal copper metabolism that results in hepatic, psychiatric, and neurologic symptoms. No investigation of taste function has been made in patients with WD, although olfactory dysfunction has been evaluated. METHODS: Quantitative taste and smell test scores of 29 WD patients were compared to those of 790 healthy controls. Taste was measured using the 53-item Waterless Empirical Taste Test (WETT®) and smell using the 40-item revised University of Pennsylvania Smell Identification Test (R-UPSIT®). Multiple linear regression analysis controlled for age and sex. RESULTS: Average WETT® scores did not differ meaningfully between WD and control subjects (respective medians & IQRs = 32 [28-42] & 34 [27-41]); linear regression coefficient = 1.19, 95% CI [-0.81, 3.19], p = 0.242). In contrast, WD was associated with significantly reduced olfactory function [respective median (IQR) R-UPSIT® scores = 35 (33-37) vs. 37 (35-38); adjusted linear regression coefficient = -1.59, 95% CI [-2.34, -0.833]; p < 0.001)]. Neither olfaction nor taste were influenced by WD symptom subtype [23 (79.3%) were hepatic-predominant; 6 (20.7%) neurologic predominant]; R-UPSIT®, p = 0.774; WETT®, p = 0.912). No effects of primary medication or years since diagnosis (R-UPSIT®, p = 0.147; WETT®, p = 0.935) were found. Weak correlations were present between R-UPSIT® and WETT® scores for both control (r=0.187, p < 0.0001) and WD (r=0.237) subjects, although the latter correlation did not reach the 0.05 α level (p = 0.084). CONCLUSION: Although WD negatively impacts smell function, taste is spared. Research is needed to understand the pathophysiologic mechanisms responsible for this divergence.

Multi-institutional Analysis of Endoscopic Sellar Surgical Volumes During the COVID-19 Pandemic.

OBJECTIVE: We sought to quantify trends in operative volumes and complications of endoscopic sellar surgery before and after the COVID-19 pandemic onset. STUDY DESIGN: We performed a retrospective analysis. SETTING: TriNetX database analysis. METHODS: All adults undergoing neuroendoscopy for resection of pituitary tumor (Current Procedural Terminology code 62165) with diagnosis of benign/malignant neoplasm of pituitary gland (D35.2/C75.1) or benign/malignant neoplasm of craniopharyngeal duct (D35.3/C75.2) were included using the TriNetX database for 2 years before (pre-COVID group) and 2 years after (post-COVID group) February 17, 2020. RESULTS: A total of 1238 patients in the pre-COVID group and 1186 patients in the post-COVID group were compared. Age, gender, and race were statistically similar between the groups (P > .05). Surgical volume decreased by 6% in the post-COVID group. In 2020 Q2, operative volume decreased by 19%, and in 2021 Q4 (peak COVID-19 caseload in the United States), operative volumes decreased by 29% compared to 2 years prior. Postoperative complications including meningitis (P = .49), cerebrospinal fluid leak (P = .36), visual field deficits (P = .07), postoperative pneumonia or respiratory failure (P = .42), and 30-day readmission rates (P = .89) were similar between the 2 groups. CONCLUSION: Overall, endoscopic sellar surgery may continue to fluctuate with increased COVID-19 outbreaks. Patient outcomes do not appear to be worsened by decreased operative volumes or delays in nonurgent surgeries.

Socioeconomic determinants impact quality of life at vestibular schwannoma diagnosis.

BACKGROUND: Socioeconomic variables including race, education, and income have been shown to affect vestibular schwannoma incidence, treatment, and outcomes. We sought to determine the impact of socioeconomic factors on quality of life at the time of vestibular schwannoma diagnosis. METHODS: Retrospective cohort study conducted at a tertiary academic center. All patients evaluated for vestibular schwannoma from March 1, 2010 to December 31, 2021 who completed at least one Penn Acoustic Neuroma Quality of Life (PANQOL) questionnaire at presentation or prior to any intervention were included. PANQOL scores were compared across income quintiles, racial groups, and health insurance categories. RESULTS: Two-hundred and ninety-six patients who had non-missing information on variables of interest were included. Compared to White/Caucasian patients (84.5 %), Black/African American patients (4.7 %) had significantly lower PANQOL total scores (b = -12.8[-21.7, -4.0], p = 0.005). Compared to patients with Commercial insurance (53 %), patients who were Uninsured/ Self-pay (1.7 %) had significantly lower PANQOL total scores (b = -16.7[-31.4, -1.9], p = 0.027). Patients in higher income quintiles had significantly higher PANQOL total scores (b = 11.7[3.9, 19.5], p = 0.004 comparing highest income quintile to lowest). After controlling for potential confounders, income quintile (b = 9.6[1.3, 17.9], p = 0.023 comparing highest quintile to lowest) and insurance (b = -17.0[-31.9, -21], p = 0.025 comparing Uninsured/Self-pay to Commercial insurance) remained predictors of total PANQOL score. CONCLUSIONS: Socioeconomic factors including race, health insurance, and income appear to contribute to quality of life at the time of vestibular schwannoma diagnosis. These variables are interrelated and the effects of race may be mediated in part by differences in income and health insurance coverage.

Factors Informing High-Risk Primary Care Patient Choice around Telehealth Use: a Framework.

BACKGROUND: While telehealth's presence in post-pandemic primary care appears assured, its exact role remains unknown. Value-based care's expansion has heightened interest in telehealth's potential to improve uptake of preventive and chronic disease care, especially among high-risk primary care populations. Despite this, the pandemic underscored patients' diverse preferences around using telehealth. Understanding the factors underlying this population's preferences can inform future telehealth strategies. OBJECTIVE: To describe the factors informing high-risk primary care patient choice of whether to pursue primary care via telehealth, in-office or to defer care altogether. DESIGN: Qualitative, cross-sectional study utilizing semi-structured telephone interviews of a convenience sample of 29 primary care patients between July 13 and September 30, 2020. PARTICIPANTS: Primary care patients at high risk of poor health outcomes and/or acute care utilization who were offered a follow-up primary care visit via audiovisual, audio-only or in-office modalities. APPROACH: Responses were analyzed via grounded theory, using a constant comparison method to refine emerging categories, distinguish codes, and synthesize evolving themes. KEY RESULTS: Of the 29 participants, 16 (55.2%) were female and 19 (65.5%) were Black; the mean age (SD) was 64.6 (11.1). Participants identified four themes influencing their choice of visit type: perceived utility (encapsulating clinical and non-clinical utility), underlying costs (in terms of time, money, effort, and safety), modifiers (e.g., participants' clinical situation, choice availability, decision phenotype), and drivers (inclusive of their background experiences and digital environment). The relationship of these themes is depicted in a novel framework of patient choice around telehealth use. CONCLUSIONS: While visit utility and cost considerations are foundational to participants' decisions around whether to pursue care via telehealth, underappreciated modifiers and drivers often magnify or mitigate these considerations. Policymakers, payers, and health systems can leverage these factors to anticipate and enhance equitable high-value telehealth use in primary care settings among high-risk individuals.

Postoperative mometasone irrigations improve quality of life in skull base tumor patients.

Objectives: The use of topical corticosteroids to manage postoperative sinonasal symptoms after endoscopic skull base surgery (ESBS) has not been well studied. We quantified long-term impact of postoperative steroid irrigations (SIs) on quality of life of patients after ESBS. Methods: Retrospective review of patients at the University of Pennsylvania undergoing ESBS from 2010 to 2019. Data on patient demographics and postoperative treatment with nasal saline irrigation twice daily with and without dissolved steroids (mometasone or budesonide) was collected. Preoperative, and 1-, 3-, 6-, 12-, 18-, and 24-month postoperative Sino-Nasal Outcome Test (SNOT-22) scores were assessed. Results: A total of 727 patients were assessed (53.4% males), with 479 patients in the no SI group and 248 patients in the SI group. Preoperative SNOT-22 scores did not differ significantly (P = 0.19). 1-, 3-, 6-, 12-, 18-, and 24-month post-op SNOT-22 scores did not significantly differ between groups. However, mometasone irrigations resulted in significantly lower postoperative 2-year SNOT-22 scores compared to budesonide (P < 0.01) and saline (P = 0.03). Conclusions: Though corticosteroid irrigations are routine in managing inflammatory sinus disease, their role in postoperative management after ESBS for tumors is unclear. Our findings suggest that mometasone irrigation may be effective at improving postoperative quality of life in patients after ESBS.

Long-Term Hearing Outcomes After Hybrid Cochlear Implantation.

OBJECTIVE: To examine long-term (>5 yr) low-frequency hearing preservation after hybrid cochlear implantation. STUDY DESIGN: Retrospective cross-sectional study. SETTING: Tertiary care center outpatient clinic. PATIENTS: All patients older than 21 years implanted with a Cochlear Hybrid L24 device from 2014 to 2021. MAIN OUTCOME MEASURE: Changes in low-frequency pure-tone average (LFPTA) were calculated at each of several time points relative to the date of implantation. The proportion of patients with preserved LFPTA at last follow-up and Kaplan-Meier estimates for loss of residual hearing were calculated in addition to hazard ratios for hearing loss according to patient- and surgery-specific factors. RESULTS: Thirty ears in 29 patients underwent hybrid cochlear implantation and were eligible for inclusion (mean age, 59 yr; 65% female). Mean preoperative LFPTA was 31.7 dB. Mean LFPTA across all implanted ears at first follow-up was 45.1 dB; no patient had experienced loss of residual hearing at first follow-up. Six patients had loss of residual hearing during the follow-up period, with Kaplan-Meier probability estimates of preserved hearing of 100% at 1 month, 90% at 12 months, 87% at 24 months, and 80% at 48 months. There was no association between loss of residual hearing and patient age, preoperative LFPTA, surgeon, or use of topical steroids intraoperatively (hazard ratios, 1.05 [0.96-1.15], 0.97 [0.88-1.05], 1.39 [0.20-9.46], 0.93 [0.09-9.74], respectively). CONCLUSIONS: Long-term (>5 yr) outcomes after hybrid cochlear implantation demonstrate good preservation of low-frequency hearing, with only modest decline in the long-term postimplantation, and a low proportion of loss of residual low-frequency hearing.

Large and small financial incentives may motivate COVID-19 vaccination: A randomized, controlled survey experiment.

INTRODUCTION: Experts continue to debate how to increase COVID-19 vaccination rates. Some experts advocate for financial incentives. Others argue that financial incentives, especially large ones, will have counterproductive psychological effects, reducing the percent of people who want to vaccinate. Among a racially and ethnically diverse U.S. sample of lower income adults, for whom vaccine uptake has lagged compared with higher income adults, we empirically examine such claims about relatively large and small guaranteed cash payments. METHODS: In 2021, we conducted a randomized, controlled experiment among U.S. residents with incomes below $80,000 who reported being unvaccinated against COVID-19. Study participants were randomized to one of four study arms. In two arms, respondents first learned about a policy proposal to pay $1,000 or $200 to those who received COVID-19 vaccination and were then asked if, given that policy, they would want to vaccinate. In the two other arms, respondents received either an educational message about this vaccine or received no vaccine information and were then asked if they wanted to vaccinate for COVID-19. The primary analyses estimated and compared the overall percentage in each study arm that reported wanting to vaccinate for COVID-19. In other analyses, we estimated and compared these percentages for subgroups of interest, including gender, race/ethnicity, and education. MAIN RESULTS: Among 2,290 unvaccinated adults, 79.7% (95%CI, 76.4-83.0%) of those who learned about the proposed $1,000 payment wanted to get vaccinated, compared with 58.9% (95%CI, 54.8-63.0%) in the control condition without vaccine information, a difference of 20 percentage points. Among those who learned of the proposed $200 payment, 74.8% (95% CI, 71.3-78.4%) wanted to vaccinate. Among those who learned only about the safety and efficacy of COVID-19 vaccines, 68.9% (95% CI, 65.1-72.7%) wanted to vaccinate. Findings were consistent across various subgroups. DISCUSSION: Despite several study limitations, the results do not support concerns that the financial incentive policies aimed to increase COVID-19 vaccination would have counterproductive effects. Instead, those who learned about a policy with a large or small financial incentive were more likely than those in the control condition to report that they would want to vaccinate. The positive effects extended to subgroups that have been less likely to vaccinate, including younger adults, those with less education, and racial and ethnic minorities. Financial incentives of $1,000 performed similarly to those offering only $200.

Craniopharyngioma surgery for rhinologists.

PURPOSE OF REVIEW: Craniopharyngiomas are rare tumors that that present with loss of pituitary function in most cases. They present in a bimodal age distribution and the most common treatment paradigms include gross total resection or subtotal resection followed by radiation. Endoscopic transnasal access to intradural tumors has become increasingly common due to improvements in equipment, increased familiarity with the surgical corridor and anatomy, and reconstruction techniques. As such, rhinologists play an increasingly important role in the management of craniopharyngiomas. RECENT FINDINGS: Recent years have highlighted our growing experience with pediatric endonasal skull base surgery. Prior concerns including sphenoid pneumatization, midfacial growth restrictions, and intercarotid space limitations have been studied more extensively. It has been found that there are no increased complications with lack of sphenoid pneumatization, no changes to midfacial growth with endonasal techniques, and the inter-carotid distance is stable after around age 5. Advances in surgical and skull base reconstruction techniques and intraoperative monitoring have reduced the risks of complications from surgery. SUMMARY: Rhinologists play an important role in craniopharyngioma surgery. The approach to and reconstruction after tumor removal are vital portions of the procedure that allow for resection and prevent postsurgical complications.

Flipping the Otolaryngology Didactics Curriculum: Results of a Novel Resident Course Structure.

OBJECTIVE: To assess the impact of a novel flipped-classroom (FC) otolaryngology resident didactic curriculum on resident learning. METHODS: Based on the preferences elicited in a survey of preferred learning styles of residents, a hybrid web-based and in-person FC otolaryngology didactic curriculum was implemented over a 6-month period in 2020-2021. Resident reactions to the new curriculum were assessed via a second survey. Kruskal Wallis tests were used to compare mean stanine scores on the Otolaryngology Training Examination (OTE) exam for topics taught in the new format with topics delivered in the old format. RESULTS: After instituting the curriculum reform, engagement in at least a moderate amount of the pre-didactic work and synchronous case discussions was reported by 67% and 88% of the residents, respectively. After the curriculum change, residents in years PGY2 and above reported statistically significant increases in self-reported ability to retain information from didactics, to feel prepared for the OTE, and to feel confident in fund of knowledge (p < 0.001, p = 0.004, and p = 0.004, respectively). Compared to the prior year, mean stanine increased on OTE scores for residents in years PGY2-PGY5 to a statistically significant degree (5.45 vs. 4.41, p = 0.001) for the topics delivered in the new format compared to topics delivered in the traditional format (5.13 vs. 4.70, p = 0.07). CONCLUSION: By organizing a didactic curriculum through online modules that incorporate pre-recorded lectures and external resources, residents reported and demonstrated improved knowledge retention. LEVEL OF EVIDENCE: NA Laryngoscope, 133:2129-2134, 2023.

Assessment of clinical guidelines for medication-related osteonecrosis of the jaw: current status and future directions.

OBJECTIVE: To evaluate the current quality and utility of clinical practice guidelines (CPGs) issued for the diagnosis, prevention, and treatment of medication-related osteonecrosis of the jaw (MRONJ). STUDY DESIGN: We performed a systematic literature search of guidelines for MRONJ diagnosis, staging, prevention, or management. An appraisal of guidelines was completed using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. Scaled domain scores were calculated for each domain. Key recommendations were abstracted from guidelines distinguished as "high" quality. RESULTS: Six CPGs were identified from systematic review. Four of 6 (66.7%) guidelines were published within the last 2 years. Each guideline discussed management of antiresorptive and antiangiogenic therapy-associated osteonecrosis of the jaw. The highest-scoring domain was domain 1: "Scope and purpose," with an average score of 85.0% (range: 76.4%-100.0%). The lowest domain score was in domain 5: "Applicability," with an average score of 41.7% (range: 22.9%-92.7%). Only 2 guidelines (33.3%) met the quality threshold of > 60% in 5 or more AGREE II domains, distinguishing them as "high"-quality guidelines. The average kappa statistic calculated across domains was 0.77, suggesting substantial interrater correlation in the CPG appraisal process. CONCLUSIONS: Despite the increasing recognition of MRONJ as a debilitating consequence of antiresorptive and antiangiogenic therapy, clinical guideline recommendations may be lacking in overall quality and clinical utility.

Comparative effectiveness of mandates and financial policies targeting COVID-19 vaccine hesitancy: A randomized, controlled survey experiment.

Experts debate whether COVID-19 vaccine mandates or financial incentives will reduce, rather than increase, interest in vaccination. Among 3,698 unvaccinated U.S. residents, we conducted a randomized, controlled survey-embedded experiment to estimate the absolute and relative psychological effects of vaccine policies specifying: mandates by employers or airlines, bars, and restaurants; lotteries for $1 million, $200,000, or $100,000; guaranteed cash for $1000, $200, or $100; and $1,000 as either a tax credit or penalty. Vaccine intention -the study outcome- predicts uptake and provides insight into the psychological mechanism that is most proximal to behavior (i.e., vaccination). Compared to controls, those who learned about the $1,000 cash reward policy were 17.1 (±5.3)% more likely to want vaccination. Employer mandates are more promising than other mandate policies (8.6 [+/- 7.4]% vs. 1.4 [+/- 6.0]%). The full results suggest that neither mandates nor financial incentives are likely to have counterproductive psychological effects. These policies are not mutually exclusive and, if implemented well, they may increase vaccine uptake.

Reconstruction with Mucosal Graft Reduces Recurrence After Endoscopic Surgery of Rathke Cleft Cyst.

OBJECTIVES: Rathke cleft cysts (RCCs) arise from the development of the Rathke pouch. Recurrence is common after either drainage or cyst removal. The endoscopic endonasal approach (EEA) is increasingly utilized for the management of RCC. Various techniques have been described to try to reduce the rates of recurrence. We studied the effect of fenestration with a nasoseptal flap (NSF) on recurrence rates by comparing a cohort of patients undergoing this technique to a cohort of patients undergoing conventional drainage. METHODS: Patients who underwent EEA for RCC between 2011 and 2020 were identified and divided into 2 cohorts: conventional fenestration versus fenestration with NSF. Surgical approach, reconstructive method, and recurrences were recorded. Primary end point was symptomatic or radiographic recurrence. RESULTS: 21 patients were identified undergoing EEA. An NSF was used to line the cyst cavity in 11 cases. Conventional fenestration without mucosal reconstruction was performed in the remaining 10 cases. In the cases without NSF, 5 (50%) developed recurrence requiring revision surgery, while there was only one recurrence in the NSF group (P < 0.05). In patients requiring revision, all had an NSF placed and none had a second recurrence of their RCC. CONCLUSIONS: NSF placement into a fenestrated RCC is useful to prevent cyst reaccumulation and reoperation. Typical fenestration carries an unacceptably high rate of recurrence.

Comparative Effectiveness of Lifestyle Intervention on Fasting Plasma Glucose in Normal Weight Versus Overweight and Obese Adults With Prediabetes.

Background. It is hypothesized that normal weight individuals develop diabetes through different pathophysiological mechanisms and that methods of prevention may differ in the absence of overweight/obesity. In this study, we compared the effect of lifestyle health coaching (LHC) on fasting plasma glucose (FPG) in normal weight, overweight, and obese US adults with prediabetes. Methods. Subjects were 1358 individuals who completed baseline and follow-up evaluations as part of an LHC program (follow-up = ~6 months). Participants were stratified, based on baseline body mass index (BMI), into normal weight (n = 129), overweight (n = 345), and obese (n = 884) cohorts. LHC included counseling, predominantly via telehealth, on exercise and nutrition. Results. BMI decreased (P < .001) in the overweight and obese participants but was unchanged in the normal weight participants. FPG decreased (P < .001) in all 3 cohorts, and the magnitude of decrease did not differ significantly among cohorts. FPG decreased to <5.6 mmol/L in 58.1%, 49.3%, and 41.4% of the normal weight, overweight, and obese participants, respectively. Conclusions. To our knowledge, this study is the first outside of Asia to show that LHC is as effective in managing FPG in normal weight adults with prediabetes versus those who are overweight/obese.

Validation of Claims Data for the Identification of Intraoperative Transesophageal Echocardiography During Cardiac Surgery.

OBJECTIVE: The goal of this study was to assess the validity of Current Procedural Terminology (CPT) claims data for the identification of intraoperative transesophageal echocardiography (TEE) during cardiac surgery. DESIGN: This study was a retrospective, cohort analysis. SETTING: This study used data from electronic medical records (EMRs), in combination with CPT billing claims data, from two hospitals within the Penn Medicine Health System-Penn Presbyterian Medical Center and the Hospital of the University of Pennsylvania. PARTICIPANTS: The cohort consisted of adult patients, aged ≥18 years, undergoing open cardiac valve surgery (repair or replacement), coronary artery bypass graft surgery, or aortic surgery between April 1 and October 31, 2019. INTERVENTIONS: Agreement between TEE identified using CPT billing code(s) (93312-8 with or without 93320-1 or 93325) and TEE identified by manual EMR review. MEASUREMENTS AND MAIN RESULTS: As identified by a reference standard (ie, EMR review) of the 873 cases that met inclusion criteria, 867 (99.31%) cases were performed with TEE and six cases were performed without TEE (<1%). Of the 867 cases performed with TEE, CPT code(s) correctly identified 866 cases, as indicated by having at least one of the CPT codes (93312-8 with or without 93320-1 or 93325). These CPT codes identified intraoperative TEE with a 99.88% sensitivity, 100.00% specificity, 100.00% positive predictive value, and 85.71% negative predictive value. When billing claims for TEE were restricted to the CPT code 93312 alone, the results were identical. CONCLUSIONS: Billing claims using CPT code(s) identified true intraoperative TEE with a high sensitivity, specificity, excellent positive predictive value, and moderate negative predictive value. These results demonstrated that claims data are a valuable data source from which to study the effect of TEE in cardiac surgical patients.

Left atrial appendage occlusion with the Amulet device: to tug or not to tug?

PURPOSE: Left atrial appendage occlusion (LAAO) involves a "tug test," in which implanters pull on the device delivery cable to ensure stable occluder placement. The aim of this study was to evaluate the recommendation to perform the tug test, by comparing forces exerted on the device during deployment and subsequent tug test. A secondary objective was to simulate forces experienced on left atrial appendage tissue by placement of a 20-mm device. METHODS: The AMPLATZER™ Amulet™ device was used for occlusion. A force transducer recorded forces in the delivery cable during deployment and tug test in 23 patients. Four patients were excluded due to improper transducer placement or technical errors in data collection. For a 20-mm device, the force imparted on the circumferential contact with left atrial appendage wall tissue was simulated in a computational model, using the measured externally applied forces as inputs. RESULTS: For devices < 25-mm in diameter, disc deployment force (mean ± standard deviation) was 1.72 ± 0.43 N, and tug force was 1.01 ± 0.59 N. For devices ≥ 25 mm in diameter, disc deployment force was 2.96 ± 0.57 N, and tug force was 1.04 ± 0.24 N. The increase in disc deployment force compared with tug test force was statistically significant for small devices (< 25 mm; p = 0.049) and large devices (≥ 25 mm; p < 0.001). CONCLUSIONS: Increased force applied on the AMPLATZER™ Amulet™ device during disc deployment compared with during tug test was statistically significant, suggesting that the tug test is redundant in most cases for checking device stability.