Reliability of Wrist Arthroscopy in the Diagnosis and Treatment of Triangular Fibrocartilage Complex Tears.

PURPOSE: Wrist arthroscopy is considered the gold standard for diagnosis of intra-articular wrist conditions including triangular fibrocartilage complex (TFCC) tears; however, the ability to reliably diagnose TFCC pathology during wrist arthroscopy is unclear. The purpose of this study was to assess the reliability of the diagnosis of TFCC tears on wrist arthroscopy videos. METHODS: Five hand surgeons reviewed 43 cases on a secure web-based platform at two time points separated by 4-6 weeks. Each case included a deidentified clinical vignette and wrist radiographs with ulnar variance measurements and an arthroscopy video of ulnar wrist pathology, averaging 42 seconds. Surgeons were queried on the presence of TFCC tear and Palmer and Atzei classifications. Interobserver/intraobserver reliabilities were determined using kappa coefficients. RESULTS: The interobserver reliability regarding the presence/absence of TFCC tear was fair-good, with kappa coefficients of 0.596 in the first round of case review and 0.708 in the second round. The overall intraobserver reliability for the presence/absence of TFCC tear was also fair-good, with a kappa coefficient of 0.567. For cases with central TFCC tears, the interobserver reliability regarding the presence of TFCC tear was perfect, with a kappa coefficient of 1.0. When central tears were excluded, the kappa coefficients decreased to 0.322 and 0.368 in each round. The interobserver reliability for the Palmer and Atzei classifications was low, with kappa coefficients of 0.220 and 0.121 in the first round and 0.222 and 0.123 in the second round. CONCLUSIONS: Experienced wrist arthroscopy surgeons demonstrated fair-good interobserver reliability for the diagnosis of TFCC tear on wrist arthroscopy. However, when central TFCC tears were excluded, interobserver reliability was poor. These findings demonstrate a need for a focus on education for wrist arthroscopy anatomy. CLINICAL RELEVANCE: This investigation demonstrated poor agreement in surgeon identification and classification of TFCC tears, aside from central TFCC tears. The low reliability has a direct bearing on treatment considerations for TFCC tears.

Craniocervical Morphometry in Pomeranians-Part I: Intra-Observer, Interobserver, and Intermodality (CT vs. MRI) Agreement.

BACKGROUND: Currently, there are no diagnostic imaging-based studies that have focused specifically on the craniocervical morphology of Pomeranian dogs in relation to Chiari-like malformation and syringomyelia (CM/SM). The aims of Part I of this two-part study are to assess the intra-observer, interobserver, and intermodality reliability and agreement for various aspects of the craniocervical morphology of Pomeranians with and without CM/SM. METHODS: Prospectively, Pomeranians were included that underwent both CT and MRI studies of the head and cervicothoracic vertebral column. Two observers (experienced and novice) independently performed CM and SM classifications, qualitative assessments, and quantitative measurements. The experienced observer performed these assessments twice. A third observer (experienced) performed CM and SM normal or abnormal classifications. RESULTS: Ninety-nine (99) dogs were included. Interobserver reliability was influenced by observer experience level. For the experienced versus novice observers, substantial interobserver agreement was found for classification of SM as normal or abnormal (Cohen's kappa = 0.63), while interobserver agreement was fair for classification of SM as normal or abnormal (Cohen's kappa = 0.31). Interobserver, intra-observer, and intermodality reliability were variable for different measurements and assessments, and best overall for the CT-based measurements. CONCLUSIONS: Interobserver reliability and agreement results should be taken into account in the evaluation of results of future studies as well as the evaluation of imaging studies of Pomeranians presented clinically.

How reliable is the distinction between thoracolumbar AO type A3 and A4 fractures? A systematic literature review.

PURPOSE: The AOSpine classification divides thoracolumbar burst fractures into A3 and A4 fractures; nevertheless, past research has found inconsistent interobserver reliability in detecting those two fracture patterns. This systematic analysis aims to synthesize data on the reliability of discriminating between A3 and A4 fractures. METHODS: We searched PubMed, Scopus, and the Web of Science for studies reporting the inter- and intra-observer reliability of detecting thoracolumbar AO A3 and A4 fractures using computed tomography (CT). The search spanned 2013 to 2023 and included both primarily reliability and observational comparative studies. We followed the PRISMA guidelines and used the modified COSMIN checklist to assess the studies' quality. Kappa coefficient (k) values were categorized according to Landis and Koch, from slight to excellent. RESULTS: Of the 396 identified studies, nine met the eligibility criteria; all were primarily reliability studies except one observational study. Interobserver k values for A3/A4 fractures varied widely among studies (0.19-86). The interobserver reliability was poor in two studies, fair in one study, moderate in four studies, and excellent in two studies. Only two studies reported intra-observer reliability, showing fair and excellent agreement. The included studies revealed significant heterogeneity in study design, sample size, and interpretation methods. CONCLUSION: Considerable variability exists in interobserver reliability for distinguishing A3 and A4 fractures from slight to excellent agreement. This variability might be attributed to methodological heterogeneity among studies, limitations of reliability analysis, or diagnostic pitfalls in differentiating between A3 and A4. Most observational studies comparing the outcome of A3 and A4 fractures do not report interobserver agreement, and this should be considered when interpreting their results.

In Which Cases Do We Operate? Posterior Malleolar Fractures-Intraobserver and Interobserver Reliability of the Bartonícek/Rammelt Classification and Corresponding Surgery Rates.

INTRODUCTION: The Bartonícek/Rammelt classification is established for posterior malleolar fractures. It subdivides the fractures into 5 types and outlines treatment recommendations. This study aims to determine the intraobserver and interobserver reliability of the Bartonícek/Rammelt classification and investigates its applicability regarding treatment recommendations. MATERIALS AND METHODS: Computed tomography (CT) scans of 80 ankle fractures with a posterior malleolar fracture were analyzed by four observers at two different time points 30 days apart (d1 and d2). Intrarater and interrater reliability was measured using kappa values. The corresponding surgery rates of the fracture subtypes were analyzed, and the surgery rates were correlated with fragment sizes and displacements. RESULTS: A moderate interobserver reliability for d1 0.41 (CI 0.35-0.47) and d2 0.42 (CI 0.36-0.48) was detected. Intraobserver reliability was documented as perfect, with a mean kappa of 0.83. Type II fractures were operated on in 50% of cases. In 50% of type II cases, a nonoperative treatment was chosen. Fragment size correlated strongly with the chosen therapy, and osteosynthesis was performed significantly more often when the fragment size exceeded 3 cm3 (P < .01). CONCLUSIONS: The Bartonícek/Rammelt classification system showed moderate interobserver reliability and perfect to substantial intraobserver reliability. In clinical practice of this study cohort, the size of the posterior malleolar fragment rather than the dislocation and joint impaction seemed to have the decision to operate on type II or III fractures. Existing treatment recommendations based on the Bartonícek/Rammelt classification correspond to the therapy algorithm carried out in this cohort of patients.Levels of Evidence: Level III: Retrospective study.

Interobserver Reliability and Sensitivity to Change of a Composite Ocular Inflammatory Activity Index: UVEDAI©.

INTRODUCTION: This was a multicenter, prospective, longitudinal, observational study involving eight Spanish tertiary hospitals to determine the interobserver reliability of an uveitis disease activity index, (UVEDAI) and assess its sensitivity to change in patients with receiving pharmacologic treatment. METHODS: Patients aged ≥ 18 years diagnosed with active noninfectious uveitis were included. A complete baseline assessment was performed by two ophthalmologists who determined ocular inflammatory activity using the UVEDAI index independently of each other. The principal ophthalmologist made a new visit at 4 weeks to determine the change in inflammatory activity. The interobserver reliability analysis was performed by calculating the intraclass correlation coefficient (ICC), with the values of the variables and the UVEDAI obtained by both ophthalmologists in the more active eye at the baseline visit. Sensitivity to change in the UVEDAI index was assessed at 4 weeks from the start of pharmacologic treatment by determining the clinically relevant change, defined as a change in UVEDAI of ≥ 0.8 points over baseline. The mean change between both measures was compared using the repeated-measures t-test. RESULTS: A total of 111 patients were included. In the interobserver reliability analysis, the ICC for the UVEDAI value was 0.9, and, when compared with the mean UVEDAI values obtained by the ophthalmologists, no statistically significant differences were found (p value > 0.05). As for the sensitivity to change in UVEDAI, statistically significant differences (p value = 0.00) were found for the mean values of the index compared with baseline. In all cases, the index value decreased by > 1 point at the 4-week visit. CONCLUSIONS: The interobserver reliability of the UVEDAI was high in the total sample. Furthermore, the index was sensitive in determining the change in inflammatory activity after treatment. We believe that UVEDAI is a disease activity index that enables objective comparison of results in clinical practice and trials.

The Gartland classification for expediting supracondylar humerus fracture triage: a collaborative approach to structured reporting between pediatric radiologists and orthopedists.

BACKGROUND: The modified Gartland classification is an important tool for evaluation of pediatric supracondylar humerus fractures (SCHF) because it can direct treatment decisions. Gartland type I can be managed outpatient, while emergent surgical consult occurs with type II and III. This study assesses the interobserver reliability of the Gartland classification between pediatric radiologists and orthopedic providers. METHODS: A retrospective review of 320 children diagnosed with a SCHF at a single tertiary children's hospital during 2022 was conducted. The Gartland classification documented in the radiographic report by a pediatric radiologist and the classification documented in the first encounter with an orthopedic provider was collected. Kappa value was used to assess interobserver reliability of classifications between radiologists and orthopedic providers. A second group of 76 Gartland type I SCHF from 2015, prior to our institution's implementation of structured reporting, was reviewed for comparison of unnecessary orthopedic consults at initial presentation. RESULTS: The Gartland classification has excellent interobserver reliability between radiologists and orthopedic providers with 90 % (289/320) agreement and kappa of 0.854 (confidence interval: 0.805-0.903). The most frequent disagreement that occurred was fractures classified as type II by radiology and type III by orthopedics. There were similar rates of consults for the 2015 and 2022 cohorts (p = 0.26). CONCLUSION: The Gartland classification system is a reliable and effective tool for communication between radiologists and orthopedic providers. Implementing a structured reporting system has the potential to improve triage efficiency for SCHF.

Mayo classification of olecranon fractures revisited - Assessment of intra- and interobserver reliability based on CT scans.

Purpose: Olecranon fractures are classified using the commonly accepted Mayo classification. Its reliability has been analyzed by means of radiographs. A CT scan is often obtained due to joint involvement. Purpose of this study was to evaluate the intra- and interobserver reliability of the Mayo classification based on CT examination. Methods: Radiographic and CT images of 20 olecranon fractures were classified by four surgeons at two time points 30 days apart. Intra- and interobserver reliability were assessed using kappa coefficients. Results: Mean intraobserver reliability between X-rays was substantial and between CTs almost perfect (0.76 and 0.82, respectively). Mean interobserver reliability was fair for X-rays and moderate for CTs (0.32 and 0.44, respectively). Conclusion: Despite the more detailed imaging compared with radiography only moderate interobserver reliability was found for the classification of olecranon fractures based on CT imaging. This might lead to inconsistent fracture classification in both scientific and clinical setting.

Classification of intraarticular calcaneal fractures: comparison of two classification systems.

PURPOSE: Accurately classifying displaced intraarticular calcaneal fractures (DIACFs) is essential for orthopedic surgeons to choose optimal treatment methods and provide results evaluation and communication. Many authors studying used Sanders classification reported moderate intra- and interobserver reliability. Taking the software opportunity of 3D virtual exarticulation, Goldzak updated French tri-dimensional Utheza classification, providing an alternative framework for classifying DIACFs. The aim of this study was to compare the intra- and interobserver reliability of Sanders versus Goldzak classification systems. METHODS: The CT scans of 30 patients with displaced intraarticular calcaneal fractures, treated in the same trauma center between 2014-2018, were analyzed by 16 medical doctors (specialists and residents in orthopedic surgery, specialists and residents in radiology), and classified according to Sanders and Goldzak classifications. The same images were sent on two separate sessions, in a randomized order. Interobserver reliability and intraobserver reproducibility were assessed using Kappa statistics and Gwet's AC1 coefficient. RESULTS: Interobserver reliability using Gwet reported a value of 0.36 for Goldzak classification and 0.30 for Sanders classification (corresponding to "fair assessment" in both cases). In absence of subclasses, "substantial assessment" was reported for Goldzak classification (Gwet of 0.61) and "moderate assessment" for Sanders classification (Gwet of 0.46). Goldzak system had a greater interobserver reliability in the group of radiology residents. Intraobserver reliability coefficient was 0.60 for Goldzak classification and 0.69 for Sanders classification, indicating a substantial agreement for both classifications. CONCLUSION: Despite the better view of the fracture lines provided by 3D reconstructions, this study failed to prove the superiority of Goldzak classification compared to Sanders classification for DIACFs.

Comparison and interobserver reliability between a visual analog scale and the Wisconsin Calf Health Scoring Chart for detection of respiratory disease in dairy calves.

Respiratory disease is an ongoing challenge for calves in the dairy sector with a relatively high prevalence and impact on welfare and economics. Applying scoring protocols for detecting respiratory disease requires that they are easily implemented, consistent between observers and fast to use in daily management. This study was conducted in one Danish dairy farm from September 2020 through January 2021. The study included 126 heifer calves enrolled in the age of 17 to 24 d. All calves were observed every second day for a period of 46 d. At each visit all calves were scored with a new visual analog scale (VAS) and the Wisconsin Calf Health Scoring Chart (WCHSC). We calculated agreement between the 2 scoring systems based on conditional probability to score higher or lower than a cutoff in the VAS compared with a specified cutoff in WCHSC used as reference test. A generalized mixed effects regression model was developed to estimate the prevalence of respiratory disease and the overall agreement between the 2 scoring systems. The overall agreement between the VAS and WCHSC was 89.6%. The second part of the study assessed interobserver reliability between 2 experienced observers and between an experienced observer and veterinary students. The interobserver reliability was calculated by intraclass correlation coefficient and was 0.58 between experienced observers and was 0.34 between an experienced observer and veterinary students indicating a moderate to poor reliability between the observers. It was possible to use VAS as an alternative clinical scoring method, which primarily focuses on the general condition of the individual calf rather than specific categories of clinical signs. Our study set up lacked a comparison to other diagnostic tools i.e., thoracic ultrasound to confirm the findings which should be considered in future studies when exploring VAS as a screening tool for detection of respiratory disease in dairy calves.

Intraobserver and interobserver reliability of standardized capillary refill time in dogs is high following observer training.

OBJECTIVE: To assess intraobserver and interobserver reliability of capillary refill time (CRT) measurement in dogs using a standardized technique after training. ANIMALS: 20 dogs presented to the emergency room. METHODS: Dogs presented to the emergency room were prospectively recruited. Using a timing device and standardized technique, CRT was measured at the oral mucosa of the inner lip. Measurements were performed by 2 emergency and critical care residents (observer 1 [Ob1] and observer 2 [Ob2]) and repeated 3 times by each observer for each dog. CRT values and signalment were recorded. Intraobserver and interobserver reliability were analyzed by calculation of the coefficient of variation (CV%), intraclass correlation coefficient (ICC), and minimal detectable difference. Reliability was considered high if CV% was lower than 10% and ICC was between 0.9 and 1. RESULTS: Median CRT for Ob1 was 1.22 seconds and for Ob2 was 1.19 seconds. Intraobserver reliability was high, evidenced by a median CV% of 6.2% (range, 1.0% to 18.6%) and 9.5% (range, 1.3% to 22.6%) and an ICC of 0.97 (95% CI, 0.94 to 0.99) and 0.95 (95% CI, 0.90 to 0.98) for Ob1 and Ob2, respectively. Between observers, the CV% was 4.4% (range, 0.8% to 17.5%) and the ICC was 0.98 (95% CI, 0.94 to 0.99), indicating high interobserver reliability. The minimal detectable differences for intraobserver and interobserver were 0.30 and 0.34 seconds, respectively. CLINICAL RELEVANCE: The reported high reliability of CRT despite its subjective nature enhances its usefulness in daily practice. However, further research on the validity of CRT is warranted.

Reliability of the Clinical Measurement of Upper and Lower Extremity Joint Motion in the Pediatric Population: A Systematic Review.

AIM: To examine intraobserver and interobserver reliability of the clinical measurement of pediatric joint motion of upper and lower extremities, based on participant condition and measurement technique. METHODS: PubMed, CINAHL, and Web of Science were searched using combinations of children or adolescents, range of motion, and reliability. Reference lists and citations of reviewed studies were searched for additional publications. RESULTS: Thirty-one studies of pediatric samples of developing typically, orthopedic injuries, athletes, cerebral palsy, and other diagnoses were reviewed. For techniques, measurements were made most frequently with a goniometer followed by visual estimation, inclinometer, smartphone apps, and specialized devices. The reliability of hip abduction measurements of participants with cerebral palsy was evaluated most often and varied widely for both intraobserver and interobserver. In general, goniometric results indicated greater reliability for upper than lower extremities and for intraobserver than interobserver. As the other techniques were each utilized in only a few studies, involving different participant conditions, joint motions and statistics, the analysis of their reliability was limited. CONCLUSIONS: Intraobserver and interobserver reliability have not been established for pediatric joint motion measurements. Further research should include various joint motion measurements for different pediatric conditions using appropriate statistics. Results would provide important information for making clinical decisions.

Interobserver Reliability of the Paris Classification for Superficial Gastrointestinal Tract Neoplasms: A Systematic Review.

Background and study aims: The Paris classification characterizes the morphology of superficial gastrointestinal tract neoplasms. This system has been shown to predict the risk of submucosal invasion in certain subtypes of lesions. There is limited data that assesses its agreement amongst endoscopists. We performed a systematic review to summarize the available literature on the interobserver reliability (IOR) of the Paris classification. Methods: We conducted a search through December 2020 for studies reporting IOR of the Paris classification. Studies were included if they quantitatively evaluated the IOR of the Paris classification with at least five participating endoscopists. Two authors independently screened studies and abstracted data using an a priori-designed data collection form. Evaluation of study quality and risk of bias was performed using an adapted version of the Guidelines for Reporting Reliability and Agreement Studies. Results: Of the 1,541 studies retrieved, 5 were included in the review. All studies were observational cohort studies published between 2014 and 2020. The IOR of the Paris classification was moderate amongst all four studies evaluating colorectal neoplasms (range, κ = 0.42 to κ = 0.54) and substantial in one study that evaluated gastric neoplasms (κw = 0.65). An educational intervention was conducted by three studies with variable methodology and no significant change in IOR. Conclusions: IOR of the Paris classification is moderate for superficial colonic neoplasms. Further study is needed to determine the reliability of this system for superficial gastric lesions. Standardized training programs are required to investigate the impact of educational intervention on the Paris classification amongst endoscopists.

Fracture displacement of lateral compression type 1 (LC1) Pelvic Ring Injuries: Which measurement methods are reliable and does displacement correlate with adverse events?

PURPOSE: To determine the interobserver reliability of perceived displacement (PD) ≥ 1 cm of lateral compression type 1 (LC1) pelvic ring fractures and to determine if PD correlated with published methods of measuring fracture displacement and adverse events. METHODS: The injury and follow-up radiographs of 10 patients with nonoperative minimally displaced LC1 injuries were reviewed by 27 orthopaedic trauma surgeons to determine if they perceived an interval fracture displacement ≥ 1 cm. Perceived displacement (PD) was compared to 11 measurements of displacement: the difference in heights of iliac crests (IC), sourcils, and ischial tuberosities on AP/outlet radiographs; the distance from femoral head (FH) to the sacral midline and the distance between the radiographic teardrops (TD) on the AP; the distance from the TD to sacral midline and the difference in distances between the SI joints and the contralateral TD on the inlet. The interobserver reliability and correlation of PD and measured displacement was calculated. The association between PD and adverse events was also evaluated. RESULTS: PD had weak interobserver reliability (kappa = 0.46). Many of the measurements of displacement were poorly sensitive for PD. The magnification-corrected AP TD measurement had the highest sensitivity (100%) for PD and excellent interobserver reliability (Intraclass correlation 0.97), but had a low specificity (57.1%). All three patients with PD had adverse events while patients without PD had uneventful recoveries (p = 0.008). CONCLUSIONS: The AP TD measurement detected all cases of PD and had excellent reliability. PD was associated with adverse events, suggesting that accurate and reliable measurements of displacement are warranted. LEVEL OF EVIDENCE III: Diagnostic.

Remote visual estimation of shoulder range of motion has generally high interobserver reliability but limited accuracy.

Background: Surgeon visual estimation of shoulder range of motion (ROM) is commonplace in the outpatient office setting and routinely reported in clinical research, but the reliability and accuracy of this practice remain unclear. The purpose of this study is to establish the reliability and accuracy of remote visual estimation of shoulder ROM in healthy volunteers and symptomatic patients among a large group of shoulder surgeons. Our hypothesis is that remote visual estimation would be reliable and accurate compared with the digital goniometer method. Methods: Fifty shoulder surgeon members of the PacWest Shoulder and Elbow Society independently determined the active shoulder forward flexion (FF), internal rotation at 90° abduction (IR90), external rotation at 90° abduction, external rotation at the side , and maximal spinal level reached with internal rotation (IRspine) through visual estimation of video recordings taken from 10 healthy volunteers and 10 symptomatic patients. Variations in measurements were quantified using the interobserver reliability through calculation of the intraclass correlation coefficient. Accuracy was determined through comparison with digital goniometer measurements obtained with an on-screen protractor application using Bland-Altman mean differences and 95% limits of agreement. Results: The interobserver reliability among examiners showed moderate to excellent correlation, with intraclass correlation coefficient ranging from 0.768 to 0.928 for the healthy volunteers and 0.739 to 0.878 for the symptomatic patients. Accuracy was limited, with upper limits of agreement exceeding the established minimal clinically important differences (MCIDs) for FF (20° vs. MCID of 14°) and IR90 (25° vs. 18°) in the healthy volunteers and for FF (33° vs. 16°), external rotation at 90° abduction (21° vs. 18°), and IR90 (31° vs. 20°) in the symptomatic patients. Conclusion: Despite generally high intersurgeon reliability in the visual estimation of shoulder ROM, there was questionable accuracy when compared to digital goniometer measurements,with measurement errors often exceeding established MCID values. Given the potential implications for the clinical response to treatment and the significance of research findings, the adoption of validated instruments to measure ROM and the standardization of examination procedures should be considered.

Enhancing Consistency in Posterior Malleolus Fracture Classification: A Comprehensive Interobserver Reliability Study With 20 Raters Using the Mason & Molloy Classification.

INTRODUCTION: Over the past decade, there has been a growing interest in the identification and treatment of posterior malleolus fragments, driven by a better understanding of their significance. The Mason & Molloy (M&M) classification system has emerged as a valuable tool for systematically categorizing these fractures and assisting clinicians in formulating treatment. We aim to assess the interobserver reliability of the M&M classification for posterior malleolus fracture by using 20 raters. METHODOLOGY: The study was conducted at a major foot and ankle referral center in Wythenshawe, Manchester, UK. Thirty-eight Computed Tomography (CT) scans were evaluated by 20 independent raters: 15 general orthopedic and trauma surgeons plus five foot and ankle surgeons. Each rater classified the posterior malleolus fracture according to M&M classification into type 1, 2A, 2B, 3, or not classifiable. Statistical analysis was done with the R software package and SPSS (v26; IBM Corp., Armonk, NY). Fleiss kappa (κ) coefficient with a 95% confidence interval (CI) was applied. RESULTS: The interobserver agreement was moderate with a global κ value of 0.531 (95% CI: 0.518, 0.544). There were good agreements for identifying type 3 M&M (κ=0.785) and those that are not applicable for M&M classification (κ=0.785). There was a strong correlation between all raters in using M&M classification (Tb=0.53-0.59) except for Rater 12. CONCLUSION: M&M classification remains a valuable tool to guide the management of patients with these subsets of ankle fractures.

Application of international system for reporting serous fluid cytology (ISRSFC) in effusion samples-a prospective study in an oncology setting.

INTRODUCTION: Serous fluid cytology is a cost-effective procedure that can help in the diagnosis, staging, and origin of the malignancy. Recently introduced International System for Reporting Serous Fluid Cytology (ISRSFC) standardizes the reporting of serous fluid cytology in the 5 categories: Category 1: Nondiagnostic (ND), Category 2: negative for malignancy (NFM), Category 3: atypia of undetermined significance (AUS), Category 4: suspicious for malignancy (SFM), and Category 5: malignant (MAL). Here, we present our experience adopting the ISRSFC. MATERIALS AND METHODS: We implemented ISRSFC in December of 2019 at our institute and included a cohort of 555 prospective effusion samples. The pertinent surgical pathology, radiology, and clinical follow-up were also extracted to assess the risk of malignancy (ROM) and performance parameters. RESULTS: The assessment of interobserver reliability indicated substantial concordance (κ = 0.717) between the 2 investigators for serous fluid categorization. A total of 555 effusion samples were classified as follows: ND, 14 (2.5%); NFM, 394 (71%); AUS, 12 (2.2%); SFM, 13 (2.3%); and MAL, 122 (22%). The ROM for the ND, NFM, AUS, SFM, and MAL categories was 57.1%, 9.9%, 66.7%, 66.7%, and 97.2%, respectively, in peritoneal effusions and 57.1%, 7.1%, 66.7%, 100%, 100%, respectively, in pleural effusions. The ROM for NFM and MAL was 0% and 100%, respectively, in pericardial effusion. CONCLUSIONS: Application of the proposed ISRSFC can help in achieving uniformity and reproducibility in diagnoses and also help in risk stratification in cytology. ISRSFC was successfully adopted by our cytology laboratory and clinicians, with overall diagnostic performance similar to previous studies.

Interobserver Agreement of Post-operative Perth Computed Tomography Protocol Data in Total Knee Arthroplasty.

BACKGROUND: Total knee arthroplasty (TKA) has become the treatment of choice for advanced osteoarthritis. Identifying malalignment is central to improving TKA outcomes and providing optimal management of TKA patients with post-operative pain and dissatisfaction. Computed tomography (CT) imaging has become increasingly popular as a more precise way of analysing post-TKA component alignment and the Perth CT protocol remains the current predominant assessment tool. This study aimed to analyse and compare inter- and intra-observer agreement of a post-operative multi-parameter quantitative CT assessment (Perth CT protocol) in TKA patients. METHODS: Post-operative CT images of 27 patients who underwent TKA were analysed retrospectively. Images were analysed by an experienced radiographer and a final-year medical student at least two weeks apart. Measurements for nine angles were collected: modified hip-knee-ankle (mHKA) angle, lateral distal femoral angle (LDFA) and medial proximal tibial angle (MPTA), femoral flexion and tibial slope, femoral rotation angle, femoral-tibial match rotational angle, tibial tubercle lateralisation distance, and Berger's tibial rotation. Intra-observer and inter-observer intraclass correlation coefficients (ICCs) were calculated. RESULTS: Inter-observer reliability for the measurements of all variables varied from poor to excellent (ICC: -0.003 to 0.981). Five out of the nine angles demonstrated good to excellent reliability. Inter-observer reliability was highest for mHKA in the coronal plane and the poorest for the tibial slope angle in the sagittal plane. The intra-observer reliability for both reviewers was excellent (0.999 vs. 0.989). CONCLUSION: This study demonstrates that the Perth CT protocol has excellent intra-observer reliability and good to excellent inter-observer reliability for five out of nine of the measured angles used to assess component alignment post-TKA, making it a useful tool for surgical outcome prediction and success.

Exploration of Caregiver Interrater Agreement and Test-Retest Reliability on the Infant Cleft Observer Outcomes (iCOO).

Caregiver and observer-reported measures are frequently used as outcomes for research on infants and young children who are unable to report on their own health. Our team developed the Infant with Clefts Observation Outcomes Instrument (iCOO) for infants with cleft lip with or without cleft palate. This exploratory study compared test-retest and interrater reliabilities to inform whether differences in caregiver perspective might affect the iCOO.This study is a secondary analysis comparing caregiver interrater agreement to test-retest reliability. Twenty-five pairs of caregivers completed the iCOO before surgery, 1 week later for test-retest reliability, 2 days after surgery, and 2 months after surgery. Reliability was assessed using intraclass correlations (ICCs) and t-tests were used to compare ratings between caregivers.Infants had cleft lip (28%) or cleft lip and palate (72%). Primary caregivers were predominantly mothers (92%) and secondary caregivers were predominantly fathers (80%). Test-retest reliability met psychometric standards for most items on the iCOO (81%-86% of items). Caregiver agreement on the iCOO items was lower than test-retest reliability (33%-46% of items met psychometric standards). Caregivers did not systematically differ in whether they rated infants as healthier or less healthy than the other caregiver (5%-16% of items had statistically significant differences).Caregivers used the measure consistently, but had different experiences and perceptions of their infant's health and functioning. Future studies are needed to explore mechanisms for the differences in test-retest and interrater reliability. Whenever possible, the same caregiver should provide ratings of the infant, including on the iCOO.

Interobserver Reliability of the Nancy Index for Ulcerative Colitis: An Assessment of the Practicability and Ease of Use in a Single-Centre Real-World Setting.

BACKGROUND: Histological disease severity assessment in ulcerative colitis [UC] has become a mainstay in the definition of clinical endpoints ['histological remission'] in clinical trials of UC. Several scores have been established in the microscopic assessment of disease activity, but the Nancy index [NI] stands out as being the histological index with the fewest scoring items. To what extent histological assessment using the NI is affected by interobserver reliability in a real-word setting is poorly understood. We therefore performed a single-centre retrospective analysis of NI assessment in patients with UC. METHODS: We retrospectively evaluated the NI in two independent cohorts [total: 1085 biopsies, 547 UC patients] of clinically diagnosed UC patients, who underwent colonoscopy between 2007 and 2020. Cohort #1 consisted of 637 biopsies from 312 patients, while Cohort #2 consisted of 448 biopsies from 235 patients. Two blinded pathologists with different levels of expertise scored all biopsies from each cohort. A consensus conference was held for cases with discrepant scoring results. Finally, an overall consensus scoring was obtained from both cohorts. RESULTS: The interobserver agreement of the NI was substantial after the assessment of 1085 biopsy samples (κ = 0.796 [95% confidence interval, CI: 0.771-0.820]). An improvement of the interobserver agreement was found with increasing numbers of samples evaluated by both observers (Cohort #1: κ = 0.772 [95% CI: 0.739-0.805]; Cohort #2: κ = 0.829 [95% CI: 0.793-0.864]). Interobserver discordance was highest in NI grade 1 [observer 1: n = 128; observer 2: n = 236]. Interobserver discordance was lowest in NI grades 0 [observer 1: n = 504; observer 2: n = 479] and 3 [observer 1: n = 71; observer 2: n = 66]. CONCLUSION: The NI is an easy-to-use index with high interobserver reliability for assessment of the histological disease activity of UC patients in a real-world setting. While NI grades 0 and 3 had a high level of agreement between observers, NI grade 1 had a poorer level of agreement. This highlights the clinical need to specify histological characteristics leading to NI grade 1.

Clinical Validity of 3 Different Grading Systems for Facet Joint Violation: A Retrospective Study and In-Depth Review.

STUDY DESIGN: Retrospective. OBJECTIVES: To study the violation rate of 3 different types of facet joint violation (FJV) grading systems (Babu, Shah, and Park), and to evaluate the accuracy, reliability, and association with clinical outcomes of the above 3 grading systems. METHODS: 152 patients of lumbar spinal stenosis treated with percutaneous pedicle screw placement were enrolled in our study. FJV was evaluated on 3-dimensional lumbar CT reconstruction. Three types of grading systems were used to evaluate FJV: Babu's system (grading by the severity of violation), Shah's system (grading by side of violation), and modified Park's system (grading by different components to cause violation). The violation rate and observer consistency of the 3 grading systems were analyzed. Clinical outcomes were evaluated by visual analog score (VAS), Oswestry disability index (ODI) score. RESULTS: Kappa coefficients of interobserver consistency on Babu, Shah, and Park grading systems were 0.726,0.849,0.692, respectively. The violation rate of Babu, Shah, and Park grading systems were comparable, which were 34.54%, 32.57%, 33.55%, respectively. In all 3 grading systems, the postoperative VAS low-back pain and ODI scores in non-FJV groups were lower than those in FJV groups (P < .05), and there were no significant differences between 2 groups in VAS leg pain(P >.05). CONCLUSIONS: Babu, Shah and modified Park grading system are reliable grading systems, and it reported comparable violation rate. The self-reported clinical outcomes of patients with FJV were worse at 2-year follow-up. For clinical application, it is recommended to use 2 or even 3 different grading systems together to evaluate the FJV.