To Assess the Interobserver Variability in Mitotic Figure Counting in Various Grades of Oral Squamous Cell Carcinoma

Background: Oral squamous cell carcinoma (OSCC) is the most common oral malignancy, representing up to 80–90% of all malignant neoplasms of the oral cavity. The increasing cases of oral cancer are the most important concern for community health. Defects of mitosis result in various nuclear abnormalities namely micronuclei, binucleation, broken egg appearance, pyknotic nuclei, and increased numbers of mitotic figures. The rationale for mitotic counting is that it is frequently used for classification and grading of tumors, prediction of prognosis of tumors and even advocated as a decision point for treatment. Reproducibility of the mitotic counting is paramount for the assessment of malignancy on a histologic scale. Considering this, we decided to assess the inter-observer variability in mitotic figure counting in various grades of oral squamous cell carcinoma. Material & Methods: A retrospective study was carried out on 48 formalin fixed paraffin embedded tissue blocks of the confirmed cases of Oral squamous cell carcinoma in the archives of department of oral pathology, Govt. Dental College & Hospital, Srinagar. Mitotic figure counting was done by two independent, mutually blind observers. The data was assessed for inter-observer variability in counting of figures. Results: Least difference was seen in cases of WDSCC up to the maximum difference of 3 mitoses. MDSCC showed modest differences in observations, with a maximum difference of 4 mitoses. PDSCC cases had the highest inter-observer variability, with a maximum difference of 5 mitoses. Conclusion: Mitosis counting has been shown most convincingly to provide independent prognostic value and is the most well established component of the histological grading systems of OSCC. Reproducibility of the mitotic counting is paramount for the assessment of malignancy on a histologic scale.

A grading dilemma; Gleason scoring system: Are we sufficiently compatible? A multi center study

Objective: Gleason scoring is the grading system which strongly predicts the prognosis of prostate cancer. However, even being one of the most commonly used systems, the presence of different interobserver agreement rates push the uropathologists update the definitons of the Gleason patterns. In this study, we aimed to determine the interobserver agreement variability among 7 general pathologists, and one expert uropathologist from 6 different centers. Methods: A set of 50 Hematoxylin & Eosin stained slides from 41 patients diagnosed as prostate cancer were revised by 8 different pathologists. The pathologists were also grouped according to having their residency at the same institute or working at the same center. All pathologists' and the subgroups' Gleason scores were then compared for interobserver variability by Fleiss' and Cohen's kappa tests using R v3.2.4. Results: There were about 8 pathologists from 6 different centers revised all the slides. One of them was an expert uropathologist with experience of 18 years. Among 7 general pathologists 4 had surgical pathology experience for over 5 years whilst 3 had under 5 years. The Fleiss' kappa was found as 0.54 for primary Gleason pattern, and 0.44 for total Gleason score (moderate agreement). The Fleiss' kappa was 0.45 for grade grouping system. Conclusion: Assigning a Gleason score for a patient can be problematic because of different interobserver agreement rates among pathologists even though the patterns were accepted as well-defined.

Use of strain ultrasound elastography versus fine-needle aspiration cytology for the differential diagnosis of thyroid nodules: a retrospective analysis

OBJECTIVE: Fine-needle aspiration cytology is the risk stratification tool for thyroid nodules, and ultrasound elastography is not routinely used for the differential diagnosis of thyroid cancer. The current study aimed to compare the diagnostic parameters of ultrasound elastography and fine-needle aspiration cytology, using surgical pathology as the reference standard. METHODS: In total, 205 patients with abnormal thyroid function test results underwent ultrasound-guided fine-needle aspiration cytology on the basis of the American College of Radiology Thyroid Imaging-Reporting and Data System classification and strain ultrasound elastography according to the ASTERIA criteria. Histopathological examination of the surgical specimens was performed according to the 2017 World Health Organization classification system. Moreover, a beneficial score analysis for each modality was conducted. RESULTS: Of 265 nodules, 212 measured ≥1 cm. The strain index value increased from benign to malignant nodules, and the presence of autoimmune thyroid diseases did not affect the results (p>0.05 for all categories). The sensitivities of histopathological examination, ultrasound elastography, and fine-needle aspiration cytology for detection of nodules measuring ≥1 cm were 1, 1, and 0.97, respectively. The working area for detecting nodule(s) in a single image was similar between strain ultrasound elastography and fine-needle aspiration cytology for highly and moderately suspicious nodules. However, for mildly suspicious, unsuspicious, and benign nodules, the working area for detecting nodule(s) in a single image was higher in strain ultrasound elastography than in fine-needle aspiration cytology. CONCLUSION: Strain ultrasound elastography for highly and moderately suspicious nodules facilitated the detection of mildly suspicious, unsuspicious, and benign nodules.

Clasificación de Neer. Variabilidad interobservador / Interobserver Variability Of Neer Classification

Introducción Hacer objetiva la variabilidad interobservador al evaluar una fractura de húmero proximal utilizando la clasificación de Neer y establecer su utilidad diagnóstica y terapéutica. Materiales y Métodos Formulario digital con 20 casos elegidos al azar de fracturas de húmero proximal, de un mismo hospital entre 2010 y 2014. Cada caso incluyó: edad, sexo, lateralidad y dos proyecciones radiográficas. Evaluado de forma anónima por Traumatólogos, con y sin práctica habitual en cirugía del hombro, de hospitales nacionales e internacionales, indicando estadío de Neer y opción terapéutica adecuada. Se estableció la variabilidad interobservador entre grupos y comparando a todos por igual, calculando el índice de Kappa de Fleiss e interpretándolo según los criterios de Landis y Koch. Resultados 40 respuestas de Traumatólogos, 15 con práctica habitual de cirugía de hombro y 25 no. El índice Kappa de Fleiss medio fue 0,173 en el grupo de Traumatólogos con práctica habitual en cirugía de hombro. Siendo 0,176 en el grupo sin práctica habitual. Al evaluarlos conjuntamente, 0,184. Existe gran variabilidad interobservador en la indicación terapéutica y dentro de la indicación quirúrgica. Discusión El grado de acuerdo obtenido, según los criterios de Landis y Koch, ha sido pobre en todos los grupos en lo que a estadío se refiere y débil en lo referente al tratamiento, no influyendo la experiencia del Traumatólogo. Sería necesaria una clasificación más reproducible ya que la clasificación de Neer presenta la suficiente variabilidad interobservador como para aceptarla como único medio en la toma de decisiones.

Background To study inter-observer variability by evaluating a fracture of the proximal humerus using Neer's classification and to establish its diagnostic and therapeutic utility. Methods A computerised form was used with 20 randomly selected cases of fractures of the proximal humerus, from the same hospital between 2010 and 2014. Each case included: age, gender, laterality, and two radiographic projections. They were anonymously evaluated by Traumatologists, for whom shoulder surgery was routine practice or not, from national and international hospitals. They indicated Neer stage and an appropriate therapeutic option. Interobserver variability was established between groups, and comparing all of them equally, calculating Fleap's Kappa index and interpreting it according to the Landis and Koch criteria. Results A total of 40 responses were obtained from the Traumatologists, 15 of them were shoulder surgery was usual practice and 25 where it was not. The mean Fleap Kappa index was 0.173 in the Traumatologists group were shoulder surgery was usual practice, being 0.176 in the group were it was not usual practice. The overall index was 0.184. There is wide interobserver variability in the therapeutic indication, as well as within the surgical indication. Discussion The level of agreement obtained, according to the criteria of Landis and Koch, was poor in all groups in terms of stage, and weak in terms of treatment. The experience of the Traumatologist had no influence. A more reproducible classification may be necessary since Neer's classification has sufficient interobserver variability to accept it as the sole means of decision making.

Interobserver agreement in breast ultrasound categorization in the Mammography and Ultrasonography Study for Breast Cancer Screening Effectiveness (MUST-BE) trial: results of a preliminary study

PURPOSE: The purpose of this study was to record and evaluate interobserver agreement as quality control for the modified categorization of screening breast ultrasound developed by the Alliance for Breast Cancer Screening in Korea (ABCS-K) for the Mammography and Ultrasonography Study for Breast Cancer Screening Effectiveness (MUST-BE) trial. METHODS: Eight breast radiologists with 4-16 years of experience participated in 2 rounds of quality control testing for the MUST-BE trial. Two investigators randomly selected 125 and 100 cases of breast lesions with different ratios of malignant and benign lesions. Two versions of the modified categorization were tested. The initially modified classification was developed after the first quality control workshop, and the re-modified classification was developed after the second workshop. The re-modified categorization established by ABCS-K added size criteria and the anterior-posterior ratio compared with the initially modified classification. After a brief lecture on the modified categorization system prior to each quality control test, the eight radiologists independently categorized the lesions using the modified categorization. Interobserver agreement was measured using kappa statistics. RESULTS: The overall kappa values for the modified categorizations indicated moderate to substantial degrees of agreement (initially modified categorization and re-modified categorization: κ=0.52 and κ=0.63, respectively). The kappa values for the subcategories of category 4 were 0.37 (95% confidence interval [CI], 0.24 to 0.52) and 0.39 (95% CI, 0.31 to 0.49), respectively. The overall kappa values for both the initially modified categorization and the re-modified categorization indicated a substantial degree of agreement when dichotomizing the interpretation as benign or suspicious. CONCLUSION: The preliminary results demonstrated acceptable interobserver agreement for the modified categorization.

Large Variation in Clinical Practice amongst Pediatricians in Treating Children with Recurrent Abdominal Pain / 대한소아소화기영양학회지

PURPOSE: To evaluate intra- and inter-observer variability and guideline adherence amongst pediatricians in treating children aged between 4 and 18 years referred with recurrent abdominal pain (RAP) without red flags. METHODS: The first part of the study is a retrospective single-center cohort study. The diagnostic work-ups of eight pediatricians were compared to the national guidelines. Intra- and inter-observer variability were examined by Cramer's V test. Intra-observer variability was defined as the amount of variation within a pediatrician and inter-observer variability as the amount of variation between pediatricians in the application of diagnostic work-up in children with RAP. Prospectively, the same pediatricians were requested to provide a report on their management strategy with a fictitious case to prove similarities in retrospective diagnostic work-up. RESULTS: A total of 10 patients per pediatrician were analyzed. Retrospectively, a (very) weak association between pediatricians' diagnostic work-ups was found (0.22), which implies high inter-observer variability. The association between intra-observer diagnostic was moderate (range, 0.35–0.46). The Cramer's V of 0.60 in diagnostic work-up between pediatricians in the fictitious case implied the presence of a moderately strong association and lower inter-observer variability than in the retrospective study. Adherence to the guideline was 66.8%. CONCLUSION: We found a high intra- and inter-observer variability and moderate guideline adherence in daily clinical practice amongst pediatricians in treating children with RAP in a teaching hospital.

Consultoria em patologia cirúrgica mamária: variabilidade interobservador no diagnóstico de lesões proliferativas intraductais atípicas / Consultation in breast surgical pathology: interobserver diagnostic variability of atypical intraductal proliferative lesions

OBJETIVO: Avaliar a concordância nos diagnósticos histopatológicos de lesões mamárias proliferativas intraductais entre patologistas gerais e especialistas em patologia mamária. MÉTODOS: Trata-se de estudo observacional e transversal, com análise de 209 lesões encaminhadas ao Laboratório de Patologia Mamária da Faculdade de Medicina da Universidade Federal de Minas Gerais para consultoria, no período de 2007 a 2011, comparando os diagnósticos originais com os após a revisão. Foram incluídos apenas os casos com solicitação formal de revisão e que apresentavam diagnóstico histopatológico no laudo original ou de revisão de lesões proliferativas, carcinoma ductal in situ puro, carcinoma ductal in situ com microinvasão ou associado a carcinoma invasor. A concordância percentual e o índice kappa foram utilizados para a análise estatística. RESULTADOS: Observamos moderada concordância nos diagnósticos originais de benignidade ou malignidade versus os diagnósticos de revisão (kappa=0,5; concordância percentual=83%). Após a revisão, o diagnóstico de malignidade foi confirmado em 140/163 casos (86%) e o diagnóstico de benignidade foi confirmado em 34/46 casos (74%). Quanto aos diagnósticos específicos, observamos concordância moderada entre o laudo original e de revisão (136/209 casos; kappa=0,5; concordância percentual=65%). A maior discordância foi observada nos casos de carcinoma ductal in situ com microinvasão (6/6 casos; 100%). Grande discordância foi observada nos casos de hiperplasia ductal atípica (16/30 casos; 53%) e carcinoma ductal in situ (25/75 casos; 33%). Em relação ao grau histológico do carcinoma ductal in situ, observou-se boa concordância entre os laudos originais e de revisão (29/39 casos; kappa=0,6; concordância percentual=74%). CONCLUSÃO: Nossos dados confirmam que as lesões mamárias proliferativas intraductais, em especial as hiperplasias ductais atípicas, o carcinoma ductal in situ e o carcinoma ductal in situ com microinvasão apresentam relevantes discordâncias nos diagnósticos histopatológicos, que podem induzir o clínico a erros nas decisões terapêuticas.

PURPOSE: To evaluate the agreement about the histopathological diagnosis of intraductal proliferative breast lesions between general pathologists and a specialist in breast pathology. METHODS: This was an observational, cross-sectional study of 209 lesions received in consultation at the Breast Pathology Laboratory of the School of Medicine, Federal University of Minas Gerais, from 2007 to 2011, comparing the original diagnosis and the review. We included only cases with a formal request for review and cases in which the original diagnosis or reviewer's diagnosis showed proliferative lesions, pure ductal carcinoma in situ, ductal carcinoma in situ associated with microinvasion or associated with invasive carcinoma. The kappa index and percent concordance were used in the statistical analyses. RESULTS: A moderate agreement was observed between the original histopathological diagnosis and the second opinion (kappa=0.5; percentual concordance=83%). After the review, the diagnosis of malignancy was confirmed in 140/163 cases (86%) and the diagnosis of benign lesions was confirmed in 34/46 cases (74%). Regarding specific diagnosis, we observed moderate agreement between the original diagnosis and the reviewer's diagnosis (136/209 cases; kappa=0.5; percent concordance=65%). The highest disagreement was observed in cases of ductal carcinoma in situ with microinvasion (6/6 cases; 100%). Important discordance was observed in cases of atypical ductal hyperplasia (16/30 cases; 53%) and ductal carcinoma in situ (25/75 cases; 33%). Regarding the histological grade of ductal carcinoma in situ, we observed good agreement between the original diagnosis and the review (29/39 cases; kappa=0.6, percent agreement=74%). CONCLUSION: Our data confirm that intraductal proliferative breast lesions, especially atypical ductal hyperplasia, ductal carcinoma in situ and ductal carcinoma in situ with microinvasion show relevant discrepancies in the histopathological diagnoses, which may induce errors in therapeutic decisions.

Interobserver Variability in Interpretation of Mammogram

PURPOSE: The purpose of this study was to evaluate the performance of radiologists for mammographic screening, and to analyze interobserver agreement in the interpretation of mammograms. MATERIALS AND METHODS: 50 women were selected as subjects from the patients who were screened with mammograms at two university hospitals. The images were analyzed by five radiologists working independently and without their having any knowledge of the final diagnosis. The interobserver variation was analyzed by using the kappa statistic. RESULTS: There were moderate agreements for the findings of the parenchymal pattern (k=0.44; 95% CI 0.39-0.49), calcification type (k=0.66; 95% CI 0.60-0.72) and calcification distribution (k=0.43; 95% CI 0.38-0.48). The mean kappa values ranged from 0.66 to 0.42 for the mass findings. The mean kappa value for the final conclusion was 0.44 (95% CI 0.38-0.51). In general, moderate agreement was evident for all the categories that were evaluated. CONCLUSION: The general agreement was moderate, but there was wide variability in some findings. To improve the accuracy and reduce variability among physicians in interpretation, proper training of radiologists and standardization of criteria are essential for breast screening.

Interobserver Variability in the Assessment of Coronary Arteriogram: Comparison between Visual and Computer based Quantitative Estimation

BACKGROUND: Conventional visual assessment of coronary arteriogram is fraught with large interobserver variance and disagreement with pathologic findings. Thus quantitative coronary angiography had been recently developed to meet the requirement of more reproducible measurement of severity of coronary artery disease. This study was designed to evaluate the interobserver variability of quantitative coronary angiography and its usefulness in clinical application. METHODS: Three independent observers analysed coronary angiogram of 31 consecutive patients by visual assessment and quantitative measurement using computer based algorithm. RESULTS: 1) There was considerable disagreement between 3 observers in the identification of significant coronary stenosis. Complete agreement was achieved in only 29/61 (47%) coronary lesion and agreement of more than 2 observers in 41/61(67%) lesion. 2) In visual assessment, the largest interobserver variance was found in acute marginal artery and distal circumflex artery, whereas the least variance was observed in proximal right coronary artery. 3) The average interobserver variance was 13.1% in visual assessment, 14.9% in geometric analysis, and 10.5% in video densitometric analysis. There was no significant difference between these values. 4) Visual assessment was noted to overestimate the severity of stenotic lesion, by 5.6% compared to geometric analysis and by 11.8% compared to video-densitometric analysis. CONCLUSION: These findings suggest that identifying significant lesion is major source of interobserve variability in both visual and quantitative analysis of coronary arteriogram. In addition, suboptimal image quality was responsible for the inability of quantitative analysis to reduce the variance. These factors seem to be major limitation of quantitative coronary arterirogam.