Your browser doesn't support javascript.
loading
Interpretive Performance and Inter-Observer Agreement on Digital Mammography Test Sets
Korean Journal of Radiology ; : 218-224, 2019.
Article in English | WPRIM | ID: wpr-741405
ABSTRACT

OBJECTIVE:

To evaluate the interpretive performance and inter-observer agreement on digital mammographs among radiologists and to investigate whether radiologist characteristics affect performance and agreement. MATERIALS AND

METHODS:

The test sets consisted of full-field digital mammograms and contained 12 cancer cases among 1000 total cases. Twelve radiologists independently interpreted all mammograms. Performance indicators included the recall rate, cancer detection rate (CDR), positive predictive value (PPV), sensitivity, specificity, false positive rate (FPR), and area under the receiver operating characteristic curve (AUC). Inter-radiologist agreement was measured. The reporting radiologist characteristics included number of years of experience interpreting mammography, fellowship training in breast imaging, and annual volume of mammography interpretation.

RESULTS:

The mean and range of interpretive performance were as follows recall rate, 7.5% (3.3–10.2%); CDR, 10.6 (8.0–12.0 per 1000 examinations); PPV, 15.9% (8.8–33.3%); sensitivity, 88.2% (66.7–100%); specificity, 93.5% (90.6–97.8%); FPR, 6.5% (2.2–9.4%); and AUC, 0.93 (0.82–0.99). Radiologists who annually interpreted more than 3000 screening mammograms tended to exhibit higher CDRs and sensitivities than those who interpreted fewer than 3000 mammograms (p = 0.064). The inter-radiologist agreement showed a percent agreement of 77.2–88.8% and a kappa value of 0.27–0.34. Radiologist characteristics did not affect agreement.

CONCLUSION:

The interpretative performance of the radiologists fulfilled the mammography screening goal of the American College of Radiology, although there was inter-observer variability. Radiologists who interpreted more than 3000 screening mammograms annually tended to perform better than radiologists who did not.
Subject(s)

Full text: Available Index: WPRIM (Western Pacific) Main subject: Breast / Mammography / Observer Variation / Mass Screening / ROC Curve / Sensitivity and Specificity / Area Under Curve / Fellowships and Scholarships / Medical Audit Type of study: Diagnostic study / Prognostic study / Screening study Language: English Journal: Korean Journal of Radiology Year: 2019 Type: Article

Similar

MEDLINE

...
LILACS

LIS

Full text: Available Index: WPRIM (Western Pacific) Main subject: Breast / Mammography / Observer Variation / Mass Screening / ROC Curve / Sensitivity and Specificity / Area Under Curve / Fellowships and Scholarships / Medical Audit Type of study: Diagnostic study / Prognostic study / Screening study Language: English Journal: Korean Journal of Radiology Year: 2019 Type: Article