ABSTRACT
To assess the validity of retrospective medical chart review as a method of classifying prostate-specific antigen (PSA) tests as screening or diagnostic services, we reviewed PSA tests ordered at a university hospital (n = 95). PSA tests were reviewed by four raters: medicine resident (RES), oncologist (ONC), urologist (UR), medicine attending (GM)-and the physician who ordered the PSA test (ATTEND) using predefined standardized criteria. Agreement rates by individual rater and ATTEND were 0.79 (GM), 0.80 (ONC), 0.74 (UR), 0.83 (RES), for a composite percent agreement of 0.79. ATTEND incorrectly classified seven tests; exclusion of these tests raised agreement rates to 0.86 (GM), 0.86 (ONC), 0.80 (UR), 0.90 (RES), for a group composite percent agreement of 0.86. Of note, two raters had higher agreement rates when evaluating screening PSA tests than when evaluating diagnostic PSA tests. Standardized criteria applied to medical charts provide a valid method of retrospectively classifying PSA tests.