Interpretation of colposcopy in population-based cervical screening services in north-eastern Italy: an online interregional agreement study.

OBJECTIVE: An innovative web-based colposcopy quality assurance programme was implemented in population-based cervical screening services in three north-eastern Italian administrative regions with different colposcopists' training background. In this study, the levels of intra- and interregional intercolposcopist diagnostic agreement were evaluated. STUDY DESIGN: Of the 158 registered colposcopists, 125 accessed the website of the programme, logged-in, viewed a posted set of 50 digital colpophotographs selected by an expert steering committee, and classified them for the colposcopic impression, the visibility of the squamocolumnar junction, and the need for biopsy. Anonymous data were downloaded and analysed using the crude, or observed, proportion of agreement and the kappa coefficient. RESULTS: There were 113 eligible colposcopists. Overall, crude agreement on the colposcopic impression, the visibility of the squamocolumnar junction, and the need for biopsy was 0.72, 0.72, and 0.87, with kappa values of 0.60, 0.36, and 0.69, respectively. The homologous kappa values were 0.61, 0.41, and 0.69 in one region, 0.57, 0.36, and 0.69 in another, and 0.66, 0.38, and 0.74 in the third. Total intra- and interregional agreement were nearly identical, with kappa values of 0.59 and 0.60 for the colposcopic impression, 0.38 and 0.35 for the visibility of the squamocolumnar junction, and 0.69 and 0.69 for the need for biopsy. The width of 95% confidence intervals around the above kappa values was ≤0.01. CONCLUSIONS: The levels of agreement varied between moderate and substantial both within and between regions. Regional differences in training background had minor effects. The interpretation of colposcopy is potentially well-reproducible.

Accuracy of Colposcopically Directed Biopsy: Results from an Online Quality Assurance Programme for Colposcopy in a Population-Based Cervical Screening Setting in Italy.

PURPOSE: To report the accuracy of colposcopically directed biopsy in an internet-based colposcopy quality assurance programme in northern Italy. METHODS: A web application was made accessible on the website of the regional Administration. Fifty-nine colposcopists out of the registered 65 logged in, viewed a posted set of 50 digital colpophotographs, classified them for colposcopic impression and need for biopsy, and indicated the most appropriate site for biopsy with a left-button mouse click on the image. RESULTS: Total biopsy failure rate, comprising both nonbiopsy and incorrect selection of biopsy site, was 0.20 in CIN1, 0.11 in CIN2, 0.09 in CIN3, and 0.02 in carcinoma. Errors in the selection of biopsy site were stable between 0.08 and 0.09 in the three grades of CIN while decreasing to 0.01 in carcinoma. In multivariate analysis, the risk of incorrect selection of biopsy site was 1.97 for CIN2, 2.52 for CIN3, and 0.29 for carcinoma versus CIN1. CONCLUSIONS: Although total biopsy failure rate decreased regularly with increasing severity of histological diagnosis, the rate of incorrect selection of biopsy site was stable up to CIN3. In multivariate analysis, CIN2 and CIN3 had an independently increased risk of incorrect selection of biopsy site.

An online quality assurance program for colposcopy in a population-based cervical screening setting in Italy: results on colposcopic impression.

OBJECTIVE: To report the results of an Internet-based colposcopy quality assurance program from a population-based cervical screening service in a large region of northern Italy. METHODS: In 2010 to 2011, a Web application was made accessible on the Web site of the regional administration. Fifty-nine colposcopists of the registered 65 participated. They logged-in, viewed a posted set of 50 high-quality digital colpophotographs selected by an expert committee, and rated them for colposcopic impression using a 4-tier classification (Negative; abnormal, grade 1 [G1]; abnormal, grade 2 [G2]; suspected invasive cancer [Cancer]) derived from the International Federation for Cervical Pathology and Colposcopy 2002 classification. kappa (κ) coefficients for intercolposcopist agreement and colposcopist-committee agreement were calculated. RESULTS: Colposcopist-committee agreement was greater than intercolposcopist agreement (overall κ 0.69 vs 0.60, p<.001). The κ values for colposcopist-committee agreement were 0.83 on Negative, 0.53 on G1, 0.66 on G2, and 0.80 on Cancer (all p values for pairwise comparisons<.001, except for Negative vs Cancer [p=.078]). There was no systematic tendency for colposcopists to underestimate or overestimate the colposcopic findings (2-tailed sign test, p=.13). Overall colposcopist-committee agreement was greater among patients 35 years or older (p<.001) and for colposcopists with previous quality assurance experiences (p<.01). Only 0.2% of Negative impressions were formulated for a cervical intraepithelial neoplasia grade 2 or worse. As a parallel finding, the impression of Cancer predicted cervical intraepithelial neoplasia grade 2 or less in 0.5% of cases. The histologic substrates of G1 were dispersed over a large spectrum. CONCLUSIONS: The reproducibility of colposcopic impression, when classified by trained colposcopists examining high-quality images, is higher than is generally thought.

Rationale and development of an on-line quality assurance programme for colposcopy in a population-based cervical screening setting in Italy.

BACKGROUND: Colposcopy, the key step in the management of women with abnormal Pap smear results, is a visual technique prone to observer variation, which implies the need for prolonged apprenticeship, continuous training, and quality assurance (QA) measures. Colposcopy QA programmes vary in level of responsibility of organizing subjects, geographic coverage, scope, model, and type of actions. The programmes addressing the clinical standards of colposcopy (quality of examination and appropriateness of clinical decisions) are more limited in space and less sustainable over time than those focused on the provision of the service (resources, accessibility, etc.). This article reports on the protocol of a QA programme targeting the clinical quality of colposcopy in a population-based cervical screening service in an administrative region of northern Italy. METHODS/DESIGN: After a situation analysis of local colposcopy audit practices and previous QA initiatives, a permanent web-based QA programme was developed. The design places more emphasis on providing education and feedback to participants than on testing them. The technical core is a log-in web application accessible on the website of the regional Administration. The primary objectives are to provide (1) a practical opportunity for retraining of screening colposcopists, and (2) a platform for them to interact with colposcopists from other settings and regions through exchange and discussion of digital colposcopic images. The retraining function is based on repeated QA sessions in which the registered colposcopists log-in, classify a posted set of colpophotographs, and receive on line a set of personal feedback data. Each session ends with a plenary seminar featuring the presentation of overall results and an interactive review of the test set of colpophotographs. This is meant to be a forum for an open exchange of views that may lead to more knowledge and more diagnostic homogeneity. The protocol includes the criteria for selection of colpophotographs and the rationale for colposcopic gold standards. DISCUSSION: This programme is an ongoing initiative open to further developments, in particular in the area of basic training. It uses the infrastructure of the internet to give a novel solution to technical problems affecting colposcopy QA in population-based screening services.

Difference in overall and age-specific prevalence of high-risk human papillomavirus infection in Italy: evidence from NTCC trial.

BACKGROUND: Although among women a decreasing prevalence of human papillomavirus (HPV) infection with increasing age has been consistently observed in high-resource countries, different age profiles have been reported elsewhere. METHODS: We compared the age profile of high-risk (HR)-HPV prevalence in nine different areas of Northern and Central Italy by studying the women recruited in the intervention arm of the New Technologies in Cervical Cancer study and tested by Hybrid Capture 2. Differences in the age-distribution of HPV infection were investigated in each centre by the joinpoint approach in a logistic model. 46,900 women aged 25 to 60 years were included in the analysis. RESULTS: The HR-HPV age-standardised (on Italian population) prevalence ranged from 5.7% (Trento) to 10.3% (Ravenna). HR-HPV prevalence decreased as a logistic function of increasing age in 6 of 9 centres (Trento, Verona, Florence, Bologna, Imola, and Viterbo). The effect of age on HR-HPV prevalence slopes did not differ significantly among these 6 centres, whereas significant heterogeneity in intercepts (p < 0.001) was found, reflecting different overall HR-HPV prevalence between centres. One significant joinpoint was observed in 2 centres (Padua and Ravenna), indicating that the decrease in HR-HPV prevalence by age was better described using a function composed with two logistic segments. In Padua HR-HPV prevalence decreased only slightly up to 39 years but showed a steep downturn thereafter. In Ravenna HR-HPV prevalence decreased steeply down to 45 years of age and then showed a plateau. Finally, in Turin two significant joinpoints were observed: prevalence decreased only after age 29 and showed a plateau after age 39. CONCLUSIONS: Our results showed substantial differences in overall and age-specific HR-HPV prevalence across Italian areas. These findings may be related to different timing of changes in sexual behaviours across regions. Age-specific HR-HPV prevalence in Italy does not support an influence of age per se.

Efficacy of human papillomavirus testing for the detection of invasive cervical cancers and cervical intraepithelial neoplasia: a randomised controlled trial.

BACKGROUND: Human papillomavirus (HPV) testing is known to be more sensitive, but less specific than cytology for detecting cervical intraepithelial neoplasia (CIN). We assessed the efficacy of cervical-cancer screening policies that are based on HPV testing. METHODS: Between March, 2004, and December, 2004, in two separate recruitment phases, women aged 25-60 years were randomly assigned to conventional cytology or to HPV testing in combination with liquid-based cytology (first phase) or alone (second phase). Randomisation was done by computer in two screening centres and by sequential opening of numbered sealed envelopes in the remaining seven centres. During phase one, women who were HPV-positive and aged 35-60 years were referred to colposcopy, whereas women aged 25-34 years were referred to colposcopy only if cytology was also abnormal or HPV testing was persistently positive. During phase two, women in the HPV group were referred for colposcopy if the HPV test was positive. Two rounds of screening occurred in each phase, and all women had cytology testing only at the second round. The primary endpoint was the detection of grade 2 and 3 CIN, and of invasive cervical cancers during the first and second screening rounds. Analysis was done by intention to screen. This trial is registered, number ISRCTN81678807. FINDINGS: In total for both phases, 47,001 women were randomly assigned to the cytology group and 47,369 to HPV testing. 33,851 women from the cytology group and 32,998 from the HPV-testing group had a second round of screening. We also retrieved the histological diagnoses from screening done elsewhere. The detection of invasive cervical cancers was similar for the two groups in the first round of screening (nine in the cytology group vs seven in the HPV group, p=0.62); no cases were detected in the HPV group during round two, compared with nine in the cytology group (p=0.004). Overall, in the two rounds of screening, 18 invasive cancers were detected in the cytology group versus seven in the HPV group (p=0.028). Among women aged 35-60 years, at round one the relative detection (HPV vs cytology) was 2.00 (95% CI 1.44-2.77) for CIN2, 2.08 (1.47-2.95) for CIN3, and 2.03 (1.60-2.57) for CIN2 and 3 together. At round two the relative detection was 0.54 (0.23-1.28) for CIN2, 0.48 (0.21-1.11) for CIN3, and 0.51 (0.28-0.93) for CIN2 and 3 together. Among women aged 25-34 years, there was significant heterogeneity between phases in the relative detection of CIN3. At round one the relative detection was 0.93 (0.52-1.64) in phase one and 3.91 (2.02-7.57) in phase two. At round two the relative detection was 1.34 (0.46-3.84) in phase one and 0.20 (0.04-0.93) in phase two. Pooling both phases, the detection ratio of CIN2 for women aged 25-34 years was 4.09 (2.24-7.48) at round one and 0.64 (0.23-1.27) at round two. INTERPRETATION: HPV-based screening is more effective than cytology in preventing invasive cervical cancer, by detecting persistent high-grade lesions earlier and providing a longer low-risk period. However, in younger women, HPV screening leads to over-diagnosis of regressive CIN2. FUNDING: European Union, Italian Ministry of Health, Regional Health Administrations of Piemonte, Tuscany, Veneto and Emilia-Romagna, and Public Health Agency of Lazio.

Results at recruitment from a randomized controlled trial comparing human papillomavirus testing alone with conventional cytology as the primary cervical cancer screening test.

BACKGROUND: In the first recruitment phase of a randomized trial of cervical cancer screening methods (New Technologies for Cervical Cancer Screening [NTCC] study), we compared screening with conventional cytology with screening by human papillomavirus (HPV) testing in combination with liquid-based cytology. HPV-positive women were directly referred to colposcopy if aged 35 or older; if younger, they were retested after 1 year. METHODS: In the second recruitment phase of NTCC, we randomly assigned women to conventional cytology (n = 24,661) with referral to colposcopy if cytology indicated atypical squamous cells of undetermined significance or more severe abnormality or to testing for high-risk HPV DNA alone by Hybrid Capture 2 (n = 24,535) with referral to colposcopy if the test was positive at a concentration of HPV DNA 1 pg/mL or greater. For the main endpoint of the study, histologic detection of cervical intraepithelial neoplasia of grade 2 or more (CIN2+), we calculated and compared sensitivity and positive predictive value (PPV) of the two screening methods using HPV DNA cutoffs of 1 pg/mL and 2 pg/mL. All statistical tests were two-sided. RESULTS: For women aged 35-60 years, the relative sensitivity of HPV testing for detection of CIN2+ at a cutoff of 1 pg/mL vs conventional cytology was 1.92 (95% CI = 1.28 to 2.87) and the relative PPV was 0.80 (95% CI = 0.55 to 1.18). At a cutoff of 2 pg/mL HPV DNA, the relative sensitivity was 1.81 (95% CI = 1.20 to 2.72) and the relative PPV was 0.99 (95% CI = 0.67 to 1.46). In this age group, there was no evidence of heterogeneity between study phases. Among women aged 25-34 years, the relative sensitivity for detection of CIN2+ of HPV testing at a cutoff of 1 pg/mL vs cytology was 3.50 (95% CI = 2.11 to 5.82), statistically significantly larger (P = .019) than that observed in phase 1 at this age (1.58; 95% CI = 1.03 to 2.44). CONCLUSIONS: For women aged 35-60 years, HPV testing with a cutoff of 2 pg/mL achieves a substantial gain in sensitivity over cytology with only a small reduction in PPV. Among women aged 25-34 years, the large relative sensitivity of HPV testing compared with conventional cytology and the difference between relative sensitivity during phases 1 and 2 suggests that there is frequent regression of CIN2+ that are detected by direct referral of younger HPV-positive women to colposcopy. Thus, triage test or repeat testing is needed if HPV is to be used for primary testing in this context.

Follow-up of screening patients conservatively treated for cervical intraepithelial neoplasia grade 2-3.

OBJECTIVES: To evaluate the frequency and correlates of non-adherence to follow-up among patients conservatively treated for CIN2-3. STUDY DESIGN: Study population comprised 1560 patients aged 25-64 years from a screening programme in northern Italy. The regional standard protocol was used as a reference. Multinomial logistic regression analysis was used to estimate the odds ratio probability of a patient being lost to follow-up (no check-ups within 27 months of treatment) or incompletely followed-up (1-3 negative check-ups) versus having 4 negative check-ups. RESULTS: Three hundred twenty-six patients (21%) were lost to follow-up, 678 (43%) were incompletely followed-up, 352 (23%) presented for 4 negative check-ups and 204 (13%) were diagnosed with persistent disease. The probability of no or incomplete follow-up was greater for patients who lived in the urban district, who were treated in private settings (versus screening centres), who exhibited a visibile squamocolumnar junction on pre-treatment colposcopy, who were treated with cold knife excision and local destructive therapy (versus loop diathermy excision), and whose surgical specimens had positive excision margins. CONCLUSIONS: Adherence to the reference protocol was poor. Factors involved in follow-up failures require greater clinical attention.

Human papillomavirus testing and liquid-based cytology in primary screening of women younger than 35 years: results at recruitment for a randomised controlled trial.

BACKGROUND: Testing for human papillomavirus (HPV) DNA is more sensitive but less specific than cytological analysis. Loss in specificity is most relevant in women younger than 35 years because of increased HPV prevalence. We aimed to compare conventional screening with an experimental strategy in women aged 25-34 years, and investigate the effect of different criteria of referral to define the best methods of HPV screening. METHODS: Women were randomly assigned to the conventional procedure (standard cytology, with referral to colposcopy if cytology showed atypical squamous cells of undetermined significance or more [ASCUS+]) or an experimental procedure (liquid-based cytology and testing for high-risk HPV types, with referral to colposcopy with ASCUS+ cytology). Women positive for HPV (cutoff > or = 1 pg/mL) but with normal cytology were retested after 1 year. The main endpoint was the presence of cervical intraepithelial neoplasia at grade 2 or more (CIN2+) in reviewed histology. The main analysis was by intention to screen. This trial is registered as an International Standard Randomised Controlled Trial, number ISRCTN81678807. FINDINGS: We randomly assigned 5808 women aged 25-34 years to the conventional group and 6002 to the experimental group. The experimental procedure was significantly more sensitive than the conventional procedure (55 vs 33 CIN2+ lesions detected; relative sensitivity 1.61 [95% CI 1.05-2.48]), but had a lower positive predictive value (PPV; relative PPV 0.55 [0.37-0.82]). HPV testing (> or = 1 pg/mL) with cytology triage was also more sensitive than conventional cytology (relative sensitivity 1.58 [1.03-2.44], relative PPV 0.78 [0.52-1.16]). Relative PPV could be improved, with minimum loss in sensitivity, by use of a 2 pg/mL cutoff for HPV testing. Compared with conventional cytology, liquid-based cytology had a relative sensitivity of 1.32 (0.84-2.06), relative PPV 0.58 [0.38-0.89]). INTERPRETATION: HPV testing alone with cytology triage could be a feasible alternative to conventional cytology for screening women younger than 35 years. Follow-up will provide data on possible overdiagnosis and on the feasibility of extended intervals.

Human papillomavirus testing and liquid-based cytology: results at recruitment from the new technologies for cervical cancer randomized controlled trial.

BACKGROUND: Although testing for human papillomavirus (HPV) has higher sensitivity and lower specificity than cytology alone for detecting cervical intraepithelial neoplasia (CIN), studies comparing conventional and liquid-based cytology have had conflicting results. METHODS: In the first phase of a two-phase multicenter randomized controlled trial, women aged 35-60 years in the conventional arm (n = 16,658) were screened using conventional cytology, and women in the experimental arm (n = 16,706) had liquid-based cytology and were tested for high-risk HPV types using the Hybrid Capture 2 assay. Women in the conventional arm were referred to colposcopy with atypical cells of undetermined significance (ASCUS) or higher and those in the experimental arm were referred with ASCUS or higher cytology or with a positive (> or = 1 pg/mL) HPV test. Sensitivity and positive predictive value (PPV) for detection of cervical intraepithelial neoplasia grade 2 or higher (CIN2+) were calculated. RESULTS: The screening methods and referral criterion applied in the experimental arm had higher sensitivity than that in the conventional arm (relative sensitivity = 1.47; 95% confidence interval [CI] = 1.03 to 2.09) but a lower PPV (relative PPV = 0.40; 95% CI = 0.23 to 0.66). With HPV testing alone at > or = 1 pg/mL and at > or = 2 pg/mL, the gain in sensitivity compared with the conventional arm remained similar (relative sensitivity = 1.43, 95% CI = 1.00 to 2.04 and relative sensitivity = 1.41, 95% CI = 0.98 to 2.01, respectively) but PPV progressively improved (relative PPV = 0.58, 95% CI = 0.33 to 0.98 and relative PPV = 0.75, 95% CI = 0.45 and 1.27, respectively). Referral based on liquid-based cytology alone did not increase sensitivity compared with conventional cytology (relative sensitivity = 1.06; 95% CI = 0.72 to 1.55) but reduced PPV (relative PPV = 0.57; 95% CI = 0.39 to 0.82). CONCLUSIONS: HPV testing alone was more sensitive than conventional cytology among women 35-60 years old. Adding liquid-based cytology improved sensitivity only marginally but increased false-positives. HPV testing using Hybrid Capture 2 with a 2 pg/mL cutoff may be more appropriate than a 1 pg/mL cutoff for primary cervical cancer screening.