Inter-rater and intra-rater reliability and agreement of echocardiographic diagnosis of rheumatic heart disease using the World Heart Federation evidence-based criteria.

OBJECTIVE: Different definitions have been used for screening for rheumatic heart disease (RHD). This led to the development of the 2012 evidence-based World Heart Federation (WHF) echocardiographic criteria. The objective of this study is to determine the intra-rater and inter-rater reliability and agreement in differentiating no RHD from mild RHD using the WHF echocardiographic criteria. METHODS: A standard set of 200 echocardiograms was collated from prior population-based surveys and uploaded for blinded web-based reporting. Fifteen international cardiologists reported on and categorised each echocardiogram as no RHD, borderline or definite RHD. Intra-rater and inter-rater reliability was calculated using Cohen's and Fleiss' free-marginal multirater kappa (κ) statistics, respectively. Agreement assessment was expressed as percentages. Subanalyses assessed reproducibility and agreement parameters in detecting individual components of WHF criteria. RESULTS: Sample size from a statistical standpoint was 3000, based on repeated reporting of the 200 studies. The inter-rater and intra-rater reliability of diagnosing definite RHD was substantial with a kappa of 0.65 and 0.69, respectively. The diagnosis of pathological mitral and aortic regurgitation was reliable and almost perfect, kappa of 0.79 and 0.86, respectively. Agreement for morphological changes of RHD was variable ranging from 0.54 to 0.93 κ. CONCLUSIONS: The WHF echocardiographic criteria enable reproducible categorisation of echocardiograms as definite RHD versus no or borderline RHD and hence it would be a suitable tool for screening and monitoring disease progression. The study highlights the strengths and limitations of the WHF echo criteria and provides a platform for future revisions.

World Heart Federation criteria for echocardiographic diagnosis of rheumatic heart disease--an evidence-based guideline.

Over the past 5 years, the advent of echocardiographic screening for rheumatic heart disease (RHD) has revealed a higher RHD burden than previously thought. In light of this global experience, the development of new international echocardiographic guidelines that address the full spectrum of the rheumatic disease process is opportune. Systematic differences in the reporting of and diagnostic approach to RHD exist, reflecting differences in local experience and disease patterns. The World Heart Federation echocardiographic criteria for RHD have, therefore, been developed and are formulated on the basis of the best available evidence. Three categories are defined on the basis of assessment by 2D, continuous-wave, and color-Doppler echocardiography: 'definite RHD', 'borderline RHD', and 'normal'. Four subcategories of 'definite RHD' and three subcategories of 'borderline RHD' exist, to reflect the various disease patterns. The morphological features of RHD and the criteria for pathological mitral and aortic regurgitation are also defined. The criteria are modified for those aged over 20 years on the basis of the available evidence. The standardized criteria aim to permit rapid and consistent identification of individuals with RHD without a clear history of acute rheumatic fever and hence allow enrollment into secondary prophylaxis programs. However, important unanswered questions remain about the importance of subclinical disease (borderline or definite RHD on echocardiography without a clinical pathological murmur), and about the practicalities of implementing screening programs. These standardized criteria will help enable new studies to be designed to evaluate the role of echocardiographic screening in RHD control.

Prevalence of rheumatic heart disease in children and young adults in Nicaragua.

Rheumatic heart disease (RHD) results in morbidity and mortality that is disproportionate among individuals in developing countries compared to those living in economically developed countries. The global burden of disease is uncertain because most previous studies to determine the prevalence of RHD in children relied on clinical screening criteria that lacked the sensitivity to detect most cases. The present study was performed to determine the prevalence of RHD in children and young adults in León, Nicaragua, an area previously thought to have a high prevalence of RHD. This was an observational study of 3,150 children aged 5 to 15 years and 489 adults aged 20 to 35 years randomly selected from urban and rural areas of León. Cardiopulmonary examinations and Doppler echocardiographic studies were performed on all subjects. Doppler echocardiographic diagnosis of RHD was based on predefined consensus criteria that were developed by a working group of the World Health Organization and the National Institutes of Health. The overall prevalence of RHD in children was 48 in 1,000 (95% confidence interval 35 in 1,000 to 60 in 1,000). The prevalence in urban children was 34 in 1,000, and in rural children it was 80 in 1,000. Using more stringent Doppler echocardiographic criteria designed to diagnose definite RHD in adults, the prevalence was 22 in 1,000 (95% confidence interval 8 in 1,000 to 37 in 1,000). In conclusion, the prevalence of RHD among children and adults in this economically disadvantaged population far exceeds previously predicted rates. The findings underscore the potential health and economic burden of acute rheumatic fever and RHD and support the need for more effective measures of prevention, which may include safe, effective, and affordable vaccines to prevent the streptococcal infections that trigger the disease.