Rapid evaluation methods (REM) of health services performance: methodological observations

The rapid evaluation method (REM) was developed by WHO in order to assess the performance and quality of health care services, identify operational problems, and assist in taking managerial action. It was tested in five developing countries (Botswana, Madagascar, Papua New Guinea, Uganda and Zambia) between 1988 and 1991. REM consists of a set of observation- and survey-based diagnostic activities, carried out mainly in health care facilities. The article describes the various steps of REM, methodological issues such as setting objectives and using an issue-information matrix, preparation of survey instruments, use of computer software (Epi Info), data quality control, fieldwork, and the use of data to produce useful information for decision-makers. REM aims at bringing prompt and relevant information to planners and decision-makers who need it for a specific purpose. In the present examples, REM provided information for preparing a programme proposal for external funding, for establishing baseline data for a situation analysis, and for assessing staff performance after extensive training in order to improve the curriculum

A vaccination survey using the EPI methodology to evaluate the impact of a child health outreach programme in an urban area of South Africa

A community-based survey of the vaccination status of children aged 12-23 months was conducted to evaluate the impact of a child health outreach programme on vaccination coverage in Alexandra township, South Africa. The EPI cluster sampling technique was adapted for this purpose. The sample size, including the number of clusters and the number of units per cluster, was increased to permit stratification of the data and comparison of the results with those obtained in a study conducted prior to the introduction of the outreach services in 1988. At the time of the survey interview, 67% of the children were fully vaccinated (78% against measles) and by 1 year of age, 58% were fully vaccinated (69% against measles). The increase in coverage since the introduction of the programme was statistically significant only for measles (Student's t-test, P < 0.01). A total of 75% of children living in formal dwellings, compared with 51% living in informal dwellings, were fully vaccinated by interview (Fisher's exact test, two tailed, P < 0.0001). Mothers from informal dwellings had a 1.88 times greater chance of not knowing about the outreach services (P < 0.001). Children whose mothers knew where vaccinations were given, attended postnatal clinics, used the outreach services, possessed a road-to-health card from the Alexandra Health Centre, and who resided in a formal dwelling all had a higher chance of being vaccinated