Quality of multiple-choice questions in medical internship qualification examination determined by item response theory at Debre Tabor University, Ethiopia.

BACKGROUND: Assessment of cognitive competence is a major element of the internship qualification exam in undergraduate medical education in Ethiopia. Assessing the quality of exam items can help to improve the validity of assessments and assure stakeholders about the accuracy of the go/no decision to the internship. However, we know little about the quality of exam items utilized to ascertain fitness to join the medical internship. Therefore, this study aimed to analyze the quality of multiple-choice questions (MCQs) of the qualification exam administered to final-year medical students at Debre Tabor University (DTU), Ethiopia. METHODS: A psychometric study was conducted to assess the qualities of 120 randomly selected MCQs and 407 distractors. Item characteristics were estimated using the item response theory (IRT) model. T-test, one-way ANOVA, and chi-square tests were run to analyze the univariate association between factors. Pearson's correlation test was done to determine the predictive validity of the qualification examination. RESULT: Overall, 16, 51, and 33% of the items had high, moderate, and low distractor efficiency, respectively. About two-thirds (65.8%) of the items had two or more functioning distractors and 42.5% exhibited a desirable difficulty index. However, 77.8% of items administered in the qualification examination had a negative or poor discrimination index. Four and five option items didn't show significant differences in psychometric qualities. The qualification exam showed a positive predictive value of success in the national licensing examination (Pearson's correlation coefficient = 0.5). CONCLUSIONS: The psychometric properties of the medical qualification exam were inadequate for making valid decisions. Five option MCQs were not better than four options in terms of psychometric qualities. The qualification examination had a positive predictive validity of future performance. High-stakes examination items must be properly created and reviewed before being administered.

Quality of Midwife-provided Intrapartum Care in Amhara Regional State, Ethiopia.

BACKGROUND: Despite much progress recently, Ethiopia remains one of the largest contributors to the global burden of maternal and newborn deaths and stillbirths. Ethiopia's plan to meet the sustainable development goals for maternal and child health includes unprecedented emphasis on improving quality of care. The purpose of this study was to assess the quality of midwifery care during labor, delivery and immediate postpartum period. METHODS: A cross-sectional study using multiple data collection methods and a 2-stage cluster sampling technique was conducted from January 25 to February 14, 2015 in government health facilities of the Amhara National Regional State of Ethiopia. Direct observation of performance was used to determine competence of midwives in providing care during labor, delivery, and the first 6 h after childbirth. Inventory of drugs, medical equipment, supplies, and infrastructure was conducted to identify availability of resources in health facilities. Structured interview was done to assess availability of resources and performance improvement opportunities. Data analysis involved calculating percentages, means and chi-square tests. RESULTS: A total of 150 midwives and 56 health facilities were included in the study. The performance assessment showed 16.5% of midwives were incompetent, 72.4% were competent, and 11.1% were outstanding in providing routine intrapartum care. Forty five midwives were observed while managing 54 obstetric and newborn complications and 41 (91%) of them were rated competent. Inventory of resources found that the proportion of facilities with more than 75% of the items in each category was 32.6% for drugs, 73.1% for equipment, 65.4% for supplies, 47.9% for infection prevention materials, and 43.6% for records and forms. Opportunities for performance improvement were inadequate, with 31.3% reporting emergency obstetric and newborn care training, and 44.7% quarterly or more frequent supportive supervision. Health centers fared worse in provider competence, physical resources, and quality improvement practices except for supportive supervision visits and in-service training. CONCLUSIONS: Although our findings indicate most midwives are competent in giving routine and emergency intrapartum care, the major gaps in the enabling environment and the significant proportion of midwives with unsatisfactory performance suggest that the conditions for providing quality intrapartum care are not optimal.