Estimation of Knowledge Level with A-, K- and X-Type Multiple-Choice Questions / 医学教育

ABSTRACT

With multiple-choice questions presenting one, two, or three of five choices (types A, K or X), the expected probability of a correct answer (P) can be obtained with a five-dimensional equation for the knowledge level (q), which is the probability of discriminating correct and incorrect items. From equations for each question type, we inversely estimated the q value (the estimated knowledge level), replacing P with the raw score rate in the actual examinations for promotion. The distribution and mean value of the raw score rate of type X differed from those for types A and K. However, distributions of estimated q values for the three question types were similar. This method can be used to estimate the actual knowledge level of students without the question type affecting the raw score but cannot be used to estimate incorrect knowledge.