Post-hoc simulation study of computerized adaptive testing for the Korean Medical Licensing Examination / 보건의료교육평가
Journal of Educational Evaluation for Health Professions
;
: 14-2018.
Article
in English
| WPRIM
| ID: wpr-764463
ABSTRACT
PURPOSE:
Computerized adaptive testing (CAT) has been adopted in licensing examinations because it improves the efficiency and accuracy of the tests, as shown in many studies. This simulation study investigated CAT scoring and item selection methods for the Korean Medical Licensing Examination (KMLE).METHODS:
This study used a post-hoc (real data) simulation design. The item bank used in this study included all items from the January 2017 KMLE. All CAT algorithms for this study were implemented using the ‘catR’ package in the R program.RESULTS:
In terms of accuracy, the Rasch and 2-parametric logistic (PL) models performed better than the 3PL model. The ‘modal a posteriori’ and ‘expected a posterior’ methods provided more accurate estimates than maximum likelihood estimation or weighted likelihood estimation. Furthermore, maximum posterior weighted information and minimum expected posterior variance performed better than other item selection methods. In terms of efficiency, the Rasch model is recommended to reduce test length.CONCLUSION:
Before implementing live CAT, a simulation study should be performed under varied test conditions. Based on a simulation study, and based on the results, specific scoring and item selection methods should be predetermined.
Full text:
Available
Index:
WPRIM (Western Pacific)
Main subject:
Research Design
/
Logistic Models
/
Korea
/
Licensure
Type of study:
Prognostic study
/
Risk factors
Limits:
Animals
Country/Region as subject:
Asia
Language:
English
Journal:
Journal of Educational Evaluation for Health Professions
Year:
2018
Type:
Article
Similar
MEDLINE
...
LILACS
LIS