Quality Evaluation of Image Dataset based on Label File

ABSTRACT

The quality of the dataset affects the accuracy of the artificial intelligence model, but it is a lot of work to manually detect errors related to the quality evaluation of the dataset, and it may not be possible to perform quality evaluation through simple viewing. Therefore, we propose an image dataset quality measurement model, including nine evaluation metrics, and analyze the evaluation metrics from three aspects definition, calculation formula and description. Based on the label file, the quality of the dataset file and the content of the dataset is evaluated, and the evaluation standard is given to judge whether the quality of the dataset is qualified. The measurement model and evaluation criteria proposed in this article were verified against the Cifar-10 dataset and the COVID-CT dataset, and the problems of label accuracy and label category imbalance were found, which proved the effectiveness of the method in this paper. © 2021 IEEE.