Masked Face Detection with Illumination Awareness

ABSTRACT

Mask mandate has been applied in many countries in the last two years as a simple but effective way to limit the Covid-19 transmission. Besides the guidance from authorities regarding mask use in public, numerous vision-based approaches have been developed to aid with the monitoring of face mask wearing. Despite promising results have been obtained, several challenges in vision-based masked face detection still remain, primarily due to the insufficient of a quality dataset covering adequate variations in lighting conditions, object scales, mask types, or occlusion levels. In this paper, we investigate the effectiveness of a lightweight masked face detection system under different lighting conditions and the possibility of enhancing its performance with the employment of an image enhancement algorithm and an illumination awareness classifier. A dataset of human subjects with and without face masks in different lighting conditions is first introduced. An illumination awareness classifier is then trained on the collected dataset, the labeling of which is processed automatically based on the difference in detection accuracy when an image enhancement algorithm is taken into account. Experimental results have shown that the combination of the masked face detection system with the illumination awareness and an image enhancement algorithm can boost the system performance to up to 8.6%, 7.4%, and 8.5% in terms of Accuracy, F1-score, and AP-M, respectively. © 2022 IEEE.