Head Pose Estimation in Complex Environment Based on Four-branch Feature Selective Extraction and Regional Information Exchange Fusion Network
IEEE Access
; 2022.
Article
in English
| Scopus | ID: covidwho-1794860
ABSTRACT
Under the severe situation of the COVID-19 pandemic, masks cover most of the effective facial features of users, and their head pose changes significantly in a complex environment, which makes the accuracy of head pose estimation in some systems such as safe driving systems and attention detection systems impossible to guarantee. To this end, we propose a powerful four-branch feature selective extraction network (FSEN) structure, in which three branches are used to extract three independent discriminative features of pose angles, and one branch is used to extract composite features corresponding to multiple pose angles. By reducing the dimension of high-dimensional features, our method significantly reduces the amount of computation while improving the estimation accuracy. Our convolution method is an improved spatial channel dynamic convolution (SCDC) that initially enhances the extracted features. Additionally, we embed a regional information exchange network (RIEN) after each convolutional layer in each branch to fully mine the potential semantic correlation between regions from multiple perspectives and learn and fuse this correlation to further enhance feature expression. Finally, we fuse the independent discriminative features of each pose angle and composite features from the three directions of channel, space, and pixel to obtain perfect feature expression for each pose angle, and then obtain the head pose angle. We conducted extensive experiments on the controlled environment datasets and a self-built real complex environment dataset (RCE) and the results showed that our method outperforms state-of-the-art single-modality methods and performs on par with multimodality-based methods. This shows that our network meets the requirements of accurate head-pose estimation in real complex environments such as complex illumination and partial occlusion. Author
complex environment; Data mining; Feature extraction; four-branch feature selective extraction; Head; Head pose estimation; Information exchange; Magnetic heads; multiple feature fusion; Pose estimation; regional information exchange network; spatial channel dynamic convolution; Three-dimensional displays; Complex networks; Convolution; Extraction; Information dissemination; Semantics; Three dimensional displays; Channel dynamics; Complex environments; Features extraction; Information exchange networks; Information exchanges; Pose-estimation; Regional information; Selective extraction; Spatial channels; Three-dimensional display
Full text:
Available
Collection:
Databases of international organizations
Database:
Scopus
Language:
English
Journal:
IEEE Access
Year:
2022
Document Type:
Article
Similar
MEDLINE
...
LILACS
LIS