Dynamic Gesture Recognition Model Based on Millimeter-Wave Radar With ResNet-18 and LSTM.
Front Neurorobot
; 16: 903197, 2022.
Article
in English
| MEDLINE | ID: covidwho-1879464
ABSTRACT
In this article, a multi-layer convolutional neural network (ResNet-18) and Long Short-Term Memory Networks (LSTM) model is proposed for dynamic gesture recognition. The Soli dataset is based on the dynamic gesture signals collected by millimeter-wave radar. As a gesture sensor radar, Soli radar has high positional accuracy and can recognize small movements, to achieve the ultimate goal of Human-Computer Interaction (HCI). A set of velocity-range Doppler images transformed from the original signal is used as the input of the model. Especially, ResNet-18 is used to extract deeper spatial features and solve the problem of gradient extinction or gradient explosion. LSTM is used to extract temporal features and solve the problem of long-time dependence. The model was implemented on the Soli dataset for the dynamic gesture recognition experiment, where the accuracy of gesture recognition obtained 92.55%. Finally, compare the model with the traditional methods. The result shows that the model proposed in this paper achieves higher accuracy in dynamic gesture recognition. The validity of the model is verified by experiments.
Full text:
Available
Collection:
International databases
Database:
MEDLINE
Language:
English
Journal:
Front Neurorobot
Year:
2022
Document Type:
Article
Affiliation country:
Fnbot.2022.903197
Similar
MEDLINE
...
LILACS
LIS