关键词: 卷积神经网络, 长短期记忆网络, 动态手势识别, 空时特征提取, 在线数据增强

Abstract: Aiming at the existing 3D convolution method of dynamic gesture recognition with large number of computational parameters, it is difficult to extract 2D convolution of long-time-series images in terms of time dimension. In this paper, a gesture recognition method based on the combination of 2D convolutional neural network and long and short term memory network is proposed. Firstly, spatial features are extracted based on 2D convolutional neural network, and then features in time dimension are extracted by interrelation of sequential images through long and short term memory network. In order to verify the validity of the algorithm in this paper, using the acquisition of 7 kinds of dynamic hand gestures and IsoGD public data sets to verify this proposed algorithm, the experimental results show that under using online enhancement algorithm the paper in the collection on a set of dynamic hand gestures recognition rate reached 87.14%, IsoGD public data sets on recognition rate of 57.89%, compared with the existing method, the recognition rate is improved.

Key words: convolutional neural network, long and short term memory network, dynamic gesture recognition, space-time feature extraction, online data enhancement