Flexible Gait Recognition Based on Flow Regulation of Local Features Between Key Frames

作者：Guoheng Huang, Lu Zeng, Chi‐Man Pun, Lianglun Cheng · 发表于：IEEE Access · 年份：2020 · DOI：10.1109/access.2020.2986554 · 被引用次数：18 · 研究领域：Gait Recognition and Analysis、Human Pose and Action Recognition、Video Surveillance and Tracking Methods

The information contained in gait frames is different, and the contribution of different frames to recognition tasks is also different. However, each frame has the same degree of attention in the input layer, this prevents the network from focusing on keyframes. Therefore, we propose a keyframe extraction module via information weighting, make network can pay more attention to the high contribution frame at the input layer, and the extraction of the distinctive features is improved. Moreover, the range of motion in different parts of the human body is different, the temporal and spatial correlation of local feature between silhouettes is different. Based on the discovery, we propose a Local Features Flow Regulation module to calculate the correlation coefficient of the local features of each silhouette, and the regulation coefficient is generated by the correlation coefficient. The regulation coefficient is applied to regulate the flow of local features, this enables the network to capture areas with more spatial and temporal features. Through the extraction of frame-level features and the interaction of local features between frames, the network can extract the most discriminative features from global to local flexibly. During training, each horizontal part is trained separately. The training can adjust the regulation coefficients, and the network is more flexible and expressive. Our model has a good performance on cross-viewing and complex environments of CASIA-B dataset. I...