Joint graph convolution networks and transformer for human pose estimation in sports technique analysis

作者：Hongren Cheng, Jing Wang, Anran Zhao, Yaping Zhong, Jingli Li, Liangshan Dong · 发表于：Journal of King Saud University - Computer and Information Sciences · 年份：2023 · DOI：10.1016/j.jksuci.2023.101819 · 被引用次数：12 · 研究领域：Human Pose and Action Recognition、Video Surveillance and Tracking Methods、Anomaly Detection Techniques and Applications

Human pose estimation has various applications in domains such as sports technology analysis, virtual reality, and education. However, most previous studies focused on the respective feature representations of keypoints, but disregarded the topological relationship among keypoints. To address this challenge, we propose GTPose, a network structure that integrates graph convolutional networks and Transform. First of all, a set of multi-scale convolution operations are applied to extract local feature maps of images. Secondly, the positions of keypoints are roughly estimated by using Transform to process the sequential relations between feature maps. Finally, GCN is adopted to model the topological structure between keypoints to accurately locate the location of keypoints and learn feature representations. The performance of GTPose is evaluated on two real datasets: MS COCO and MPII. Experimental results demonstrate that GTPose outperforms other methods in human pose estimation tasks. In addition, experimental results also show that the spatial relationship between keypoints is effective for accurately characterizing keypoints.