Intelligent robotic arm for human pose recognition based on teleoperation system

作者：Mingyue Li, Xiangya Qiu, Simeng Zhu, Zeyu Sheng, Yi Liu, Yuxuan Zhao, Xin Zhao, Ran You, Siyang Wang, Dexue Bi · 发表于：Journal of Physics Conference Series · 年份：2024 · DOI：10.1088/1742-6596/2741/1/012015 · 被引用次数：2 · 研究领域：Hand Gesture Recognition Systems、Human Pose and Action Recognition、Video Surveillance and Tracking Methods

Abstract With the rapid development of skeleton recognition, machine learning and other technologies, we will find that there are great drawbacks in the control of manipulators. Robot teleoperation refers to the inclusion of human operation in the control loop of robot control. When robots deal with complex perception and a large number of tasks, teleoperation is far superior to intelligent programming when making decisions quickly and dealing with extreme situations. The goal of this paper is to build a robotic arm teleoperation system for human motion capture, so as to solve the problems that the control accuracy of the end of the robotic arm is not high and the motion of the robotic arm is greatly affected by the difference between the human arm in the current related research, the master-slave human motion mapping algorithm is designed and extended with machine learning algorithms. We use inertial motion capture to realize teleoperation, so as to avoid the use of the terminal position and orientation control method of the hand controller to form the control command of the remote robot after tedious calculation, and it is convenient for the operator to complete the attitude tracking task in real time. The obtained attitude information has a larger range, higher sensitivity and better dynamic performance.