Strong-SLAM: real-time RGB-D visual SLAM in dynamic environments based on StrongSORT

作者：Wei Huang, Chunlong Zou, Juntong Yun, Du Jiang, Li Huang, Ying Liu, Guo Zhang Jiang, Yuanmin Xie · 发表于：Measurement Science and Technology · 年份：2024 · DOI：10.1088/1361-6501/ad7a11 · 被引用次数：4 · 研究领域：Robotics and Sensor-Based Localization、Robotic Path Planning Algorithms、Robotics and Automated Systems

Abstract The assumptions of a static environment and scene rigidity are important theoretical underpinnings of traditional visual simultaneous localization and mapping (SLAM) algorithms. However, these assumptions are difficult to work in dynamic environments containing non-rigid objects, and cannot effectively handle the characteristics of local areas of non-rigid moving objects, seriously affecting the robustness and accuracy of the SLAM system in localization and mapping. To address these problems, we improved ORB-SLAM3 and proposed a real-time RGB-D visual SLAM framework for dynamic environments based on StrongSORT—Strong-SLAM. First, we combine YOLOv7-tiny with StrongSORT to match the semantic information of dynamic targets. Optical flow and epipolar constraints are then used to initially extract geometric and motion information between adjacent frames. Subsequently, based on an improved adaptive threshold segmentation algorithm and geometric residuals, a background model and a Gaussian residual model are constructed to further extract the geometric information of dynamic targets. Finally, semantic and geometric information are integrated to perform global feature motion level classification, and motion probabilities and optimization weights are defined to participate in global pose estimation and optimization. Experimental results on the publicly available TUM RGB-D dataset show that Strong-SLAM reduces the absolute trajectory error and relative pose error by at least 9...