Multi-Modal Fusion Technology Based on Vehicle Information: A Survey

作者：Xinyu Zhang, Yan Gong, Jianli Lu, Jiayi Wu, Zhiwei Li, Dafeng Jin, Jun Li · 发表于：IEEE Transactions on Intelligent Vehicles · 年份：2023 · DOI：10.1109/tiv.2023.3268051 · 被引用次数：57 · 研究领域：Video Surveillance and Tracking Methods、Autonomous Vehicle Technology and Safety、Advanced Vision and Imaging

Multi-modal fusion is a basic task of autonomous driving system perception, which has attracted many scholars' attention in recent years. The current multi-modal fusion methods mainly focus on camera data and LiDAR data, but pay little attention to the kinematic information provided by the sensors of the vehicle, such as acceleration, vehicle speed, angle of rotation. These information are not affected by complex external scenes, so it is more robust and reliable. In this article, we introduce the existing application fields of vehicle information and the research progress of related methods, as well as the multi-modal fusion methods based on information. We also introduced the relevant information of the vehicle information dataset in detail to facilitate the research as soon as possible. In addition, new future ideas of multi-modal fusion technology for autonomous driving tasks are proposed to promote the further utilization of vehicle information.