PrFu-YOLO: A Lightweight Network Model for UAV-Assisted Real-Time Vehicle Detection Toward an IoT Underlayer

作者：Zijian Tian, Haishun Liu, Jiaqi Wu, Wei Chen, Ruihan Zheng, Zehua Wang · 发表于：IEEE Internet of Things Journal · 年份：2024 · DOI：10.1109/jiot.2024.3435130 · 被引用次数：13 · 研究领域：Video Surveillance and Tracking Methods、Advanced Neural Network Applications、UAV Applications and Optimization

With the rapid development of Internet of Things (IoT) and UAV technology, for the whole IoT system of vehicle detection, the middle and high level of information transmission and server processing has made a breakthrough, so at the bottom of the real-time detection of the vehicle by the UAV is the key to the whole system. However, UAV vehicle detection faces the challenges of too many small targets in the image leading to low detection accuracy, limited hardware platform resources requiring control of model size, and real-time detection requiring high inference speed. Aiming at the above problems, we propose a lightweight model PrFu-YOLO based on YOLOv8 improvement, which achieves a good balance between the accuracy, inference speed, and model size. And it realizes real-time vehicle detection embedded in an UAV platform. To solve the problem of low vehicle detection accuracy, we design a new structure PrFuFPN based on adding a small target detection layer to achieve more advanced feature fusion. To address the limited resources of the platform and the problem of real-time vehicle detection, we add GhostConv to the structure and constantly try to adjust the parameters of the network. Finally, extensive experiments were conducted on the VisDrone2019 and CARPK data sets to fully evaluate the model. Compared to YOLOv8s on the VisDrone2019 test set, mAP50 was improved by 10.05%, mA95 by 14.54%, the number of parameters was reduced by 8.13%, and the model size was reduced by 12.5%...