Deep Learning-Based Automatic Control of Magnetic Diatom Biohybrid Microrobots for Targeted Delivery

作者：Mengyue Li, Liang Li, Junjian Zhou, Lianqing Liu, Niandong Jiao · 发表于：IEEE Transactions on Robotics · 年份：2025 · DOI：10.1109/tro.2025.3562452 · 被引用次数：11 · 研究领域：Micro and Nano Robotics、Diatoms and Algae Research

Biohybrid microrobots with autonomous movement capabilities have broad application prospects in targeted delivery, attracting researchers to study their movement characteristics. However, its automatic control is still challenging, and exploring real-time detection of its environment for path planning to achieve stable closed-loop control is highly important for its practical application. Here, we applied deep learning for the detection of biohybrid microrobots and their targets and obstacles, followed by real-time path planning and trajectory tracking of biohybrid microrobots for targeted delivery. The proposed detection algorithm introduces attention and multi-scale feature fusion mechanisms in YOLOv7 algorithm (AM-YOLOv7) with the aim of enhancing the precision of detecting small-scale targets when robots, obstacles and targets are displayed globally, and the detection capabilities are verified through simulations and experiments. The proposed planning algorithm introduces a turning penalty function and a path smoothing strategy into A* algorithm (PS-A*) to make the planned path short and smooth, which has been verified through simulation and experiments. The adaptive fuzzy PID method is used to track the robot's trajectory, and experiments and simulations show that the biohybrid microrobot can move according to the preset trajectory better. The final cell scene experimental results show that the biohybrid microrobot using this system can effectively avoid obstacle cells a...