AI-enabled full-body dynamic avatar reconstruction using triboelectric smart clothing for metaverse applications

作者：Chi Zhang, Lei Zhang, Yu Tian, Zhengang An, Bo Hu Li, Dachao Li · 发表于：eScience · 年份：2025 · DOI：10.1016/j.esci.2025.100373 · 被引用次数：22 · 研究领域：Advanced Sensor and Energy Harvesting Materials、Muscle activation and electromyography studies、Non-Invasive Vital Sign Monitoring

Full-body avatar reconstruction offers users immersive and interactive experiences in virtual space, which are crucial for the advancement of metaverse applications. However, traditional hardware solutions, reliant on optical cameras or inertial sensors, are hampered by privacy concerns, spatial limitations, high costs, and calibration challenges. Here, we propose AI-enabled smart clothing that seamlessly integrates triboelectric strain-sensing fibers (TSSFs) and AI algorithms with commercial fitness suits to achieve precise dynamic 3D reconstruction of body movement. TSSFs enable the dynamic capture of body postures and excel in sensitivity, linearity, and strain range, while maintaining mechanical stability, temperature resilience, and washability. The integrated algorithms accurately decouple posture signals — distinguishing between similar postures with the 1D-CNN algorithm, compensating for body-shape differences via a calibration algorithm, and determining spatial elements for avatar reconstruction using a decision-tree algorithm. Finally, leveraging Unity-3D, we achieve ultra-accurate dynamic 3D avatars with a joint angle error of <3.63° and demonstrate their effectiveness using VR fitness and entertainment applications, showing how they can offer users standardized yet engaging experiences. • Flexible triboelectric strain-sensing fibers for smart clothing are fabricated. • Body postures are captured accurately using the resulting wearable smart clothing. • Posture sig...