Multi-Task Load Identification and Signal Denoising via Hierarchical Knowledge Distillation

作者：Jiahao Jiang, Zhelong Wang, Sen Qiu, Xiang Li, Chenming Zhang · 发表于：IEEE Transactions on Network Science and Engineering · 年份：2025 · DOI：10.1109/tnse.2025.3542409 · 被引用次数：3 · 研究领域：Hand Gesture Recognition Systems

Complex neural networks with deep structures are beneficial for solving problems such as load classification in Non-intrusive load monitoring (NILM) due to their powerful feature extraction capabilities. Unfortunately, corresponding complex models designed based on deep learning algorithms require high computational and memory resources. Additionally, the external noise interference during practical load identification poses a challenge. To solve these difficulties with practical industrial significance, this paper proposes a multi-task-knowledge distillation (MTL-KD) framework for NILM. The main contributions within this framework include a new feature extraction method that combines variational mode extraction (VME) and mutual information (MI) to extract unique features and filter out noise interference, an attention-based MTL model to simultaneously perform the load identification and signal de-noising tasks, and new KD modules to transfer knowledge from a complex teacher model to a small student model. Experimental evaluations conducted on public datasets such as the plug-load appliance identification dataset (PLAID) and the worldwide household and industry transient energy dataset (WHITED), as well as a private load dataset collected in the lab, demonstrate that the proposed MTL-KD framework surpasses state-of-the-art approaches.