Reactive power optimization via deep transfer reinforcement learning for efficient adaptation to multiple scenarios

作者：Congbo Bi, Di Liu, Lipeng Zhu, Chao Lu, Shiyang Li, Yingqi Tang · 发表于：International Journal of Electrical Power & Energy Systems · 年份：2024 · DOI：10.1016/j.ijepes.2024.110376 · 被引用次数：10 · 研究领域：Microgrid Control and Optimization、Machine Learning and ELM、Smart Grid Energy Management

Fast reactive power optimization policy-making for various operating scenarios is an important part of power system dispatch. Existing reinforcement learning algorithms alleviate the computational complexity in optimization but suffer from the inefficiency of model retraining for different operating scenarios. To solve the above problems, this paper raises a data-efficient transfer reinforcement learning-based reactive power optimization framework. The proposed framework transfers knowledge through two phases: generic state representation in the original scenario and specific dynamic learning in multiple target scenarios. A Q-network structure that separately extracts state and action dynamics is designed to learn generalizable state representations and enable generic knowledge transfer. Supervised learning is applied in specific dynamic learning for extracting unique dynamics from offline data, which improves data efficiency and speeds up knowledge transfer. Finally, the proposed framework is tested on the IEEE 39-bus system and the realistic Guangdong provincial power grid, demonstrating its effectiveness and reliability. • A transfer reinforcement learning-based reactive power optimization is proposed. • General knowledge extraction and transfer enables adaptation to different scenarios. • A deep Q-network structure for extracting general features is adopted. • Supervised learning improves the knowledge transfer efficiency and performance.