Multi-source heterogeneous data fusion technology for electric power based on big data mining

作者：Zhongjian Liu, Ruixin Qian, Xianing Jin, Hanlin Zhao, Hongyi Li, Danlei Hu, Hanghai Hu · 发表于：Journal of Computational Methods in Sciences and Engineering · 年份：2024 · DOI：10.1177/14727978241293891 · 被引用次数：14 · 研究领域：Technology and Security Systems、Smart Grid and Power Systems、Advanced Computational Techniques and Applications

With the rapid development of smart grid technology, a large amount of multi-source heterogeneous data has been generated in the power system, and its effective utilization is crucial for the optimization operation, demand prediction, and anomaly detection of the power system. However, the fusion processing of multi-source heterogeneous data faces many challenges, such as inconsistent data format, granularity, and quality, and direct fusion can easily lead to information redundancy and contradictions. A multi-source heterogeneous data fusion technology based on big data mining has been proposed to address the above issues. This method combines the advantages of convolutional neural networks and gated recurrent units to automatically extract features from image and sequence data and handle long-term dependency issues in time series data. Meanwhile, the K-means clustering algorithm is used to preprocess the data and train a specialized ConvGRU model. The results showed that in short-term load forecasting and abnormal electricity consumption behaviour detection tasks, the accuracy of this method reached 96.3% and 98.7%, respectively, with AUC values of 0.994 and 0.996. Compared to models that use only CNN or GRU, the performance is significantly improved. This method effectively solves the problem of integrating and processing multi-source heterogeneous power data, improves the accuracy and efficiency of power system data analysis, and provides strong support for the optimized o...