A Comparative Study on the Operational Effectiveness of Machine Learning Models in Solar Power Forecasting

Manh-Hai Pham1, , Tuan Anh Nguyen1, Minh Phap Vu2, Van Duy Pham2, Thanh Doanh Le1, Thi Anh Tho Vu1, Dang Toan Nguyen1
1 Electric Power University, Ha Noi, Vietnam
2 Institute of Science and Technology for Energy and Environment, Vietnam Academy of Science and Technology, Ha Noi, Vietnam

Main Article Content

Abstract

Accurate solar power forecasting is crucial for optimizing grid operations and balancing energy supply and demand. Due to the high variability of solar radiation, advanced machine learning methods are needed to enhance forecasting accuracy. This study compares three models: Extreme Gradient Boosting (XGBoost), Light Gradient Boosting Machine (LightGBM), and a single-hidden-layer Bidirectional Gated Recurrent Unit (BiGRU). XGBoost and LightGBM are decision tree-based boosting models known for fast training and high accuracy, while BiGRU is a recurrent neural network designed for time-series data but prone to overfitting. Experimental results show that XGBoost and LightGBM train significantly faster and achieve lower errors (Normalized Mean Absolute Percentage Error-NMAPE is lower than 5%), demonstrating superior generalization. In contrast, BiGRU exhibits overfitting with NMAPE equal to 23.986% and Root Mean Squared Error (RMSE) equal to 18,763.12 kW on June 30, 2021. Notably, on December 31, 2021, XGBoost and LightGBM closely followed actual power generation trends, whereas BiGRU struggled to capture variations, further indicating its generalization issues. The findings highlight XGBoost and LightGBM as more suitable models for solar power forecasting, providing valuable insights for researchers and engineers in power grid management.

Article Details

References

[1] I. Jebli, F. Z. Belouadha, M. I. Kabbaj, and A. Tilioua, Deep learning based models for solar energy prediction, Advances in Science, Technology and Engineering Systems Journal, vol. 6, iss. 1, pp. 349-355, 2021. https://doi.org/10.25046/aj060140;
[2] X. Guo, Y. Zhan, D. Zheng, L. Li, and Q. Qi, Research on short-term forecasting method of photovoltaic power generation based on clustering SO-GRU method, Energy Reports, vol. 9, sup. 10, pp. 786-793, Oct. 2023. https://doi.org/10.1016/j.egyr.2023.05.208;
[3] Y. Peng, S. Wang, W. Chen, J. Ma, C. Wang, and J. Chen, LightGBM-integrated PV power prediction based on multi-resolution similarity, Processes, vol. 11, iss. 4, Apr. 2023. https://doi.org/10.3390/pr11041141;
[4] J. Gaboitaolelwe, A. M. Zungeru, A. Yahya, C. K. Lebekwe, D. N. Vinod, and A. O. Salau, Machine learning based solar photovoltaic power forecasting: a review and comparison, IEEE Access, vol. 11, pp. 40820-40845, Apr. 2023. https://doi.org/10.1109/ACCESS.2023.3270041;
[5] G. Ke and I.-Y. Meng, QiFinely, ThomasWang, TaifengChen, WeiMa, WeidongYe, QiweiTLiu, LightGBM: a highly efficient gradient boosting decision tree, 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA, Dec. 2017;
[6] G. Xiong, J. Zhang, X. Fu, J. Chen, and A. W. Mohamed, Seasonal short-term photovoltaic power prediction based on GSK–BiGRU–XGboost considering correlation of meteorological factors, Journal of Big Data, vol. 11, art no. 164, Nov. 2024. https://doi.org/10.1186/s40537-024-01037-x;
[7] T. Chen and C. Guestrin, XGBoost: a scalable tree boosting system, in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, vol. 42, no. 8, pp. 785-794, Aug. 2016. https://doi.org/10.1145/2939672.2939785;
[8] L. Kumar and S. Sarkar, Neural search: learning query and product representations in fashion e-commerce, vol. 1, no. 1, Association for Computing Machinery, 2021;
[9] T. A. Nguyen, M. H. Pham, M. P. Vu, D. T. Nguyen, and A. T. Vu, Solar power generation prediction using BiGRU model, Journal of Science and Technology in Energy, Electric Power University, vol. 34, pp. 1-14, 2024;
[10] S. Goswami, S. Malakar, B. Ganguli, and A. Chakrabarti, A Novel transfer learning-based short-term solar forecasting approach for India, Neural Computing and Applications, vol. 34, pp. 16829-16843, Jun. 2022. https://doi.org/10.1007/s00521-022-07328-9;
[11] M. Sabri and M. El Hassouni, A novel deep learning approach for short term photovoltaic power forecasting based on GRU-CNN model, E3S Web of Conference, vol. 336, art no. 00064, Jan. 2022. https://doi.org/10.1051/e3sconf/202233600064;
[12] Q. T. Phan, Y. K. Wu, and Q. D. Phan, Short-term solar power forecasting using XGBoost with numerical weather prediction, 2021 IEEE International Future Energy Electronnics Conference IFEEC, Taipei, Taiwan, 16-19 Nov. 2021, pp. 1-2. https://doi.org/10.1109/IFEEC53238.2021.9661874