Forecasting residential electricity demand a single hour ahead is a well-defined but persistently difficult problem, since household load fluctuates with occupant behavior in ways that simple statistical models struggle to capture. This paper compares three regression approaches for short-term residential load forecasting (STRF) - Linear Regression, Random Forest Regression, and Extreme Gradient Boosting (XGBoost) - under a single, controlled experimental pipeline. Data come from the publicly available Individual Household Electric Power Consumption dataset [1], originally logged at one-minute resolution between 2006 and 2010; after cleaning and aggregating to hourly resolution, the working dataset contains roughly 34,584 hourly observations, and the forecasting target is set one hour ahead. Alongside calendar-based predictors (hour of day, day of week, a weekend flag), two lagged variables, Lag_1 and Lag_24, were engineered to encode short-term momentum and daily periodicity in consumption. The dataset was split chronologically, 75% for training and 25% for testing, so that no future information leaks into the training process. Accuracy was assessed with three complementary metrics: MAE, MSE, and R². Across all three, XGBoost is the clear winner: relative to the Linear Regression baseline, it cuts MAE by 50.1% and MSE by 68.6%, and lifts R² from 0.5272 to 0.8518 - a 61.6% relative gain. These results indicate that boosting-based ensembles are considerably better suited than linear or purely bagging-based models at capturing the nonlinear, time-dependent structure of household electricity use, which is directly relevant for applied forecasting in smart energy systems.
Keywords
Short-Term Residential Load ForecastingMachine LearningXGBoostRandom ForestLinear RegressionTime Series AnalysisApplied Information Technology
References
G. Hebrail and A. Berard, “Individual Household Electric Power Consumption,” UCI Machine Learning Repository, 2006, [Online]. Available: https://doi.org/10.24432/C58K54.
G. Chicco, “Overview and performance assessment of the clustering methods for electrical load pattern grouping,” Energy, vol. 42, no. 1, pp. 68-80, Jun. 2012, [Online]. Available: https://doi.org/10.1016/j.energy.2011.12.031.
H. L. Willis and J. E. Northcote-Green, Power Distribution Planning Reference Book, 2nd ed. Boca Raton, FL, USA: CRC Press, 2004.
T. Chen and C. Guestrin, “XGBoost: A scalable tree boosting system,” in Proc. 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), San Francisco, CA, USA, 2016, pp. 785-794, [Online]. Available: https://doi.org/10.1145/2939672.2939785.
S. Fan and R. J. Hyndman, “Short-term load forecasting based on a semi-parametric additive model,” IEEE Transactions on Power Systems, vol. 27, no. 1, pp. 134-141, Feb. 2012, [Online]. Available: https://doi.org/10.1109/TPWRS.2011.2162082.
H. Hippert, C. Pedreira, and R. Souza, “Neural networks for short-term load forecasting,” IEEE Transactions on Power Systems, vol. 16, no. 1, pp. 44-55, Feb. 2001, [Online]. Available: https://doi.org/10.1109/59.910780.
Z. Qinghe, X. Wen, H. Boyan, W. Jong, and F. Junlong, “Optimised extreme gradient boosting model for short term electric load demand forecasting of regional grid system,” Scientific Reports, vol. 12, Art. no. 19282, 2022, [Online]. Available: https://doi.org/10.1038/s41598-022-22024-3.
P. Koukaras, A. Mustapha, A. Mystakidis, and C. Tjortjis, “Optimizing building short-term load forecasting: A comparative analysis of machine learning models,” Energies, vol. 17, no. 6, Art. no. 1450, Mar. 2024, [Online]. Available: https://doi.org/10.3390/en17061450.
H. J. Bae, J.-S. Park, J. Choi, and H.-Y. Kwon, “Learning model combined with data clustering and dimensionality reduction for short-term electricity load forecasting,” Scientific Reports, vol. 15, Art. no. 3575, 2025, [Online]. Available: https://doi.org/10.1038/s41598-025-86982-0.
A. Lahouar and J. Ben Hadj Slama, “Day-ahead load forecast using random forest and expert input selection,” Energy Conversion and Management, vol. 103, pp. 1040-1051, Oct. 2015, [Online]. Available: https://doi.org/10.1016/j.enconman.2015.07.041.
L. Breiman, “Random forests,” Machine Learning, vol. 45, no. 1, pp. 5-32, 2001, [Online]. Available: https://doi.org/10.1023/A:1010933404324.
G. Dudek, “A comprehensive study of random forest for short-term load forecasting,” Energies, vol. 15, no. 20, Art. no. 7547, 2022, [Online]. Available: https://doi.org/10.3390/en15207547.
T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning, 2nd ed. New York, NY, USA: Springer, 2009.
W. Kong, Z. Y. Dong, Y. Jia, D. J. Hill, Y. Xu, and Y. Zhang, “Short-term residential load forecasting based on LSTM recurrent neural network,” IEEE Transactions on Smart Grid, vol. 10, no. 1, pp. 841-851, Jan. 2019, [Online]. Available: https://doi.org/10.1109/TSG.2017.2753802.