<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="research-article" dtd-version="2.3" xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Energy Res.</journal-id>
<journal-title>Frontiers in Energy Research</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Energy Res.</abbrev-journal-title>
<issn pub-type="epub">2296-598X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">792358</article-id>
<article-id pub-id-type="doi">10.3389/fenrg.2021.792358</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Energy Research</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>A Novel Decomposition and Combination Technique for Forecasting Monthly Electricity Consumption</article-title>
<alt-title alt-title-type="left-running-head">Zhang and Li</alt-title>
<alt-title alt-title-type="right-running-head">Electricity Consumption Forecasting</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Zhang</surname>
<given-names>Xi</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/1511637/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Li</surname>
<given-names>Rui</given-names>
</name>
<xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
</contrib>
</contrib-group>
<aff id="aff1">
<label>
<sup>1</sup>
</label>School of Economics, Beijing Technology and Business University, <addr-line>Beijing</addr-line>, <country>China</country>
</aff>
<aff id="aff2">
<label>
<sup>2</sup>
</label>School of Economics and Management, University of Chinese Academy of Sciences, <addr-line>Beijing</addr-line>, <country>China</country>
</aff>
<author-notes>
<fn fn-type="edited-by">
<p>
<bold>Edited by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1303271/overview">Jian Chai</ext-link>, Xidian University, China</p>
</fn>
<fn fn-type="edited-by">
<p>
<bold>Reviewed by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1471138/overview">Hao Xiao</ext-link>, Hunan University, China</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1518667/overview">Dongmei Guo</ext-link>, Central University of Finance and Economics, China</p>
</fn>
<corresp id="c001">&#x2a;Correspondence: Rui Li, <email>lirui21@ucas.ac.cn</email>
</corresp>
<fn fn-type="other">
<p>This article was submitted to Smart Grids, a section of the journal Frontiers in Energy Research</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>01</day>
<month>12</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="collection">
<year>2021</year>
</pub-date>
<volume>9</volume>
<elocation-id>792358</elocation-id>
<history>
<date date-type="received">
<day>10</day>
<month>10</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>01</day>
<month>11</month>
<year>2021</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2021 Zhang and Li.</copyright-statement>
<copyright-year>2021</copyright-year>
<copyright-holder>Zhang and Li</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these&#x20;terms.</p>
</license>
</permissions>
<abstract>
<p>With the share of electricity in total final energy consumption increasing quickly, the world is becoming increasingly dependent on electricity, which makes it more and more important to improve the forecasting accuracy of electricity consumption to ensure the normal operation of economic activities. In this paper, a novel decomposition and combination technique to forecast monthly electricity consumption is proposed. First, we use STL decomposition to obtain the trend, season, and residual components of the time series. Second, we use SARIMA, SVR, ANN, and LSTM to forecast trend, season, and residual component, respectively. Third, we use time correlation principle to improve the forecasting accuracy of season component. Fourth, we integrated the residual component predicted by SARIMA, SVR, ANN, and LSTM into a new sequence to improve the forecasting accuracy of residual component. In order to verify the performance of the proposed forecast model, monthly electricity consumption data in China is introduced as an example for empirical analysis. The results show that after STL decomposition, time correlation modification, and residual modification, the forecasting accuracy of each model has been gradually improved. We believe that the proposed forecast model in this paper can also be used to solve other mid- and long-term forecasting problems with obvious seasonal characteristics.</p>
</abstract>
<kwd-group>
<kwd>monthly electricity consumption</kwd>
<kwd>STL</kwd>
<kwd>time correlation modification</kwd>
<kwd>ANN</kwd>
<kwd>LSTM</kwd>
</kwd-group>
<contract-sponsor id="cn001">National Natural Science Foundation of China<named-content content-type="fundref-id">10.13039/501100001809</named-content>
</contract-sponsor>
</article-meta>
</front>
<body>
<sec id="s1">
<title>Introduction</title>
<sec id="s1-1">
<title>Background</title>
<p>Resource depletion and global climate change are serious problems that human society is facing and will face for a long time. To escape from this dilemma, the global energy mix needs two transformations: clean energy substitution on the energy supply side and electric energy substitution on the energy consumption side. This paper focuses on electricity consumption. According to statistics, global electrification of the final consumption continues to follow an increasing trend, and the share of electricity in total final energy consumption is close to 20% in&#x20;2020.</p>
<p>As the world becomes more and more dependent on electricity, planning for electricity production is crucial. In addition, electricity is difficult to store, so it is usually used immediately after it is generated. This further increases the need for power companies to plan their electricity supply in a proactive manner. Reliable forecast of future electricity consumption level is the primary guiding principle of planning. In particular, high forecasting accuracy of medium- and long-term electricity consumption is the key to power system scheduling and planning. In contrast, inaccurate forecast of electricity consumption can backfire. Overestimation will waste scarce energy resources, huge capital investment, and long construction time. Underestimation will lead to more serious negative consequences, such as power shortage. Clearly, if effective early warning is given in advance based on high forecasting accuracy of electricity consumption, some measures can be adopted to avoid negative consequences. However, electricity consumption is uncertain, complex, and nonlinear, which depends on political conditions, economy (<xref ref-type="bibr" rid="B17">Lin and Liu, 2016</xref>), human activities, population behavior (<xref ref-type="bibr" rid="B11">Hussain et&#x20;al., 2016</xref>), climate factors (<xref ref-type="bibr" rid="B10">Hern&#xe1;ndez, 2013</xref>), and other external factors affecting the forecasting accuracy of electricity consumption.</p>
</sec>
<sec id="s1-2">
<title>Literature Review and Motivation</title>
<p>At present, many techniques are used to forecast electricity consumption, which can be roughly divided into three categories: nonlinear intelligent model, statistical analysis model, and gray forecasting model. Nonlinear models mainly include the artificial neural network (<xref ref-type="bibr" rid="B13">Kandananond, 2011</xref>; <xref ref-type="bibr" rid="B15">Kaytez et&#x20;al., 2015</xref>; <xref ref-type="bibr" rid="B18">Liu et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B8">Ghadimi et&#x20;al., 2018</xref>; <xref ref-type="bibr" rid="B3">Bedi and Toshniwal, 2019</xref>; <xref ref-type="bibr" rid="B9">Hamza&#xe7;ebi et&#x20;al., 2019</xref>), support vector machine (<xref ref-type="bibr" rid="B22">Pai and Hong, 2005</xref>; <xref ref-type="bibr" rid="B14">Kavaklioglu, 2011</xref>; <xref ref-type="bibr" rid="B4">Cao and Wu, 2016</xref>), and Markov chain (<xref ref-type="bibr" rid="B35">Zhao et&#x20;al., 2014</xref>). In addition to the nonlinear intelligent models mentioned above, statistical analysis models, such as regression analysis method (<xref ref-type="bibr" rid="B20">Mohamed and Bodger, 2005</xref>; <xref ref-type="bibr" rid="B30">Wang et&#x20;al., 2018</xref>) and autoregressive integrated moving average (<xref ref-type="bibr" rid="B33">Yuan et&#x20;al., 2016</xref>), have also been widely used in electricity consumption forecasting. The gray forecasting model proposed by Deng enjoys high popularity in many forecasting applications because it can describe the characteristics of uncertain systems even in the face of a small amount of data. Therefore, some literature forecast electricity consumption based on the gray model (<xref ref-type="bibr" rid="B1">Akay and Atak, 2007</xref>; <xref ref-type="bibr" rid="B2">Bahrami et&#x20;al., 2014</xref>; <xref ref-type="bibr" rid="B34">Zhao and Guo, 2016</xref>; <xref ref-type="bibr" rid="B32">Xu et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B7">Ding et&#x20;al., 2018</xref>; <xref ref-type="bibr" rid="B31">Wu et&#x20;al., 2018</xref>).</p>
<p>These methods can generally provide good forecasts. However, the statistical analysis models have the limitation of linear (or near linear) assumption, the gray forecasting models are usually only suitable for time series that approximate exponential growth, and the nonlinear intelligent models often suffer from overfitting or the difficulty of parameter selection. To remedy these shortcomings, some decomposition and combination techniques have been proposed in recent years and achieve better performance: the SARIMA model with residual modification (<xref ref-type="bibr" rid="B29">Wang et&#x20;al., 2012</xref>), wavelet transform combined with machine learning and time series models (<xref ref-type="bibr" rid="B21">Nguyen and Nabney, 2010</xref>), weighted hybrid model where trend and seasonal components are predicted by combined method, and SARIMA, respectively (<xref ref-type="bibr" rid="B26">Zhu, 2011</xref>), bagging ARIMA and exponential smoothing methods (<xref ref-type="bibr" rid="B6">de Oliveira and Cyrino Oliveira, 2018</xref>), convolutional neural networks and fuzzy time series (<xref ref-type="bibr" rid="B24">Sadaei et&#x20;al., 2019</xref>), and structural combination of seasonal exponential smoothing forecasts (<xref ref-type="bibr" rid="B23">Rendon-Sanchez and de Menezes, 2019</xref>).</p>
<p>For the above existing researches, there are still some issues that need to be further studied. First, the statistical analysis models assume linearity and have good forecasting accuracy for periodic and regular sequences. The nonlinear intelligent model can forecast nonlinear and irregular time series better, but it has the problem of overfitting. How could the advantages of the two methods be combined to improve the forecasting accuracy? Second, except for the fluctuations of monthly electricity consumption affected by extreme weather changes, and sudden major economic and health events, the monthly electricity consumption also shows strong periodicity and regularity, so the comprehensive utilization of these two characteristics is meaningful to increase forecasting accuracy.</p>
</sec>
<sec id="s1-3">
<title>Contributions</title>
<p>To bridge the gap discussed above in the <italic>Literature review and motivation</italic> section, this paper develops a novel decomposition and combination forecasting technique. The primary research contents of this paper include three parts. First is the research on the monthly electricity consumption forecast based on STL decomposition. Second is the research on a time correlation modification based on annual periodicity and adjacent similarity to improve the forecasting accuracy of the season component. Third, considering the residual component has nonlinear and irregular characteristics, the individual model may only extract a certain feature of the sequence. Therefore, we integrate the residual component predicted by four models&#x20;into a new sequence to improve the forecasting accuracy of the residual component. The main contributions of this paper are as follows:<list list-type="simple">
<list-item>
<p>1) A novel decomposition and combination forecasting model utilizing STL decomposition, time correlation principle (embodied as annual periodicity and adjacent similarity), and hybrid forecasting principle is proposed.</p>
</list-item>
<list-item>
<p>2) The monthly electricity consumption data of China are&#x20;applied to evaluate the performance of the proposed&#x20;model.</p>
</list-item>
</list>
</p>
<p>The remainder of the paper is organized as follows. The <italic>Electricity consumption month-ahead forecasting model</italic> section introduces the proposed forecasting model. The <italic>Case study</italic> section presents the simulation results and discussion, in which the performance of the proposed forecasting model is evaluated. Finally, conclusions are drawn in the <italic>Conclusion</italic> section.</p>
</sec>
</sec>
<sec id="s2">
<title>Electricity Consumption Month-Ahead Forecasting Model</title>
<p>This section first briefly introduces individual models, including the STL algorithm, SARIMA, SVR, ANN, and LSTM model. Then the operation process of the proposed decomposition and combination method is described.</p>
<sec id="s2-1">
<title>Seasonal&#x2013;Trend Decomposition Using Loess Decomposition</title>
<p>For seasonal time series, academics generally use STL decomposition proposed by <xref ref-type="bibr" rid="B5">Cleveland et&#x20;al. (1990)</xref> to obtain trend, season, and residual components. STL is a decompose model in the form of addition. In STL, loess is used to divide the time series into trend component, seasonal component, and residual component. Division is addition, that is, adding up the parts to get the original series. Specifically, the steps of STL decomposition are 1) detrending; 2) periodic subsequence smoothing: establish a sequence for each seasonal component and smooth it separately; 3) smoothing periodic substring low-pass filtering: recombine substring to smooth; 4) detrending the seasonal series; 5) detrending the original series using the seasonal components calculated in the previous steps; and 6) smoothing the de-seasonal sequence to obtain the trend component.</p>
</sec>
<sec id="s2-2">
<title>Seasonal Autoregressive Integrated Moving Average</title>
<p>SARIMA is one of the most widely used linear models for time series prediction. The general equation of this model is given by <xref ref-type="disp-formula" rid="e1">Eq. 1</xref>.<disp-formula id="e1">
<mml:math id="m1">
<mml:mrow>
<mml:msub>
<mml:mo>&#x3d5;</mml:mo>
<mml:mi>p</mml:mi>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi mathvariant="normal">B</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>&#x2212;</mml:mo>
<mml:mi>B</mml:mi>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mi>d</mml:mi>
</mml:msup>
<mml:msub>
<mml:mi>&#x3a6;</mml:mi>
<mml:mi>P</mml:mi>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:msup>
<mml:mi>B</mml:mi>
<mml:mi>s</mml:mi>
</mml:msup>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>&#x2212;</mml:mo>
<mml:msup>
<mml:mi>B</mml:mi>
<mml:mi>s</mml:mi>
</mml:msup>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mi>D</mml:mi>
</mml:msup>
<mml:msub>
<mml:mi>y</mml:mi>
<mml:mi>t</mml:mi>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:msub>
<mml:mi>&#x3b8;</mml:mi>
<mml:mi>q</mml:mi>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi mathvariant="normal">B</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:msub>
<mml:mi>&#x398;</mml:mi>
<mml:mi>Q</mml:mi>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:msup>
<mml:mi>B</mml:mi>
<mml:mi>s</mml:mi>
</mml:msup>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:msub>
<mml:mi>a</mml:mi>
<mml:mi>t</mml:mi>
</mml:msub>
<mml:mo>.</mml:mo>
</mml:mrow>
</mml:math>
<label>(1)</label>
</disp-formula>
</p>
<p>Here <inline-formula id="inf1">
<mml:math id="m2">
<mml:mrow>
<mml:msub>
<mml:mi>y</mml:mi>
<mml:mi>t</mml:mi>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula> is time series, <inline-formula id="inf2">
<mml:math id="m3">
<mml:mrow>
<mml:msub>
<mml:mi>a</mml:mi>
<mml:mi>t</mml:mi>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula> is white noise, and B is the lag operator. D represents the seasonal differentiation order, and d represents the regular differentiation order.<disp-formula id="e2">
<mml:math id="m4">
<mml:mrow>
<mml:msub>
<mml:mo>&#x3d5;</mml:mo>
<mml:mi>p</mml:mi>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi mathvariant="normal">B</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>&#x3c6;</mml:mi>
<mml:mn>1</mml:mn>
</mml:msub>
<mml:mi>B</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>&#x3c6;</mml:mi>
<mml:mn>2</mml:mn>
</mml:msub>
<mml:msup>
<mml:mi>B</mml:mi>
<mml:mn>2</mml:mn>
</mml:msup>
<mml:mo>&#x2212;</mml:mo>
<mml:mo>&#x2026;</mml:mo>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>&#x3c6;</mml:mi>
<mml:mi>p</mml:mi>
</mml:msub>
<mml:msup>
<mml:mi>B</mml:mi>
<mml:mi>p</mml:mi>
</mml:msup>
<mml:mo>.</mml:mo>
</mml:mrow>
</mml:math>
<label>(2)</label>
</disp-formula>
<disp-formula id="e3">
<mml:math id="m5">
<mml:mrow>
<mml:mo>&#xa0;</mml:mo>
<mml:msub>
<mml:mo>&#x3b8;</mml:mo>
<mml:mi>p</mml:mi>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi mathvariant="normal">B</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>&#x3b8;</mml:mi>
<mml:mn>1</mml:mn>
</mml:msub>
<mml:mi>B</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>&#x3b8;</mml:mi>
<mml:mn>2</mml:mn>
</mml:msub>
<mml:msup>
<mml:mi>B</mml:mi>
<mml:mn>2</mml:mn>
</mml:msup>
<mml:mo>&#x2212;</mml:mo>
<mml:mo>&#x2026;</mml:mo>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>&#x3b8;</mml:mi>
<mml:mi>q</mml:mi>
</mml:msub>
<mml:msup>
<mml:mi>B</mml:mi>
<mml:mi>q</mml:mi>
</mml:msup>
<mml:mo>.</mml:mo>
</mml:mrow>
</mml:math>
<label>(3)</label>
</disp-formula>
</p>
<p>
<xref ref-type="disp-formula" rid="e2">Eqs. 2</xref>, <xref ref-type="disp-formula" rid="e3">3</xref> represent the autoregressive and moving average polynomial, respectively. They represent the dependence of future values of time series on past values as well as errors.<disp-formula id="e4">
<mml:math id="m6">
<mml:mrow>
<mml:msub>
<mml:mi>&#x3a6;</mml:mi>
<mml:mi>P</mml:mi>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi mathvariant="normal">B</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>&#x3bc;</mml:mi>
<mml:mn>1</mml:mn>
</mml:msub>
<mml:msup>
<mml:mi>B</mml:mi>
<mml:mi>S</mml:mi>
</mml:msup>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>&#x3bc;</mml:mi>
<mml:mn>2</mml:mn>
</mml:msub>
<mml:msup>
<mml:mi>B</mml:mi>
<mml:mrow>
<mml:mn>2</mml:mn>
<mml:mi>S</mml:mi>
</mml:mrow>
</mml:msup>
<mml:mo>&#x2212;</mml:mo>
<mml:mo>&#x2026;</mml:mo>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>&#x3bc;</mml:mi>
<mml:mi>P</mml:mi>
</mml:msub>
<mml:msup>
<mml:mi>B</mml:mi>
<mml:mrow>
<mml:mi>P</mml:mi>
<mml:mi>S</mml:mi>
</mml:mrow>
</mml:msup>
<mml:mo>.</mml:mo>
</mml:mrow>
</mml:math>
<label>(4)</label>
</disp-formula>
<disp-formula id="e5">
<mml:math id="m7">
<mml:mrow>
<mml:mo>&#xa0;</mml:mo>
<mml:msub>
<mml:mi>&#x398;</mml:mi>
<mml:mi>Q</mml:mi>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi mathvariant="normal">B</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>&#x3c5;</mml:mi>
<mml:mn>1</mml:mn>
</mml:msub>
<mml:msup>
<mml:mi>B</mml:mi>
<mml:mi>S</mml:mi>
</mml:msup>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>&#x3bd;</mml:mi>
<mml:mn>2</mml:mn>
</mml:msub>
<mml:msup>
<mml:mi>B</mml:mi>
<mml:mrow>
<mml:mn>2</mml:mn>
<mml:mi>S</mml:mi>
</mml:mrow>
</mml:msup>
<mml:mo>&#x2212;</mml:mo>
<mml:mo>&#x2026;</mml:mo>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>&#x3bd;</mml:mi>
<mml:mi>P</mml:mi>
</mml:msub>
<mml:msup>
<mml:mi>B</mml:mi>
<mml:mrow>
<mml:mi>Q</mml:mi>
<mml:mi>S</mml:mi>
</mml:mrow>
</mml:msup>
<mml:mo>.</mml:mo>
</mml:mrow>
</mml:math>
<label>(5)</label>
</disp-formula>
</p>
<p>Similarly, <xref ref-type="disp-formula" rid="e4">Eqs. 4</xref>, <xref ref-type="disp-formula" rid="e5">5</xref> represent the seasonal autoregressive and seasonal moving average polynomials, respectively. Addition of these polynomials to the ARIMA equation helps in capturing the seasonal variation in time series. Differentiation is necessary for converting the nonstationary time series to a stationary one. S represents the order of seasonality.</p>
</sec>
<sec id="s2-3">
<title>Support Vector Machine</title>
<p>SVM was first proposed by <xref ref-type="bibr" rid="B27">Vapnik (1963)</xref> based on the statistical learning theory and principle of structural risk minimization, which possess good performance even for small samples. The basic idea of support vector regression is to map original data to high-dimensional feature space and perform linear regression in the space. It can be formulated into:<disp-formula id="e6">
<mml:math id="m8">
<mml:mrow>
<mml:mi>f</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>x</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x3d;</mml:mo>
<mml:msup>
<mml:mi>w</mml:mi>
<mml:mi>T</mml:mi>
</mml:msup>
<mml:mi>&#x3c6;</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>x</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>b</mml:mi>
<mml:mo>,</mml:mo>
</mml:mrow>
</mml:math>
<label>(6)</label>
</disp-formula>where <inline-formula id="inf3">
<mml:math id="m9">
<mml:mrow>
<mml:mi>&#x3c6;</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>x</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
</inline-formula> is a nonlinear mapping function, <inline-formula id="inf4">
<mml:math id="m10">
<mml:mrow>
<mml:mi>f</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>x</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
</inline-formula> is the estimation value, and <inline-formula id="inf5">
<mml:math id="m11">
<mml:mrow>
<mml:msup>
<mml:mi>w</mml:mi>
<mml:mi>T</mml:mi>
</mml:msup>
</mml:mrow>
</mml:math>
</inline-formula> and b are weights. It can be translated into an optimization problem:<disp-formula id="equ1">
<mml:math id="m12">
<mml:mrow>
<mml:mtext>Min</mml:mtext>
<mml:mo>&#xa0;</mml:mo>
<mml:mfrac>
<mml:mn>1</mml:mn>
<mml:mn>2</mml:mn>
</mml:mfrac>
<mml:msup>
<mml:mi>w</mml:mi>
<mml:mi>T</mml:mi>
</mml:msup>
<mml:mi>w</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>C</mml:mi>
<mml:mstyle displaystyle="true">
<mml:munderover>
<mml:mo>&#x2211;</mml:mo>
<mml:mrow>
<mml:mi>t</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mi>T</mml:mi>
</mml:munderover>
<mml:mrow>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>&#x3be;</mml:mi>
<mml:mi>t</mml:mi>
</mml:msub>
<mml:mo>&#x2b;</mml:mo>
<mml:msubsup>
<mml:mi>&#x3be;</mml:mi>
<mml:mi>t</mml:mi>
<mml:mo>&#x2217;</mml:mo>
</mml:msubsup>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mstyle>
<mml:mo>,</mml:mo>
</mml:mrow>
</mml:math>
</disp-formula>
<disp-formula id="e7">
<mml:math id="m13">
<mml:mrow>
<mml:mrow>
<mml:mi>s</mml:mi>
<mml:mo>.</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>{</mml:mo>
<mml:mrow>
<mml:mtable>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msup>
<mml:mi>w</mml:mi>
<mml:mi>T</mml:mi>
</mml:msup>
<mml:mi>&#x3c6;</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>x</mml:mi>
<mml:mi>t</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>b</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>y</mml:mi>
<mml:mi>t</mml:mi>
</mml:msub>
<mml:mo>&#x2264;</mml:mo>
<mml:mi>&#x3b5;</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:msub>
<mml:mi>&#x3be;</mml:mi>
<mml:mi>t</mml:mi>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mi>t</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1,2</mml:mn>
<mml:mo>,</mml:mo>
<mml:mo>&#x2026;</mml:mo>
<mml:mo>,</mml:mo>
<mml:mi>T</mml:mi>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi>y</mml:mi>
<mml:mi>t</mml:mi>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:msup>
<mml:mi>w</mml:mi>
<mml:mi>T</mml:mi>
</mml:msup>
<mml:mi>&#x3c6;</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>x</mml:mi>
<mml:mi>t</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>b</mml:mi>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x2264;</mml:mo>
<mml:mi>&#x3b5;</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:msubsup>
<mml:mi>&#x3be;</mml:mi>
<mml:mi>t</mml:mi>
<mml:mo>&#x2217;</mml:mo>
</mml:msubsup>
<mml:mo>,</mml:mo>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mi>t</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1,2</mml:mn>
<mml:mo>,</mml:mo>
<mml:mo>&#x2026;</mml:mo>
<mml:mo>,</mml:mo>
<mml:mi>T</mml:mi>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi>&#x3be;</mml:mi>
<mml:mi>t</mml:mi>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:msubsup>
<mml:mi>&#x3be;</mml:mi>
<mml:mi>t</mml:mi>
<mml:mo>&#x2217;</mml:mo>
</mml:msubsup>
<mml:mo>&#x2265;</mml:mo>
<mml:mn>0</mml:mn>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
</mml:mrow>
<mml:mo>,</mml:mo>
</mml:mrow>
</mml:math>
<label>(7)</label>
</disp-formula>where C is the penalty parameter, and <inline-formula id="inf6">
<mml:math id="m14">
<mml:mrow>
<mml:msub>
<mml:mi>&#x3be;</mml:mi>
<mml:mi>t</mml:mi>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula> and <inline-formula id="inf7">
<mml:math id="m15">
<mml:mrow>
<mml:msubsup>
<mml:mi>&#x3be;</mml:mi>
<mml:mi>t</mml:mi>
<mml:mo>&#x2217;</mml:mo>
</mml:msubsup>
</mml:mrow>
</mml:math>
</inline-formula> are the nonnegative slack variables. Generally speaking, the parameters of SVR have a great influence on the accuracy of the regression estimation. Thereby, the grid search method is employed to automatically choose the optimal parameters of SVR in this&#x20;paper.</p>
</sec>
<sec id="s2-4">
<title>Artificial Neural Network</title>
<p>ANN is an information processing method based on the biological neural network. Neural networks can theoretically simulate any complex nonlinear relationship through nonlinear units (neurons) and have been widely used in the field of forecast. The structure of artificial neural network consists of input layer, hidden layer, and output layer. The most widely used ANN model is the BP neural network model based on the BP algorithm. The neural network is determined by determining the weight between each layer. Therefore, the neural network is trained to set&#x20;all the weights before being used for prediction. The initial weights are set randomly, and the output data can be obtained according to certain rules when the training process is going forward. The weights are modified based on the difference between the output data and the expected data during the fallback process. The forward and backward process is repeated until the difference between the output data and the required data is small enough.</p>
</sec>
<sec id="s2-5">
<title>Long Short-Term Memory</title>
<p>Traditional artificial neural networks (ANN) attempt to establish direct mapping between input historical data and output forecast data to achieve prediction methods. However, due to the absence of time correlation in data series, the neural network model cannot capture the relationship between data and time, which limits its application in time series prediction methods. Therefore, recursive neural network (RNN) is proposed to overcome this shortcoming. By adding cyclic connections on neurons, RNN can establish sequence-to-sequence mappings between input and output data. Therefore, the output of each time step is affected by the input of the previous time step. Therefore, RNN is used to realize the memory feature (<xref ref-type="bibr" rid="B25">Sutskever et&#x20;al., 2014</xref>; <xref ref-type="bibr" rid="B16">LeCun et&#x20;al., 2015</xref>).</p>
<p>The structure of RNN is shown in <xref ref-type="fig" rid="F1">Figure&#x20;1</xref>. Each node represents a single time-step neuron. The connection weight of input neuron is W1, the self-connection weight of each neuron is W2, and the connection weight of output neuron is W3. The input data sequence enters the network in turn according to the time step, and the weight coefficient is recycled.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption>
<p>The structure of recursive neural network (RNN) (<xref ref-type="bibr" rid="B28">Wang et&#x20;al., 2020</xref>).</p>
</caption>
<graphic xlink:href="fenrg-09-792358-g001.tif"/>
</fig>
</sec>
<sec id="s2-6">
<title>The Proposed Forecast Framework</title>
<p>The proposed forecast framework utilizing STL decomposition, time correlation modification (embodied as annual periodicity and adjacent similarity) and residual modification is illustrated in <xref ref-type="fig" rid="F2">Figure&#x20;2</xref>.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption>
<p>The proposed forecast framework.</p>
</caption>
<graphic xlink:href="fenrg-09-792358-g002.tif"/>
</fig>
<p>In <xref ref-type="fig" rid="F2">Figure&#x20;2</xref>, The proposed forecast framework consists of four steps:</p>
<p>In the first step, we use the Seasonal&#x2013;Trend decomposition using Loess (STL decomposition) to obtain the trend, season, and residual components of the time series.</p>
<p>In the second step, we use SARIMA, SVR, ANN, and LSTM to forecast trend, season, and residual component, respectively.</p>
<p>In the third step, we use the time correlation principle to&#x20;improve the forecasting accuracy of the season component. The&#x20;season component presents time correlation characteristics, which embodies as annual periodicity and&#x20;adjacent similarity. Here the annual periodicity means&#x20;that data from the same month in the next year are similar. The adjacent similarity means that data are close to each other in adjacent months. In the second step, only&#x20;adjacent similarity is used. We divide the season component into 11<xref ref-type="fn" rid="fn2">
<sup>2</sup>
</xref> subsequences, each of which represents&#x20;a certain month. Then the exponential smoothing method is used to forecast each subsequence. The forecasting results are weighted with the season component predicted by each model (SARIMA, SVR, ANN, LSTM) to improve the forecasting accuracy of the season component. The weight is calculated based on the last forecasting error of the&#x20;model.</p>
<p>In the fourth step, because the residual component has nonlinear and irregular characteristics, the individual model may only extract a certain feature of the sequence, so the forecasting accuracy is low. In fact, it is rare that a single forecasting model is always best in all cases. Each model has its own unique strengths and weaknesses. When multiple forecasting models are available, consider a combined approach, which is a good way to take full advantage of the strengths of each model. Therefore, we integrate the residual component predicted by SARIMA, SVR, ANN, and LSTM into a new sequence, and replace the residual component predicted by the above four methods with the new sequence to improve the forecasting accuracy of the residual component.</p>
</sec>
</sec>
<sec id="s3">
<title>Case Study</title>
<sec id="s3-1">
<title>Data Collection</title>
<p>We evaluate the performance of the proposed forecasting method using the monthly electricity consumption data of China. However, these figures cannot be used directly as Chinese New Year always lasts for a few days in January or February. Almost all companies and factories have stopped operating. As a result, electricity consumption in January and February is sometimes abnormal. To avoid this problem, we treat the January and February averages as observations of a new month 1 and 2 each year, i.e.,&#x20;each year has 11 monthly values with a period length of 11. This study collects electricity consumption data from the beginning of 1 and 2&#x20;2006 to the end of August 2021 to keep relevant to the current situation of electricity development. These original data are shown in <xref ref-type="fig" rid="F3">Figure&#x20;3</xref>.</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption>
<p>The monthly electricity consumption of China from 1 and 2&#x20;2006 to August&#x20;2021.</p>
</caption>
<graphic xlink:href="fenrg-09-792358-g003.tif"/>
</fig>
</sec>
<sec id="s3-2">
<title>Experimental Design</title>
<p>We select the data from 1 and 2&#x20;2006 to December 2018 as the training dataset (i.e.,&#x20;the first 143 data points) and the remaining data as the test dataset (i.e.,&#x20;the last 29 data points). The training data set is further divided into the optimization training data set and the verification data set. The optimization training data set contains the first 121 data points, and the verification training data set contains the last 22 data points. Optimization training and validation data sets were used to determine the hyperparameters of SVR, ANN, and LSTM models, while test data sets are used to evaluate forecasting performance.</p>
<p>Three error indices, mean absolute error (MAE), mean absolute percentage error (MAPE), and correlation coefficient (COR), are applied to evaluate the model performance according to forecast results. The official functions of the three error indices are:<disp-formula id="equ2">
<mml:math id="m16">
<mml:mrow>
<mml:mtext>MAE</mml:mtext>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msubsup>
<mml:mstyle displaystyle="true">
<mml:mo>&#x2211;</mml:mo>
</mml:mstyle>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mi>n</mml:mi>
</mml:msubsup>
<mml:mo>&#x7c;</mml:mo>
<mml:msub>
<mml:mi>y</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mi>y</mml:mi>
<mml:mo>&#x5e;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
<mml:mi>n</mml:mi>
</mml:mfrac>
<mml:mo>.</mml:mo>
</mml:mrow>
</mml:math>
</disp-formula>
<disp-formula id="equ3">
<mml:math id="m17">
<mml:mrow>
<mml:mtext>MAPE</mml:mtext>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mn>100</mml:mn>
<mml:mo>%</mml:mo>
</mml:mrow>
<mml:mi>n</mml:mi>
</mml:mfrac>
<mml:mstyle displaystyle="true">
<mml:munderover>
<mml:mo>&#x2211;</mml:mo>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mi>n</mml:mi>
</mml:munderover>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mi>y</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mi>y</mml:mi>
<mml:mo>&#x5e;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mi>y</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
</mml:mstyle>
<mml:mo>.</mml:mo>
</mml:mrow>
</mml:math>
</disp-formula>
<disp-formula id="equ4">
<mml:math id="m18">
<mml:mrow>
<mml:mtext>COR</mml:mtext>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mi>C</mml:mi>
<mml:mi>o</mml:mi>
<mml:mi>v</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>y</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>&#xa0;</mml:mo>
<mml:mo>,</mml:mo>
<mml:mo>&#xa0;</mml:mo>
<mml:mo>&#xa0;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mi>y</mml:mi>
<mml:mo>&#x5e;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mi>&#x3c3;</mml:mi>
<mml:mi>y</mml:mi>
</mml:msub>
<mml:msub>
<mml:mi>&#x3c3;</mml:mi>
<mml:mrow>
<mml:mover accent="true">
<mml:mi>y</mml:mi>
<mml:mo>&#x5e;</mml:mo>
</mml:mover>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfrac>
<mml:mo>,</mml:mo>
</mml:mrow>
</mml:math>
</disp-formula>where <inline-formula id="inf8">
<mml:math id="m19">
<mml:mi>y</mml:mi>
</mml:math>
</inline-formula> is the actual value, <inline-formula id="inf9">
<mml:math id="m20">
<mml:mrow>
<mml:mover accent="true">
<mml:mi>y</mml:mi>
<mml:mo>&#x5e;</mml:mo>
</mml:mover>
</mml:mrow>
</mml:math>
</inline-formula> is the forecasted value, and <inline-formula id="inf10">
<mml:math id="m21">
<mml:mi>i</mml:mi>
</mml:math>
</inline-formula> is the index value of the&#x20;data.</p>
</sec>
<sec id="s3-3">
<title>Results</title>
<sec id="s3-3-1">
<title>Seasonal&#x2013;Trend decomposition using Loess Decomposition</title>
<p>
<xref ref-type="fig" rid="F4">Figure&#x20;4</xref> shows the STL decomposition results of the monthly electricity consumption. The trend component of the electricity consumption of China is increasing year by year, and the growth trend has accelerated since 2016. This is mainly because in 2016, eight departments in China jointly issued <italic>The Guidelines on Promoting the Substitution of Electric Energy</italic>, with a view to increasing the proportion of electric energy in the final energy consumption to 27%. Electric energy substitution is an important way to achieve carbon peak and carbon neutrality by replacing coal, oil, gas, and wood with electricity in energy consumption. The season component vibrates more and more. Due to financial crisis, extreme weather events, and epidemic, there are several relatively large negative and positive shocks on the residual component. If the original sequence is directly used, these huge shocks will seriously threaten the forecasting accuracy of the&#x20;model.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption>
<p>The trend, seasonal, and residual for monthly electricity consumption data decomposed by Seasonal&#x2013;Trend decomposition using Loess (STL).</p>
</caption>
<graphic xlink:href="fenrg-09-792358-g004.tif"/>
</fig>
<p>
<xref ref-type="table" rid="T1">Table&#x20;1</xref> shows the performance evaluation results of four models without STL decomposition and with STL decomposition. The model comparisons demonstrate that STL decomposition is effective in boosting the forecasting accuracy of monthly electricity consumption. Compared with any single model (SARIMA, SVR, ANN, LSTM), the models with STL decomposition leads to reductions in all of the evaluation indices (MAE, MAPE and&#x20;COR).</p>
<table-wrap id="T1" position="float">
<label>TABLE 1</label>
<caption>
<p>Performance evaluations of different models with or without Seasonal&#x2013;Trend decomposition using Loess (STL).</p>
</caption>
<table>
<thead valign="top">
<tr>
<th colspan="2" align="left">Horizons</th>
<th colspan="3" align="center">One-step ahead</th>
<th colspan="3" align="center">Two-step ahead</th>
<th colspan="3" align="center">Three-step ahead</th>
</tr>
<tr>
<th colspan="2" align="left">Indices</th>
<th align="center">Mean absolute error (MAE) (TWh)</th>
<th align="center">Mean absolute percentage error (MAPE) (%)</th>
<th align="center">Correlation coefficient(COR)</th>
<th align="center">MAE (TWh)</th>
<th align="center">MAPE (%)</th>
<th align="center">COR</th>
<th align="center">MAE (TWh)</th>
<th align="center">MAPE (%)</th>
<th align="center">COR</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td rowspan="4" align="left">Without STL</td>
<td align="left">SARIMA</td>
<td align="char" char=".">230</td>
<td align="char" char=".">3.58</td>
<td align="char" char=".">0.88</td>
<td align="char" char=".">259</td>
<td align="char" char=".">4.06</td>
<td align="char" char=".">0.86</td>
<td align="char" char=".">280</td>
<td align="char" char=".">4.40</td>
<td align="char" char=".">0.85</td>
</tr>
<tr>
<td align="left">SVR</td>
<td align="char" char=".">346</td>
<td align="char" char=".">5.59</td>
<td align="char" char=".">0.79</td>
<td align="char" char=".">346</td>
<td align="char" char=".">5.59</td>
<td align="char" char=".">0.79</td>
<td align="char" char=".">383</td>
<td align="char" char=".">6.22</td>
<td align="char" char=".">0.76</td>
</tr>
<tr>
<td align="left">Artificial neural network (ANN)</td>
<td align="char" char=".">266</td>
<td align="char" char=".">4.22</td>
<td align="char" char=".">0.87</td>
<td align="char" char=".">266</td>
<td align="char" char=".">4.22</td>
<td align="char" char=".">0.87</td>
<td align="char" char=".">317</td>
<td align="char" char=".">5.07</td>
<td align="char" char=".">0.86</td>
</tr>
<tr>
<td align="left">LSTM</td>
<td align="char" char=".">336</td>
<td align="char" char=".">5.36</td>
<td align="char" char=".">0.78</td>
<td align="char" char=".">336</td>
<td align="char" char=".">5.36</td>
<td align="char" char=".">0.78</td>
<td align="char" char=".">406</td>
<td align="char" char=".">6.35</td>
<td align="char" char=".">0.71</td>
</tr>
<tr>
<td rowspan="4" align="left">With STL</td>
<td align="left">STL-SARIMA</td>
<td align="char" char=".">126</td>
<td align="char" char=".">1.98</td>
<td align="char" char=".">0.96</td>
<td align="char" char=".">121</td>
<td align="char" char=".">1.93</td>
<td align="char" char=".">0.96</td>
<td align="char" char=".">131</td>
<td align="char" char=".">2.10</td>
<td align="char" char=".">0.96</td>
</tr>
<tr>
<td align="left">STL-SVR</td>
<td align="char" char=".">145</td>
<td align="char" char=".">2.23</td>
<td align="char" char=".">0.95</td>
<td align="char" char=".">145</td>
<td align="char" char=".">2.23</td>
<td align="char" char=".">0.95</td>
<td align="char" char=".">197</td>
<td align="char" char=".">3.04</td>
<td align="char" char=".">0.94</td>
</tr>
<tr>
<td align="left">STL-ANN</td>
<td align="char" char=".">150</td>
<td align="char" char=".">2.34</td>
<td align="char" char=".">0.95</td>
<td align="char" char=".">150</td>
<td align="char" char=".">2.34</td>
<td align="char" char=".">0.95</td>
<td align="char" char=".">189</td>
<td align="char" char=".">2.99</td>
<td align="char" char=".">0.94</td>
</tr>
<tr>
<td align="left">STL-LSTM</td>
<td align="char" char=".">169</td>
<td align="char" char=".">2.78</td>
<td align="char" char=".">0.96</td>
<td align="char" char=".">173</td>
<td align="char" char=".">2.83</td>
<td align="char" char=".">0.96</td>
<td align="char" char=".">211</td>
<td align="char" char=".">3.41</td>
<td align="char" char=".">0.93</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>According to <xref ref-type="table" rid="T1">Table&#x20;1</xref>, the divide-and-conquer strategy improves the forecasting accuracy. Next, we analyze the source of errors, that is, the percentage of trend, season, and residual component forecasting errors to the total errors. As shown in <xref ref-type="fig" rid="F5">Figure&#x20;5</xref>, for any model, most of the errors come from residual component forecast. SARIMA, in particular, was the least effective. This is because the residual component has nonlinear and irregular characteristics, and SARIMA is not good at forecasting these kinds of sequences. In addition, a single model may only extract a certain feature of the sequence, so the forecasting accuracy is low. For trend component, it can be seen that SARIMA has the highest forecasting accuracy, while for machine learning algorithms, such as SVR, ANN, and LSTM, the accuracy is not high. Therefore, it can be concluded that the traditional statistical method is better for simple sequence like trend component. The forecasting errors of season component also account for a large&#x20;part.</p>
<fig id="F5" position="float">
<label>FIGURE 5</label>
<caption>
<p>Trend, season, random error&#x20;ratio.</p>
</caption>
<graphic xlink:href="fenrg-09-792358-g005.tif"/>
</fig>
</sec>
<sec id="s3-3-2">
<title>Time Correlation Modification</title>
<p>As shown in <xref ref-type="fig" rid="F5">Figure&#x20;5</xref>, the errors caused by season component account for 18%&#x2013;28%. In this section, we use the periodicity of the seasonal series to improve the forecasting accuracy of the season component. As we can see, the season component presents time correlation characteristics, which embodies as annual periodicity and adjacent similarity. We divide the season component into 11 subsequences, each of which represents a certain month. Then exponential smoothing method is used to forecast each subsequence. The forecasting results are weighted with the season component predicted by each model (SARIMA, SVR, ANN, and LSTM) to improve the forecasting accuracy of the season component. The weight is calculated based on the last forecast error of the model. Rows 3&#x2013;6 in <xref ref-type="table" rid="T2">Table&#x20;2</xref> show that the forecasting accuracy has been improved after time correlation modification (TCM).</p>
<table-wrap id="T2" position="float">
<label>TABLE 2</label>
<caption>
<p>Performance evaluations of different models with time correlation modification and residual modification.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th colspan="2" align="left">Horizons</th>
<th colspan="3" align="center">One-step ahead</th>
<th colspan="3" align="center">Two-step ahead</th>
<th colspan="3" align="center">Three-step ahead</th>
</tr>
<tr>
<th colspan="2" align="left">Indices</th>
<th align="center">MAE (TWh)</th>
<th align="center">MAPE (%)</th>
<th align="center">COR</th>
<th align="center">MAE (TWh)</th>
<th align="center">MAPE (%)</th>
<th align="center">COR</th>
<th align="center">MAE (TWh)</th>
<th align="center">MAPE (%)</th>
<th align="center">COR</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td rowspan="4" align="left">TCM</td>
<td align="left">STL-SARIMA-TCM</td>
<td align="char" char=".">118</td>
<td align="char" char=".">1.86</td>
<td align="char" char=".">0.97</td>
<td align="char" char=".">115</td>
<td align="char" char=".">1.83</td>
<td align="char" char=".">0.96</td>
<td align="char" char=".">127</td>
<td align="char" char=".">2.04</td>
<td align="char" char=".">0.96</td>
</tr>
<tr>
<td align="left">STL-SVR-TCM</td>
<td align="char" char=".">131</td>
<td align="char" char=".">2.05</td>
<td align="char" char=".">0.97</td>
<td align="char" char=".">131</td>
<td align="char" char=".">2.05</td>
<td align="char" char=".">0.97</td>
<td align="char" char=".">182</td>
<td align="char" char=".">2.84</td>
<td align="char" char=".">0.96</td>
</tr>
<tr>
<td align="left">STL-ANN-TCM</td>
<td align="char" char=".">134</td>
<td align="char" char=".">2.11</td>
<td align="char" char=".">0.97</td>
<td align="char" char=".">136</td>
<td align="char" char=".">2.14</td>
<td align="char" char=".">0.96</td>
<td align="char" char=".">168</td>
<td align="char" char=".">2.68</td>
<td align="char" char=".">0.96</td>
</tr>
<tr>
<td align="left">STL-LSTM-TCM</td>
<td align="char" char=".">158</td>
<td align="char" char=".">2.61</td>
<td align="char" char=".">0.97</td>
<td align="char" char=".">165</td>
<td align="char" char=".">2.71</td>
<td align="char" char=".">0.97</td>
<td align="char" char=".">167</td>
<td align="char" char=".">2.70</td>
<td align="char" char=".">0.95</td>
</tr>
<tr>
<td rowspan="4" align="left">RM</td>
<td align="left">STL-SARIMA-TCM-RM</td>
<td align="char" char=".">113</td>
<td align="char" char=".">1.82</td>
<td align="char" char=".">0.97</td>
<td align="char" char=".">113</td>
<td align="char" char=".">1.80</td>
<td align="char" char=".">0.97</td>
<td align="char" char=".">123</td>
<td align="char" char=".">1.98</td>
<td align="char" char=".">0.96</td>
</tr>
<tr>
<td align="left">STL-SVR-TCM-RM</td>
<td align="char" char=".">135</td>
<td align="char" char=".">2.14</td>
<td align="char" char=".">0.97</td>
<td align="char" char=".">136</td>
<td align="char" char=".">2.15</td>
<td align="char" char=".">0.97</td>
<td align="char" char=".">187</td>
<td align="char" char=".">2.92</td>
<td align="char" char=".">0.96</td>
</tr>
<tr>
<td align="left">STL-ANN-TCM-RM</td>
<td align="char" char=".">129</td>
<td align="char" char=".">2.06</td>
<td align="char" char=".">0.97</td>
<td align="char" char=".">132</td>
<td align="char" char=".">2.10</td>
<td align="char" char=".">0.96</td>
<td align="char" char=".">156</td>
<td align="char" char=".">2.48</td>
<td align="char" char=".">0.96</td>
</tr>
<tr>
<td align="left">STL-LSTM-TCM-RM</td>
<td align="char" char=".">129</td>
<td align="char" char=".">2.10</td>
<td align="char" char=".">0.97</td>
<td align="char" char=".">131</td>
<td align="char" char=".">2.11</td>
<td align="char" char=".">0.97</td>
<td align="char" char=".">141</td>
<td align="char" char=".">2.27</td>
<td align="char" char=".">0.96</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s3-3-3">
<title>Residual Modification</title>
<p>
<xref ref-type="fig" rid="F5">Figure&#x20;5</xref> shows that most of the errors come from a residual component. This is because the residual component has nonlinear and irregular characteristics; a single model may only extract a certain feature of the sequence, so the forecasting accuracy of a single model is low. Therefore, we need to improve the forecasting accuracy of the residual component. We integrate the residual component predicted by SARIMA, SVR, ANN, and LSTM into a new sequence, and&#x20;replace the residual component predicted by the above&#x20;four methods with the new sequence to optimize each model. Rows 7&#x2013;10 in <xref ref-type="table" rid="T2">Table&#x20;2</xref> show that the forecasting accuracy has been improved after residual modification&#x20;(RM).</p>
</sec>
<sec id="s3-3-4">
<title>Comparison Between Different Models</title>
<p>
<xref ref-type="fig" rid="F6">Figures 6</xref>&#x2013;<xref ref-type="fig" rid="F8">8</xref> show that after STL decomposition, time correlation modification, and residual modification, the forecasting accuracy of each model has been gradually improved. Among them, the forecasting accuracy improved the most after STL decomposition. This is mainly because there are many random disturbances in the original sequence, and the model will be affected by these disturbances if it is not decomposed.</p>
<fig id="F6" position="float">
<label>FIGURE 6</label>
<caption>
<p>Comparison between different models for 1-month ahead forecasting.</p>
</caption>
<graphic xlink:href="fenrg-09-792358-g006.tif"/>
</fig>
<fig id="F7" position="float">
<label>FIGURE 7</label>
<caption>
<p>Comparison between different models for 2-month ahead forecasting.</p>
</caption>
<graphic xlink:href="fenrg-09-792358-g007.tif"/>
</fig>
<fig id="F8" position="float">
<label>FIGURE 8</label>
<caption>
<p>Comparison between different models for 3-month ahead forecasting.</p>
</caption>
<graphic xlink:href="fenrg-09-792358-g008.tif"/>
</fig>
</sec>
</sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>Discussion</title>
<p>According to <xref ref-type="fig" rid="F6">Figures 6</xref>&#x2013;<xref ref-type="fig" rid="F8">8</xref>, STL&#x2013;SARIMA&#x2013;TCM&#x2013;RM is the most accurate forecasting model.<xref ref-type="fn" rid="fn3">
<sup>3</sup>
</xref>. As we can see, on the one hand, compared with machine learning, SARIMA is better at forecasting trend, season, and other sequences with clear patterns. That is why it is so accurate. On the other hand, SARIMA is not good at forecasting an irregular random term. Therefore, residual modification can improve the forecasting accuracy of SARIMA most significantly. <xref ref-type="fig" rid="F9">Figures 9</xref>&#x2013;<xref ref-type="fig" rid="F11">11</xref> show the STL&#x2013;SARIMA&#x2013;TCM&#x2013;RM forecasting performance in the data set, as well as a scatter plot of forecasting results and actual values.</p>
<fig id="F9" position="float">
<label>FIGURE 9</label>
<caption>
<p>STL-SARIMA&#x2013;time correlation modification (TCM)&#x2013;residual modification (RM) for 1-month ahead forecasting.</p>
</caption>
<graphic xlink:href="fenrg-09-792358-g009.tif"/>
</fig>
<fig id="F10" position="float">
<label>FIGURE 10</label>
<caption>
<p>STL-SARIMA-TCM-RM for 2-month ahead forecasting.</p>
</caption>
<graphic xlink:href="fenrg-09-792358-g010.tif"/>
</fig>
<fig id="F11" position="float">
<label>FIGURE 11</label>
<caption>
<p>STL-SARIMA-TCM-RM for 3-month ahead forecasting.</p>
</caption>
<graphic xlink:href="fenrg-09-792358-g011.tif"/>
</fig>
<p>Considering that the test set includes COVID-19, we divide the test set into 2019, 2020, and 2021. <xref ref-type="table" rid="T3">Table&#x20;3</xref> shows that the 2019 forecast results are significantly better than that for 2020 and&#x20;2021.</p>
<table-wrap id="T3" position="float">
<label>TABLE 3</label>
<caption>
<p>Performance evaluation of STL-SARIMA-TCM-RM in 2019, 2020, and&#x20;2021.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left">Horizons</th>
<th colspan="3" align="center">One-step ahead</th>
<th colspan="3" align="center">Two-step ahead</th>
<th colspan="3" align="center">Three-step ahead</th>
</tr>
<tr>
<th align="left">Indices</th>
<th align="center">MAE (TWh)</th>
<th align="center">MAPE (%)</th>
<th align="center">COR</th>
<th align="center">MAE (TWh)</th>
<th align="center">MAPE (%)</th>
<th align="center">COR</th>
<th align="center">MAE (TWh)</th>
<th align="center">MAPE (%)</th>
<th align="center">COR</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">2019</td>
<td align="char" char=".">70</td>
<td align="char" char=".">1.16</td>
<td align="char" char=".">0.99</td>
<td align="char" char=".">52</td>
<td align="char" char=".">0.86</td>
<td align="char" char=".">0.99</td>
<td align="char" char=".">48</td>
<td align="char" char=".">0.76</td>
<td align="char" char=".">0.99</td>
</tr>
<tr>
<td align="left">2020</td>
<td align="char" char=".">166</td>
<td align="char" char=".">2.77</td>
<td align="char" char=".">0.97</td>
<td align="char" char=".">193</td>
<td align="char" char=".">3.19</td>
<td align="char" char=".">0.97</td>
<td align="char" char=".">220</td>
<td align="char" char=".">3.66</td>
<td align="char" char=".">0.96</td>
</tr>
<tr>
<td align="left">2021</td>
<td align="char" char=".">97</td>
<td align="char" char=".">1.36</td>
<td align="char" char=".">0.98</td>
<td align="char" char=".">82</td>
<td align="char" char=".">1.11</td>
<td align="char" char=".">0.99</td>
<td align="char" char=".">89</td>
<td align="char" char=".">1.24</td>
<td align="char" char=".">0.98</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec sec-type="conclusion" id="s5">
<title>Conclusion</title>
<p>This paper provides a novel decomposition and combination method to forecast electricity consumption. This approach first uses STL to decompose the sequence into trend, season, and residual components. Then the three decomposed subsequences are forecasted, and the season component forecasting results are modified according to the annual periodicity, and the forecasting results of the residual component of each model are integrated. The results show that STL-SARIMA-TCM-RM is the most accurate forecasting&#x20;model.</p>
<p>In addition to electricity forecasting, we believe that the forecasting method proposed in this paper can also be used to solve other mid- and long-term forecasting problems with obvious seasonal characteristics, including tourist flow forecasting, energy consumption forecasting, traffic flow forecasting, and so on. Furthermore, this paper only focuses on univariate time series analysis and does not consider other factors affecting electricity consumption. If these factors can be introduced into the proposed learning method, the predictive performance may be better.</p>
</sec>
</body>
<back>
<sec id="s6">
<title>Data Availability Statement</title>
<p>The raw data supporting the conclusion of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="s7">
<title>Author Contributions</title>
<p>All authors listed have made a substantial, direct, and intellectual contribution to the work and approved it for publication.</p>
</sec>
<sec id="s8">
<title>Funding</title>
<p>The research was supported by National Natural Science Foundation of China (72003009).</p>
</sec>
<sec sec-type="COI-statement" id="s9">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s10">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<fn-group>
<fn id="fn1">
<label>1</label>
<p>
<xref ref-type="bibr" rid="B28">Wang et&#x20;al.,&#x20;2020</xref>.</p>
</fn>
<fn id="fn2">
<label>2</label>
<p>In the later empirical research, we treat the January and February averages as observations of a new month 1 and 2 each&#x20;year.</p>
</fn>
<fn id="fn3">
<label>3</label>
<p>The STL-SARIMA-TCM-RM model is also superior to the existing models (<xref ref-type="bibr" rid="B35">Zhao et&#x20;al., 2014</xref>; <xref ref-type="bibr" rid="B4">Cao and Wu, 2016</xref>; <xref ref-type="bibr" rid="B12">Jiang et&#x20;al., 2020</xref>; <xref ref-type="bibr" rid="B19">Liu et&#x20;al., 2020</xref>). Their models&#x2019; MAPE all above 2, and the STL-SARIMA-TCM-RM model is less than&#x20;2.</p>
</fn>
</fn-group>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Akay</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Atak</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2007</year>). <article-title>Grey Prediction with Rolling Mechanism for Electricity Demand Forecasting of Turkey</article-title>. <source>Energy</source> <volume>32</volume> (<issue>9</issue>), <fpage>1670</fpage>&#x2013;<lpage>1675</lpage>. <pub-id pub-id-type="doi">10.1016/j.energy.2006.11.014</pub-id> </citation>
</ref>
<ref id="B2">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bahrami</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Hooshmand</surname>
<given-names>R.-A.</given-names>
</name>
<name>
<surname>Parastegari</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Short Term Electric Load Forecasting by Wavelet Transform and Grey Model Improved by PSO (Particle Swarm Optimization) Algorithm</article-title>. <source>Energy</source> <volume>72</volume>, <fpage>434</fpage>&#x2013;<lpage>442</lpage>. <pub-id pub-id-type="doi">10.1016/j.energy.2014.05.065</pub-id> </citation>
</ref>
<ref id="B3">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bedi</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Toshniwal</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Deep Learning Framework to Forecast Electricity Demand</article-title>. <source>Appl. Energ.</source> <volume>238</volume>, <fpage>1312</fpage>&#x2013;<lpage>1326</lpage>. <pub-id pub-id-type="doi">10.1016/j.apenergy.2019.01.113</pub-id> </citation>
</ref>
<ref id="B4">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cao</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Wu</surname>
<given-names>L.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Support Vector Regression with Fruit Fly Optimization Algorithm for Seasonal Electricity Consumption Forecasting</article-title>. <source>Energy</source> <volume>115</volume>, <fpage>734</fpage>&#x2013;<lpage>745</lpage>. <pub-id pub-id-type="doi">10.1016/j.energy.2016.09.065</pub-id> </citation>
</ref>
<ref id="B5">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cleveland</surname>
<given-names>R. B.</given-names>
</name>
<name>
<surname>Cleveland</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>McRae</surname>
<given-names>J.&#x20;E.</given-names>
</name>
<name>
<surname>Terpenning</surname>
<given-names>I. J.</given-names>
</name>
</person-group> (<year>1990</year>). <article-title>STL: A Seasonal-Trend Decomposition Procedure Based on Loess (With Discussion)</article-title>. <source>J. Off. Stat</source> <volume>6</volume>, <fpage>3</fpage>&#x2013;<lpage>73</lpage>. </citation>
</ref>
<ref id="B6">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>de Oliveira</surname>
<given-names>E. M.</given-names>
</name>
<name>
<surname>Cyrino Oliveira</surname>
<given-names>F. L.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Forecasting Mid-long Term Electric Energy Consumption through Bagging ARIMA and Exponential Smoothing Methods</article-title>. <source>Energy</source> <volume>144</volume>, <fpage>776</fpage>&#x2013;<lpage>788</lpage>. <pub-id pub-id-type="doi">10.1016/j.energy.2017.12.049</pub-id> </citation>
</ref>
<ref id="B7">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ding</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Hipel</surname>
<given-names>K. W.</given-names>
</name>
<name>
<surname>DangDang</surname>
<given-names>Y.-g.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Forecasting China&#x27;s Electricity Consumption Using a New Grey Prediction Model</article-title>. <source>Energy</source> <volume>149</volume>, <fpage>314</fpage>&#x2013;<lpage>328</lpage>. <pub-id pub-id-type="doi">10.1016/j.energy.2018.01.169</pub-id> </citation>
</ref>
<ref id="B8">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ghadimi</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Akbarimajd</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Shayeghi</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Abedinia</surname>
<given-names>O.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Two Stage Forecast Engine with Feature Selection Technique and Improved Meta-Heuristic Algorithm for Electricity Load Forecasting</article-title>. <source>Energy</source> <volume>161</volume>, <fpage>130</fpage>&#x2013;<lpage>142</lpage>. <pub-id pub-id-type="doi">10.1016/j.energy.2018.07.088</pub-id> </citation>
</ref>
<ref id="B9">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hamza&#xe7;ebi</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>H&#xfc;seyin Avni.</surname>
<given-names>Es.</given-names>
</name>
<name>
<surname>Es</surname>
<given-names>H. A.</given-names>
</name>
<name>
<surname>&#xc7;akmak</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Forecasting of Turkey&#x27;s Monthly Electricity Demand by Seasonal Artificial Neural Network</article-title>. <source>Neural Comput. Applic</source> <volume>31</volume> (<issue>7</issue>), <fpage>2217</fpage>&#x2013;<lpage>2231</lpage>. <pub-id pub-id-type="doi">10.1007/s00521-017-3183-5</pub-id> </citation>
</ref>
<ref id="B10">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hern&#xe1;ndez</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Energy Insecurity: A Framework for Understanding Energy, the Built Environment, and Health Among Vulnerable Populations in the Context of Climate Change</article-title>. <source>Am. J.&#x20;Public Health</source> <volume>103</volume> (<issue>4</issue>), <fpage>e32</fpage>&#x2013;<lpage>e34</lpage>. <pub-id pub-id-type="doi">10.2105/ajph.2012.301179</pub-id> </citation>
</ref>
<ref id="B11">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hussain</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Rahman</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Memon</surname>
<given-names>J.&#x20;A.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Forecasting Electricity Consumption in Pakistan: The Way Forward</article-title>. <source>Energy Policy</source> <volume>90</volume>, <fpage>73</fpage>&#x2013;<lpage>80</lpage>. <pub-id pub-id-type="doi">10.1016/j.enpol.2015.11.028</pub-id> </citation>
</ref>
<ref id="B12">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Jiang</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Wu</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Gong</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Yu</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Zhong</surname>
<given-names>X.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Holt-Winters Smoothing Enhanced by Fruit Fly Optimization Algorithm to Forecast Monthly Electricity Consumption</article-title>. <source>Energy</source> <volume>193</volume>, <fpage>116779</fpage>. <pub-id pub-id-type="doi">10.1016/j.energy.2019.116779</pub-id> </citation>
</ref>
<ref id="B13">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kandananond</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>Forecasting Electricity Demand in Thailand with an Artificial Neural Network Approach</article-title>. <source>Energies</source> <volume>4</volume> (<issue>8</issue>), <fpage>1246</fpage>&#x2013;<lpage>1257</lpage>. <pub-id pub-id-type="doi">10.3390/en4081246</pub-id> </citation>
</ref>
<ref id="B14">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kavaklioglu</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>Modeling and Prediction of Turkey&#x27;s Electricity Consumption Using Support Vector Regression</article-title>. <source>Appl. Energ.</source> <volume>88</volume> (<issue>1</issue>), <fpage>368</fpage>&#x2013;<lpage>375</lpage>. <pub-id pub-id-type="doi">10.1016/j.apenergy.2010.07.021</pub-id> </citation>
</ref>
<ref id="B15">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kaytez</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Taplamacioglu</surname>
<given-names>M. C.</given-names>
</name>
<name>
<surname>Cam</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Hardalac</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Forecasting Electricity Consumption: A Comparison of Regression Analysis, Neural Networks and Least Squares Support Vector Machines</article-title>. <source>Int. J.&#x20;Electr. Power Energ. Syst.</source> <volume>67</volume>, <fpage>431</fpage>&#x2013;<lpage>438</lpage>. <pub-id pub-id-type="doi">10.1016/j.ijepes.2014.12.036</pub-id> </citation>
</ref>
<ref id="B16">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>LeCun</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Bengio</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Hinton</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Deep Learning</article-title>. <source>Nature</source> <volume>521</volume> (<issue>7553</issue>), <fpage>436</fpage>&#x2013;<lpage>444</lpage>. <pub-id pub-id-type="doi">10.1038/nature14539</pub-id> </citation>
</ref>
<ref id="B17">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lin</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Liu</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Why Is Electricity Consumption Inconsistent with Economic Growth in China</article-title>. <source>Energy Policy</source> <volume>88</volume>, <fpage>310</fpage>&#x2013;<lpage>316</lpage>. <pub-id pub-id-type="doi">10.1016/j.enpol.2015.10.031</pub-id> </citation>
</ref>
<ref id="B18">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Liu</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Ghadimi</surname>
<given-names>N.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Electricity Load Forecasting by an Improved Forecast Engine for Building Level Consumers</article-title>. <source>Energy</source> <volume>139</volume>, <fpage>18</fpage>&#x2013;<lpage>30</lpage>. <pub-id pub-id-type="doi">10.1016/j.energy.2017.07.150</pub-id> </citation>
</ref>
<ref id="B19">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Liu</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Zhao</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Liu</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Chen</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Ouyang</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Regional Midterm Electricity Demand Forecasting Based on Economic, Weather, Holiday, and Events Factors</article-title>. <source>IEEJ&#x20;Trans. Elec Electron. Eng.</source> <volume>15</volume>, <fpage>225</fpage>&#x2013;<lpage>234</lpage>. <pub-id pub-id-type="doi">10.1002/tee.23049</pub-id> </citation>
</ref>
<ref id="B20">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mohamed</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Bodger</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>2005</year>). <article-title>Forecasting Electricity Consumption in New&#x20;Zealand Using Economic and Demographic Variables</article-title>. <source>Energy</source> <volume>30</volume> (<issue>10</issue>), <fpage>1833</fpage>&#x2013;<lpage>1843</lpage>. <pub-id pub-id-type="doi">10.1016/j.energy.2004.08.012</pub-id> </citation>
</ref>
<ref id="B21">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nguyen</surname>
<given-names>H. T.</given-names>
</name>
<name>
<surname>Nabney</surname>
<given-names>I. T.</given-names>
</name>
</person-group> (<year>2010</year>). <article-title>Short-Term Electricity Demand and Gas Price Forecasts Using Wavelet Transforms and Adaptive Models</article-title>. <source>Energy</source> <volume>35</volume> (<issue>9</issue>), <fpage>3674</fpage>&#x2013;<lpage>3685</lpage>. <pub-id pub-id-type="doi">10.1016/j.energy.2010.05.013</pub-id> </citation>
</ref>
<ref id="B22">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Pai</surname>
<given-names>P.-F.</given-names>
</name>
<name>
<surname>Hong</surname>
<given-names>W. C. H.</given-names>
</name>
</person-group> (<year>2005</year>). <article-title>Support Vector Machines with Simulated Annealing Algorithms in Electricity Load Forecasting</article-title>. <source>Energ. Convers. Manag.</source> <volume>46</volume> (<issue>17</issue>), <fpage>2669</fpage>&#x2013;<lpage>2688</lpage>. <pub-id pub-id-type="doi">10.1016/j.enconman.2005.02.004</pub-id> </citation>
</ref>
<ref id="B23">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rendon-Sanchez</surname>
<given-names>J.&#x20;F.</given-names>
</name>
<name>
<surname>de Menezes</surname>
<given-names>L. M.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Structural Combination of Seasonal Exponential Smoothing Forecasts Applied to Load Forecasting</article-title>. <source>Eur. J.&#x20;Oper. Res.</source> <volume>275</volume> (<issue>3</issue>), <fpage>916</fpage>&#x2013;<lpage>924</lpage>. <pub-id pub-id-type="doi">10.1016/j.ejor.2018.12.013</pub-id> </citation>
</ref>
<ref id="B24">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sadaei</surname>
<given-names>H. J.</given-names>
</name>
<name>
<surname>de Lima e SilvaSilva</surname>
<given-names>P. C.</given-names>
</name>
<name>
<surname>Guimar&#xe3;es</surname>
<given-names>F. G.</given-names>
</name>
<name>
<surname>Lee</surname>
<given-names>M. H.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Short-Term Load Forecasting by Using a Combined Method of Convolutional Neural Networks and Fuzzy Time Series</article-title>. <source>Energy</source> <volume>175</volume>, <fpage>365</fpage>&#x2013;<lpage>377</lpage>. <pub-id pub-id-type="doi">10.1016/j.energy.2019.03.081</pub-id> </citation>
</ref>
<ref id="B25">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sutskever</surname>
<given-names>I.</given-names>
</name>
<name>
<surname>Vinyals</surname>
<given-names>O.</given-names>
</name>
<name>
<surname>QuocLe</surname>
<given-names>v.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Sequence to Sequence Learning with Neural Networks</article-title>. <source>Adv. Neural Inf. Process. Syst.</source> <volume>4</volume> (<issue>January</issue>), <fpage>3104</fpage>&#x2013;<lpage>3112</lpage>. </citation>
</ref>
<ref id="B26">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zhu</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Huang</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Shi</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Cai</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Song</surname>
<given-names>Y.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>Transport Pathways and Potential Sources of PM10 in Beijing</article-title>. <source>Atmos. Environ.</source> <volume>45</volume> (<issue>3</issue>), <fpage>594</fpage>&#x2013;<lpage>604</lpage>. <pub-id pub-id-type="doi">10.1016/j.atmosenv.2010.10.040</pub-id> </citation>
</ref>
<ref id="B27">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Vapnik</surname>
<given-names>V.</given-names>
</name>
</person-group> (<year>1963</year>). <article-title>Pattern Recognition Using Generalized Portrait Method</article-title>. <source>Autom. Remote Control</source> <volume>24</volume>, <fpage>774</fpage>&#x2013;<lpage>780</lpage>. </citation>
</ref>
<ref id="B28">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Xuan</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Zhen</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Li</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Shi</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>A Day-Ahead PV Power Forecasting Method Based on LSTM-RNN Model and Time Correlation Modification under Partial Daily Pattern Prediction Framework</article-title>. <source>Energ. Convers. Manag.</source> <volume>212</volume>, <fpage>112766</fpage>. <pub-id pub-id-type="doi">10.1016/j.enconman.2020.112766</pub-id> </citation>
</ref>
<ref id="B29">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Zhao</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Dong</surname>
<given-names>Y.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>Application of Residual Modification Approach in Seasonal ARIMA for Electricity Demand Forecasting: A Case Study of China</article-title>. <source>Energy Policy</source> <volume>48</volume>, <fpage>284</fpage>&#x2013;<lpage>294</lpage>. <pub-id pub-id-type="doi">10.1016/j.enpol.2012.05.026</pub-id> </citation>
</ref>
<ref id="B30">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>Z.-X.</given-names>
</name>
<name>
<surname>Li</surname>
<given-names>Q.</given-names>
</name>
<name>
<surname>Pei</surname>
<given-names>L.-L.</given-names>
</name>
<name>
<surname>Pei</surname>
<given-names>L. L.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>A Seasonal GM(1,1) Model for Forecasting the Electricity Consumption of the Primary Economic Sectors</article-title>. <source>Energy</source> <volume>154</volume>, <fpage>522</fpage>&#x2013;<lpage>534</lpage>. <pub-id pub-id-type="doi">10.1016/j.energy.2018.04.155</pub-id> </citation>
</ref>
<ref id="B31">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wu</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Gao</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Xiao</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Yang</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Chen</surname>
<given-names>X.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Using a Novel Multi-Variable Grey Model to Forecast the Electricity Consumption of Shandong Province in China</article-title>. <source>Energy</source> <volume>157</volume>, <fpage>327</fpage>&#x2013;<lpage>335</lpage>. <pub-id pub-id-type="doi">10.1016/j.energy.2018.05.147</pub-id> </citation>
</ref>
<ref id="B32">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Xu</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Dang</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Gong</surname>
<given-names>Y.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Novel Grey Prediction Model with Nonlinear Optimized Time Response Method for Forecasting of Electricity Consumption in China</article-title>. <source>Energy</source> <volume>118</volume>, <fpage>473</fpage>&#x2013;<lpage>480</lpage>. <pub-id pub-id-type="doi">10.1016/j.energy.2016.10.003</pub-id> </citation>
</ref>
<ref id="B33">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Yuan</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Liu</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Fang</surname>
<given-names>Z.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Comparison of China&#x27;s Primary Energy Consumption Forecasting by Using ARIMA (The Autoregressive Integrated Moving Average) Model and GM(1,1) Model</article-title>. <source>Energy</source> <volume>100</volume>, <fpage>384</fpage>&#x2013;<lpage>390</lpage>. <pub-id pub-id-type="doi">10.1016/j.energy.2016.02.001</pub-id> </citation>
</ref>
<ref id="B34">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zhao</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Guo</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>An Optimized Grey Model for Annual Power Load Forecasting</article-title>. <source>Energy</source> <volume>107</volume>, <fpage>272</fpage>&#x2013;<lpage>286</lpage>. <pub-id pub-id-type="doi">10.1016/j.energy.2016.04.009</pub-id> </citation>
</ref>
<ref id="B35">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zhao</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Lu</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Combining Forecasts of Electricity Consumption in China with Time-Varying Weights Updated by a High-Order Markov Chain Model</article-title>. <source>Omega</source> <volume>45</volume>, <fpage>80</fpage>&#x2013;<lpage>91</lpage>. <pub-id pub-id-type="doi">10.1016/j.omega.2014.01.002</pub-id> </citation>
</ref>
</ref-list>
</back>
</article>