Conference PaperPDF Available

Big Data Based Electricity Price Forecasting Using Enhanced Convolutional Neural Network in the Smart Grid

Authors:

Abstract and Figures

With the development of renewable energies resources and uncertainties in load time series, it is necessary to predict an accurate price for efficient scheduling and operation of generation that is reliable and reduce the power losses in smart grid. The machine learning algorithms are mostly used for power and price forecasting. However, on large data set, it causes over fitting, computational overhead and complexity. To cope with these challenges, in this paper, an electricity price forecasting model is developed using deep learning technique. The proposed method is composed of three modules. First, to performs better feature selection, a hybrid model composed of Mutual Information (MI) and ReliefF is used. Second, Kernel Principal Component Analysis (KPCA) is performed to avoid feature redundancy. Finally, Enhanced Convolution Neural Network (ECNN) performs the regression. To investigate the performance of the proposed model, the results of the proposed is compared with Multilayer Perceptron (MLP) and Support Vector Machine (SVM) as benchmark schemes. The accuracy results show that the performance of our model is better than benchmark schemes. Our technique is robust and helps in better operation and planning of generation in smart grid.
Content may be subject to copyright.
Big Data Based Electricity Price Forecasting
Using Enhanced Convolutional Neural Network
in the Smart Grid
Muhammad Adil, Nadeem Javaid, Nazia Daood, Muhammad Asim, Irfan ullah,
and Muhammad Bilal
Abstract With the development of renewable energies resources and uncertainties
in load time series, it is necessary to predict an accurate price for efficient schedul-
ing and operation of generation that is reliable and reduce the power losses in smart
grid. The machine learning algorithms are mostly used for power and price forecast-
ing. However, on large data set, it causes over fitting, computational overhead and
complexity. To cope with these challenges, in this paper, an electricity price fore-
casting model is developed using deep learning technique. The proposed method
is composed of three modules. First, to performs better feature selection, a hybrid
model composed of Mutual Information (MI) and ReliefF is used. Second, Kernel
Principal Component Analysis (KPCA) is performed to avoid feature redundancy.
Finally, Enhanced Convolution Neural Network (ECNN) performs the regression.
To investigate the performance of the proposed model, the results of the proposed is
compared with Multilayer Perceptron (MLP) and Support Vector Machine (SVM) as
benchmark schemes. The accuracy results show that the performance of our model
is better than benchmark schemes. Our technique is robust and helps in better oper-
ation and planning of generation in smart grid.
1 Introduction
The reliability and losses in power system due to inappropriate generation of elec-
tricity are the key issues in power system. The recent efforts made in development
of data science in smart grid for electricity load and price forecasting has played a
vital role in balancing the supply and demand and planning an efficient operation of
generation. Smart grid provides the two-way communication between supplier and
Muhammad Adil, Nadeem Javiad (Coressponding Author), Nazia Daood, Muhammad Asim, Irfan
ullah, and Muhammad Bilal
COMSATS University Islamabad, Islamabad 44000, Pakistan e-mail: : nadeem-
javaidqau@gmail.com
1
2 Authors Suppressed Due to Excessive Length
user to prevent the electricity outages and blackouts. To reduce the losses in power
system, it is necessary to predict an accurate price prediction of electricity prices
to make an efficient generation and planning of electricity consumption. With the
introduction of Renewable Energies (RE) and Distributed Energy Resources (RES)
in the recent years, the prediction of electricity prices becomes difficult as they are
intermittent in nature. The generation of solar and wind power depend on solar ra-
diance and wind speed respectively. Moreover,there are various factors affecting the
electricity price forecasting such as renewable energies like solar and wind, fuel
prices, temperature, humidity and seasons that majorly effect the consumption be-
haviour of electricity prices.
Machine learning techniques have been introduced for prediction of electricity
prices for short and long-term forecasting to solve the aforementioned problems.
Machine learning uses the artificial intelligence algorithms that first take the training
data and predict an output function based on learned experience. For minimizing the
loss function, the optimization techniques are used that tune the parameters of the
machine learning algorithm to get an optimal result. Most of the price forecasting
work has been done in literature. The authors addressed the problem to take big
data into consideration for prediction of electricity prices to improve the prediction
accuracy [1]. The Voltage fluctuation in power systems cause the major wastage
of electricity. However, in accurate electricity price forecasting there are still some
issues like cost of computation, reliability and execution time [1]. The MLP is used
for classification of electricity prices that causes the problem of over fitting. In [2],
the authors addressed the problem of long-term forecasting of electricity prices.
In [3], the Stacked De noising Autoencoders (SDA) is used for feature selection.
However, to train an autoencoder, it requires a lot of data processing time, hyper
tuning parameter and over fitting. The authors use Stacked Sparse Autoencoders
(SSAE) which use back propagation to reduce the error. However, back propagation
has problems in weight adjustment [4]. In [7], the authors addressed the issues on
the residential load forecasting to support future grid application.
The aforementioned literature has some limitations which need some attention
to overcome and enhance the performance of electricity price prediction. To tackle
these limitations, an enhanced deep neural network is introduced. First, for good
performance of classfier, a hybrid feature selection is performed using ReliefF and
MI. To avoid feature redundancy, KPCA is performed. The refned features are given
to ECNN for classifcation of electricity prices. The framework performs better when
compared with existing benchmark schemes in terms of performance matrix. The
benchmark candidates are NB, DT, SVR and MLP. The major contributions of this
paper are:
The complexity and execution time of feature selection is reduced which overall
reduce the computational time and enhance the performance of the framework.
The problem of overfitting is overcome which increasing the accuracy perfor-
mance of forecasting model.
The framework performs better on complex data set by predicting the prices
through ECNN which work better on big kernel function time series data.
Title Suppressed Due to Excessive Length 3
The rest of paper is organized as follow. Section II represents the literature re-
view. In Section III and IV, the problem statement and proposed solution is demon-
strated respectively. Section V discusses the methodology for the proposed method.
In VI, the simulations results are discussed. Finally, conclusion and future work are
talk about in the last section.
2 Related Work
The literature review related to our work is discussed in this section.
2.1 Load Forecasting Work
Table 1: Summary of price forecasting work from existing literature
Problem Addressed Proposed Solution Techniques Simulation Validation Limitations
Big data Prediction[1] HSEC RF,ReliefF,
KPCA, SVM
Accuracy and error Complexity and execu-
tion time
Long term forecasting[2] ANN MI,KNN, ANN MAD,RMSE Robustness, overfitting
Overfitting[3] DPP KNN,SVR,
ELM,ENN
SDE,RMSE MAPE Complexity
STLF[10] SVR, BiLSTM EWT,SVR BiL-
STM,BO
MAE,MAPE, RMSE
Complex data[11] EPNet CNN,LSTM MAE,RMSE Execution Time
Limited data selec-
tion[13]
Re-routed method SVR,NN DNN MSE Limited RE integration
In [3], the authors utilize SDA for feature extraction and SVR for regression
for accurate load forecasting. However, to train an autoencoder it requires a lot of
data processing time, hyper tuning parameter and overfitting. In [5], the authors ad-
dressed the problem of extracting features and proposed a framework for load fore-
casting.In [7], the authors addressed the issues on the residential load forecasting to
support future grid application. In [9], the authors addressed the issue of accurately
forecasting the power, the authors proposed SVR technique to predict short-term
load forecasting model. An optimal function is used to predict the forecasting func-
tion. The authors used the case study of four cities to evaluate proposed model and
the result was good. In [14], the authors addressed to predict accurate load forecast-
ing using large time series data, the authors proposed a framework for electric load
forecasting using SVR. In [20-22], authors focused on feature selection techniques
for prediction of load forecasting using large time series data.
4 Authors Suppressed Due to Excessive Length
Table 2: Summary of load forecasting work from existing literature
Problem Addressed Proposed
Solution
Techniques Simulation Validation Limitations
Separate data Prepro-
cessing[3]
SDA SVR,SDA MAPE Over-fitting
Feature extraction[5] Deep NN MLP MAPE,MAE, MRPE Computationally
expensive
STLF[7] LSTM RNN MAPE Gradient vanishing
Fair base line in DR[9] SVR SVR RMSE,MAPE Over-fitting
Automatic lag selec-
tion[14]
KP-SVR ANN,ARIMA
KP-SVR
MAPE Computational time
Computational
Cost[15]
ENN ENN IEEE 14 bus system Limited bus system
2.2 Price Forecasting Work
In [6], the authors addressed the fluctuations in electricity price data that usually
cause the overfitting. In [10], the authors addressed the short-term load and power
forecasting problems. The authors in [11], addressed the problems of traditional
machine learning techniques on complex data set. In [13], the authors addressed
problem of accurate electricity price forecasting. In [23-26], the authors focused on
short term power forecasting time series data and achieve significant results.
3 Problem Statement
In [1], the Support Vector Machine (SVM) is used for regression. However, the al-
gorithm complexity and memory requirements are high. In case of high dimensional
kernel, it generates too many support vectors which reduce the training speed and
decrease the accuracy. For tuning the parameters, Differential Evolution (DE) opti-
mization technique is used. However, DE is prone to converge to local optima. In
[19], the Multilayer Perceptron (MLP) is used for classification of electricity prices.
However, it converges slow and easily trap to local optima. The performance of MLP
on large time series data cause the over fitting and degrade the accuracy of classi-
fier. The authors do not perform the selection and extraction techniques for feature
refinement, which makes the model more complex and reduces the accuracy.
Title Suppressed Due to Excessive Length 5
4 Proposed Model
In this paper, our proposed system model is shown in figure 1. The proposed model
has basically three modules. In the first module, a hybrid model is used for fea-
ture selection using Mutual Information (MI) and ReliefF technique. In the second
module, the Kernel Principle Component analysis (KPCA) avoid duplicate informa-
tion and third module is used for classification of electricity prices using Enhanced
Convolution Neural Network (ECNN).
Fig. 1: Proposed System Model
5 Overview of Proposed Methodology Approach
5.1 Data Collection and Pre-processing
In the data pre-processing stage, two steps are performed are data cleaning and data
normalization. In data cleaning, the null or undefined and irrelevant features from
the data set are removed. In data normalization, the data is scaled in to the range 0
and 1. The normalization formula given in [17] is used to normalize the data given
in equation 1. The purpose of normalization is to get data on a common scale.
A=(AMin(A))
(Max(A)Min(A)((DC) + C)(1)
6 Authors Suppressed Due to Excessive Length
Where A’ is normalized component of data sequence. C and D are the pre-defined
boundaries which is set between 0 and 1 respectively
5.2 Feature Selection
The accuracy of regression depend on the input features. Therefore, it necessary to
provide the relevant information to the classifier. A hybrid model is used for feature
selection that consist of MI and ReliefF.
5.2.1 Mutual Information Algorithm
MI calculate the relationship of two random variables x and y and measures how
much information is communicated. If information between two random variables
is zero, then it means that they are independent on each other and information gain
is zero. The information gain in equation 2,3 and 4 given in [18] is calculated as
IG(H(fi)H(fi|C)) (2)
from the above equation, H(Fi)represents the entropy for the feature of index i,
while H(fi|C)shows measure the entropy of feature of index i belonging to class C.
H(fi) =
j
p(xj)log2p(xj)(3)
H(fi|C) = p(xj|ck)
j
p(xj|ck)log2(p(xj|ck)) (4)
In this paper, the threshold value is set 0.1, any feature value having mutual
information gain greater than 0.1, the feature is selected, else it is rejected.
5.2.2 ReliefF Algorithm
ReliefF is widely used for feature selection in data science and it is enhanced version
of Relief. In ReliefF, the features importance value is calculated on the basis of
score and rank of each feature which is based on feature value difference observed
between the nearest neighbour instant pair find by Euclidean distance. The formula
to calculate the feature importance in [1] is given as
WF[Tk] = WF[Tk]k
j=1di f f (A,a
,Hj)
mk+C6=class(λ)di f f (A,a
,M j)
mk(5)
Title Suppressed Due to Excessive Length 7
If feature value difference is observed in nearest neighbour within the class called
miss, the feature value is decreased and get less feature importance value. If feature
value difference is observed with nearest neighbour pair within different class called
hit, then feature value increases and get high importance value.
The combined importance of ReliefF and MI is calculted for final feature selec-
tion. The thresold is selected as 0.5. Any feature value having importance less than
0.5 are rejected and feature importance having value greater than 0.5 are selected.
5.3 Extraction of Features
Extraction of feature is performed to extract redundant information from already
selected features. PCA is mostly used to avoid feature redundancy and assumes lin-
ear mapping. However, electricity price forecasting requires non-linear mapping.
In this paper, KPCA is used for feature redundancy and better exploit the compli-
cated structure from high to low dimension. The KPCA out performs better feature
extraction than the existing techniques.
5.4 Price Forecasting Model
The ECNN is deep neural network is used for electricity price forecasting in this
framework. The working of ECNN is shown in the flow diagram as shown in fig-
ure 5. The four layer performs the prediction of electricity prices. Firstly, the pre-
processed data after selection and extraction is fed at the input layer. Second is
the convolution layer, that contain filters and perform features mapping function. It
takes the input image and learn by calculating the weights and bias. The activation
function is Relu as given in [17].
Relu(x) = max(0,x)(6)
In equation 6, x shows the input features. If x is positive, the function returns the
actual value and return zero for negative value of x. The output from convolution
layer is given as input to Pooling layer. Pooling layer as shown in figure lies between
drop out layer and convolution layer. It combines the output of neurons and reduces
the computational overhead due to a smaller number of parameters. The Adam is
used as an optimizer that adjusts the learning weight and momentum.
8 Authors Suppressed Due to Excessive Length
Fig. 2: Flow daigram of ECNN
6 Simulation Results
6.1 Feature Selection
A hybrid feature selection technique using MI and ReliefF is used for feature selec-
tion to select the important features.
Title Suppressed Due to Excessive Length 9
Fig. 3: Feature Selection
6.2 Computational Time Comparison of MI with RF
In order to reduce the execution time for feature selection as discussed in section
three, in the proposed model, for feature selection MI is applied which is simple
technique to overcome this limitation. The Random Forest (RF) has hig computa-
tional time and complexity. To construct the decision tree it takes enough time . RF
computational time is twice greater than MI.
6.3 Comparison of Radial PCA with PCA and Linear KPCA
Feature extraction is performed to avoid the irrelevant information from the selected
features. KPCA performs the feature extraction that remove the duplicate informa-
tion to reduce overfitting. The comparison of Redial KPCA, linear KPCA and PCA
is shown in figure 5. Redial KPCA efficently extract the important principle compo-
nents than the other two methods.
10 Authors Suppressed Due to Excessive Length
Fig. 4: Performance of Redial and linear KPCA
Fig. 5: Comparision of proposed ECNN and benchmark schemes
Title Suppressed Due to Excessive Length 11
6.4 Performance of ECNN on Electricity Price Forecasting
The ECNN performs better for large time series data. In order to verify the effec-
tiveness of proposed model, the prediction and actual results as shown in figure 5
are very near to each other. The dotted yellow line shows price forecasting of ECNN
and red line represent actual price forecasting. To show effectiveness of ECNN, the
proposed model is compared with benchmark schemes and the results are shown in
the mention figures. The accuracy performance in figure 6 shows that the proposed
model performance is better results than existing benchmark schemes.
Fig. 6: Comparision of ECNN and benchmarks
7 Conclusion
This paper proposed a framework for forecasting the electricity price using deep
learning model on large time series data. The prime goal is to overcome the prob-
lems of over fitting, accuracy and complexity. To cope with these problems, we
proposed a model consists three modules. First, a hybrid module that comprised of
MI and ReliefF performs feature selection. The refined features are given to KPCA
12 Authors Suppressed Due to Excessive Length
to avoid further feature redundancy. Finally, an efficient prediction of power prices
is performed using ECNN. The proposed model is compared with existing mod-
els and the result of proposed method is promising. The system model is flexible
enough to achieve better result. For future work, the proposed model will be inte-
grated with more external features and increase system memory capacity to enhance
the performance of the model .
References
1. Wang, Kun, et al. ”Robust big data analytics for electricity price forecasting in the smart grid.
IEEE Transactions on Big Data 5.1 (2017): 34-45.
2. Keles, Dogan, et al. ”Extended forecast methods for day-ahead electricity spot prices applying
artificial neural networks.” Applied energy 162 (2016): 218-230.
3. Tong, Chao, et al. ”An efficient deep model for day-ahead electricity load forecasting with
stacked denoising auto-encoders.” Journal of Parallel and Distributed Computing 117 (2018):
267-273.
4. Chen, Kunjin, Jun Hu, and Jinliang He. ”A framework for automatically extracting overvoltage
features based on sparse autoencoder.” IEEE Transactions on Smart Grid 9.2 (2016): 594-604
5. Guo, Zhifeng, et al. ”A deep learning model for short-term power load and probability density
forecasting.” Energy 160 (2018): 1186-1200.
6. Shayeghi, Hossein, A. Ghasemi, Mohammad Moradzadeh, and M. Nooshyar. “Day-ahead elec-
tricity price forecasting using WPT, GMI and modified LSSVM-based S-OLABC algorithm.
Soft Computing 21, no. 2 (2017): 525-541.
7. Kong, Weicong, et al. ”Short-term residential load forecasting based on LSTM recurrent neural
network.” IEEE Transactions on Smart Grid 10.1 (2017): 841-851.
8. Gu, Quanquan, Zhenhui Li, and Jiawei Han. “Generalized fisher score for feature selection.
arXiv preprint arXiv:1202.3725 (2012).
9. Chen, Yongbao, et al. ”Short-term electrical load forecasting using the Support Vector Regres-
sion (SVR) model to calculate the demand response baseline for office buildings.” Applied
Energy 195 (2017): 659-670.
10. Cheng, Hangyang, et al. ”A hybrid electricity price forecasting model with Bayesian opti-
mization for German energy exchange.” International Journal of Electrical Power and Energy
Systems 110 (2019): 653-666.
11. Kuo, Ping-Huan, and Chiou-Jye Huang. ”An electricity price forecasting model by hybrid
structured deep neural networks.” Sustainability 10.4 (2018): 1280.
12. Lee, Woonghee, et al. ”Forecasting Solar Power Using Long-Short Term Memory and Con-
volutional Neural Networks.” IEEE Access 6 (2018): 73068-73080.
13. Luo, Shuman, and Yang Weng. ”A two-stage supervised learning approach for electricity price
forecasting by leveraging different data sources.” Applied energy 242 (2019): 1497-1512.
14. Maldonado, Sebastian, Agustin Gonzalez, and Sven Crone. ”Automatic time series analysis
for electric load forecasting via support vector regression.” Applied Soft Computing 83 (2019):
105616.
15. Devarajan, Sandhiya, and S. Chitra. ”LOAD FORECASTING MODEL FOR ENERGY
MANAGEMENT SYSTEM USING ELMAN NEURAL NETWORK.” International Research
Journal of Multidisciplinary Technovation 1.5 (2019): 48-56.
16. Devarajan, Sandhiya, and S. Chitra. ”LOAD FORECASTING MODEL FOR ENERGY
MANAGEMENT SYSTEM USING ELMAN NEURAL NETWORK.” International Research
Journal of Multidisciplinary Technovation 1.5 (2019): 48-56.
17. Zahid, Maheen, et al. ”Electricity price and load forecasting using enhanced convolutional
neural network and enhanced support vector regression in smart grids.” Electronics 8.2 (2019):
122.
Title Suppressed Due to Excessive Length 13
18. Yu, Lei, and Huan Liu. “Feature selection for high-dimensional data: A fast correlation-
based filter solution.” In Proceedings of the 20th international conference on machine learning
(ICML-03), pp. 856-863. 2003.
19. Giovanelli, Christian, et al. ”Exploiting Artificial Neural Networks for the Prediction of An-
cillary Energy Market Prices.” Energies 11.7 (2018): 1906.
20. Omaji Samuel, Fahad A. Alzahrani, Raja Jalees Ul Hussen Khan, Hassan Farooq, Muham-
mad Shafiq, Muhammad Khalil Afzal and Nadeem Javaid, ”Towards Modified Entropy Mutual
Information Feature Selection to Forecast Medium-Term Load Using a Deep Learning Model
in Smart Homes”, Entropy, Volume: 22, Issue: 1, Article Number: 68, Pages: 1-31, Published:
January 2020, ISSN: 1874-4907. DOI: https://doi.org/10.3390/e22010068.
21. Rabiya Khalid, Nadeem Javaid, Fahad A. Al-zahrani, Khursheed Aurangzeb, Emad-ul-
Haq Qazi and Tehreem Ashfaq, ”Electricity Load and Price Forecasting Using Jaya-
Long Short Term Memory (JLSTM) in Smart Grids”, Entropy, Volume: 22, Issue: 1,
Article Number: 10, Pages: 1-21, Published: January 2020, ISSN: 1099-4300. DOI:
https://doi.org/10.3390/e22010010.
22. Sana Mujeeb and Nadeem Javaid, ”ESAENARX and DE-RELM: Novel Schemes for Big Data
Predictive Analytics of Electricity Load and Price”, Sustainable Cities and Society, Volume:
51, Article Number: 101642, Pages: 1-16, Published: November 2019, ISSN: 2210-6707. DOI:
https://doi.org/10.1016/j.scs.2019.101642.
23. Sana Mujeeb, Turki Ali Alghamdi, Sameeh Ullah, Ayesha Fatima, Nadeem Javaid and Tanzila
Saba, ”Exploiting Deep Learning for Wind Power Forecasting based on Big Data Analytics”,
Applied Sciences, Volume: 9, Issue: 20, Article Number: 4417, Pages: 1-19, Published: October
2019, ISSN: 2076-3417, DOI: https://doi.org/10.3390/app9204417.
24. Aqdas Naz, Nadeem Javaid, Muhammad Babar Rasheed, Abdul Haseeb, Musaed Alhussein
and Khursheed Aurangzeb, ”Game Theoretical Energy Management with Storage Capacity Op-
timization and Photo-Voltaic Cell Generated Power Forecasting in Micro Grid”, Sustainability,
2019, Volume: 11, Issue: 10, Article Number: 2763, Pages: 1-22, Published: May 2019, ISSN:
2071-1050. DOI:https://doi.org/10.3390/su11102763.
25. Aqdas Naz, Muhammad Umar Javed, Nadeem Javaid, Tanzila Saba, Musaed Alhussein
and Khursheed Aurangzeb, ”Short-Term Electric Load and Price Forecasting Using En-
hanced Extreme Learning Machine Optimization in Smart Grids”, Energies, Volume: 12,
Issue: 5, Article Number: 866, Pages: 1-30, Published: March 2019, EISSN 1996-1073.
DOI:https://doi.org/10.3390/en12050866.
26. Sana Mujeeb, Nadeem Javaid, Manzoor Ilahi, Zahid Wadud, Farruh Ishmanov and Muham-
mad Khalil Afzal, ”Deep Long Short-Term Memory: A New Price and Load Fore-
casting Scheme for Big Data in Smart Cities”, Sustainability, Volume: 11, Issue: 4,
Article Number: 987, Pages: 1-29, Published: February 2019, ISSN: 2071-1050. DOI:
https://doi.org/10.3390/su11040987.
... At present, many neural network algorithms based on the MapReduce calculation model have been successfully applied to the field of big data analysis and processing. Adil et al. [13] proposed the CNN-MR (convolution neural network based MapReduce) algorithm, which uses a data parallel strategy to divide the training samples into each computing node in the platform, which improves the efficiency of algorithm training. Hao et al. [14] proposed DCNN parallel algorithm MR-DCNN (MapReduce based deep convolution neural network algorithm), which reduces the computational complexity of DCNN, but the accuracy of the algorithm is still insufficient. ...
Article
Full-text available
In high-paced and efficient life and work, fatigue is one of the important factors that cause accidents such as traffic and medical accidents. This study designs a feature map-based pruning strategy (PFM), which effectively reduces redundant parameters and reduces the time and space complexity of parallelized deep convolutional neural network (DCNN) training; a correction is proposed in the Map stage. The secant conjugate gradient method (CGMSE) realizes the fast convergence of the conjugate gradient method and improves the convergence speed of the network; in the Reduce stage, a load balancing strategy to control the load rate (LBRLA) is proposed to achieve fast and uniform data grouping to ensure the parallelization performance of the parallel system. Finally, the related fatigue algorithm's research and simulation based on the human eye are carried out on the PC. The human face and eye area are detected from the video image collected using the USB camera, and the frame difference method and the position information of the human eye on the face are used. To track the human eye area, extract the relevant human eye fatigue characteristics, combine the blink frequency, closed eye duration, PERCLOS, and other human eye fatigue determination mechanisms to determine the fatigue state, and test and verify the designed platform and algorithm through experiments. This system is designed to enable people who doze off, such as drivers, to discover their state in time through the system and reduce the possibility of accidents due to fatigue.
Article
Full-text available
Electric load forecasting is used for forecasting of future electric loads. Since the economy and reliability of operations of a power system are greatly affected by electric load, cost savings mainly depend on load forecasting accuracy. An accurate system load forecasting which is used to calculate short-term electric load forecasts, is an essential component of any Energy Management System (EMS). This can be improved by making use of Artificial Neural Networks (ANN). Existing Boosted Neural Networks (BooNN) technique helps in reduction of forecasting errors and variation in forecasting accuracy. However it is not flexible to rapid load changes.In the proposed work, Elman Neural Network technique is considered. This technique improves the load forecasting accuracy. The proposed method is implemented in IEEE 14 bus system. Simulation results showed that this method has increased the Voltage profile and also the active power losses have been reduced. Overall power transfer capability has been improved. Also the computational time has been minimized when compared to the existing techniques.
Article
Full-text available
Over the last decades, load forecasting is used by power companies to balance energy demand and supply. Among the several load forecasting methods, medium-term load forecasting is necessary for grid’s maintenance planning, settings of electricity prices, and harmonizing energy sharing arrangement. The forecasting of the month ahead electrical loads provides the information required for the interchange of energy among power companies. For accurate load forecasting, this paper proposes a model for medium-term load forecasting that uses hourly electrical load and temperature data to predict month ahead hourly electrical loads. For data preprocessing, modified entropy mutual information-based feature selection is used. It eliminates the redundancy and irrelevancy of features from the data. We employ the conditional restricted Boltzmann machine (CRBM) for the load forecasting. A meta-heuristic optimization algorithm Jaya is used to improve the CRBM’s accuracy rate and convergence. In addition, the consumers’ dynamic consumption behaviors are also investigated using a discrete-time Markov chain and an adaptive k-means is used to group their behaviors into clusters. We evaluated the proposed model using GEFCom2012 US utility dataset. Simulation results confirm that the proposed model achieves better accuracy, fast convergence, and low execution time as compared to other existing models in the literature.
Article
Full-text available
Recently, power systems are facing the challenges of growing power demand, depleting fossil fuel and aggravating environmental pollution (caused by carbon emission from fossil fuel based power generation). The incorporation of alternative low carbon energy generation, i.e., Renewable Energy Sources (RESs), become crucial for energy systems. Effective Demand Side Management (DSM) and RES incorporation enable power systems to maintain demand, supply balance and optimize energy in an environment friendly manner. The wind power is a popular energy source because of its environmental and economical benefits. However, the uncertainty of wind power, makes its incorporation in energy systems really difficult. To mitigate the risk of demand-supply imbalance, an accurate estimation of wind power is essential. Recognizing this challenging task, an efficient deep learning based prediction model is proposed for wind power forecasting. The proposed model has two stages. In the first stage, Wavelet Packet Transform (WPT) is used to decompose the past wind power signals. Other than decomposed signals and lagged wind power, multiple exogenous inputs (such as, calendar variable and Numerical Weather Prediction (NWP)) are also used as input to forecast wind power. In the second stage, a new prediction model Efficient Deep Convolution Neural Network (EDCNN) is employed to forecast wind power. A DSM scheme is formulated based on forecasted wind power, day-ahead demand and price. The proposed forecasting model's performance is evaluated on big data of Maine wind farm ISO NE, USA.
Article
Full-text available
Accurate forecasting of the electricity price and load is an essential and challenging task in smart grids. Since electricity load and price have a strong correlation, the forecast accuracy degrades when bidirectional relation of price and load is not considered. Therefore, this paper considers price and load relationship and proposes two Multiple Inputs Multiple Outputs (MIMO) Deep Recurrent Neural Networks (DRNNs) models for price and load forecasting. The first proposed model, Efficient Sparse Autoencoder Nonlinear Autoregressive Network with eXogenous inputs (ESAENARX) comprises of feature engineering and forecasting. For feature engineering, we propose ESAE and performed forecasting using existing method NARX. The second proposed model: Differential Evolution Recurrent Extreme Learning Machine (DE-RELM) is based on RELM model and the meta-heuristic DE optimization technique. The descriptive and predictive analyses are performed on two well-known electricity markets' big data, i.e., ISO NE and PJM. The proposed models outperform their sub models and a benchmark model. The refined and informative features extracted by ESAE improve the forecasting accuracy in ESANARX and optimization improves the DE-RELMâââs accuracy. As compared to cascade Elman network, ESAENARX has reduced MAPE upto 16% for load forecasting, 7% for price forecasting. DE-RELM reduce 1% MAPE for both load and price forecasting.
Article
Full-text available
In order to ensure optimal and secure functionality of Micro Grid (MG), energy management system plays vital role in managing multiple electrical load and distributed energy technologies. With the evolution of Smart Grids (SG), energy generation system that includes renewable resources is introduced in MG. This work focuses on coordinated energy management of traditional and renewable resources. Users and MG with storage capacity is taken into account to perform energy management efficiently. First of all, two stage Stackelberg game is formulated. Every player in game theory tries to increase its payoff and also ensures user comfort and system reliability. In the next step, two forecasting techniques are proposed in order to forecast Photo Voltaic Cell (PVC) generation for announcing optimal prices. Furthermore, existence and uniqueness of Nash Equilibrium (NE) of energy management algorithm are also proved. In simulation, results clearly show that proposed game theoretic approach along with storage capacity optimization and forecasting techniques give benefit to both players, i.e., users and MG. The proposed technique Gray wolf optimized Auto Regressive Integrated Moving Average (GARIMA) gives 40% better result and Cuckoo Search Auto Regressive Integrated Moving Average (CARIMA) gives 30% better results as compared to existing techniques.
Article
Full-text available
A Smart Grid (SG) is a modernized grid to provide efficient, reliable and economic energy to the consumers. Energy is the most important resource in the world. An efficient energy distribution is required as smart devices are increasing dramatically. The forecasting of electricity consumption is supposed to be a major constituent to enhance the performance of SG. Various learning algorithms have been proposed to solve the forecasting problem. The sole purpose of this work is to predict the price and load efficiently. The first technique is Enhanced Logistic Regression (ELR) and the second technique is Enhanced Recurrent Extreme Learning Machine (ERELM). ELR is an enhanced form of Logistic Regression (LR), whereas, ERELM optimizes weights and biases using a Grey Wolf Optimizer (GWO). Classification and Regression Tree (CART), Relief-F and Recursive Feature Elimination (RFE) are used for feature selection and extraction. On the basis of selected features, classification is performed using ELR. Cross validation is done for ERELM using Monte Carlo and K-Fold methods. The simulations are performed on two different datasets. The first dataset, i.e., UMass Electric Dataset is multi-variate while the second dataset, i.e., UCI Dataset is uni-variate. The first proposed model performed better with UMass Electric Dataset than UCI Dataset and the accuracy of second model is better with UCI than UMass. The prediction accuracy is analyzed on the basis of four different performance metrics: Mean Absolute Percentage Error (MAPE), Mean Absolute Error (MAE), Mean Square Error (MSE) and Root Mean Square Error (RMSE). The proposed techniques are then compared with four benchmark schemes. The comparison is done to verify the adaptivity of the proposed techniques. The simulation results show that the proposed techniques outperformed benchmark schemes. The proposed techniques efficiently increased the prediction accuracy of load and price. However, the computational time is increased in both scenarios. ELR achieved almost 5% better results than Convolutional Neural Network (CNN) and almost 3% than LR. While, ERELM achieved almost 6% better results than ELM and almost 5% than RELM. However, the computational time is almost 20% increased with ELR and 50% with ERELM. Scalability is also addressed for the proposed techniques using half-yearly and yearly datasets. Simulation results show that ELR gives 5% better results while, ERELM gives 6% better results when used for yearly dataset.
Article
Full-text available
This paper focuses on analytics of an extremely large dataset of smart grid electricity price and load, which is difficult to process with conventional computational models. These data are known as energy big data. The analysis of big data divulges the deeper insights that help experts in the improvement of smart grid’s (SG) operations. Processing and extracting of meaningful information from data is a challenging task. Electricity load and price are the most influential factors in the electricity market. For improving reliability, control and management of electricity market operations, an exact estimate of the day ahead load is a substantial requirement. Energy market trade is based on price. Accurate price forecast enables energy market participants to make effective and most profitable bidding strategies. This paper proposes a deep learning-based model for the forecast of price and demand for big data using Deep Long Short-Term Memory (DLSTM). Due to the adaptive and automatic feature learning mechanism of Deep Neural Network (DNN), the processing of big data is easier with LSTM as compared to the purely data-driven methods. The proposed model was evaluated using well-known real electricity markets’ data. In this study, day and week ahead forecasting experiments were conducted for all months. Forecast performance was assessed using Mean Absolute Error (MAE) and Normalized Root Mean Square Error (NRMSE). The proposed Deep LSTM (DLSTM) method was compared to traditional Artificial Neural Network (ANN) time series forecasting methods, i.e., Nonlinear Autoregressive network with Exogenous variables (NARX) and Extreme Learning Machine (ELM). DLSTM outperformed the compared forecasting methods in terms of accuracy. Experimental results prove the efficiency of the proposed method for electricity price and load forecasting.
Article
Electricity price forecasting affects the operation of the entire electricity market and it is extremely important to every market participant. In this paper, a novel hybrid method, with using empirical wavelet transform (EWT), support vector regression (SVR), Bi-directional long short-term memory (BiLSTM) and Bayesian optimization (BO), is proposed to increase the accuracy of electricity price forecasting. First, EWT is used as a processing tool to decompose the original signal into specific modal components according to the characteristics of the signal itself. Then, considering the complexity of forecasting nonlinear subseries, SVR and BiLSTM are used as basic framework to forecast the nonlinear subseries. At the same time, BO is introduced to adjust parameters and optimize model performance. In last, the final prediction results are combined by the prediction results of different models. The proposed hybrid model is employed on the data gathered from the European Power Exchange Spot (EPEXSPOT). Five different case studies are adopted to verify the effectiveness of BO, EWT and hybrid model respectively. Statistical tests of experimental results compared with other situations demonstrated the proposed hybrid model can achieve a better forecasting performance.
Article
In this work, a strategy for automatic lag selection in time series analysis is proposed. The method extends the ideas of feature selection with support vector regression, a powerful machine learning tool that can identify nonlinear patterns effectively thanks to the introduction of a kernel function. The proposed approach follows a backward variable elimination procedure based on gradient descent optimisation, iteratively adjusting the widths of an anisotropic Gaussian kernel. Experiments on four electricity demand forecasting datasets demonstrate the virtues of the proposed approach in terms of predictive performance and correct identification of relevant lags and seasonal patterns, compared to well-known strategies for time series analysis designed for energy load forecasting and state-of-the-art strategies for automatic model selection.
Article
Over the years, the growing penetration of renewable energy into the electricity market has resulted in a significant change in the electricity market price. This change makes the existing forecasting method prone to error, decreasing the economic benefits. Hence, more precise forecasting methods need to be developed. This paper starts with a survey and benchmark of existing machine learning approaches for forecasting the real-time market (RTM) price. While these methods provide sufficient modeling capability via supervised learning, their accuracy is still limited due to the single data source, e.g., historical price information only. In this paper, a novel two-stage supervised learning approach is proposed by diversifying the data sources such as highly correlated power data. This idea is inspired by the recent load forecasting methods that have shown extremely well performances. Specifically, the proposed two-stage method, namely the rerouted method, learns two types of mapping rules. The first one is the mapping between the historical wind power and the historical price. The second is the forecasting rule for wind generation. Based on the two rules, we forecast the price via the forecasted generation and the first learned mapping between power and price. Additionally, we observed that it is not the more training data the better, leading to our validation steps to quantify the best training intervals for different datasets. We conduct comparisons of numerical results between existing methods and the proposed methods based on datasets from the Electric Reliability Council of Texas (ERCOT). For each machine learning step, we examine different learning methods, such as polynomial regression, support vector regression, neural network, and deep neural network. The results show that the proposed method is significantly better than existing approaches when renewables are involved.