ArticlePublisher preview available

Integrated nonlinear autoregressive neural network and Holt winters exponential smoothing for river streaming flow forecasting at Aswan High

Authors:
  • الجامعه المصريه الروسيه
To read the full-text of this research, you can request a copy directly from the authors.

Abstract and Figures

Streamflow forecasting process exhibited highly nonstationary and stochastic pattern, thus not easy to be done with simple models. There is a need to develop an efficient and precise streamflow forecasting system which is vital for water management at hydrological infrastructures like Aswan High Dam (AHD). As the decision makers will be able to decide on water allocation for different purposes such as irrigation, domestic and industrial uses. This study explores the potential of AI model: nonlinear autoregressive neural network (NAR) in performing inflow forecasting to AHD. The dataset of past 130 years of Nile River discharge rate was used for the network development as well as evaluation of models’ performance. This study also proposes an integration process of NAR with Holt-Winters exponential smoothing to improve the accuracy of the model. To determine the models’ performance, different indicators were employed and calculated (MAE, MAPE, RMSE, R2). The results were compared to identify the optimal network architecture. The results show that the NAR models are capable of predicting the future values of AHD inflow in monthly time steps accurately. For standard NAR model, the root mean squared error (RMSE) was 2.0072, and the coefficient of determination (R2) between recorded and forecasted values was 0.9152. Values of RMSE = 1.5421 and R2 = 0.9760 and RMSE = 1.0843 and R2 = 0.9823 were obtained by NAR-SES and NAR-HW models respectively. The results reveal that combination of Holt-Winters exponential smoothing with NAR significantly improved the precision beyond the standard model. This study proved that NAR neural networks can be useful to address streamflow forecasting problems.
This content is subject to copyright. Terms and conditions apply.
Vol.:(0123456789)
1 3
Earth Science Informatics (2023) 16:773–786
https://doi.org/10.1007/s12145-022-00913-5
RESEARCH
Integrated nonlinear autoregressive neural network andHolt winters
exponential smoothing forriver streaming flow forecasting atAswan
High
HayanaDullah1· AliNajahAhmed1· PavitraKumar2· AhmedElshae3,4
Received: 7 October 2022 / Accepted: 30 November 2022 / Published online: 12 December 2022
© The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2022
Abstract
Streamflow forecasting process exhibited highly nonstationary and stochastic pattern, thus not easy to be done with simple
models. There is a need to develop an efficient and precise streamflow forecasting system which is vital for water management
at hydrological infrastructures like Aswan High Dam (AHD). As the decision makers will be able to decide on water allocation
for different purposes such as irrigation, domestic and industrial uses. This study explores the potential of AI model: nonlinear
autoregressive neural network (NAR) in performing inflow forecasting to AHD. The dataset of past 130years of Nile River
discharge rate was used for the network development as well as evaluation of models’ performance. This study also proposes an
integration process of NAR with Holt-Winters exponential smoothing to improve the accuracy of the model. To determine the
models’ performance, different indicators were employed and calculated (MAE, MAPE, RMSE, R2). The results were compared
to identify the optimal network architecture. The results show that the NAR models are capable of predicting the future values
of AHD inflow in monthly time steps accurately. For standard NAR model, the root mean squared error (RMSE) was 2.0072,
and the coefficient of determination (R2) between recorded and forecasted values was 0.9152. Values of RMSE = 1.5421 and
R2 = 0.9760 and RMSE = 1.0843 and R2 = 0.9823 were obtained by NAR-SES and NAR-HW models respectively. The results
reveal that combination of Holt-Winters exponential smoothing with NAR significantly improved the precision beyond the
standard model. This study proved that NAR neural networks can be useful to address streamflow forecasting problems.
Keywords Forecasting· Machine learning· Nonlinear autoregressive neural network· Aswan high dam· Holt-winters·
Exponential smoothing
Introduction
There are several challenges, in term of water management,
faced by the designers and engineers due to the changing cli-
mate and topography. This is critical since most water bodies
are affected by rainfall, groundwater, and runoff; and its poor
design may result in disaster for the environment, as well
as property and life (Ripon and Al-Mamun 2020; Qi etal.
2020). Streamflow or reservoir inflow forecasting models are
important in predicting the inflow in case of extreme events
like flood that will damage the existing structure. In addition,
inflow forecasting model helps decision-maker in monitor-
ing and operating the dam or water reservoir for water sup-
ply, water distribution and irrigation. In general, streamflow
forecasting is classified into two main temporal categories,
i.e., short-term forecasting and long-term forecasting. The
later includes weekly, monthly, and yearly forecasting that
is vital for reservoirs or dams’ operation and management.
Long-term forecasting are also being applied in electrical
Communicated by: H. Babaie
* Ali Najah Ahmed
Mahfoodh@uniten.edu.my
1 Institute ofEnergy Infrastructure andDepartment ofCivil
Engineering , College ofEngineering, Universiti Tenaga
Nasional, 43000Kajang, Selangor, Malaysia
2 Department ofGeography andPlanning, University
ofLiverpool, Liverpool, UK
3 Department ofCivil Engineering, Faculty ofEngineering,
University ofMalaya (UM), 50603KualaLumpur, Malaysia
4 National Water andEnergy Center, United Arab Emirates
University, P.O. Box15551, AlAin, UnitedArabEmirates
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
... The current mainstream prediction models encompass grey models (Ding, 2021), neural network models , time series models (González et al., 2024), the Holt-Winters exponential smoothing method (Hayana and Ali, 2022), and their hybrid models (Jin, 2022). These predictive models have not only demonstrated excellent performance in fields such as agriculture, industry, and medicine but have also been extensively applied in water resource management in arid and semi-arid regions. ...
Article
Full-text available
Water resources are the lifelines of the agricultural development in Xinjiang. Currently, the problem of water shortage for agriculture in this region is becoming increasingly severe. Against this backdrop, predicting the changing trends of water supply and agricultural water use in Xinjiang and analyzing the supply and use relationship between them are of great practical significance for ensuring the sustainable development of regional agriculture. Firstly, we conducted an in-depth analysis of the water supply and agricultural water use patterns in Xinjiang over the past two decades. Secondly, we evaluated and compared several mainstream water resource prediction models, ultimately developing a novel GM(1,1)-NN essemble model. Validation results demonstrated that this model exhibits superior accuracy in forecasting water supply and agricultural water use compared to other existing models. Finally, we utilized the newly developed GM(1,1)-NN essemble model to predict short-term water supply and agricultural water use trends in Xinjiang. Based on these findings, we proposed recommendations for water resource conservation from both technological and regional planting perspectives. The key results are as follows: (1) There are significant regional disparities in water resources in Xinjiang, primarily attributed to uneven precipitation distribution and imbalanced economic development. (2) The GM(1,1)-NN essemble model demonstrates high short-term predictive accuracy for both water supply and agricultural water use in Xinjiang. (3) According to our GM(1,1)-NN essemble model’s projections, both water supply and agricultural water use in Xinjiang are expected to exhibit a downward trend in the coming years. The reduction in agricultural water use will help allocate more water resources to non-agricultural sectors. (4) Despite these improvements, the contradiction between water shortage and the high proportion of agricultural water use (approaching to 88%) remains unresolved. Therefore, it is recommended to reduce agricultural water use through the widespread adoption of water-saving facilities and the optimization of crop planting structures across different regions.
Book
Full-text available
The Nile has given not only material gifts to Egypt and the world, but also intellectual gifts to science, especially to geoscience. The Nile still has much to teach science-especially about climatology, as it reflects climatic behaviors over vast areas in tropical and subtropical zones. These climatic behaviors have been documented across time with some of its extraordinarily long records surviving to present day. The records provide insights to the perpetual change of climate and support quantification of change in a stochastic framework.
Article
A high concentration of dissolved oxygen is essential for the maintenance of healthy aquatic ecosystems. Aeration studies have been conducted in both closed systems and open channels utilizing conventional hydraulic structures. However, the feasibility of aeration through screens with square openings has not yet been explored. This study aimed to evaluate the aeration efficiency (E20) in an open channel system using screens with square jets. Five input parameters were analyzed: angle of inclination, number of square jets, discharge, hydraulic radius, and Froude number. The results showed that Nj, α, and Q significantly influence E20. The highest E20 recorded was 37% on level terrain with moderate discharge in the open channel. This method has the potential to enhance oxygen concentrations in rural regions where skilled labor and mechanised systems may be challenging. The study also focused on identifying suitable soft computing models for predicting E20. Five machine learning approaches were employed: artificial neural network, random forest with Bagging, Gaussian process utilizing the Pearson VII function kernel (GP_PUK), support vector machine with the PUK kernel function (SVM_PUK), and a radial basis function (SVM_RBF). The GP model employing the PUK kernel function demonstrated superior performance.
Chapter
The spillway is a component of the dam's flow control channel that serves to enhance regulation and boost the flow rate that passes through the spillway building. By rapidly changing local pressure and velocity, surface cracks can cause cavitation damage. Cavitation is defined as the phenomenon where pressure is less than 1 atm, resulting in air bubbles on the building surface, causing holes due to the release of aggregate grains on the construction surface. Unremoved cavitation can endanger the bottom surface of the spillway due to scouring/erosion. Damage to the canal floor due to continuous scouring can cause water to enter through the scour cracks, thus disrupting the stability of the spillway. Hence, this article mainly discusses a cavitation study that was conducted at the dam spillway. Based on the review in this paper, to determine hydraulic cavitation features of a spillway, most research employ prototype observation, physical model observation, and numerical model simulation. Furthermore, more comprehensive results produced by numerical simulations than by actual investigation is proved by previous research reviewed in this paper. However, using both a physical model and a numerical simulation to determine a spillway's hydraulic cavitation characteristics is reliable.
Article
Ozone (O3) from the troposphere is one of the substances that has a strong effect on air pollution in the city of Tanger. Prediction of this pollutant can have positive improvements in air quality. This paper presents a new approach combining deep-learning algorithms and the Holt–Winters method in order to detect pollutant peaks and obtain a more accurate forecasting model. Given that LSTM is an extremely powerful algorithm, we hybridized with the Holt–Winters method to enhance the model. Making use of multiple accuracy metrics, the models' efficiency is investigated. Empirical findings reveal the superiority of the hybrid model by providing forecasts that are more accurate with an index of agreement equal to 0.91.
Thesis
Full-text available
An artificial neural network is a (simplified) mathematical model of the human brain. Many different types of neural network models are suited, but we shall describe just one, called feed-forward neural network with one hidden layer (also called as multilayer perceptron with one hidden layer). Since 1960 a number of results have been published showing that a multilayer neural network with only one hidden layer can approximate arbitrary well a continuous function of n real variables. E.g. poofs have been given by Cybenko (1989), Halbert White (1990) and Kurt Hornik (1991), the later proofs require less assumptions on the activation functions. The problem with these proofs is that they are not constructive (and not elementary). These theorems do not state how many neurons should be used in the hidden layer, and they do not claim anything about the error of the approximation with a given number of neurons. Our main aim was to prove the universal approximation theorem of the feed-forward artificial neural networks in a constructive (and may be elementary) way and if possible also estimate the error. The basic form of this theorem claims that every continuous function defined on a compact set of the nth dimensional vector space over the real numbers can be arbitrary well approximated by a feed-forward artificial neural network with one hidden layer (with finite number of artificial neurons).
Article
Full-text available
Bangladesh is a disaster-prone country which is vulnerable to climatic risks. Climate change has a great impact on rural physical infrastructures. The physical infrastructures include roads, bridges/culverts, markets, disaster shelters, solid waste disposal and small-scale water resources. Due to climate change, the physical infrastructure will suffer from damage after natural disasters, as climate change amplifies the chance of natural disaster. The salinity problem, soil erosion, embankment failure due to soil conditions and disaster issues greatly affect the rural infrastructure. Furthermore, due to the impacts, the repair, operations and maintenance costs of rural infrastructure will be increased. As higher design standards will be required to build climate proof infrastructures, costs of new infrastructure projects will be increased.
Article
Full-text available
Urban flooding has become a serious issue in most Chinese cities due to rapid urbanization and extreme weather, as evidenced by severe events in Beijing (2012), Ningbo (2013), Guangzhou (2015), Wuhan (2016), Shenzhen (2019), and Chongqing (2020). The Chinese “Sponge City Program” (SCP), initiated in 2013 and adopted by 30 pilot cities, is developing solutions to manage urban flood risk, purify stormwater, and provide water storage opportunities for future usage. Emerging challenges to the continued implementation of Sponge Cities include (1) uncertainty regarding future hydrological conditions related to climate change projections, which complicates urban planning and designing infrastructure that will be fit for purpose over its intended operating life, and (2) the competing priorities of stakeholders and their reluctance to make trade-offs, which obstruct future investment in the SCP. Nature-Based Solutions (NBS) is an umbrella concept that emerged from Europe, which encourages the holistic idea of considering wider options that combine “Blue–Green” practices with traditional engineering to deliver “integrated systems of Blue–Green–Grey infrastructure”. NBS includes interventions making use of natural processes and ecosystem services for functional purposes, and this could help to improve current pilot SCP practices. This manuscript reviews the development of the SCP, focusing on its construction and design aspects, and discusses how approaches using NBS could be included in the SCP to tackle not only urban water challenges but also a wide range of social and environmental challenges, including human health, pollution (via nutrients, metals, sediments, plastics, etc.), flood risk, and biodiversity.
Article
Full-text available
Time series analysis and prediction are major scientific challenges that find their applications in fields as diverse as finance, biology, economics, meteorology, and so on. Obtaining the method with the least prediction error is one of the difficult problems of financial market and investment analysts. State space modelling is an efficient and flexible method for statistical inference of a broad class of time series and other data. The neural network is an important tool for analyzing time series especially when it is nonlinear and nonstationary. Essential tools for the study of Box-Jenkins methodology, neural networks, and extended Kalman filter were put together. We examine the use of the nonlinear autoregressive neural network method as a prediction technique for financial time series and the application of the extended Kalman filter algorithm to improve the accuracy of the model. As application on a real example, we are analyzing the time series of the daily price of steel over a 790-day period for establishing the superiority of this method over other existing methods. The simulation results using MATLAB and R software show that the model is capable of producing a reasonable accuracy.
Article
Full-text available
Hydraulic fracturing of horizontal wells is an essential technology for the exploitation of unconventional resources, but led to environmental concerns. Fracturing fluid upward migration from deep gas reservoirs along abandoned wells may pose contamination threats to shallow groundwater. This study describes the novel application of a nonlinear autoregressive (NAR) neural network to estimate fracturing fluid flow rate to shallow aquifers in the presence of an abandoned well. The NAR network is trained using the Levenberg–Marquardt (LM) and Bayesian Regularization (BR) algorithms and the results were compared to identify the optimal network architecture. For NAR-LM model, the coefficient of determination (R²) between measured and predicted values is 0.923 and the mean squared error (MSE) is 4.2 × 10⁻⁴, and the values of R² = 0.944 and MSE = 2.4 × 10⁻⁴ were obtained for the NAR-BR model. The results indicate the robustness and compatibility of NAR-LM and NAR-BR models in predicting fracturing fluid flow rate to shallow aquifers. This study shows that NAR neural networks can be useful and hold considerable potential for assessing the groundwater impacts of unconventional gas development.
Article
Full-text available
The control effect of various intelligent terminals is affected by the data sensing precision. The filtering method has been the typical soft computing method used to promote the sensing level. Due to the difficult recognition of the practical system and the empirical parameter estimation in the traditional Kalman filter, a neuron-based Kalman filter was proposed in the paper. Firstly, the framework of the improved Kalman filter was designed, in which the neuro units were introduced. Secondly, the functions of the neuro units were excavated with the nonlinear autoregressive model. The neuro units optimized the filtering process to reduce the effect of the unpractical system model and hypothetical parameters. Thirdly, the adaptive filtering algorithm was proposed based on the new Kalman filter. Finally, the filter was verified with the simulation signals and practical measurements. The results proved that the filter was effective in noise elimination within the soft computing solution.
Article
Full-text available
The balance between water supply and demand requires efficient water supply systems management techniques. This balance is achieved through operational actions, many of which require the application of forecasting concepts and tools. In this article, recent research on urban water demand forecasting employing artificial intelligence are reviewed, aiming to present the ‘state of the art’ on the subject and provide some guidance regarding methods and models to researches and professional sanitation companies. The review covers the models developed using standard statistical techniques, such as linear regression or time-series analysis, or techniques based on Soft Computing. This review shows that the studies are, mostly, focused on the management of the operating systems. There is, therefore, room for long-term forecasts. It is worth noting that there is no global model that surpasses all the methods for all cases, being necessary to study each region separately, evaluating the strengths of each model or the combination of methods. The use of statistical applications of Machine Learning and Artificial Intelligence methodologies has grown considerably in recent years. However, there is still room for improvement with regard to water demand forecasting.
Article
Full-text available
This paper presents the winning submission of the M4 forecasting competition. The submission utilizes a Dynamic Computational Graph Neural Network system that enables mixing of a standard Exponential Smoothing model with advanced Long Short Term Memory networks into a common framework. The result is a hybrid and hierarchical forecasting method. Keywords: Forecasting competitions, M4, Dynamic Computational Graphs, Automatic Differentiation, Long Short Term Memory (LSTM) networks, Exponential Smoothing
Article
Considering that the non-linear path of monthly time-series for the iron ore imported to China is under reciprocal influences of multiple factors, the process of data generation is not easily represented in a time-series model. Based on the decomposition-integration method, superiorities of empirical mode decomposition (EMD), non-linear autoregressive neural network (NARNN), and autoregressive integrated moving average (ARIMA) models are integrated to establish a combined model EMD-NARNN-ARIMA. The empirical results show that, compared with the NARNN or seasonal autoregressive integrated moving average (SARIMA) models, the proposed model is more suitable for predicting data pertaining to the import of iron ore to China. The prediction error of EMD-NARNN-ARIMA is significantly lower than that of NAR and SARIMA, and, more importantly, it does not increase the time-complexity. The predicted result attained through the proposed model reveals that the import of iron ore to China from January 2019 to December 2020 will gradually decrease, accompanied by reasonable seasonal fluctuations, which is consistent with the decreasing trend in the demand for iron and steel as a result of the adjustment of China’s current industrial structure.
Article
Accurate influent flow forecasting plays a significant role in management, operation, scheduling and utilization of the sewage treatment plants. In design and operate such plants, it is essential to measure and forecast the influent flow rate in wastewater plants. In this paper, the Very immediate-short-term to long-term influent flow rate are modeled and forecasted by a new developed hybrid model of ANFIS and Grey Wolf Optimizer (GWO). The objective of this study is the integration of GWO with ANFIS in forecasting multi-ahead influent flow rate. The forecast horizon of the model is from 5 min up to 10 days bases on Gamma Test (GT) feature selection of input combinations. As the parameters of ANFIS have effect on the forecasting accuracy, these parameters are adjusted and optimized by using Grey Wolf Optimizer (GWO). Then the choice of appropriate input parameters at different prediction horizons from Very immediate-short-term (5-min ahead) to long-term (10 days ahead) was discussed for influent forecasting. The statistical indices of RMSE, NSE, MAE, RAE, R², d, CI and graphical evaluations such as scatter-plots with confidence bounds, error distributions, Taylor diagrams, box-plots and empirical cumulative distribution function (ECDF) were implemented for assessing the performance of all models in prediction horizons. Furthermore as another novelty in the present paper, recursive forecasting models based on previous forecasted values is used to improve the accuracy and applicability of ANFIS-GWO in recursive predictions. Our Results showed that: (1) the hybrid of ANFIS-GWO significantly improved the prediction accuracy. (2) ANFIS-GWO performs more efficiently than the ANFIS in almost all of the prediction horizons (ANFIS-GWO1: 5 min ahead; ANFIS-GWO11: 1–2 days ahead; ANFIS-GWO8: one week ahead). (3) The performance of models in influent flow forecasting is significantly influenced by the prediction horizon. The computational results confirmed that the ANFIS-GWO performs well in all of prediction horizons. Equally the true values and the trends are precisely forecasted by the ANFIS-GWO. Results of this novel study demonstrate that reliable estimates of influent flow rate from 5-min up to 10 days in advance can be achieved using the developed direct and recursive hybrid GWO models.