ArticlePDF Available

Abstract

This article reviews the common used forecast error measurements. All error measurements have been joined in the seven groups: absolute forecasting errors, measures based on percentage errors, symmetric errors, measures based on relative errors, scaled errors, relative measures and other error measures. The formulas are presented and drawbacks are discussed for every accuracy measurements. To reduce the impact of outliers, an Integral Normalized Mean Square Error have been proposed. Due to the fact that each error measure has the disadvantages that can lead to inaccurate evaluation of the forecasting results, it is impossible to choose only one measure, the recommendations for selecting the appropriate error measurements are given.
(
)
()m
t tt
e yf= −
()
m
ft
1,
1
1
,
n
ii
in
i
MAE e mean e
n=
=
= =
1,
,
i
in
MdAE median e
=
=
() ()
22
11,
1
,
n
ii
iin
MSE e mean e
n==
= =
World Applied Sciences Journal 24 (Information Technologies in Modern Industry, Education & Society): 171-176, 2013
ISSN 1818-4952
© IDOSI Publications, 2013
DOI: 10.5829/idosi.wasj.2013.24.itmies.80032
Corresponding Author: Shcherbakov, Volgograd State Technical University, Lenin avenue, 28, 400005, Volgograd, Russia.
171
A Survey of Forecast Error Measures
Maxim Vladimirovich Shcherbakov, Adriaan Brebels,
Nataliya Lvovna Shcherbakova, Anton Pavlovich Tyukov,
Timur Alexandrovich Janovsky and Valeriy Anatol’evich Kamaev
Volgograd State Technical University, Volgograd, Russia
Submitted: Aug 7, 2013; Accepted: Sep 18, 2013; Published: Sep 25, 2013
Abstract: This article reviews the common used forecast error measurements. All error measurements have been
joined in the seven groups: absolute forecasting errors, measures based on percentage errors, symmetric errors,
measures based on relative errors, scaled errors, relative measures and other error measures. The formulas are
presented and drawbacks are discussed for every accuracy measurements. To reduce the impact of outliers, an
Integral Normalized Mean Square Error have been proposed. Due to the fact that each error measure has the
disadvantages that can lead to inaccurate evaluation of the forecasting results, it is impossible to choose only
one measure, the recommendations for selecting the appropriate error measurements are given.
Key words: Forecasting Forecast accuracy Forecast error measurements
INTRODUCTION
Different criteria such as forecast error measurements,
the speed of calculation, interpretability and others have where - y is the measured value at time t, - predicted
been used to assess the quality of forecasting [1-6].
Forecast error measures or forecast accuracy are the most
important in solving practical problems [6]. Typically, the
common used forecast error measurements are applied for
estimating the quality of forecasting methods and for
choosing the best forecasting mechanism in case of
multiple objects. A set of "traditional" error measurements
in every domain is applied despite on their drawbacks.
These error measurements are used as presets in domains
despite on drawbacks.
This paper provides an analysis of existing and quite
common forecast error measures that are used in
forecasting [4, 7-10]. Measures are divided into groups
according to the calculating method an value of error for
certain time t. The calculating formula, the description of
the drawbacks, the names of assessments are considered
for each error measure.
A Review
Absolute Forecasting Error: The first group is based on
the absolute error calculation. It includes estimates based
on the calculation of the value ei
(1)
t
value at time t, obtained from the use of the forecast
model m. Hereinafter referred to as the index of the model
(m) will be omitted.
Mean Absolute Error, MAE is given by:
(2)
where n –forecast horizon, mean(•) – a mean operation.
Median Absolute Error, MdAE is obtained using the
following formula
(3)
where mean(•) – operation for calculation of a median.
Mean Square Error, MSE is calculated by the formula
(4)
() ()
22
11,
1n
ii
iin
RMSE e mean e
n==
= =
t
t
t
e
py
=
()
1,
1
1100 100
n
ii
in
i
MAPE p mean p
n=
=
= ⋅=
(
1,
100 i
in
MdAPE median p
=
= ⋅
()
2
1,
10
0,
i
in
RMSPE mean p
=
= ⋅
()
2
1,
10
0,
i
in
RMdSPE median p
=
= ⋅
()
.
t
t
tt
e
syf
=+
()
1,
1
1200 20
0,
n
ii
in
i
sMAPE s mean s
n=
=
= ⋅=
(
)
1,
20
0.
i
in
sMdAPE median s
=
= ⋅
()
1
1
,
/2
n
ii
ii i
i
yf
msMAPE nyf S
=
=++
11
11
,.
11
11
11
ii
S yy y y
ik k
ii
ii
kk
−−
= −=
−−
−−
= =
∑∑
World Appl. Sci. J., 24 (Information Technologies in Modern Industry, Education & Society): 171-176, 2013
172
hence, Root Mean Square Error, RMSE is calculated as:
(5) We note the following shortcomings.
These error measures are the most popular in various is equal to zero.
domains [8, 9]. However, absolute error measures have the Non-symmetrical issue - the error values differ
following shortcomings. whether the predicted value is bigger or smaller than
The main drawback is the scale dependency [9]. Outliers have significant impact on the result,
Therefore if the forecast task includes objects with particularly if outlier has a value much bigger then
different scales or magnitudes then absolute error the maximal value of the "normal" cases [4].
measures could not be applied. The error measures are biased. This can lead to an
The next drawback is the high influence of outliers in incorrect evaluation of the forecasting models
data on the forecast performance evaluation [11]. performance [15].
So, if data contain an outliers with maximal value
(this is common case in real world tasks), then Symmetric Errors: The criteria which have been included
absolute error measures provide conservative values. in this group are calculated based on the value:
RMSE,MSE have a low reliability: the results could
be different depending on different fraction of data
[4]. (11)
Measures Based on Percentage Errors: Percentage errors The group includes next measures. Symmetric
are calculated based on the value PMean Absolute Percentage Error, sMAPE is calculated
t
(6)
Also these errors are the most common in forecasting
domain. The group of percentage based errors includes and the median mean absolute percentage error
the following errors.
Mean Absolute Percentage Error, MAPE
(7) To avoid the problems associated with the division
Median Absolute Percentage Error, MdAPE is more has been proposed. Their denominators have an
resistant to outliers and calculated according to the additional member:
formula
(14)
(8)
Root Mean Square Percentage Error, RMSPE is
calculated according to:
(9)
and the median percentage error of the quadratic
(10)
Appearance division by zero when the actual value
the actual [12-14].
according to
(12)
(13)
by zero, a modified sMAPE - Modified sMAPE, msMAPE
where .
Developing the idea for the inclusion of an additional
terms, more sophisticated measures was presented [16]:
KL-N, KL-N1, KL-N2, KL-DE1, KL-DE2, IQR
()
*
,
t
t
tt
e
r
yf
=
*
ft
*
t
tl
fy
=
1,
,
i
in
MRAE mean r
=
=
1,
,
i
in
MdRAE median r
=
=
1
2
.
1
1
t
tn
ii
i
e
q
yy
n
=
=
1,
,
i
in
MASE mean q
=
=
(
)
2
1,
.
i
in
RMSSE mean q
=
=
*
,
MAE
RMAE
MAE
=
*
.
RMSE
RRMSE
RMSE
=
World Appl. Sci. J., 24 (Information Technologies in Modern Industry, Education & Society): 171-176, 2013
173
The following disadvantages should be noted. If naive model has been chosen then division by zero
Despite its name, this error is also non-symmetric
[13].
Furthermore, if the actual value is equal to forecasted
value, but with opposite sign, or both of these values
are zero, then a divide by zero error occurs.
These criteria are affected by outliers in analogous
with the percentage errors.
If more complex estimations have been used, the
problem of interpretability of results occurs and this
fact slows their spread in practice [4].
Measures Based on Relative Errors: The basis for
calculation of errors in this group is the value determined
as follows:
(15)
where - the predictive value obtained using a reference
model prediction (benchmark model). The main practice is
to use a naive model as a reference model
,
(16)
where l - the value of the lag and l = 1.
The group includes the next measures. Mean Relative
Absolute Error, MRAE is given by the formula
(17)
Median Relative Absolute Error, MRAE is calculated
according to
(18)
and Geometric Mean Relative Absolute Error, GMRAE),
which is calculated similarly to (17), but instead of mean(•)
the geometric mean is obtained gmean(•).
It should be noted the following shortcomings.
Based the formulas (15-18), division by zero error
occurs, if the predictive value obtained by reference
model is equal to the actual value.
error occurs in case of continuous sequence of
identical values of the time series.
Scaled Error: As a basis for calculating the value of the
scaled errors q is given by
i
(19)
This group contains Mean Absolute Scaled Error,
MASE proposed in [9]. It is calculated according to:
(20)
Another evaluation of this group is Root Mean
Square Scaled Error, RMSSE is calculated by the formula
[10]:
(22)
These measures is symmetrical and resistant to
outliers. However, we can point to two drawbacks.
If the forecast horizon real values are equal to each
other, then division by zero occurs.
Besides it is possible to observe a weak bias
estimates if you do the experiments by analogy with
[15].
Relative Measures: This group contains of measures
calculated as a ratio of mentioned above error measures
obtained by estimated forecasting models and reference
models. Relative Mean Absolute Error, RelMAE is
calculated by the formula.
(23)
where MAE and MAE the mean absolute error for the
*
analyzed forecasting model and the reference model
respectively, calculated using the formula (2).
Relative Root Mean Square Error, RelRMSE is
calculated similarly to (23), except that the right side is
calculated by (5)
(24)
*
lo
g.
RMSE
LMR
RMSE

=

{
}
(
)
*
( ) 100
%.
PB MAE mean I MAE MAE=⋅<
*
0
,;
() 1.
if MAE MAE
I MAE <
=
(
)
2
1,
1
,
i
in
nRMSE mean e
y=
=
y
(
)
2
1,
1
1
.
i
n
in
i
i
inRSE mean e
y=
=
=
()
()
2
1
2
1
,
n
i
i
n
i
i
e
inRSE
yy
=
=
=
1
1
n
yy
k
n
k
=
=
()
2
1
_1
n
i
i
e MAE
Std AE n
=
=
()
2
1
_1
n
i
i
p MAPE
Std APE n
=
=
World Appl. Sci. J., 24 (Information Technologies in Modern Industry, Education & Society): 171-176, 2013
174
In some situations it is reasonable to calculate the over the entire interval or time horizon or defined
logarithm of the ratio (23). In this case, the measure is
called the Log Mean Squared Error Ratio, (LMR)
(25)
Syntetos et al. proposed a more complex assessment
of the relative geometric standard deviation Relative
Geometric Root Mean Square Error, RGRMSE [17].
The next group of measures counts the number of
cases where the error of the model prediction error is
greater than the reference model. For instance, PB (MAE)
- Percentage Better (MAE), calculated by the formula:
(26)
where I{•} - the operator that yields the value of zero or
one, in accordance with the expression:
(27)
By analogy with PB (MAE), Percentage Better (MSE)
can be defined.
The disadvantages of these measures are the
following.
Division by zero error occurs if the reference forecast
error is equal to zero.
These criteria determine the number of cases when
the analyzed forecasting model superior to the base
but do not evaluate the value of difference.
Other Error Measures: This group includes measures
proposed in various studies to avoid the shortcomings of
existing and common measures.
To avoid the scale dependency, Normalized Root
Mean Square Error (nRMSE) has been proposed,
calculated by the formula:
(28)
where - the normalization factor, which is usually equal
to either the maximum measured value on the forecast
horizon, or the difference between the maximum and
minimum values. Normalization factor can be calculated
short interval of observation [18]. However, this
estimate is affected by influence of outliers, if outlier has
a value much bigger the maximal "normal" value. To
reduce the impact of outliers, Integral Normalized Mean
Square Error [19] have been proposed, calculated by the
formula:
(29)
Some research contains the the ways of NRMSE
calculation as [16]:
(30)
where .
Other measures are called normalized std_APE and
std_MAPE [20, 21] and calculated by the formula
(31)
and
(32)
respectively.
As a drawback, you can specify a division by zero
error if normalization factor is equal to zero.
Recommendations How to Choose Error Measures:
One of the most difficult issues is the question of
choosing the most appropriate measures out of the
groups. Due to the fact that each error measure has the
disadvantages that can lead to inaccurate evaluation of
the forecasting results, it is impossible to choose only one
measure [5].
World Appl. Sci. J., 24 (Information Technologies in Modern Industry, Education & Society): 171-176, 2013
175
We provide the following guidelines for choosing the ACKNOWLEDGMENTS
error measures.
If forecast performance is evaluated for time series research (Grants #12-07-31017, 12-01-00684).
with the same scale and the data preprocessing
procedures were performed (data cleaning, anomaly REFERENCES
detection), it is reasonable to choose MAE, MdAE,
RMSE. In case of different scales, these error 1. Tyukov, A., A. Brebels, M. Shcherbakov and
measures are not applicable. The following V. Kamaev, 2012. A concept of web-based energy
recommendations are provided for mutli-scales cases. data quality assurance and control system. In the
In spite of the fact that percentage errors are Proceedings of the 14th International Conference on
commonly used in real world forecast tasks, but due Information Integration and Web-based Applications
to the non-symmetry, they are not recommended. & Services, pp: 267-271.
If the range of the values lies in the positive 2. Kamaev, V.A., M.V. Shcherbakov, D.P. Panchenko,
half-plane and there are no outliers in the data, it is N.L. Shcherbakova and A. Brebels, 2012. Using
advisable to use symmetric error measures. Connectionist Systems for Electric Energy
If the data are "dirty", i.e. contain outliers, it is Consumption Forecasting in Shopping Centers.
advisable to apply the scaled measures such as Automation and Remote Control, 73(6): 1075-1084.
MASE, inRSE. In this case (i) the horizon should be 3. Owoeye, D., M. Shcherbakov and V. Kamaev, 2013.
large enough, (ii) no identical values should be, (iii) A photovoltaic output backcast and forecast method
the normalized factor should be not equal to zero. based on cloud cover and historical data. In the
If predicted data have seasonal or cyclical patterns, Proceedings of the The Sixth IASTED Asian
it is advisable to use the normalized error measures, Conference on Power and Energy Systems (AsiaPES
wherein the normalization factors could be calculated 2013), pp: 28-31.
within the interval equal to the cycle or season. 4. Armstrong, J.S. and F. Collopy, 1992. Error measures
If there is no results of prior analysis and a-prior for generalizing about forecasting methods: Empirical
information about the quality of the data, it comparisons. International Journal of Forecasting,
reasonable to use the defined set of error measures. 8(1): 69-80.
After calculating, the results are analyzed with 5. Mahmoud, E., 1984. Accuracy in forecasting: A
respect to division by zero errors and contradiction survey. Journal of Forecasting, 3(2): 139-159.
cases: 6. Yokuma, J.T. and J.S. Armstrong, 1995. Beyond
For the same time series the results for model maccuracy: Comparison of criteria used to select
1
is better than m, based on the one error forecasting methods. International Journal of
2
measure, but opposite for another one; Forecasting, 11(4): 591-597.
For different time series the results for model m7. Armstrong, J.S., 2001. Evaluating forecasting
1
is better in most cases, but worst for a few of methods. In Principles of forecasting: a handbook for
cases. researchers and practitioners. Norwell, MA: Kluwer
CONCLUSION 8. Gooijer, J.G.D. and R.J. Hyndman, 2006. 25 years of
The review contains the error measures for time series Forecasting, 22(3): 443-473.
forecasting models. All these measures are grouped into 9. Hyndman, R.J. and A.B. Koehler, 2006. Another look
seven groups: absolute forecasting error, percentage at measures of forecast accuracy. International
forecasting error, symmetrical forecasting error, measures Journal of Forecasting, 22(4): 679-688.
based on relative errors, scaled errors, relative errors and 10. Theodosiou, M., 2011. Forecasting monthly
other (modified). For each error measure the way of and quarterly time series using STL
calculation is presented. Also shortcomings are defined decomposition. International Journal of Forecasting,
for each of group. 27(4): 1178-1195.
Authors would like to thank RFBR for support of the
Academic Publishers, pp: 443-512.
time series forecasting. International Journal of
World Appl. Sci. J., 24 (Information Technologies in Modern Industry, Education & Society): 171-176, 2013
176
11. Shcherbakov, M.V. and A. Brebels, 2011. Outliers and 18. Tyukov, A., M. Shcherbakov and A. Brebels, 2011.
anomalies detection based on neural networks Automatic two way synchronization between server
forecast procedure. In the Proceedings of the 31 and multiple clients for HVAC system. In the
st
Annual International Symposium on Forecasting, Proceedings of The 13th International Conference on
ISF-2011, pp: 21-22. Information Integration and Web-based Applications
12. Goodwin, P. and R. Lawton, 1999. On the asymmetry & Services, pp: 467-470.
of the symmetric MAPE. International Journal of 19. Brebels, A., M.V. Shcherbakov and V.A. Kamaev,
Forecasting, 15(4): 405-408. 2010. Mathematical and statistical framework for
13. Koehler, A.B., 2001. The asymmetry of the sAPE comparison of neural network models with other
measure and other comments on the M3-competition. algorithms for prediction of Energy consumption in
International Journal of Forecasting, 17: 570-574. shopping centres. In the Proceedings of the 37 Int.
14. Makridakis, S., 1993. Accuracy measures: Theoretical Conf. Information Technology in Science Education
and practical concerns. International Journal of Telecommunication and Business, suppl. to Journal
Forecasting, 9: 527-529. Open Education, pp: 96-97.
15. Kolassa, S. and R. Martin, 2011. Percentage errors 20. Casella, G. and R. Berger, 1990. Statistical inference.
can ruin your day (and rolling the dice shows how). 2nd ed. Duxbury Press, pp: 686.
Foresight, (Fall): 21-27. 21. Kusiak, A., M. Li and Z. Zhang, 2010. A data-driven
16. Assessing Forecast Accuracy Measures. Date View approach for steam load prediction in buildings.
01.08.2013 http:// www.stat.iastate.edu/ preprint/ Applied Energy, 87(3): 925-933.
articles/2004-10.pdf
17. Syntetos, A.A. and J.E. Boylan, 2005. The accuracy
of intermittent demand estimates. International
Journal of Forecasting, 21(2): 303-314.
... The evaluation of the models is performed offline. The metrics selected are the Root Mean Square Error [56] (RMSE, equation 5), symmetric mean absolute percentage error [56] (SMAPE, equation 6). ...
... The evaluation of the models is performed offline. The metrics selected are the Root Mean Square Error [56] (RMSE, equation 5), symmetric mean absolute percentage error [56] (SMAPE, equation 6). ...
Preprint
Full-text available
High computational power and the availability of large datasets have supported the development of Foundational Models. They are a new emerging technique widely used in Generative Artificial Intelligence, characterized by their scalability and their use in Transfer Learning. The enormous and heterogeneous amounts of data used in their initial training phase, known as pre-training, give them a higher generalization capacity than any other specific model, constituting a solid base that can be adapted or adjusted to a wide range of tasks, increasing their applicability. This study proposes LLIAM, the Llama Lora-Integrated Autorregresive Model. Low-Rank Adaptations are used to enhance the knowledge of the model with diverse time series datasets, known as the fine-tuning phase. To illustrate the capabilities of our proposal, two sets of experiments have been carried out that obtained favorable and promising results with lower training times than other Deep Learning approaches. With this work, we also encourage the use of available resources (such as these pre-trained models) to avoid unnecessary and costly training, narrowing the gap between the goals of traditional Artificial Intelligence and those specified by the definition of Green Artificial Intelligence.
... A fourth-order Butterworth low-pass filter is then used to smooth the reconstructed signal curve. To show the difference between the original and the reconstructed signal, root mean squared percentage error (RMSPE) has been calculated based on the following formula [27]: ...
Article
Full-text available
The first line of treatment for urinary incontinence is pelvic floor muscle (PFM) training, aimed at reducing leakage episodes by strengthening these muscles. However, many women struggle with performing correct PFM contractions or have misconceptions about their contractions. To address this issue, we present a novel PFM contraction quality assessment system. This system combines a PFM contraction detector with a maximal PFM contraction performance classifier. The contraction detector first identifies whether or not a PFM contraction was performed. Then, the contraction classifier autonomously quantifies the quality of maximal PFM contractions across different features, which are also combined into an overall rating. Both algorithms are based on artificial intelligence (AI) methods. The detector relies on a convolutional neural network, while the contraction classifier uses a custom feature extractor followed by a random forest classifier to predict the strength rating based on the modified Oxford scale. The AI algorithms were trained and tested using datasets measured by vaginal dynamometry, combined in some cases with digital assessment results from expert physiotherapists. The contraction detector was trained on one dataset and then tested on two datasets measured with different dynamometers, achieving 97% accuracy on the first dataset and 100% accuracy on the second. For the contraction performance classifier, the results demonstrate that important clinical features can be extracted automatically with an acceptable error. Furthermore, the contraction classifier is able to predict the strength rating within a ±1 scale point with 97% accuracy. These results demonstrate the system’s potential to enhance PFM training and rehabilitation by enabling women to monitor and improve their PFM contractions autonomously.
... The linear and non-linear models were compared based on goodness of fit statistic (Shcherbakov et al., 2013); coefficient of multiple determination (R 2 ), adjusted R 2 , Mean Absolute Percentage Error (MAPE) and Root Mean Square Percentage Error (RMSPE). Assumptions of residuals were also worked out. ...
Article
Full-text available
Weather-based models were developed to accurately forecast wheat productivity in three districts of Punjab, India, predicting the wheat yield with accuracy as early as two and a half months before the crop harvest. The trends in weather parameters were identified using Mann-Kendal, Sen's Slope and Pettitt's test. Amongst the linear and non-linear models, the logistic model was found to be the most effective in eliminating the influence of technological factors on wheat productivity over time. Forecasting of wheat productivity was done using detrended data derived from fourteen weeks of weather data during the vegetative period. The stepwise regression technique for detrended wheat productivity on weather indices revealed model II best for Amritsar, Ludhiana and Patiala districts, explaining 60%, 67% and 52% variation in the detrended wheat productivity and had root mean square percentage error 8.57%, 6.93% and 6.20% respectively. The model concluded that warm maximum and cool night temperatures of the wheat growing season will increase detrended wheat productivity, whereas an increase in rainfall and relative humidity in the morning will decrease detrended wheat productivity and hence the production.
... 4 This method is not how a percentage forecast error is calculated in other sectors. 5 It is also not the method the system operators typically employ to calculate the errors in the electricity load, i.e. consumption, forecasts. ...
Article
Kevin F. Forbes describes how a misleading statistic is imperilling the transition to renewable energy in Great Britain and Ireland
... The linear and non-linear models were compared based on goodness of fit statistic (Shcherbakov et al., 2013); coefficient of multiple determination (R 2 ), adjusted R 2 , Mean Absolute Percentage Error (MAPE) and Root Mean Square Percentage Error (RMSPE). Assumptions of residuals were also worked out. ...
Article
Full-text available
Weather-based models were developed to accurately forecast wheat productivity in three districts of Punjab, India, predicting the wheat yield with accuracy as early as two and a half months before the crop harvest. The trends in weather parameters were identified using Mann-Kendal, Sen's Slope and Pettitt's test. Amongst the linear and non-linear models, the logistic model was found to be the most effective in eliminating the influence of technological factors on wheat productivity over time. Forecasting of wheat productivity was done using detrended data derived from fourteen weeks of weather data during the vegetative period. The stepwise regression technique for detrended wheat productivity on weather indices revealed model II best for Amritsar, Ludhiana and Patiala districts, explaining 60%, 67% and 52% variation in the detrended wheat productivity and had root mean square percentage error 8.57%, 6.93% and 6.20% respectively. The model concluded that warm maximum and cool night temperatures of the wheat growing season will increase detrended wheat productivity, whereas an increase in rainfall and relative humidity in the morning will decrease detrended wheat productivity and hence the production.
... The gap between the actual observation value and the predicted value is usually called the error measure in prediction models. In [40], depending on the input of the model (whether the input is binary or not), different error measurements are considered and the importance to choose the appropriate one is discussed. For data converted into either start-time and end-time or start-time and duration like time series data, a continuous error measurement is required. ...
Article
Full-text available
The detection of behavioral drifts by applications monitoring daily living activities, is very relevant in health care monitoring systems particularly for older persons. The detection of behavioral drifts can be crucial, as it may indicate the early stages of a disease. Our research objectives are focused on building a model to conduct a continuous and long-term analysis of elderly’s behavior in order to detect slow changes. The first originality of this work is to use rich contextual information such as weather conditions, holidays, seasons, etc. to identify and learn routine behavior patterns. These patterns are updated throughout the aging process of the elderly person by proposing a novel dynamic behavior clustering method through an iterative process using a moving-window mechanism. The routine behavior patterns are then used for comparing each observed day’s behavior to the associated routine behavior pattern in preceding period to define a similarity score. The second originality of this work is to exploit machine learning techniques on previously observed Activities of Daily Living (ADL) to forecast when the future ones should occur. We use this forecast to measure the actual gap with the future ADLs, as soon as they occur, and detect behavioral drifts of the monitored elderly people and thus specify its type (degradation or recovery). Experimental results are proposed to show the superiority of the proposed method compared to the existing state-of-the-art methods.
... During the parameter optimization process for both methods, forecast error values were monitored to assess how well each model performed. The errors monitored included MBE (5), MAPE (6), MAE (7), and R2Score (8) [33]. ...
Article
Full-text available
The primary objective of this study is to evaluate the accuracy of different forecasting models for monthly wind farm electricity production. This study compares the effectiveness of three forecasting models: Autoregressive Integrated Moving Average (ARIMA), Seasonal ARIMA (SARIMA), and Support Vector Regression (SVR). This study utilizes data from two wind farms located in Poland—‘Gizałki’ and ‘Łęki Dukielskie’—to exclude the possibility of biased results due to specific characteristics of a single farm and to allow for a more comprehensive comparison of the effectiveness of both time series analysis methods. Model parameterization was optimized through a grid search based on the Mean Absolute Percentage Error (MAPE). The performance of the best models was evaluated using Mean Bias Error (MBE), MAPE, Mean Absolute Error (MAE), and R2Score. For the Gizałki farm, the ARIMA model outperformed SARIMA and SVR, while for the Łęki Dukielskie farm, SARIMA proved to be the most accurate, highlighting the importance of optimizing seasonal parameters. The SVR method demonstrated the lowest effectiveness for both datasets. The results indicate that the ARIMA and SARIMA models are effective for forecasting wind farm energy production. However, their performance is influenced by the specificity of the data and seasonal patterns. The study provides an in-depth analysis of the results and offers suggestions for future research, such as extending the data to include multidimensional time series. Our findings have practical implications for enhancing the accuracy of wind farm energy forecasts, which can significantly improve operational efficiency and planning.
Article
This study aims to enhance active vibration control in a cantilever beam using macro fiber composite (MFC) actuators. To address the challenge of accurately modeling the complex hysteresis behavior of MFC actuators, an advanced hysteresis modeling technique is employed, integrating a non-symmetric Bouc–Wen model with an Auto-Regressive model with eXogenous inputs (ARX). The parameter estimation of this model is optimized using an adaptive mutation factor, and multiple mutation strategy differential evolution (AmFMMDE) algorithm. Additionally, a Variable Step Size Filtered-x Least Mean Square (VSS-FxLMS) algorithm with step size adaptation based on normalized error change is utilized for effective vibration control. This approach shows promising potential for practical engineering applications requiring precise and efficient active vibration control.
Article
Güneş paneli teknolojisi, güneş enerjisini elektrik enerjisine dönüştürerek sürdürülebilir ve temiz enerji üretimini desteklemektedir. Yapay zekâ, bu süreçte veri analizi, enerji yönetimi ve panel verimliliğinin optimizasyonu gibi alanlarda önemli katkılar sunmaktadır. Bu iki teknolojinin entegrasyonu, enerji üretimi ve tüketiminde daha yüksek verimlilik sağlamayı mümkün kılmaktadır. Bu çalışmada, sensörler aracılığıyla veri toplayarak güneş panellerinin gerçek performansını yapay zekâ tabanlı tahminlerle karşılaştırmak ve makine öğrenmesi yöntemleri ile güneş paneli kurulumu için en uygun alanları belirlemek amaçlanmaktadır. Elde edilen tahminlerin doğruluğu yüksek olduğu takdirde, sensörler ve yapay zekâ kullanılarak güneş paneli kurulumu olmaksızın da potansiyel enerji üretiminin tahmin edilebilmesi hedeflenmektedir.
Article
Since direct measurement of reference evapotranspiration (ET0) is a complex, time-consuming and expensive process, the most common procedure is to estimate ET0 from climate data. The purpose of this study was to perform reference evapotranspiration calculations based on the data of the state meteorological station Askania-Nova and compare them with the actual ET0 data obtained using an automatic Internet meteorological station. The data for the study were taken from the state meteorological station Askania-Nova (township Askania-Nova, Kakhovsky district, Kherson region, 46.45°N 33.88°E) and the automatic Internet meteorological station iMetos IMT 300 from the company "Pessl Instruments", which is located at the meteorological site of the Askaniysk DSDS (Tavrychanka village, Kakhovsky district, Kherson region, 46.55°N, 33.83°E). Standard evapotranspiration was calculated using the Penman-Monteith method (FAO56-RM). To assess the accuracy of ET0 calculations, mean absolute percent error (MAPE), root mean square error (RMSE) and Standard Error of Estimate (SEE ) were determined. According to the results of the comparison of indicators from two meteorological stations, it was found that the smallest errors are inherent in the daily average and maximum temperature and relative air humidity (MAPE<10%), for the minimum temperature and relative air humidity, the MAPE errors are 18,1 and 13,7%, respectively. The MAPE error for water vapor pressure deficit and solar radiation is 20,2 and 26,3%, respectively. The largest MAPE error of 40,3% was established for wind speed measurements. The average MAPE error between the calculated ET0, based on the meteorological data of the Askania-Nova station, and the actual ET0 data obtained from the automatic Internet meteorological station iMetos is 16,8%, RMSE – 0,65 mm, SEE – 0,56 mm. Applying a coefficient of 0,92 when calculating ET0 reduces the errors of MAPE, RMSE, and SEE by 3,2%, 0,15 mm, and 0,05 mm, respectively, for all calculation periods. For the May-August period, the MAPE error was 10,7%, which brings the calculations close to high accuracy (MAPE <10%). Based on the results of the calculations, it was established that on average over the years of research, the actual ET0 was 68 mm less than the calculated one. The absolute errors of determination of ETc depended on the crop and the average over the years of research ranged from 33 mm (winter wheat) to 68 mm (early tomatoes). The application of the refined value of ET0 in calculations reduces the absolute errors in the determination of c over the years of research, this error did not exceed 6 mm (early tomato). Research results confirm the possibility of using meteorological indicators obtained from state meteorological stations to calculate ET0. To increase the accuracy of calculations, it is necessary to use a refinement coefficient.
Conference Paper
Full-text available
Silicon photonics has become in the past years an important technology adopted by a growing number of industrial players to develop their next generation optical transceivers. However most of the technology platforms established in CMOS fabrication lines are kept captive or open to only a restricted number of customers. In order to make silicon photonics accessible to a large number of players several initiatives exist around the world to develop open platforms. In this paper we will present imec's silicon photonics active platform accessible through multi-project wafer runs.
Article
Full-text available
We report a high-performance germanium waveguide photodetectors (WPDs) without doping in germanium or direct metal contacts on germanium, grown on and contacted through a silicon p-i-n diode structure. Wafer-scale measurements demonstrate high responsivities larger than 1.0 A/W across the C-band and low dark current of ~3 nA at -1 V and ~8 nA at -2 V. Owing to its small dimensions, the Ge WPD exhibits a high optoelectrical 3-dB bandwidth of 20 and 27 GHz at low-bias voltages of -1 and -2 V, respectively, which are sufficient for operation at 28 Gb/s. The reduced processing complexity at the tungsten contact plug module combined with the high responsivity makes these Ge WPD devices particularly attractive for emerging low-cost CMOS-Si photonics transceivers.
Conference Paper
Full-text available
Owing to the fact that input data for existing PV forecast algorithms are hard to come by, there is the need to develop a method based on data that is relatively easy to obtain and one with a much simpler algorithm which still produces acceptable results. This paper proposes a method for photovoltaic output backcast and forecast using cloud cover and historical data. The method is about five times more efficient than the benchmark model.
Article
Full-text available
A solution is presented for the short-term electrical energy forecasting in shopping centers located in the Netherlands and Belgium. A forecasting method is proposed on the basis of connectionist systems. General description of the forecasting method is provided, as well as its specific features with respect to the forecasting problem are studied. Several connectionist models are generalized, stated and applied, notably, moving average model, linear regression model, and neural network model. In addition, changes in forecasting quality are demonstrated depending on different input variables. The results of using these connectionist models are discussed, and conclusions regarding specific features of every model are outlined.
Article
Full-text available
We present a silicon-on-insulator (SOI) polarization-insensitive fiber-to-fiber coupler fabricated on a 200-mm wafer with the standard complementary metal-oxide-semiconductor technology. The coupling losses from a lensed fiber into a 500-nm-wide SOI waveguide were measured to be less than 1 dB in the 1520- to 1600-nm spectral range and below 3 dB between 1300 and 1600 nm.
Conference Paper
Precise dimension control technology for the fabrication of silicon photonics devices was established. The dimension control technology consists of the devices fabrication using 40-nm-node CMOS technology and in-line process monitoring by optical wafer-level probing system. As the results of process optimization in waveguide formation, superior dimension control in 440-nm-wide / 220-nm-thick waveguides was achieved, in which waveguide width deviation of 1.0 nm and height deviation of 0.3 nm were respectively obtained for a single 300 mm wafer. In the characterization of 5th-order coupled resonator optical waveguides (CROWs), remarkably small deviation of resonant frequency 0.7 nm in a single wafer was confirmed, which values agreed with the theoretical estimation from the fabrication error. As for the optical wafer-level probing system, quite small deviation less than 0.2 dB in I/O coupling loss between optical devices under test and fiber probe was confirmed. It was successfully shown that the combination of the precise process control and the in-line optical process control monitor is sufficient to the reproducible device fabrication for wide-bandwidth optical interconnection.
Article
This paper is a re-examination of the benefits and limitations of decomposition and combination techniques in the area of forecasting, and also a contribution to the field, offering a new forecasting method. The new method is based on the disaggregation of time series components through the STL decomposition procedure, the extrapolation of linear combinations of the disaggregated sub-series, and the reaggregation of the extrapolations to obtain estimates for the global series. Applying the forecasting method to data from the NN3 and M1 Competition series, the results suggest that it can perform well relative to four other standard statistical techniques from the literature, namely the ARIMA, Theta, Holt-Winters' and Holt's Damped Trend methods. The relative advantages of the new method are then investigated further relative to a simple combination of the four statistical methods and a Classical Decomposition forecasting method. The strength of the method lies in its ability to predict long lead times with relatively high levels of accuracy, and to perform consistently well for a wide range of time series, irrespective of the characteristics, underlying structure and level of noise of the data.