ArticlePDF Available

Abstract and Figures

Extensive research has been devoted to the quality of analysts' earnings forecasts. The common finding is that analysts' forecasts are not very accurate. Prior studies have tended to focus on the mean of forecasts and measure accuracy using various summaries of forecast errors. The present study sheds new light on the accuracy of analysts' forecasts, by measuring how well calibrated these forecasts are. The authors follow the tradition of calibration studies in psychological literature and measure the degree of calibration by the hit rate. They analyze a year's worth of data from the Institutional Brokers Estimate System database, which includes over 200,000 annual earnings forecasts made by over 6,000 analysts for over 5,000 companies. By using different ways to convert analysts' point estimates of earnings into a range of values, the authors establish the bounds that are necessary to determine the hit rates, and examine to what extent the actual earnings announced by the companies are bracketed by these intervals. These hit rates provide a more complete picture of the accuracy of the forecasts.
Content may be subject to copyright.
Full Terms & Conditions of access and use can be found at
http://www.tandfonline.com/action/journalInformation?journalCode=hbhf20
Download by: [Mr David V. Budescu] Date: 15 December 2017, At: 11:33
Journal of Behavioral Finance
ISSN: 1542-7560 (Print) 1542-7579 (Online) Journal homepage: http://www.tandfonline.com/loi/hbhf20
How (Over) Confident Are Financial Analysts?
Ning Du & David V. Budescu
To cite this article: Ning Du & David V. Budescu (2017): How (Over) Confident Are Financial
Analysts?, Journal of Behavioral Finance, DOI: 10.1080/15427560.2018.1405004
To link to this article: https://doi.org/10.1080/15427560.2018.1405004
Published online: 15 Dec 2017.
Submit your article to this journal
View related articles
View Crossmark data
How (Over) Condent Are Financial Analysts?
Ning Du
a
and David V. Budescu
b
a
DePaul University;
b
Fordham University
ABSTRACT
Extensive research has been devoted to the quality of analystsearnings forecasts. The common
nding is that analystsforecasts are not very accurate. Prior studies have tended to focus on the
mean of forecasts and measure accuracy using various summaries of forecast errors. The present
study sheds new light on the accuracy of analystsforecasts, by measuring how well calibrated
these forecasts are. The authors follow the tradition of calibration studies in psychological literature
and measure the degree of calibration by the hit rate. They analyze a years worth of data from the
Institutional Brokers Estimate System database, which includes over 200,000 annual earnings
forecasts made by over 6,000 analysts for over 5,000 companies. By using different ways to convert
analystspoint estimates of earnings into a range of values, the authors establish the bounds that
are necessary to determine the hit rates, and examine to what extent the actual earnings
announced by the companies are bracketed by these intervals. These hit rates provide a more
complete picture of the accuracy of the forecasts.
KEYWORDS
Financial analyst; Earning
forecasts; Overcondence;
Judgment and decision
making; Calibration
Introduction
Financial analysts are important information
intermediaries in the capital market. Analysts receive
and transfer nancial accounting information, research
macroeconomic and microeconomic conditions, analyze
company fundamentals and private information, and
help investors and other market participants make sound
investment decisions. Two key outputs of their research
activities are earnings forecasts and stock recommenda-
tions. Analyst earnings forecasts are inputs to stock rec-
ommendation and serve as the basis for some investors
trading decisions. Analysts usually predict companies
future earnings 1 or 2 years ahead of the actual earnings
are announced, and may also predict a companys annual
or quarterly earnings. Prior research has shown that ana-
lyst forecasts affect stock prices and are often used as a
proxy for investorsexpectation and differences in opin-
ions (Friesen and Weller [2006]). Naturally, researchers
have been interested in the quality of analyst forecast.
Forecast accuracy is usually dened as the absolute dif-
ference between the forecast and the actual earnings, and
is found to be affected by factors such as frequency and
timeliness of forecasts, experience, industry specializa-
tion, number of companies an analyst follows, and bro-
kerage house characteristics (Jacobs, Lys, and Neale
[1999]). Studies have also found that analyst earnings
forecasts are often inaccurate, as analysts tend to issue
optimistic estimates that are systematically higher than
the actual realized earnings are (Brown [1997], Ramnath
et al. [2008]). In addition to measurement errors, incen-
tive (intentional bias) and unintentional cognitive biases
have been proposed to explain the inaccuracy (Easter-
wood and Nutt [1999], Lin and McNichols [1998], Libby
et al. [2006]).
The incentive explanation suggests that analysts are
motivated to generate biased earnings forecasts to con-
vince investors to follow their recommendations. For
example, analysts might forecast higher earnings when
they offer buyrecommendation and forecast lower
earnings when their recommendation is sell.In addi-
tion, analysts may try to positively affect companies
stock prices for the sake of maintaining a good relation-
ship with managers and gain access to more private
information from managers. Analysts may also feel pres-
sure from their employers to generate biased forecasts
(Stickel [1990], Easterwood and Nutt [1999], Lin and
McNichols [1998], Libby et al. [2006]).
Other researchers have invoked cognitive biases, such
as overcondence, representativeness, or self-attribution
to explain inaccuracy in an analysts forecast. In these
studies, overcondence has been used as overarching
explanation for forecast inaccuracy. These studies have
CONTACT Ning Du ndu1@depaul.edu School of Accountancy and Management Information Systems, DePaul University, One East Jackson Boulevard,
Chicago, IL 60604.
© 2018 The Institute of Behavioral Finance
JOURNAL OF BEHAVIORAL FINANCE
https://doi.org/10.1080/15427560.2018.1405004
Downloaded by [Mr David V. Budescu] at 11:33 15 December 2017
utilized large samples of analystsforecast data to search
for overcondence in the analystsforecasts. Consistent
with theories in behavioral nance (Gervais and Odean
[2001], Daniel et al. [1998]), they have dened an over-
condent analyst as one who overestimates her ability
and attaches excessive weight to private, relative to pub-
lic, information (Daniel et al. [1998]). For example, Frie-
sen and Weller [2006] developed a formal rational
(Bayesian) model and empirically test whether analysts
deviate from rational Bayesian updating by examining
errors from analyst forecasts. They found that analysts
place twice as much weight on their private information
as justied by rational Bayesian updating. They con-
cluded that when analysts incorporate new information
into their forecasts, the new information does not receive
the rational Bayesian weight due to overcondence.
Hilary and Menzly [2006] used past forecast accuracy to
predict the overcondence of a given analyst. They
showed that after a short series of good predictions, ana-
lysts are more likely to be inaccurate as they often take
additional risks by deviating from the consensus. They
interpreted this pattern to be consistent with overcon-
dence as past successes, through the mechanism of self-
attribution bias, exacerbate overcondence (Gervais and
Odean [2001], Daniel et al. [1998]). Bessiere and Elke-
mali [2014] focused on forecast revisions and forecast
errors to test the notion that overcondence leads to an
overreaction to private information followed by an
underreaction when the information becomes public.
They showed that preceding an earnings announcement,
analysts excessively integrate information in their revi-
sions (i.e., overreact) and revise their forecasts too
strongly, but this overreaction disappears in the period
following the announcement.
One problem with these studies is that they do not
measure directly overcondence. Instead, they rely on
proxies to infer overcondence from abnormal forecast
error or excessive forecast revision after benchmarking
against some rational expectations. The use of indirect
proxies makes it difcult to know whether overcon-
dence is the real, or primary, source of earnings forecast
inaccuracy. Overcondence is a well-dened term in the
psychological literature, and is most closely related to the
probability judgment research. Overcondence has been
dened as a particular form of miscalibration observed
when the judged probability that the answers given or
selected are correct, exceeds the actual rate of occurrence
of the target events. For example, Oskamp [1965]dened
overcondence as an excess of condence in expressed
judgment over accuracy of this judgment. Fischhoff et al.
[1977] suggested that appropriate calibration takes place
if over the long run, for all propositions assigned a given
probability, the proportion that is true is equal to the
probability assigned(p. 552). Following this tradition,
we suggest that a well-calibrated analyst is one who is
able to correctly asses his or her accuracy, whereas an
overcondent analyst is one who overestimate his or her
accuracy in earnings forecasts.
We believe the rst step is to establish the level of con-
dence among nancial analysts is to determine how
accurate, or well calibrated, they are. Our goal is to estab-
lish a baseline of analystsforecast condence, to calcu-
late their degree of overcondence. To avoid problems
such as nonrepresentative sampling and small sample
size, we rely on large sample of analystsdata. We ran-
domly selected a years worth of data from the Institu-
tional Brokers Estimate System (IBES) database, which
includes over 200,000 annual earnings forecasts made by
over 6,000 analysts for over 5,000 companies. Based on
this dataset, we calculated the accuracy of analystsfore-
casts and empirically established the degree of con-
dence associated with these forecasts.
Literature review
Overcondence in the psychological literature
Moore and Healy [2008] discussed 3 prevalent deni-
tions of overcondence in the psychological literature:
(1) overestimation of ones actual performance, (2) over-
placement of ones performance relative to others, and
(3) excessive precision in ones beliefs. Extensive research
has focused primarily on 1 facet of judgment quality, cal-
ibrationthe match between subjective probabilities
with the corresponding fraction of actual realizations of
the target events (Gigerenzer et al. [1991], Lichtenstein
et al. [1982], Von Winterfeldt and Edwards [1986]).
Most studies have shown that people are systematically
overcondent about the accuracy of their knowledge and
judgments, because their subjective probabilities are fre-
quently more extreme than corresponding accuracy rates
are. For example, when people express 95% condence,
they may be correct only about 80% of the time. These
studies also have found that the amount of overcon-
dence depends on the difculty of the task. The so-called
hard-easy effect implies that overcondence is higher in
hard tasks, but attenuated, or even eliminated, in easy
tasks (Lichtenstein et al. [1982], Keren 1991]), although
the reality of this effect was questioned (Juslin et al.
[2000]).
Calibration studies use 2 types of response modes:
probability intervals or direct probability estimates.
Probability intervals require estimation of quantiles
(sometimes referred to as fractiles) of probability func-
tions of continuous variables, as well as probabilistic
judgments about discrete propositions (Keren [1991]).
2N. DU AND D. V. BUDESCU
Downloaded by [Mr David V. Budescu] at 11:33 15 December 2017
Estimates of the quantiles of probability distributions are
used for uncertain continuous quantities. Judges are
required to provide values that correspond to prestated
probabilities (Juslin et al. [2000], Keren [1991]), and one
can use them to derive probability intervals (e.g., a sub-
jective 50% probability interval spans the range from the
25th to 75th quantiles). Typically, over- or undercon-
dence is measured by the rate of surprises across multiple
judgments (i.e., the percentage of true values falling out-
side the subjective intervals). For example, consider an
investor who provides 90% intervals for the values of a
variety of stocks at the end of the year. If the investor is
perfectly calibrated, 90% of bounds he or she provided
should bracket the actual values (and 10% of the values
should fall outside the stated intervals). If the percentage
of surprises is higher than 10%, and the proportion of
values in the intervals is lower than the prestated proba-
bility (e.g., only 40% of true values fall within the 90%
intervals), it is inferred that the judge is overcondent.
Conversely, undercondence is inferred when the pro-
portion of true values in the interval is higher than the
prestated probability. The common nding is that the
empirical intervals are far too narrow. Hit rates in many
studies using 9099% condence intervals are less than
50%, leading to surprise rates of 50% or higher instead of
the 110% expected from well-calibrated judges (Alpert
and Raiffa [1982], Klayman et al. [1999], Lichtenstein
et al. [1982]). However, there is literature challenging
this approach (for review, see Park and Budescu [2015]).
Essentially, the claim is that people cannot tell the differ-
ence among 50%, 70%, and 90% intervals and they
respond similarly regardless of the condence level pre-
scribed. Thus, if one compares their answers to the 50%
standard, they look undercondent, but if one compares
them to 90% the same people look overcondent.
Direct probability estimates of binary events ask
judges to assess the probability that various statements
are true (or that certain events will occur) on a scale
ranging from 0 (certainly false)to1(certainly true). For
example, one could ask investors to estimate the proba-
bility that the stock price for Google will be higher than
$160 at the end of the year (and other similar questions
about other stocks). Judges are considered well cali-
brated if the relative frequencies of true statements
match the stated probabilities (e.g., 90% of all events
assigned probability 0.9 should be correct). The calibra-
tion curve plots the proportion of true (correct) items
as a function of the judgesprobabilities. The 45line
represents perfect calibration, and points below (above)
this line reect over- (under-) condence (Lichtenstein
et al. [1982]). Most studies have found overcondence
(e.g., Lichtenstein et al. [1982]), but conservatism
(undercondence) was also observed (Budescu and Du
[2007], Du and Budescu [2005]). Winman et al. [2004]
suggested that probability estimates and condence
intervals are formally equivalent because high (low)
uncertainties can be expressed either by low (high)
probability judgments or by wide (narrow) interval esti-
mates. Empirically, however, different elicitation meth-
ods have produced systematically different judgments
(Rottenstreich and Tversky [1997]). For example
Budescu and Du [2007] and Du and Budescu [2005]
investigated the 2 response modes using different meas-
ures of miscalibration. They asked decision makers
(DMs) to make judgments about a random sample of
stocks (accompanied by identical information to facili-
tate comparison between the 2 judgment methods).
DMs judged the probabilities that the stocks will reach
a certain threshold, provided lower and upper bounds
of these forecasts, and estimated median, 50%, 70%,
and 90% condence intervals of their future prices.
They found that the direct probability method induced
overcondence as DMssubjective probabilities were
higher than the observed relative frequencies, but the
condence interval method generated a mixed pattern:
undercondence at the 50% level, perfect calibration at
the 70% level, and overcondence at the 90% level.
Yaniv and Foster [1995,1997] challenged the use of
probabilistic calibration as the normativestandard for
accuracy. They suggest the communication of judgment
estimates, such as forecasts of future outcomes, is part of
the interaction between information senders and
receivers; the choice of the information precision, such
as the width of an interval estimate, not only reects the
level of uncertainty judged by the senders, but also infor-
mation receiverspreferences. Stating an enormous pre-
diction range would be perceived as uninformative in
many real-life decisions. For example, consider a nan-
cial analyst who can issue 1 of 3 annual forecasts for
earnings per share: (a) $5, (b) $46, and (c) $010. The
third option with its wide interval is highly likely to be
accurate (i.e., to include the real future earnings), but it
is not very informative (some would call it useless) for
investors who seek guidance about the rms protabil-
ity. Yaniv and Foster [1995,1997] studied this conict
between the accuracy (dened as the hit rate) and the
informativeness of a range estimate in a series of studies.
They argued that the choice of the graininess of estima-
tion under uncertainty involves a tradeoff between these
2 conicting objectives and proposed a simple additive
(i.e., compensatory) model that weights differentially
accuracy and informativeness, and showed that people
are willing to accept errors in the interest of securing
more informative judgments. This line of work provides
a sensible explanation for the inaccuracy in analyst
forecasts.
JOURNAL OF BEHAVIORAL FINANCE 3
Downloaded by [Mr David V. Budescu] at 11:33 15 December 2017
Overcondence in the behavioral nance literature
Researchers in behavioral nance have used overcon-
dence to explain market anomalies for decades and
explored this topic through experiments, surveys, theo-
retical modeling, and analysis of nancial market data.
Overcondence is usually dened as an overestimation
of ones knowledge or precision of their information
(sometimes more specically: overestimating the impact
of private signals and underestimating the relevance or
diagnosticity of public ones). Incorporating the notion of
overcondence in an economic theory allows researchers
to explain puzzles in the nancial markets such as securi-
ties misvaluations, excessive trading volumes, and the
disposition effect (i.e., a tendency to sell well-performing
stocks too quickly and to hold on to losing ones for too
long; Odean [1998], Daniel et al. [2001], Chuang and
Lee [2006]). Chuang and Lee [2006] developed a com-
plex theoretical model of major ndings on overcon-
dence in behavioral nance and evaluated it empirically.
They provided both theoretical and empirical evidence
for 4 hypotheses: (1) overcondence causes investors to
overreact to private information, and underreact to pub-
lic information (see Daniel et al. [1998], Odean [1998]),
(2) experienced market gains result in increasingly
aggressive trading (e.g., Gervais and Odean [2001], De
Long et al. [1991], Kyle and Wang [1997], Benos
[1998]), (3) excessive trading of overcondent traders
induce persistent excessive volatility (Benos [1998], Dan-
iel et al. [1998], Odean [1998], Gervais and Odean
[2001]), and (4) overcondent traders underestimate
risk (Hirshleifer and Luo [2001]).
To understand abnormal returns, excessive trading
volume, or extreme volatility, some researchers analyzed
nancial market data to establish the link between over-
condence and the trading behavior (Odean [2001], Bar-
ber and Odean [2000,2001]). Other researchers
attempted to establish a direct link. For example, De
Bondt [1998] surveyed investors and conrmed the prev-
alence of overcondence: He found that investors were
overly optimistic about the performance of shares they
own but not about the level of the stock index in general.
Investors were miscalibrated and their probability inter-
vals were consistently too narrow (De Bondt [1998]). In
an experimental study, Glaser and Weber [2007] docu-
mented a direct relation between investor overcondence
and trading volume. Their results also supported miscali-
bration as participants underestimated price volatilities
and their judgments reected tight probability distribu-
tions. Analyzing survey results of German nancial mar-
ket participants, Deaves et al. [2010] documented
overcondence among participants, and found that
learning occurred as participants widened or narrowed
condence intervals to correct judgment errors, but years
of working experience did not appear to moderate misca-
libration. Similarly, Gort et al. [2008] focused on institu-
tional investors in Switzerland by surveying the decision
makers of Swiss pension plans. They found that these
managers and members of investment committees pro-
vided too narrow condence intervals when asked to
estimate past returns of various assets as well as to fore-
cast future returns but their overcondence is less severe
compared with laypeople. They also found that people
with more education and working experience are more
overcondent.
The present study
In this study, we rst calculate the accuracy of analysts
annual forecasts and then we determine hit rates of these
forecasts to examine the degree of calibration. The meth-
odological novelty of our approach is the use of a very
large multicompany and multianalysts database that
allows us to examine empirical probability distributions
of forecasts and use them to infer interval predictions.
This approach allows us to examine to what extent the
actual earnings announced by the companies are brack-
eted by these intervals and calculate hit rates at various
levels (analyst, time period, industry, etc.). These hit rates
provide a more complete picture of the accuracy of the
forecasts.
Data analysis
We use data from the IBES database that is maintained
by Thomson Financial and contains comprehensive
global information on analyst estimates of earnings per
share (EPS) including individual forecasts and consensus
data. The database currently covers over 69,000 compa-
nies in 90 countries. We selected all 205,664 individual
forecasts related to the scal year 2014 in the United
States. The earliest forecast was made 488 days before
the actual EPS announcement date, and the average lag
between the forecast date and the actual EPS announce-
ment is 204 days. This 2014 dataset contains 205,664
forecasts issued by 5,197 analysts for 6,010 companies.
An analyst may issue multiple forecasts for one com-
pany, or for multiple companies. For example, there are
65 analysts who follow Apple, Inc. Table 1 shows the dis-
tribution of analysts following a company. Two compa-
nies are followed by more than 60 analysts and, at the
other extreme, 3,332 companies are followed by fewer
than 10 analysts (The mode and the median of the distri-
bution are in this category). Table 2 shows the distribu-
tion of the number of companies followed by various
4N. DU AND D. V. BUDESCU
Downloaded by [Mr David V. Budescu] at 11:33 15 December 2017
analysts. For example, one analyst follows 83 different
companies, and a total of 3,903 analysts follow fewer
than 10 companies.
We start by calculating the 4 different measures of
accuracy of the analystsearnings forecasts: individual
error, relative individual error, absolute error, and rela-
tive absolute error. Individual error is the difference
between each individual forecast and the actual EPS
announced by the company and is not signicantly dif-
ferent from zero (t0.76, df D205,663, p>0.05). As
the positive and negative errors tend to cancel out, we
also analyze the absolute errors. The mean absolute error
is 0.69 with a standard deviation of 7.10, and is signi-
cantly higher than 0 (tD44.19, df D205,663, p<0.05).
Because of the large variability in EPSs, we calculated rel-
ative values by dividing the individual error and absolute
error by the actual EPS announced by the company. As
some companies have negative EPS value, we use the
absolute value of the actual EPS as the denominator to
ensure that all relative absolute errors are positive. The
mean relative absolute error is 0.47 with a standard devi-
ation of 12.51, not signicantly different from 0 (tD
1.18, df D205,515, pD0.24). Table 3 presents the details
of forecast errors.
Naturally, we expect that forecasts will become more
accurate as a function of how close they are to the actual
EPS announcement date. For example, there are 112
forecasts made by 34 different nancial analysts for Star-
bucks in 2014 (scal year ending 9/30/2014). These fore-
casts are made on 25 different dates and the actual EPS
is announced on 10/30/2014. The forecast horizon, the
time lag between each forecast date and the earnings
announcement date (10/30/2014), ranges from 17 to
364 days with a mean lag of 203.80 days (SD D105.29).
To examine how forecast accuracy changes as a func-
tion of time, we ran 4 different regressions using the 4
measures of error (i.e., individual errors, relative individual
errors, absolute error, and relative absolute error) as
dependent variables. We used the same predictorstime
lag, market capitalization, and several dummy variables for
the various classes of industries. We matched the company
code with a different database Capital to match companies
with industries. We rely on SIC industry code (Standard
Industrial Classication by U.S. Department of Labor)
and divide the companies into 9 industries: agriculture,
forestry and shing, mining, construction, manufacturing,
transportation, communications, electric, gas and sanitary
Table 1. Distribution of analysts following specic companies.
# of Analysts Following a Company Frequency
More than 60 2
Between 50 and 60 12
Between 40 and 50 42
Between 30 and 40 168
Between 20 and 30 470
Between 10 and 20 1,171
Less than 10 3,332
Total 5,197
Table 2. Distributions of companies followed by specic analysts.
# of Companies Followed by the Analysts Frequency
Above 80 1
Between 70 and 80 2
Between 60 and 70 1
Between 50 and 60 5
Between 40 and 50 18
Between 30 and 40 88
Between 20 and 30 587
Between 10 and 20 1,405
Less than 10 3,903
Total 6,010
Table 3. Descriptive statistics of four measures of analyst forecast error.
Measure of Accuracy
Statistic Individual Error Relative Individual Error Absolute Error Relative Absolute Error
Mean ¡0.01 ¡0.02 0.69 0.47
95% condence interval for mean ¡0.04 to 0.02 ¡0.07 to 0.04 0.66 to 0.72 0.41 to 0.52
5% Trimmed Mean 0.04 ¡0.01 0.27 0.18
Median 0.00 ¡0.01 0.14 0.08
Variance 50.87 156.56 50.39 156.34
Std. Deviation 7.13 12.51 7.10 12.53
Minimum ¡921.00 ¡842.00 0.00 0
Maximum 541.39 5,204.00 921.00 5,204
Range 1,462.39 6,046.00 921.00 5,204
Interquartile range 0.29 0.15 0.34 0.22
Skewness ¡46.27 349.42 65.46 356.29
Kurtosis 6,361.01 145,861.81 6,457.14 146,216
Number of forecasts 205,564 205,516 205,564 205,516
Note: Individual error is the difference between each individual forecast and the actual earnings per share (EPS) announced by the company. Relative individual
error is calculated by dividing individual error with the actual EPS. Absolute error is the absolute value of individual error. We calculate relative individual error
by dividing the individual error with the actual EPS value. The relative absolute error is calculated by dividing the absolute error with the absolute value of
actual EPS.
JOURNAL OF BEHAVIORAL FINANCE 5
Downloaded by [Mr David V. Budescu] at 11:33 15 December 2017
service, wholesale trade, nance, insurance and real estate,
and services. We excluded from the analysis 990 compa-
nies that do not have a matching SIC industry code. Com-
panies in the regression analysis are mostly from the
manufacturing, nance, and services industries. Market
capitalization is the aggregate valuation of the company
based on its current share price and the total number of
outstanding stocks. Table 4 shows the coefcients for the
regressions.
Errors Db1timelag Cb2market capitalization
Cb3industry dummy variablesðÞ
Most coefcients are not signicant and the adjusted
R
2
for the models is zero. Time lag and size have signi-
cant coefcients for all errors except for the relative
error. The positive coefcients for time lag indicate that
short (long) horizons forecasts are more (less) accurate
but, as indicated previously, the effect size is miniscule.
In addition, we examined forecast errors in different
time periods. We use 2 methods to stratify the forecast
horizons into different time periods. The rst method
(we refer it as DAY1 method) divides them into 4 differ-
ent horizons using intervals of 100 days: (1) less than
100 days (from the actual EPS days), and (4) more
than 300 days. For example, Starbucks has 26 forecasts
that were issued less than 100 days before the actual
earnings days; 28 forecasts were issued between 101 and
200 days, 33 were made between 201 and 300 days, and
25 made more than 300 days before the actual EPS
announcement. The second grouping method (DAY2
method) divides the forecast horizon into 9 time periods
of size 50 days: (1) less than 50 days, (9) more than
400 days. By this grouping, Starbucks has 3 forecasts in
group 2 (between 0 and 49 days), 23 in group 3, 4 in
group 4, 24 in group 5, 5 in group 6, 28 in group 7, 6 in
group 8, and 19 in group 9.
First, we focus on the DAY1 grouping with 4 time
periods. Table 5 shows the relative absolute errors for
each of the 4 time periods. A 1-way analysis of variance
(ANOVA) suggests that the means are signicantly dif-
ferent from each other (FD3.54, p<0.05, df D3,
205,512), and the mean relative absolute errors increase
as the time lag increases. Note that the distribution of
the forecasts in this time period is also skewed, where
skewness D[mean median)/SD] positively.
Then, we use the more rened DAY2 grouping, which
divides the forecasts into 10 time period groups. Table 6
shows the means for all 10 periods. In general, the values
increase as a function of duration (see, especially the
high value for the last category), but the 1-way ANOVA
suggests that means are not signicantly different from
each other.
The error analysis conrms prior ndings that ana-
lystsforecasts are not accurate, and we nd only weak
evidence that longer forecasting horizons are associated
with larger errors. Next, we follow the tradition in the
judgment and decision making literature, and rely on the
hit rate to measure forecast accuracy. We dene hit rate
as the relative frequency that the actual earnings number
(EPS) announced by each company is bracketed by the
Table 4. Coefcients for the regression (Errors Db1timelag C
b2market capitalization Cb3industry (dummy variables)).
Predictor
Individual
Error
Relative
Error
Absolute
Error
Relative Absolute
Error
Timelag 0.02
*
0.00 0.04
*
0.00
*
Size 0.01
*
0.00 ¡0.01
*
¡0.21
*
Agriculture 0.00 0.00 0.00 0.00
Mining 0.00 ¡0.01 0.01 0.31
*
Construction 0.00 0.00 0.00 0.00
Manufacture ¡0.04 0.01 ¡0.02 0.00
Transportation ¡0.01 0.00 ¡0.01 0.71
*
Wholesale ¡0.01 0.00 ¡0.01 ¡0.09
Retail ¡0.01 0.00 ¡0.02 ¡0.05
Finance ¡0.04 0.00 ¡0.01 ¡0.06
Service ¡0.07
*
0.00 0.02 0.05
Adj. R square 0.00 0.00 0.00 0.00
N 186,118 185,978 186,118 185,978
Note: Individual error is the difference between each individual forecast and
the actual earnings per share (EPS) announced by the company. Relative
individual error is calculated by dividing individual error with the actual EPS.
Absolute error is the absolute value of individual error. We calculate relative
individual error by dividing the individual error with the actual EPS value.
The relative absolute error is calculated by dividing the absolute error with
the absolute value of actual EPS. We rely on SIC industry code (Standard
Industrial Classication by U.S. Department of Labor and divide the compa-
nies into 9 industries. Market capitalization is the aggregate valuation of the
company based on its current share price and the total number of outstand-
ing stocks.
p<0.05.
Table 5. Relative absolute error for each of the 4 periods.
Period (Days) Mean SD Skewness n
Less than 100 0.32 5.99 73.58 41,467
100200 0.45 21.58 228.12 61,903
200300 0.51 5.09 77.22 58,323
Over 300 0.59 2.63 17.845 43,826
Table 6. Relative absolute error for each of the 10 periods.
Period (Days) Mean SD Skewness N
Under 49 0.75 11.63 13.311 15,940
5099 0.30 6.84 83.222 25,527
100149 0.36 5.28 62.813 32,127
150199 0.53 5.89 112.648 29,775
200249 0.51 30.51 166.986 23,161
250299 0.51 4.32 83.385 35,161
300349 0.63 5.54 73.329 17,297
350399 0.55 2.71 18.554 26,409
Over 400 1.70 2.58 17.408 119
6N. DU AND D. V. BUDESCU
Downloaded by [Mr David V. Budescu] at 11:33 15 December 2017
forecasted range. To calculate hit rate, we must rst
establish a relevant range of values. We rely on different
methods to obtain these bounds and we aggregate fore-
casts in different waysacross forecast horizons, compa-
nies, or analysts.
First, we use the DAY1 grouping scheme to examine
the hit rate within each category. For each company, we
aggregated the forecasts made by different analysts in the
same time period to establish the relevant bounds. For
example, Starbucks112 forecasts from 34 different ana-
lysts were classied into 4 unique time period groups
and, for each time period, we aggregated the Starbucks
forecasts and found their minimal and maximal forecasts
for each period. Thus, we create 4 unique time-specic
records with minimum and maximum values for Star-
bucks. We calculated the hit rate by matching the actual
EPS with each record and determined whether the actual
EPS falls into the time-specic bounds. For Starbucks,
for example, the ranges for the 4 time periods are
1.331.36, 1.321.36, 1.301.35, and 1.301.37. The
actual EPS is 1.33, so this constitutes a hitfor all time
periods.
When we aggregate across different companies over
the 4 different time periods in DAY1 grouping scheme,
we have 17,515 sets of forecasts. Table 7 shows the fore-
casts are quite evenly distributed across the time (ranging
from 4,042 made less than 100 days before the actual EPS
date to 4,653 made between 100 and 199 days). Across
the 17,515 distribution of forecasts, the hit rate is around
45%, with 30% of the cases falling below the minimum
and 25% above the maximal value, suggesting a slight
tendency to overestimate the EPS. We examined the hit
rates across time periods to see whether it is time sensi-
tive. The hit rate appears to be the highest between 100
and 199 days, and it decreases to 37% when the forecasts
are made 300 days ahead. We also examined the width
of these intervals. Wider intervals reect higher uncer-
tainty in, and variably between, the forecasts. The mean
width is quite low, except for the time period of 200
299 days, where it is considerably higher (23.82). Post
Table 7. Hit rates across the 4 periods (using DAY1 grouping).
Classication Less Than 100 Days 100199 Days 200299 Days More Than 300 Days Total
Below minimum 887 1,154 1,398 1,581 5,020
22% 25% 32% 38% 30%
Hit 1,945 2,437 1,960 1,522 7,864
48% 52% 44% 37% 45%
Above maximum 1,208 1,062 1,078 1,037 4,355
30% 23% 24% 25% 25%
Total 4,040 4,653 4,436 4,140 17,269
Mean width (SD) 1.06 (9.45) 1.23 (14.84) 23.81 (3,002.41) 1.14 (17.70) 6.97 (761.10)
Table 8. Hit rates across the 4 periods using the 90% quasi-range (using DAY1 grouping).
Classication Less than 100 days 100199 days 200299 More than 300 Total
Below minimum 717 1,006 1,257 1,433 4,413
21% 24% 31% 38% 28%
Hit 1,757 2,238 1,794 1,400 7,189
50% 53% 44% 37% 46%
Above maximum 1,016 984 985 961 (3,946)
29% 23% 24% 25% 25%
Total 3,490 4,228 4,036 3,794 15,548
Mean width (SD) 0.29 (0.43) 0.38 (0.47) 0.41 (0.48) 0.40 (0.46) 0.37 (0.46)
Table 9. Hit rates across the 10 periods (using DAY2 grouping).
Number of days before EPS announcement
Classication Under 49 5099 s 100149 150199 200249 250299 300349 350399 Over 400 Total
Below minimum 893 927 1,131 1,203 1,402 1,402 1,506 1,460 14 9,949
27% 27% 28% 32% 38% 36% 44% 40% 64% 34%
Hit 1,135 1,392 1,800 1,418 1,379 1,379 849 1,127 3 10,289
35% 40% 44% 38% 32% 35% 25% 31% 14% 35%
Above maximum 1,265 1,175 1,177 1,119 1,112 1,112 1,055 1,032 5 9,057
38% 34% 29% 30% 30% 29% 31% 29% 23% 31%
Total 3,293 3,494 4,108 3,716 3,893 3,893 3,410 3,619 22 29,295
Mean width (SD) 0.75 (0.78) 0.75 (8.05) 1.10 (15.10) 0.67 (6.12) 0.76 (11.81) 1.02 (15.43) 1.01 (17.15) 0.91 (17.97) 0.34 (0.48) 0.87 (13.18)
JOURNAL OF BEHAVIORAL FINANCE 7
Downloaded by [Mr David V. Budescu] at 11:33 15 December 2017
hoc tests using Fishers Least Signicant Difference
(LSD) test show none of the means is signicantly differ-
ent from the others.
We used a very liberal denition of the intervals in the
initial analysis (range Dmax min). Next, we used a
stricter 90% quasi-range, which is obtained by eliminating
the highest 5% and the lowest 5%. Using this measure, the
hit rate increases slightly from 45% to 46%, as shown in
Table 6, so the previous results cannot be attributed to a
minority of extreme and highly inuential outlying fore-
casts. The mean width of the quasi-ranges is quite low (all
are less than 0.5). This indicates that the unusually wide
interval in one of the periods in Table 8 is due to a small
minority of aberrant responses. Post hoc tests using LSD
shows most of the mean widths are not signicantly differ-
ent from the other, except for the period less than 100 days,
which has intervals that are signicantly narrower than the
other time periods (p<0.05).
Next, we break the forecasts by DAY2 grouping. For
each company we calculated the minimum and maxi-
mum forecast value across these 10 periods. This gives
us a total of 29,542 distributions of forecasts. We can see
from Table 9 that the highest number of forecasts are
issued in the third period (100149 days before the target
event), with a total of 4,108 forecasts. The mean widths
of the forecast intervals are quite narrow, ranging from
0.07 to 1.10. A 1-way ANOVA suggests their widths are
not signicantly different. It appears the forecasts are
evenly distributed in terms of accuracy. About one third
(34%) fall below the minimum forecasts, 31% above the
maximum with a hit rate of 35%. The hit rate is highest
during the third period (100149 days prior to
announcement). Post hoc tests using LSD show that the
mean widths are not signicantly different from the
other. Table 10 shows the results using 90% quasi-ranges
by trimming the extreme values. The hit rate changes
only slightly but the mean width shrinks signicantly.
The most consistent forecasts (narrowest intervals) are
issued in the second period (50100 days before
announcement).
Next, we aggregated the forecasts for each com-
pany and calculated its hit rate (each company should
have one actual annual earnings for 2014). We have
4,729 companies that are valid for our calculation (we
have a total of 5,221, but 492 have missing values).
Table 11 shows the mean hit rate is around 68%.
Table 12 shows that the hit rate increases to 70%
when we use the 90% quasi-ranges by trimming the
extreme values.
There are 6,011 analysts in the database. On aver-
age each analyst made 35 forecasts across different
companies. One analyst made a total of 1,110 fore-
casts. Two analysts made over 500 forecasts. Many
analysts (a total of 565) only made 1 forecast in
2014! Multiple analysts may follow the same compa-
nies, but the company has only 1 actual earnings for
2014. Thus, some analysts have multiple hit rates
depending on the number of companies they follow.
For example, Starbucks have 34 analysts following the
company, and each analyst made multiple forecasts
for Starbucks related to the 2014 scal year. For each
analyst, we take the minimum and maximum values
he/she made for Starbucks, so this gives us 34 unique
records containing minimum and maximum values
Table 10. Hit rates across the 10 periods using the 90% quasi-range (using DAY2 grouping).
Number of days before EPS announcement
Classication Under 49 5099 100149 150199 200249 250299 300349 350399 Over 400 Total
Below minimum 775 803 1,012 1,085 1,286 1,270 1,364 1,337 12 8.944
34% 26% 27% 32% 38% 36% 45% 40% 60% 34%
Hit 1,000 1,254 1,629 1,287 1,070 1,235 748 1,021 3 9,247
26% 40% 44% 38% 32% 35% 25% 31% 15% 35%
Above maximum 550 1,056 1,085 1,013 1,011 1,009 943 961 5 8,183
42% 34% 29% 30% 30% 29% 31% 29% 25% 31%
Total 2,875 3,113 3,726 3,385 3,367 3,514 3,055 3,319 20 26,374
Mean width (SD) 0.18 (0.32) 0.21 (0.32) 0.26 (0.35) 0.26 (0.35) 0.26 (0.35) 0.30 (0.37) 0.25 (0.35) 0.31 (0.36) 0.37 (0.49) 0.26 (0.35)
Table 11. Hit rates for forecasts for individual companies (nD
5,221).
Classication Percentage
Below minimum 11%
Hit 68%
Above maximum 11%
Missing 9%
Total 100%
Table 12. Hit rates for individual companies using the 90% quasi-
range (nD4,699).
Classication Percentage
Below minimum 11%
Hit 70%
Above maximum 11%
Total 8%
Total 100%
8N. DU AND D. V. BUDESCU
Downloaded by [Mr David V. Budescu] at 11:33 15 December 2017
for Starbucks. We calculate the hit rate by counting
the frequencies when the actual earnings fall within
each minimum and maximum record, and nd a hit
rate of 59% for Starbucks. We use this procedure and
create a dataset of 49,475 unique analyst-company
dataset (1,764 records are invalid due to missing
actual EPS numbers). Table 13 shows a hit rate of
39%, 27% of the forecast are lower than the minimal
value and 31% are higher than the maximal one, and
3% with missing values. Table 14 shows the result
does not change much when we rely on the quasi-
range (see Table 12).
Last, we investigated the analystsforecasts by each
industry. Of the total of 49,475 records, 6,454 cannot be
matched with the industry code. Deleting the missing
values, we are left with a dataset of 43,021 records.
Table 15 shows the hit rates are the highest when ana-
lystsforecasts the retail industry and agriculture, for-
estry, and shing industries, with a 48% hit rate.
Conclusions
Extensive research has been devoted to the quality of
analystsearnings forecasts. The common nding is that
analystsforecasts are not very accurate. Prior studies
tend to focus on the mean of forecasts and measure accu-
racy using various forecast errors. By examining the fore-
cast error, the distance between actual earnings from the
company and estimates made by analysts, these studies
tell us how inaccurate the analystsearnings estimates
are. Depending on the metric of inaccuracy one chooses
(see Table 3), the answer is in $ (errors and absolute
errors) or as fraction of the actual values (for the relative
measures). It is not surprising that analystsforecasts are
not very accurate, because earnings forecasts are always
issued in the form of a point estimate, almost impossible
to match the actual realized earnings. In fact work on
investorsperceptions of these estimates (Du et al.
[2011]) has shown that they preferred forecasts that
include some margin of error, and judged them to be
more informative and credible than their precise (point)
counterparts.
Our study takes a different approach to and sheds light
on the accuracy of analystsforecasts, by measuring how
well calibrated these forecasts are. We follow the tradition
of calibration studies in psychological literature and mea-
sure the degree of calibration by the hit rate. By using differ-
ent ways to convert analystspoint estimates of earnings
into a range of values, we established the bounds that are
necessary to determine the hit rate, and examined to what
extent the actual earnings announced by the companies are
bracketed by these intervals. These hit rates provide a more
complete picture of the accuracy of the forecasts.
We used a very large multicompany and multianalysts
database to examine empirical probability distributions
of forecasts and use them to infer interval predictions.
We used different procedures to collapse data to estab-
lish upper and lower bounds and calculated hit rates at
various levels (analyst, time period, industry, etc.). The
procedure is very exible as we can use different levels to
determine the calibration, and allows us to investigate
different facets of the quality of analystsearnings. We
believe this method potentially may be useful for invest-
ors as they evaluate analyst performance and decide to
what degree to use analystsforecasts as inputs to their
investment decision. For example, none of Starbucks
112 forecasts from 34 different analysts exactly matches
Table 13. Hit rates of individual nancial analysts for each com-
pany (nD49,475).
Classication Percentage
Below minimum 27%
Hit 39%
Above maximum 31%
Missing 3%
Total 100%
Table 14. Hit rates of individual nancial analysts for each com-
pany using the 90% quasi-range (nD44,529).
Classication Percentage
Below minimum 26%
Hit 39%
Above maximum 31%
Missing 4%
Total 100%
Table 15. Hit rate for individual nancial analysts across industry.
Industry
Below
minimum Hit
Above
maximum Total
Agriculture, forestry, and shing 7 30 26 63
11% 48% 41%
Mining 1,526 1,994 705 4,225
36% 47% 17%
Construction 177 198 153 34
34% 37% 29%
Manufacturing 3,617 6,370 5,042 15,030
24% 42% 30%
Transportation, communications,
electric, gas, and sanitary service
1,386 1,863 1,405 4,654
30% 40% 30%
Wholesale trade 377 301 235 913
41% 33% 26%
Retail trade 898 1,506 739 3,143
29% 48% 24%
Finance, insurance, and real estate 1,891 2,859 2,351 7,101
27% 40% 33%
Services 1,321 2,546 2,920 6,787
20% 37% 43%
Nonclassied 9 22 3 34
26% 65% 9%
Total 11,209 17,689 13,580 4,2479
26% 42% 32%
JOURNAL OF BEHAVIORAL FINANCE 9
Downloaded by [Mr David V. Budescu] at 11:33 15 December 2017
the actual EPS; thus, these forecasts will be determined as
inaccurate based on most conventional metrics. How-
ever, when we aggregated the Starbucksforecasts and
established time-specic bounds (1.331.36, 1.321.36,
1.301.35, and 1.301.37 for the 4 time periods), the
actual EPS of 1.33 constitutes a hitfor all time periods.
In addition, when we focus on these 34 analysts, we nd
a hit rate of 59%, suggesting that forecasts for Starbucks
are relatively well calibrated. Moreover, as 32% of the
forecasts are below the minimal value and only 9% are
higher than the maximal value it appears that the typical
error in this case is to underestimate.
Prior studies have relied on proxies to infer overcon-
dence from abnormal forecast error or excessive forecast
revision without directly measuring overcondence. The
use of indirect proxies makes it difcult to know whether
overcondence is the real, or primary, source of earnings
forecast inaccuracy. The analysis of hit rate suggests that
analysts are not very accurate. When aggregated across
different time periods, the forecasts by different analysts
include the actual EPS number less than 50%, as the hit
rate ranges from 35% to 45%. The hit rate increases
somewhat when we use different aggregation levels. Our
results establish an empirical baseline for analyst con-
dence, and can be used as an effective way to evaluate or
select some nancial analysts based on the degree of cali-
bration and, similarly, learn to put more trust in forecasts
provided for some companies, and ignore analystspro-
jections for other companies. A possible explanation for
the low hit rates documented in this study is that analysts
may trade accuracy for informativeness when making
forecasts, as suggested by Yaniv and Foster [1995,1997],
and thus, it is almost impossible for forecasts to be per-
fectly calibrated. To test this claim, we articially
increased the widths of the original range forecasts by
50%, 100%, 300%, 500%, and calculated the hit rate for
each of the new inatedintervals (see also Du et al.
[2011]). We nd the hit rates increase to 79.3%, 82.4%,
84.6%, and 85.4%. However, to achieve a hit rate of 90%,
we must increase the range width 100-fold. This suggests
that analysts might have deliberately chosen narrow
widths so they could keep range forecasts sufciently
informative, even though this reduces their accuracy.
References
Alpert, M., and H. Raiffa. A Progress Report on the Training
of Probability Assessors.In D. Kahneman, P. Slovic, and
A. Tversky (eds.), Judgment Under Uncertainty: Heuristics
and Biases, (pp. 294305.) Cambridge: Cambridge Univer-
sity Press, 1982.
Barber, B., and T. Odean. Trading is Hazardous to Your
Wealth: The Common Stock Investment Performance of
Individual Investors.Journal of Finance, 55, (2000), pp.
773806.
Barber, B., and T. Odean. Boys Will Be Boys: Gender, Over-
condence, and Common Stock Investment.The Quarterly
Journal of Economics, 116, (2001), pp. 261292.
Benos, A. V. Aggressiveness and Survival of Overcondent Trad-
ers.Journal of Financial Markets, 1, (1998), pp. 353383.
Bessi
ere, V., and T. Elkemali. Does Uncertainty Boost Over-
condence? The Case of Financial AnalystsForecasts.
Managerial Finance, 40, (2014), pp. 300324.
Brown, P. R. Financial Data and Decision-making By Sell-side
Analysts.Journal of Financial Statement Analysis,2,
(1997), pp. 4348.
Budescu, D. V., and N. Du. Coherence and Consistency of
InvestorsProbability Judgments.Management Science, 53,
(2007), pp. 17311744.
Chuang, W. I., and B. S. Lee. An Empirical Evaluation of the
Overcondence Hypothesis.Journal of Banking and
Finance, 30, (2006), pp. 24892515.
Daniel, K., D. Hirshleifer, and A. Subrahmanyam. Investor
Psychology and Security Market Under- and Overreac-
tions.Journal of Finance, 53, (1998), pp. 18391885.
Daniel, K., D. Hirshleifer, and A. Subrahmanyam. Overcon-
dence, Arbitrage, and Equilibrium Asset Pricing.Journal
of Finance, 56, (2001), pp. 921965.
De Bondt, W. F. M. A Portrait of the Individual Investor.
European Economic Review, 42, (1998), pp. 831844.
De Long, B. J., A. Shleifer, L. H. Summers, and R. Waldmann.
The Survival of Noise Traders in Financial Markets.Jour-
nal of Business, 64, (1991), pp. 119.
Deaves, R., E. L
uders, and M. Schr
ode. The Dynamics of Over-
condence: Evidence from Stock Market Forecasters.Journal
of Economic Behavior & Organization, 75, (2010), pp. 402412.
Du, N., and D. V. Budescu. The Effects of Imprecise Probabil-
ities and Outcomes in Evaluating Investment Options.
Management Science, 51, (2005), pp. 17911803.
Du, N., D. V. Budescu, M. Shelley, and T. Omer. The Appeal
of Vague Financial Forecasts.Organizational Behavior and
Human Decision Processes, 114, (2011), pp. 179189.
Easterwood, J. and S. Nutt. Inefciency in AnalystsEarning
Forecasts: Systematic Misreaction or Systematic Opti-
mism?Journal of Finance, 54, (1999), pp. 17771797.
Fischhoff, B., P. Slovic, and S. Lichtenstein. Knowing with
Certainty.Journal of Experimental Psychology: Human
Perception and Performance,3, (1977), pp. 552564.
Friesen, G., and P. A. Weller. Quantifying Cognitive Biases in
Analyst Earnings Forecasts.Journal of Financial Markets,
9, (2006), pp. 333365.
Gervais, S., and T. Odean. Learning To Be Overcondent.
The Review of Financial Studies, 14, (2001), pp. 127.
Gigerenzer, G., U. Hoffrage, and H. Kleinbolting. Probabilistic
Mental Models: A Brunswikian Theory of Condence.Psy-
chological Review, 98, (1991), pp. 506528.
Glaser, M., and M. Weber. Overcondence and Trading Vol-
ume.The Geneva Risk and Insurance Review, 32, (2007),
pp. 136.
Gort, C., M. Wang, and M. Siegrist. Are Pension Fund Man-
agers Overcondent?The Journal of Behavioral Finance,9,
(2008), pp. 163170.
Hilary, G., and L. Menzly. Does Past Success Lead Analysts to
Become Overcondent?Management Science, 52, (2006),
pp. 489500.
10 N. DU AND D. V. BUDESCU
Downloaded by [Mr David V. Budescu] at 11:33 15 December 2017
Hirshleifer, D., and G. Y. Luo. On the Survival of Overcon-
dent Traders in a Competitive Securities Market.Journal
of Financial Markets, 4, (2001), pp. 7384.
Jacobs, J., T. Lys, and M. Neale. Expertise in Forecasting Per-
formance of Security Analysts.Journal of Accounting and
Economics, 28, (1999), pp. 5182.
Juslin, P., A. Winman, and H. Olsson. Naive Empiricism and
Dogmatism in Condence Research: A Critical Examina-
tion of the Hard-easy Effect.Psychological Review, 107,
(2000), pp. 384396.
Keren, M. Single Dimensional Linear and Forcing Contracts:
Did Targets and Bonuses Cause the Collapse of the Soviet
Economy?Economic Systems, 15, (1991), pp. 1941.
Klayman, J., J. B. Soil, C. Gonzales-Vallejo, and S. Barlas.
Overcondence: It Depends on How, What, and Whom
You Ask.Organizational Behavior Human Decision Pro-
cesses, 79, (1999), pp. 216247.
Kyle, A. S., and F. A. Wang. Speculation Duopoly with Agree-
ment to Disagree: Can Overcondence Survive the Market
Test?Journal of Finance, 52, (1997), pp. 20732090.
Lichtenstein, S., B. Fischhoff, and L. Philips. Calibration of
Probabilities: The State of the Art to 1980.In D. Kahne-
man, P. Slovic, and A. Tversky (eds.), Judgement Under
Uncertainty: Heuristics and Biases (pp. 306334). Cam-
bridge University Press, 1982.
Libby, R., H. T. Tan, and J. E. Hunton. Does the Form of
Managements Earnings Guidance Affect AnalystsEarn-
ings Forecasts?The Accounting Review, 81, (2006), pp.
207225.
Lin, H., and M. F. McNichols. Underwriting Relationships, Ana-
lystsEarnings Forecasts and Investment Recommendations.
Journal of Accounting and Economics, 25, (1998), pp. 101127.
Moore, D. A., and P. J. Healy. The Trouble with Overcon-
dence.Psychological Review, 115, (2008), pp. 502517.
Odean, T. Volume, Volatility, Price and Prot When All
Traders Are Above Average.Journal of Finance, 53,
(1998), pp. 18871934.
Oskamp, S. Overcondence in Case-study Judgments.Jour-
nal of Consulting Psychology, 29, (1965), pp. 261265.
Park, S., and D. V. Budescu. Aggregating Multiple Probability
Intervals to Improve Calibration.Judgment and Decision
Making, 10(2), (2015), pp. 130143.
Ramnath, S., S. Rock, and P. Shane. The Financial Analyst
Forecasting Literature: A Taxonomy with Suggestions for
Further Research.International Journal of Forecasting, 24,
(2008), pp. 3475.
Rottenstreich, Y., and A. Tversky. Unpacking, Repacking, and
Anchoring: Advances in Support Theory.Psychological
Review, 104, (1997), pp. 406415.
Saemi, P., and D. V. Budescu. Aggregating Multiple Probabil-
ity Intervals to Improve Calibration.Judgment and Deci-
sion Making, 10, (2015), pp. 130143.
Stickel, S. E. Predicting Individual Analyst Earnings Fore-
casts.Journal of Accounting Research, 28 (1990), 409417.
Yaniv, I., and D. P. Foster. Graininess of Judgment Under
Uncertainty: An Accuracy Informativeness Trade-off.
Journal of Experimental Psychology: General, 124, (1995),
pp. 424432.
Yaniv, I., and D. P. Foster. Precision and Accuracy of Judg-
mental Estimation.Journal of Behavioral Decision Making,
10, (1997), pp. 2132.
Von Winterfeldt, D., and W. Edwards. Decision Analysis and
Behavioral Research. Cambridge: Cambridge University
Press, 1986.
Winman, A., P. Hansson, and P. Juslin. Subjective Probability
Intervals: How to Reduce Overcondence by Interval Eval-
uation.Journal of Experimental Psychology: Learning,
Memory, & Cognition, 30, (2004), pp. 11671175.
JOURNAL OF BEHAVIORAL FINANCE 11
Downloaded by [Mr David V. Budescu] at 11:33 15 December 2017
... Given this context, and considering the seminal work of Simon (1955), which discusses concepts of bounded rationality and simplifying approaches to rationality, some research has sought to observe the relationship between behavioral biases and analysts' accuracy, such as: a) optimism (Gervais & Odean, 2001;Kafayat, 2014;Galanti & Vaubourg, 2017); b) overconfidence (Gervais, Heaton & Odean, 2002;Hilary & Menzly, 2006;Du & Budescu, 2018); c) anchoring (Brown, 2001;Campbell & Sharpe, 2009;Silva Filho, Miranda, Lucena & Machado, 2018); d) representativeness (Marsden, Veeraraghavan & Ye, 2008); e) time (Amiran, Landsman, Ownes & Stubben, 2017;Muslu, Mutlu, Radhakrishnan & Tsang, 2019), etc. ...
... Thus, Kafayat (2014), Bosquet, Goeji and Smedts. (2015), Du and Budescu (2018) point out that overconfidence can harm financial decisions, which may indicate less accurate forecasts and higher risk investments (Barber & Odean, 2001). ...
... The results for biases of overconfidence, representativeness and realism, were found to be consistent with the relationship expected by the literature (Piotr & Sina, 2015;Du & Budescu, 2018), however, the results were not statistically significant, which also differs from previous research (Mokoteli, Taffler & Ryan, 2006). Therefore, hypotheses 3, 4 and 5 of this research could not be confirmed. ...
Article
Full-text available
The study analyzed the relationship between optimism, anchoring, overconfidence, representativeness, realism, commonality and time, with the accuracy in the profit forecast of analysts. Publicly traded Brazilian companies were considered in 2019, and correlation tests, mean differences and multiple regression analyses were applied. The results indicated that accuracy is negatively influenced by optimism and positively by anchoring and commonality. In addition, the uncertainty present in the distance between the forecast issued and the disclosure of earnings per share also negatively influences the accuracy of analysts. Additionally, it was found that fair value, profitability, issuing ADRs and self-regulated sector, are aspects related to greater accuracy. Thus, the research contributes to the literature by linking behavioral and temporal aspects to financial ones, as well as by signaling the importance of analysts' forecasting models to consider behavioral aspects in their information technologies.
... That said, it is evident that early research ventures in behavioral finance have not delved into the mediating effects of heuristics in the risk perception-perceived investment performance relationship. The present study claims that covid 19 fears and aggravated risk perceptions of averting impending risks and gaining immediate competitive advantage led to cognitive overload and misinterpretations in the form of herding, anchoring and over confidence heuristics (Azam et al., 2022), which in turn significantly impact investment decisions detrimentally due to irrational and cognitive bias embedded decisions (Du & Budescu, 2018) arising from mental short cuts. The hypotheses formulated are therefore as follows: ...
Article
Full-text available
As the financial condition of most individuals has taken the toll during the COVID-19 pandemic, this study aims to analyze varied risk perceptions owing to dynamic behavioral aspects ingrained in individuals. The study primarily incorporates the impact of COVID-19 induced risk perceptions on psychological bias and its aftermath on perceived investment performance, with gender differences being moderators in the aforesaid relationship. A mix of probability and non-probability sampling has been used to collect data from 1,133 respondents through a structured questionnaire. The partial least square structured equation modeling (PLS-SEM) has been employed as an estimation technique. The findings highlight that risk perception has been significant in affecting the heuristics and prospects. However, it is insignificant in directly impacting the perceived investment performance. However, psychological biases, proxied by heuristics and prospects, were found to mediate the relationship between risk perception and perceived investment performance. Practical implications suggest a judicious combination of risk, return, and behavioral portfolio to stimulate, and upscale investments thereby enhancing the investment momentum to reach pre-covid levels. At the same time, the relevance for society lies in the fact that they need to re-consider their investment portfolio to adjust for uncertainties like COVID-19. Future studies can embark on cross country research to investigate varied risk perception-investment performance relationships prevalent in respective economic settings. Also, studies can explore the variation in findings with respect to different classes of investors that is, experiences, first timers, institutional, influencers and others.
... Additionally, behavioral finance plays a role in investors' decision-making, contributing to market inefficiency and challenging the assumptions of investor rationality. Research has shown that evaluation errors can arise when rational investors interact with irrational ones, such as the presence of noise traders (Gao & Ladley, 2022;Ramiah, Xu, & Moosa, 2015;Ryu & Yang, 2020) and over-confident investors (Abreu & Brunnermeier, 2003;Du & Budescu, 2018). ...
Article
Dynamic costs arising from the variable impact of information on asset pricing present a challenge for accurate European currency option pricing. The Garman and Kohlhagen model, though influential in the literature, does not adequately account for these costs. This study extends the model by integrating an intensity function into the interest rates to measure dynamic information costs. Inspired by the Beer–Lambert law, the function is applied to a decade-long dataset of daily futures continuous calls on the EUR/USD pair from September 21, 2012, to September 23, 2022. The augmented model reduces pricing errors and manages implied volatility better than the 1983 model, consistent across different categories of maturity and moneyness. Our findings emphasize the need to consider dynamic information costs in asset pricing, demonstrating that their inclusion can significantly enhance the accuracy and reliability of currency option pricing.
... Tversky and Kahneman's (1974) research on biases identified representativeness, availability, and anchoring as the three primary heuristics used for decision-making under ambiguity, which are significant in investment decisions due to the unpredictable nature of the stock market. This irrationality is influenced by both cognitive and emotional factors (Novianggie & Asandimitra,211 2019) Investors use intuition, perceptions, emotions, and thinking to make complex judgments in unpredictable markets (Kahneman & Riepe, 1998), which are often illogical due to cognitive biases and incomplete information (Du & Budescu, 2018). According to Bowers & Khorakian (2014), investors base their investment decisions on the information available, and heuristic biases affect both experienced and inexperienced investors (Elliot, Rennekamp, & White, 2018). ...
Article
Full-text available
The study aims to examine the influence of heuristic and prospect theory biases on the portfolio management and performance (PMP) of individual investors in Pakistan, a country that has experienced significant market fluctuations due to a deep debt crisis, currency devaluation, political instability, and a shortage of foreign reserves. Data was collected from 400 individual investors trading on the Pakistan Stock Exchange. The data revealed that PMP is positively and significantly influenced by regret aversion, loss aversion, overconfidence, anchoring bias, and mental accounting, while availability bias and the gambler's fallacy have insignificant impact. The study suggests that investors with higher levels of these biases are more likely to achieve better PMP, and using mental accounting strategies may improve PMP. However, overconfidence may also lead to excessive risktaking and lower performance in certain cases. Regret aversion may lead to suboptimal investment decisions in some cases. Study recommends the investors should consider the potential risks associated with overconfidence and regret aversion. By understanding these biases, they can make more informed and objective investment decisions that lead to better PMP. A major significance of this paper is it examines the prominent heuristic and prospect behavioral factors that affect portfolio formation and performance of individual investors in Pakistan.
... A large number of empirical studies have found that both single point probabilities and probability interval estimates tend to be mostly overconfident (e.g., Alpert & Raiffa, 1982;Budescu & Du, 2007;Juslin, Wennerholm & Olsson, 1999;McKenzie, Liersch & Yaniv, 2008;Fischhoff, Slovi & Lichtenstein, 1977;Klayman et al., 1999;Park & Budescu, 2015). Sometimes miscalibration carries over to specific expertise domains (Christensen-Szalanski & Bushyhead, 1981;Du & Budescu, 2018). ...
Article
Full-text available
The accuracy of human forecasters is often reduced because of incomplete information and cognitive biases that affect the judges. One approach to improve the accuracy of the forecasts is to recalibrate them by means of non-linear transformations that are sensitive to the direction and the magnitude of the biases. Previous work on recalibration has focused on binary forecasts. We propose an extension of this approach by developing an algorithm that uses a single free parameter to recalibrate complete subjective probability distributions. We illustrate the approach with data from the quarterly Survey of Professional Forecasters (SPF) conducted by the European Central Bank (ECB), document the potential benefits of this approach, and show how it can be used in practical applications.
Chapter
The study examines the direct and indirect effects of heuristic biases on investors’ behavior on decision making (through how they perceive risk). The research also examines the potential moderating role of extraversion in investor’s decision both direct and indirect connections between perceptual biases with irrational behavior. The findings of this study shows that there is a direct and indirect impact of heuristic biases on investor’s decision making via risk perception. This is based on questionnaire data from 325 Indian investors registered with various brokerage firms, as well as analysis (mediation and moderation) performed in SPSS using the process macro technique (proposed by Hayes in Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression Based Approach. Guilford Publications, New York, 2017 [13]). Extraversion, a personality trait, was discovered to regulate both direct and indirect links among heuristic prejudices and irrational behavior.
Article
Purpose The study explored various dimensions of overconfidence bias (OB) among retail investors in Indian financial markets. Further, these dimensions were validated through formative assessments for OB. Design/methodology/approach The study applied exploratory factor analysis (EFA) to 764 respondents to explore dimensions of OB. These were validated with formative assessments on 489 respondents by the partial least square path modeling (PLS-PM) approach in SmartPLS 4.0 software. Findings The major findings of EFA explored four dimensions for OB, i.e. accuracy, perceived control, positive illusions and past investment success. The formative assessments revealed that positive illusions followed by past investment success among retail investors played an instrumental role in orchestrating the OBs that affect investment decisions in financial markets. Practical implications The formative index of OB has several practical implications for registered financial and investment advisors, bank advisors, business media companies and portfolio managers, besides individual investors in the domain of behavioral finance. Originality/value This research provides a novel approach to provide a formative index of OB with four dimensions. This formative index can acts as an overview for upcoming researchers to investigate the OB of retail individual investors. Highlights Overconfidence bias is an important predictor of retail investors' behavior Formative dimensions of the overconfidence bias index. Accuracy, perceived control, positive illusions and past investment success are important dimensions of overconfidence bias. Modern portfolio theory and illusion of control theory support this study.
Article
Purpose This article analyzes the hypothesis that analysts issue higher long-term earnings growth (LTG) forecasts following a market-wide investor sentiment. Design/methodology/approach This study analyzed 193 publicly traded Brazilian firms listed on B3 (Brasil, Bolsa, Balcão), totaling 2,291 observations. To address the potential selection bias resulting from analysts' preference for more liquid firms, this study used the Heckman model in the analysis with samples with only one analyst and the entire sample. The study also applied other robustness tests to ensure the reliability of the findings. Findings The results suggest that market-wide investor sentiment influences LTG when the firm's stocks are difficult to value. Market optimism did not reflect five-year profit growth after the forecast issue, suggesting lower forecast accuracy during high investor sentiment values. Practical implications Volatile-earnings firms have relevant implications in LTG forecasts during bullish moments. According to the study’s evidence, investors' decisions and policymakers' and regulators' rules should consider analysts' expertise as independent information when considering LTG as input for valuation models, even under market optimism. Originality/value This paper contributes to the literature on the influence of investor sentiment on analysts' forecasts by incorporating two crucial elements in the discussion: the scenario free from herding behavior, as usually only one analyst issues LGT forecast for Brazilian firms, and the analysis of research hypotheses incorporates the difficulty of pricing a firm given the uncertainty of its earnings as an explanation to bullish forecast.
Article
Full-text available
Market situations affect investors’ sentiments. Sudden and sharp changes in the market may make investors adjust their beliefs and change their viewpoints. To quote, such sharp changes include the stock market crash of 2008 and the COVID-19 pandemic, which significantly impacted investors' emotions. In this direction, this study attempts to find investors’ overconfidence bias in different market situations, i.e., precrash period (2006–2008), crash period (2008–2010), and post-crash period (2010–2015, 2015–2020, 2020–2021). We have obtained secondary data for this study from the BSE 100 index (as a proxy of the Indian stock market). Econometric techniques used for data analysis include Vector Auto Regression (VAR), Granger causality VAR/Block Exogeneity Wald Test, and Impulse Response Function (IRF). The study finds that the investors were overconfident during pre-crash periods, i.e., before the global market crash of 2008 and the duration between 2015 and March 2020. In postcrash periods, i.e., during 2008–2010, 2010–2015, and 2020–2021, investors were not overconfident.
Article
Full-text available
This paper proposes a general method to handle forecasts exposed to behavioural bias by finding appropriate outside views, in our case corporate sales forecasts of analysts. The idea is to find reference classes, i.e. peer groups, for each analyzed company separately that share similarities to the firm of interest with respect to a specific predictor. The classes are regarded to be optimal if the forecasted sales distributions match the actual distributions as closely as possible. The forecast quality is measured by applying goodness‐of‐fit tests on the estimated probability integral transformations and by comparing the predicted quantiles. The method is out‐of‐sample backtested on a data set consisting of 21,808 US firms over the time period 1950‐2019, which is also descriptively analyzed. It appears that in particular the past operating margins are good predictors for the distribution of future sales. A case study compares the outside view of our distributional forecasts with actual analysts’ forecasts and emphasizes the relevance of our approach in practice.
Article
Full-text available
We apply the principles of the "Wisdom of Crowds (WoC)" to improve the calibration of interval estimates. Previous research has documented the significant impact of the WoC on the accuracy of point estimates but only a few studies have examined its effectiveness in aggregating interval estimates. We demonstrate that collective probability intervals obtained by several heuristics can reduce the typical overconfidence of the individual estimates. We re-analyzed data from Glaser, Langer and Weber (2013) and from Soll and Klayman (2004) and applied four heuristics Averaging, Median, Enveloping, Probability averaging-suggested by Gaba, Tsetlin and Winkler (2014) and new heuristics, Averaging with trimming and Quartiles. We used the hit rate and the Mean Squared Error (MSE) to evaluate the quality of the methods. All methods reduced miscalibration to some degree, and Quartiles was the most beneficial securing accuracy and informativeness.
Article
Full-text available
Investigated how often people are wrong when they are certain that they know the answer to a question. Five studies with a total of 528 paid volunteers suggest that the answer is "too often." For a variety of general-knowledge questions, Ss first chose the most likely answer and then indicated their degree of certainty that the answer they had selected was, in fact, correct. Across several different question and response formats, Ss were consistently overconfident. They had sufficient faith in their confidence judgments to be willing to stake money on their validity. The psychological bases for unwarranted certainty are discussed in terms of the inferential processes whereby knowledge is constructed from perceptions and memories. (15 ref)
Article
We develop a multiperiod market model describing both the process by which traders learn about their ability and how a bias in this learning can create overconfident traders. A trader in our model initially does not know his own ability. He infers this ability from his successes and failures. In assessing his ability the trader takes too much credit for his successes. This leads him to become overconfident. A trader's expected level of overconfidence increases in the early stages of his career. Then, with more experience, he comes to better recognize his own ability. The patterns in trading volume, expected profits, price volatility, and expected prices resulting from this endogenous overconfidence are analyzed. Article published by Oxford University Press on behalf of the Society for Financial Studies in its journal, The Review of Financial Studies.
Article
Purpose – This article aims to examine the link between uncertainty and analysts' reaction to earnings announcements for a sample of European firms during the period 1997-2007. In the same way as Daniel et al., the authors posit that overconfidence leads to an overreaction to private information followed by an underreaction when the information becomes public. Design/methodology/approach – In this study, the authors test analysts' overconfidence through the overreaction preceding a public announcement followed by an underreaction after the announcement. If overconfidence occurs, over- and underreactions should be, respectively, observed before and after the public announcement. If uncertainty boosts overconfidence, the authors predict that these two combined misreactions should be stronger when uncertainty is higher. Uncertainty is defined according to technology intensity, and separate two types of firms: high-tech or low-tech. The authors use a sample of European firms during the period 1997-2007. Findings – The results support the overconfidence hypothesis. The authors jointly observe the two phenomena of under- and overreaction. Overreaction occurs when the information has not yet been made public and disappears just after public release. The results also show that both effects are more important for the high-tech subsample. For robustness, the authors sort the sample using analyst forecast dispersion as a proxy for uncertainty and obtain similar results. The authors also document that the high-tech stocks crash in 2000-2001 moderated the overconfidence of analysts, which then strongly declined during the post-crash period. Originality/value – This study offers interesting insights in two ways. First, in the area of financial markets, it provides a test of a major over- and underreaction model and implements it to analysts' reactions through their revisions (versus investors' reactions through stock returns). Second, in a broader way, it deals with the link between uncertainty and biases. The results are consistent with the experimental evidence and extend it to a cross-sectional analysis that reinforces it as pointed out by Kumar.
Article
Behavioral finance models often rely on a concept of noise traders who are prone to judgment and decision-making errors. What do noise traders do? We review prior research and present new survey evidence on the behavior of small individual investors who manage their own equity portfolios. Many people (1) discover naive patterns in past price movements, (2) share popular models of value, (3) are not properly diversified, and (4) trade in suboptimal ways.
Article
In this study I propose and test a model that predicts individual analyst forecasts of corporate earnings per share (EPS) using the change in the mean consensus forecast of other analysts since the date of the analyst's current outstanding forecast; the deviation of the analyst's current forecast from the consensus forecast; and cumulative stock returns since the date of the analyst's current forecast. I find that these three variables explain about 38% of the variability in analyst forecast revisions. While there is evidence of a relation betlveen changes in earnings expectations and price changes, virtually all of the explanatory power of my model arises from other analyst forecasts. Section 2 describes the data bases used and the sample selection process. Section 3 presents the model and method for predicting individual anal-vst forecasts. Section 4 reports the bias and accuracy of the predicted forecasts. Conclusions are in section 5. 2.