ArticlePDF Available

Recognition-based judgments and decisions: What we have learned (so far)

Authors:

Abstract and Figures

This special issue on recognition processes in inferential decision making represents an adversarial collaboration among the three guest editors. This introductory article to the special issue's third and final part comes in three sections. In Section 1, we summarize the six papers that appear in this part. In Section 2, we give a wrap-up of the lessons learned. Specifically, we discuss (i) why studying the recognition heuristic has led to so much controversy, making it difficult to settle on mutually accepted empirically grounded assumptions, (ii) whether the development of the recognition heuristic and its theoretical descriptions could explain some of the past controversies and misconceptions, (iii) how additional cue knowledge about unrecognized objects could enter the decision process, (iv) why recognition heuristic theory should be complemented by a probabilistic model of strategy selection, and (v) how recognition information might be related to other information, especially when considering real-world applications. In Section 3, we present an outlook on the thorny but fruitful road to cumulative theory integration. Future research on recognition-based inferences should (i) converge on overcoming past controversies, taking an integrative approach to theory building, and considering theories and findings from neighboring fields (such as marketing science and artificial intelligence), (ii) build detailed computational process models of decision strategies, grounded in cognitive architectures, (iii) test existing models of such strategies competitively, (iv) design computational models of the mechanisms of strategy selection, and (v) effectively extend its scope to decision making in the wild, outside controlled laboratory situations.
Content may be subject to copyright.
A preview of the PDF is not available
... If a person employs the recognition heuristic (Goldstein & Gigerenzer, 2002), the recognized object is inferred to score a larger value on a given criterion without any further consideration of probabilistic cues. There have been three special issues on this heuristic and intense debate (Marewski, Pohl, & Vitouch, 2010, Marewski, Pohl, & Vitouch, 2011a, Marewski et al., 2011b. ...
... accounts best for the behavior of most individuals. Other researchers might respond that studies such as the aforementioned ones by Glöckner andBröder (2011, 2014)-as well as others (e.g., Bröder & Eichler, 2006) -do not fall in the scope of the recognition heuristic, for instance, by examining the heuristic in inferences from givens as opposed to inferences from memory or by providing additional cue knowledge about unrecognized objects (see Oliver Vitouch's essay in Marewski et al., 2011b, for an overview of the history of specification and scope of the recognition heuristic; see also Gigerenzer & Goldstein, 2011, Marewski & Mehlhorn, 2011, Pohl, 2011. However, no such arguments may be raised against Heck and Erdfelder's (2017) reanalyses of existing data on inferences from memory. ...
... Although this seems to be an almost trivial requirement, scientific reality does not always meet the demands, and sometimes, the scope itself is misinterpreted, including by those who set out to test a model developed by others. The history of controversies on the recognition heuristic offers an example (see e.g., Oliver Vitouch's discussion of the development of that model in Marewski et al., 2011b). Similarly, scientists formulating single mechanism models may not always define the scope of their model in advance, and boundary conditions have to be explored empirically (e.g., Söllner, Bröder, & Hilbig, 2013) in a process of cumulative theory development. ...
Article
Organisms must be capable of adapting to environmental task demands. Which cognitive processes best model the ways in which adaptation is achieved? People can behave adaptively, so many frameworks assume, because they can draw from a repertoire of decision strategies, with each strategy particularly fitting to certain environmental demands. In contrast to that multi-mechanism assumption, competing approaches posit a single decision mechanism. The juxtaposition of such single-mechanism and multi-mechanism approaches has fuelled not only much theory-building, empirical research, and methodological developments, but also many controversies. This special issue on “Strategy Selection: A Theoretical and Methodological Challenge” sheds a spotlight on those developments. The contribution of this introductory article is twofold. First, we offer a documentation of the controversy, including an outline of competing approaches. Second, this special issue and this introductory article represent adversarial collaborations among the three of us: we have modeled adaptive decision making in different ways in the past. Together, we now work on resolving the controversy and point to five guiding principles that might help to improve our models for predicting adaptive behavior. Copyright © 2018 John Wiley & Sons, Ltd.
... Indeed, Cologne does have more inhabitants than Kappeln, and Cologne may have appeared in your memory because it appears more often on the Web, in newspapers, or in personal discussions than the rather small city of Kappeln. This example shows that people who rely on only one reason (or "cue") can make successful decisions, in this case and in many different tasks (see Marewski, Pohl, & Vitouch, 2011). ...
Article
Full-text available
Presenting research and defining the relation between different areas of research (e.g., performance psychology and sport psychology) enhance the potential for cross‐fertilization on theoretical, methodological, and practical levels. This chapter clarifies the distinctions between performance psychology and sport psychology, and provides a general framework of performance psychology that is informative for sport psychology. It discusses the recognition heuristic, the take‐the‐best heuristic, and the hot‐hand heuristic. The chapter describes, explains, and predicts behavior according to the particles that form the building blocks of heuristics, and provides examples of how these building blocks are integrated into heuristics. The chapter examines the impact of findings in performance psychology on sport psychology and vice‐versa.
... Additionally, research has identified several environments in which, from a prescriptive perspective, the recognition heuristic is ecologically rational and can compete with well-established forecasting instruments. These environments include the prediction of sports results such as Wimbledon or soccer, election outcomes, university rankings, and geographical properties such as the size of cities or mountains (for a recent overview of the discussion, see Marewski et al., 2011). ...
Chapter
Full-text available
In a world of known risks, rational theories provide the norms for successful behavior. In a world where not all risks are known and where optimization is not feasible, onrational tools such as heuristics are needed. In comparison to optimization models, heuristics are robust and can lead to more accurate predictions, while saving time and effort. The study of heuristics addresses the descriptive question of what heuristics an individual or institution has in their adaptive toolbox, as well as the normative question of their ecological rationality, i.e., which heuristics in which situations are most accurate and effective.
... In such cases, where not all of the alternatives are recognized, the adaptive toolbox states that people rely on the recognition heuristic (RH; Goldstein & Gigerenzer, 1999), which is defined as a precise, formal model (Goldstein & Gigerenzer, 2002, p. 76) as follows: "If one of two objects is recognized and the other is not, then infer that the recognized object has the higher value with respect to the criterion." The RH is one of the core heuristics of the adaptive toolbox and has been the subject of three special issues in Judgment and Decision Making (Marewski, Pohl, & Vitouch, 2010, Marewski et al., 2011a, 2011b. ...
Article
Full-text available
When making inferences about pairs of objects, one of which is recognized and the other is not, the recognition heuristic states that participants choose the recognized object in a noncompensatory way without considering any further knowledge. In contrast, information-integration theories such as parallel constraint satisfaction (PCS) assume that recognition is merely one of many cues that is integrated with further knowledge in a compensatory way. To test both process models against each other without manipulating recognition or further knowledge, we include response times into the r-model, a popular multinomial processing tree model for memory-based decisions. Essentially, this response-time-extended r-model allows to test a crucial prediction of PCS, namely, that the integration of recognition-congruent knowledge leads to faster decisions compared to the consideration of recognition only—even though more information is processed. In contrast, decisions due to recognition-heuristic use are predicted to be faster than decisions affected by any further knowledge. Using the classical German-cities example, simulations show that the novel measurement model discriminates between both process models based on choices, decision times, and recognition judgments only. In a reanalysis of 29 data sets including more than 400,000 individual trials, noncompensatory choices of the recognized option were estimated to be slower than choices due to recognition-congruent knowledge. This corroborates the parallel information-integration account of memory-based decisions, according to which decisions become faster when the coherence of the available information increases.
... This simple strategy works well in domains where recognition is correlated with the criterion (e.g., city sizes, mountain heights, turnover rates of companies), and it has been proposed as a psychological model for these situations. However, the non-compensatory nature of RH (people rely exclusively on recognition) has been debated extensively (e.g., Bröder & Eichler, 2006;Hilbig, Erdfelder, & Pohl, 2010;Marewski, Pohl, & Vitouch, 2010, 2011a, 2011bNewell, 2011;Newell & Fernandez, 2006;Pachur & Hertwig, 2006;Pachur, Todd, Gigerenzer, Schooler, & Goldstein, 2011Pohl, 2011), and studies demonstrating the compensatory use of additional cue knowledge have helped to delineate the conditions under which RH might be used (see Gigerenzer, Hertwig & Pachur, 2011). ...
Article
Full-text available
Glöckner and Bröder (2011) have shown that for 77.5% of their participants' decision making behavior in decisions involving recognition information and explicitly provided additional cues could be better described by weightedcompensatory Parallel Constraint Satisfaction (PCS) Models than by non-compensatory strategies such as recognition heuristic (RH) or Take the Best (TTB). We investigate whether this predominance of PCS models also holds in memorybased decisions in which information retrieval is effortful and cognitively demanding. Decision strategies were analyzed using a maximum-likelihood strategy classification method, taking into account choices, response times and confidence ratings simultaneously. In contrast to the memory-based-RH hypothesis, results show that also in memory-based decisions for 62% of the participants behavior is best explained by a compensatory PCS model. There is, however, a slight increase in participants classified as users of the non-compensatory strategies RH and TTB (32%) compared to the previous study, mirroring other studies suggesting effects of costly retrieval.
Article
Full-text available
While bibliometrics are widely used for research evaluation purposes, a common theoretical framework for conceptually understanding, empirically studying, and effectively teaching its usage is lacking. In this paper, we outline such a framework: the fast-and-frugal heuristics research program, proposed originally in the context of the cognitive and decision sciences, lends itself particularly well for understanding and investigating the usage of bibliometrics in research evaluations. Such evaluations represent judgments under uncertainty in which typically not all possible options, their consequences, and those consequences’ probabilities of occurring may be known. In these situations of incomplete information, candidate descriptive and prescriptive models of human behavior are heuristics. Heuristics are simple strategies that, by exploiting the structure of environments, can aid people to make smart decisions. Relying on heuristics does not mean trading off accuracy against effort: while reducing complexity, heuristics can yield better decisions than more information-greedy procedures in many decision environments. The prescriptive power of heuristics is documented in a cross-disciplinary literature, cutting across medicine, crime, business, sports, and other domains. We outline the fast-and-frugal heuristics research program, provide examples of past empirical work on heuristics outside the field of bibliometrics, explain why heuristics may be especially suitable for studying the usage of bibliometrics, and propose a corresponding conceptual framework.
Chapter
Over the last decades, people’s behaviour and attitudes towards privacy have been thoroughly studied by scholars, approaching the issue from different perspectives. To address privacy-related decisions, it is necessary to consider aspects of human cognition, employing, for instance, methods used in Human-Computer Interaction and Information Science research. This paper analyses findings and contributions of existing privacy decision-making research, and suggests filling gaps in current understanding by applying a cognitive architecture framework to model privacy decision-making. This may broaden the range of factors and their relationships that can be integrated into the models of privacy decisions, beyond those in existing decision models.
Article
Full-text available
According to the recognition heuristic, decision makers base their inferences on recognition alone, assuming that recognized objects have larger criterion values than unrecognized ones. Knowing that recognition is a valid cue and thus using the recognition heuristic should increase with age. This was tested in two experiments with preadolescents (N = 140), adolescents (N = 186), and adults (N = 78). The results show, as expected, a monotonic age-related trend in the improvement of domain-specific knowledge but, unexpectedly, a non-monotonic one for using the recognition heuristic. More specifically, use of the recognition heuristic increased from preadolescents to adolescents, but then dropped for adults.
Article
Some researchers on binary choice inference have argued that people make inferences based on simple heuristics, such as recognition, fluency, or familiarity. Others have argued that people make inferences based on available knowledge. To examine the boundary between heuristic and knowledge usage, we examine binary choice inference processes in terms of attribute substitution in heuristic use (Kahneman & Frederick, 2005). In this framework, it is predicted that people will rely on heuristic or knowledge-based inference depending on the subjective difficulty of the inference task. We conducted competitive tests of binary choice inference models representing simple heuristics (fluency and familiarity heuristics) and knowledge-based inference models. We found that a simple heuristic model (especially a familiarity heuristic model) explained inference patterns for subjectively difficult inference tasks, and that a knowledge-based inference model explained subjectively easy inference tasks. These results were consistent with the predictions of the attribute substitution framework. Issues on usage of simple heuristics and psychological processes are discussed.
Article
Full-text available
One view of heuristics is that they are imperfect versions of optimal statistical procedures considered too complicated for ordinary minds to carry out. In contrast, the authors consider heuristics to be adaptive strategies that evolved in tandem with fundamental psychological mechanisms. The recognition heuristic, arguably the most frugal of all heuristics, makes inferences from patterns of missing knowledge. This heuristic exploits a fundamental adaptation of many organisms: the vast, sensitive, and reliable capacity for recognition. The authors specify the conditions under which the recognition heuristic is successful and when it leads to the counterintuitive less-is-more effect in which less knowledge is better than more for making accurate inferences.
Article
Full-text available
Research on people's confidence in their general knowledge has to date produced two fairly stable effects, many inconsistent results, and no comprehensive theory. We propose such a comprehensive framework, the theory of probabilistic mental models (PMM theory). The theory (a) explains both the overconfidence effect (mean confidence is higher than percentage of answers correct) and the hard–easy effect (overconfidence increases with item difficulty) reported in the literature and (b) predicts conditions under which both effects appear, disappear, or invert. In addition, (c) it predicts a new phenomenon, the confidence–frequency effect, a systematic difference between a judgment of confidence in a single event (i.e., that any given answer is correct) and a judgment of the frequency of correct answers in the long run. Two experiments are reported that support PMM theory by confirming these predictions, and several apparent anomalies reported in the literature are explained and integrated into the present framework.
Article
Full-text available
Research on the processing of recognition information has focused on testing the recognition heuristic (RH). On the aggregate, the noncompensatory use of recognition information postulated by the RH was rejected in several studies, while RH could still account for a considerable proportion of choices. These results can be explained if either a) a part of the subjects used RH or b) nobody used it but its choice predictions were accidentally in line with predictions of the strategy used. In the current study, which exemplifies a new approach to model testing, we determined individuals' decision strategies based on a maximum-likelihood classification method, taking into account choices, response times and confidence ratings simultaneously. Unlike most previous studies of the RH, our study tested the RH under conditions in which we provided information about cue values of unrecognized objects (which we argue is fairly common and thus of some interest). For 77.5% of the subjects, overall behavior was best explained by a compensatory parallel constraint satisfaction (PCS) strategy. The proportion of subjects using an enhanced RH heuristic (RHe) was negligible (up to 7.5%); 15% of the subjects seemed to use a take the best strategy (TTB). A more-fine grained analysis of the supplemental behavioral parameters conditional on strategy use supports PCS but calls into question process assumptions for apparent users of RH, RHe, and TTB within our experimental context. Our results are consistent with previous literature highlighting the importance of individual strategy classification as compared to aggregated analyses.
Chapter
Two books have been particularly influential in contemporary philosophy of science: Karl R. Popper's Logic of Scientific Discovery, and Thomas S. Kuhn's Structure of Scientific Revolutions. Both agree upon the importance of revolutions in science, but differ about the role of criticism in science's revolutionary growth. This volume arose out of a symposium on Kuhn's work, with Popper in the chair, at an international colloquium held in London in 1965. The book begins with Kuhn's statement of his position followed by seven essays offering criticism and analysis, and finally by Kuhn's reply. The book will interest senior undergraduates and graduate students of the philosophy and history of science, as well as professional philosophers, philosophically inclined scientists, and some psychologists and sociologists.
Chapter
How can the intelligence of monkeys and apes, and the huge brain expansion which marked human evolution be explained? In 1988, Machiavellian Intelligence was the first book to assemble the early evidence suggesting a new answer: that the evolution of intellect was primarily driven by selection for manipulative, social expertise within groups where the most challenging problem faced by individuals was dealing with their companions. Since then a wealth of new information and ideas has accumulated. This new book will bring readers up to date with the most important developments, extending the scope of the original ideas and evaluating them empirically from different perspectives. It is essential reading for reseachers and students in many different branches of evolution and behavioural sciences, primatology, and philosophy.
Chapter
Where do new ideas come from? What is social intelligence? Why do social scientists perform mindless statistical rituals? This vital book is about rethinking rationality as adaptive thinking: to understand how minds cope with their environments, both ecological and social. The author proposes and illustrates a bold new research program that investigates the psychology of rationality, introducing the concepts of ecological, bounded, and social rationality. His path-breaking collection takes research on thinking, social intelligence, creativity, and decision-making out of an ethereal world where the laws of logic and probability reign, and places it into our real world of human behavior and interaction. This book is accessibly written for general readers with an interest in psychology, cognitive science, economics, sociology, philosophy, artificial intelligence, and animal behavior. It also teaches a practical audience, such as physicians, AIDS counselors, and experts in criminal law, how to understand and communicate uncertainties and risks.
Article
This paper attempts further to explicate and justify the belief, held by a number of critics of mainstream psychology, that much customary empirical research tells one little that could not have been known without it. Apart from questions of tautology or indeterminate relations to observation, many hypotheses are derivable from propositions that are unfalsitiable because they cannot he tested without relying on conceptualizations which imply the propositions themselves. Experiments that serve no purpose beyond the operationalization of such hypotheses are a misguided enterprise.
Article
This chapter describes four models of cognitive control in pilots of remotely piloted aircraft. The models vary in the knowledge available to them and in the aircraft maneuvering strategies that control the simulated pilot's interaction with the heads-up display. These models are Type 3 (knowledge/strategy) variants. The first two models are successive approximations toward a valid model of expert-level pilot cognitive control. The first model failed because of a naïve flight control strategy, and the second succeeded because of an effective flight control strategy that is taught to Air Force pilots. The last two models are investigations of the relative contributions of different major components of the more successful model of pilot cognitive control. This investigation of knowledge and strategy variants produces an anomalous result in relative model performance, which is explored and explained through a sensitivity analysis across a portion of the Type 3 parameter space. The lesson learned is that seemingly innocuous assumptions at the Type 3 level can have large impacts in the performance of models that simulate human cognition in complex, dynamic environments.