ArticlePublisher preview available

Hidden Costs of Reflectiveness: Aspects of Successful Scientific Reasoning

Authors:
To read the full-text of this research, you can request a copy directly from the authors.

Abstract

We tested a prediction of Baron's (1985) rationality theory: that reflectiveness is directly related to creative problem-solving performance. In two experiments, subjects solved a series of four induction problems involving conventional rules, followed by an induction problem involving an unconventional rule. Subjects who had been extremely reflective or extremely impulsive on successfully solving conventional problems performed more poorly on solving the unconventional problem than did subjects who had been moderately reflective or moderately impulsive on conventional problems. This U-shaped relationship between degree of reflectiveness/impulsiveness on conventional problems and problem-solving performance on an unconventional problem conflicts with predictions of rationality theory. (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Journal of Educational Psychology
1988,
Vol. 80. No. 4. 419-423Copyright 1988 by the American Psychological Association, Inc.
Ofm-066 3/88/$OO. 7 5
Hidden Costs of Reflectiveness:
Aspects of Successful Scientific Reasoning
David Duemler and Richard E. Mayer
University of California, Santa Barbara
We tested a prediction of Baron's (1985) rationality theory: that reflectiveness is directly related
to creative problem-solving performance. In two experiments, subjects solved a series of four
induction problems involving conventional rules, followed by an induction problem involving
an unconventional rule. Subjects who had been extremely reflective or extremely impulsive on
successfully solving conventional problems performed more poorly on solving the unconventional
problem than did subjects who had been moderately reflective or moderately impulsive on
conventional problems. This U-shaped relationship between degree of reflectiveness/impulsive-
ness on conventional problems and problem-solving performance on an unconventional problem
conflicts with the predictions of rationality theory.
Scientific reasoning involves generating and testing hy-
potheses based on collected data. In the course of scientific
thinking, one person may
go
public with a theory more rapidly
than another person; that is, some people may be willing to
publically state their theories on the basis of a small amount
of collected data, whereas other people prefer to wait until
more data are collected before accepting a theory. Premature
acceptance of a theory may be considered one aspect of
impulsive thinking, whereas waiting for data may be consid-
ered one aspect of reflective thinking.
Baron's (1985) theory of rational thinking is based on the
idea that a reflective thinking style is more conducive to
successful performance on creative problem-solving tasks
than is an impulsive thinking style. Baron (1985) lists
"insuf-
ficient search" as one of the defining features of
the
reflective-
ness/impulsiveness distinction:
I suggested that there might be a general bias to stop too soon
when collecting evidence. We can call this bias impulsiveness.
(P.
157)
Baron (1985) goes on to argue that students should be taught
to think in a way that prevents them from forming hypotheses
(or jumping to conclusions) on the basis of insufficient evi-
dence:
My purpose here is to show ... the teaching of good thinking
.. . should direct itself at the removal and prevention of the
major
biases
[including] insufficient search (and
its
total absence)
.... (p. 244)
One straightforward prediction of Baron's rationality theory
is that reflectiveness (or absence of impulsiveness) is directly
related to the probability of success on creative problem-
solving
tasks,
that
is,
the more reflective a student
is,
the more
successful the student will be in creatively solving problems.
Although we are sympathetic to Baron's, as well as to
Dewey:s (1933), call for the teaching of proper habits of
Correspondence concerning this article should be addressed to
David Duemler or Richard E. Mayer, Department of Psychology,
University of California, Santa Barbara, California 93106.
reflective thinking, the present study explores some limita-
tions on the positive effects of reflective thinking. In particu-
lar, we focus on one aspect of the reflectiveness/impulsiveness
distinction, what Baron (1985, p. 157) calls the "bias to stop
too soon when collecting evidence" during hypothesis testing.
This bias is indicated by the tendency to go public with a
hypothesis after collecting minimal evidence. Like Baron, we
also avoid the view of reflectivity/impulsivity as a personality
trait (Baron, Badgio,
&
Gaskins, 1986; Kagan, Rosman, Day,
Albert, & Phillips, 1964; Messer, 1976), and we focus on just
one aspect of
this
dimension.1
To investigate the predictions of rationality theory, we used
a modified version of the classic einstellung procedure (Lu-
chins,
1942). Students solved a series of
rule
induction prob-
lems that were all based on the same type of salient rule (i.e.,
conventional problems), and then we gave the students an
identical-looking problem that was based on a qualitatively
different and less salient kind of rule (i.e., unconventional
problem). Some students (whom we defined as reflective)
solved the conventional problems without ever overtly stating
an incorrect hypothesis along the way; other students (whom
we defined as impulsive) stated incorrect hypotheses on all or
most of the conventional problems before eventually solving
them; and other students (whom we defined as moderate)
stated incorrect hypotheses on some but not most of the
conventional problems before eventually solving them. Our
interpretation of rationality theory predicts a linear relation-
ship between degree of reflectiveness on conventional prob-
lems (i.e., the tendency to withhold stating a hypothesis until
it is completely tested) and probability of success on solving
the unconventional problem.
1 It should be noted that our operational definition of reflective-
ness/impulsiveness is more limited and specific than, and possibly
different from, some of
the
more traditional, general definitions. For
example, in contrast to some definitions of reflectiveness/impulsive-
ness,
we do not use measures of latency in our definition. Therefore,
the reader may prefer to substitute different terminology such as low
versus
high risk taking for
reflectiveness versus
impulsiveness.
419
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
... Research on the effect of cognitive tempo on problem solving (Messer, 1976) in dicates that a slower, more reflective tempo usually results in better solutions. However, Duemler and Mayer (1988) found that highly reflective or impulsive persons may solve problems poorer than do persons who are moderately reflective or impulsive, suggesting an inverted U-shaped relationship between tempo and problem solving. ...
... Thus, the findings in this study support Packard (1973), who found that slower tempo students create more highly rated art, and do not support Schmidt and Sinor (1986), who report that cognitive tempo has no effect on musical creativity. No U-shaped relationships were found in the present data to support Duemler and Mayer's (1988) conten tion that extremes in cognitive tempo adversely affect the product. Baron (1981Baron ( , 1985 writes that impulsivity hinders problem solving and is a learned habit. ...
... Brainstorming-"saying whatever comes to mind without evaluation"-is considered an aspect of "non-critical thinking" as is "putting facts, concepts and principles together in new and original ways" (Huitt 1998). However, when students use techniques associated with reason and logic as well as creativity and divergence, they are more successful in problem-solving (Duemler and Mayer 1988) suggesting that a careful balance needs to be maintained in this phase between diverging and converging (Manning 2016), or more broadly between design (creative) and critical thinking. Conscious, rational, and logical reasoning can lead to formalized sets of rules being applied to solution generation and selection, while design thinking approaches leave open the possibility of iterative development of options over time as experience-based feedback is garnered (Glen et al. 2015). ...
Chapter
Business schools around the world are increasingly integrating design thinking into their curricula, which invites definition of a new professional identity for individuals effectively working at the intersection of the two fields. Research is needed, however, to understand what such a profession might entail and in what ways students might best be prepared to enter it. Defining the capabilities that a design thinking business professional will embody requires an understanding of the ways design thinking complements or contradicts more traditional critical thinking approaches applied to business decisions. This chapter adopts a framework grounded in learning theory to describe the four basic capabilities needed to frame and solve problems in practice: observing and noticing; framing and reframing; imagining and designing; and making and experimenting. Using that framework, it unpacks the contributions that design and critical thinking make to the development of each of the capabilities in a business setting and highlights challenges associated with helping business students learn design thinking and how they might use it to complement other approaches to framing and solving business problems.
... The level of evaluation is thought to be involved in left-brain, as in problem-solving and decision-making critical thinking, while synthesis is thought to be right brain, as in emotional, intuitive creative thinking (Springer and Deutsch, 1993). Educators and researchers believe that productive learning requires cognition at all levels of Bloom's taxonomy, and that students that are effective at creative and critical thinking are better problem-solvers (Duemler and Mayer, 1988). ...
Article
Full-text available
The main objective of this study was to investigate the impact of an outdoor environmental program, Math and Science in the Outdoor Classroom, on elementary grade students' creative and critical thinking, and attitudes toward math and science. Math and Science in the Outdoor Classroom is an on-campus nature program in Santa Fe, N.M. Students participated in half-day programs focusing on topics such as water, insects, soil, and weather. Twenty-one teachers from five schools volunteered 175 second through sixth graders to participate in the program and research study. Surveys were administered to students, teachers, and volunteers after completion of the program. Interview data was analyzed using QSR NUD*IST (Nonnumerical Unstructured Data Indexing Searching and Theory-building) computer-assisted qualitative data analysis system to examine respondents' perceptions of the program using Bloom's taxonomy as a theoretical framework. Results indicated that students not only learned math and science at the lower levels of Bloom's taxonomy, but were also thinking at the higher levels of synthesis and evaluation within the framework.
Article
D. Duemler and R. E. Mayer (see record 1989-14366-001) claimed to have found evidence against my theory of rational thinking (J. Baron, 1985), which they interpreted as saying that more reflective thinking is always better. They claimed to show that the most reflective subjects do worse in a task that requires generation of unusual hypotheses. The theory itself, however, implies that people can be too reflective. Their data do not test even this implication adequately because their measure of reflectiveness is very likely invalid.
Article
J. Baron (see record 1990-27432-001) makes two assertions concerning our research on reflectiveness in scientific reasoning (D. Duemler and R. E. Mayer; see record 1989-14366-001): (a) His theory, particularly as stated in Baron (1988), predicts our findings, and (b) we have misnamed the independent variable in our study as reflectiveness. In this essay, we briefly respond to each assertion and call for three improvements in theories of scientific reasoning.
Article
Writing instructors often assign collaborative writing activities as a way to foster reflective thinking; many assume that the very act of explaining and defending ideas in the presence of a responsive audience actually forces writers to take critical positions on their own ideas. This article questions this assumption by examining the role of critical reflection in one particular writing context—that of collaborative planning. The authors' observations address three questions: (a) When students collaborate on plans for a paper do they necessarily reflect critically on their own ideas and processes, as many advocates of collaboration might expect? (b) If and when students engage in reflection, does it make a qualitative difference in their writing plans? And finally, (c) how do student writers engage in and use reflection as they develop plans? Twenty-two college freshmen audio-taped themselves as they planned course papers with a peer. Transcripts were coded for reflective comments and were holistically rated for quality. The analysis revealed a significant correlation between amount of reflective conversation and the quality of students' plans. Students used reflection to identify problems, to search for and evaluate alternative plans, and to elaborate ideas through the process of justification. This problem solving was most effective when reflection was sustained over many conversational turns. Collaboration did not guarantee reflection, however. Some sessions contained no reflective comments and some students used collaboration in a way that undermined reflective thinking. This study suggests that how students represented collaboration and the writing assignment itself determined whether and how they reflected on their own ideas.
Article
Full-text available
This paper examines the research on design methods for shifting attention between visuals (for example, text, graphics or moving images) and auditory prompts (such as speech, music or effects) in multimedia environments. Stochastic design methods are most prevalent in the literature. Stochastic approaches reflect outdated bottleneck theories of human attention. Results using stochastic design methods have been mostly poor. Studies using the Structured Sound Function (SSF) model, however have shown good immediate results in student retention, and even better results following a latency period. The SSF model relies on the ‘explicitness’ and ‘gist’ requirements inherent in tasks and the interrelatedness of spatial and language representations. It is recommended that designs that incorporate gist and explicit requirements using the SSF model be applied developmentally, because as we get older we get better at extracting gist from sound than details from text.
Article
Full-text available
Three experiments test the hypothesis that positive mood facilitates cognitive flexibility in categorization. Study 1 used a sorting task and found that positive mood subjects in relation to subjects in other mood states, formed fewer (broader) categories when focusing on similarities among exemplars and more (narrower) categories when focusing on differences. Study 2 used a within-subject design and assessed more direct measures of flexibility. Study 2 found that compared with neutral mood subjects, positive mood subjects (a) perceived a greater number of both similarities and differences between items, (b) accessed more distinct types of similarities and differences, and (c) listed more novel and creative similarities and differences. Study 3 demonstrated that these effects occur for both positive (mood-congruent) and neutral stimuli and identified intrinsic interest in the task as a possible mediating factor. The implications of these findings for understanding the effects of mood on cognitive organization and processing are discussed. (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Article
Full-text available
A series of studies with children in Grades 1-4 inquired into the immediate and historical determinants of a preference for analytic conceptual groupings. An analytic concept is based upon shared similarity in a particular objective component among a set of stimuli (e.g., animals with 1 car, people with hats on). Results revealed that 2 more fundamental cognitive dispositions each contributed variance to the production of analytic concepts: the tendency to reflect over alternative solutions or classifications in situations in which several response alternatives arc available simultaneously, and the tendency to analyze visual arrays into their component parts. These 2 dispositions are relatively independent of each other, orthogonal to verbal skills; and each influences the frequency of errors in perceptual recognition tasks. Degree of reflection over alternative solution hypotheses (as measured by response time) displayed remarkable generality across a variety of tasks and marked intraindividual stability over a 1-yr. period. There was an inverse relation between the production of analytic concepts and extreme degrees of hyperactivity and distractibility contemporaneously as well as during the 1st 8 yr. of life.
Article
Full-text available
Studies of reflection-impulsivity (RI) suggest that the tendency is correlated with performance on a variety of similar tests. They predict the quality of problem solving under conditions of response uncertainty, except in the case of preschoolers who have not yet learned to delay and scrutinize alternative hypotheses. It is noted that the response time component of RI is relatively independent of IQ, whereas the error component is moderately related. Shortcomings of the major test (the Matching Familiar Figures Test) used to measure RI are described, and norms to guide the researcher are presented. Studies of scanning behavior show that reflectives gather more information more carefully and systematically than do impulsives. Attempts to relate this variable to personality and social variables have been only partially successful. RI is related to certain clinical syndromes including hyperactivity, brain damage, epilepsy, and mental retardation. It also affects school performance, as evidenced by the greater impulsivity of children with reading difficulties, learning disabilities, and school failure. Impulsivity has been found to be modifiable: The most consistently successful strategy in this regard is to teach impulsives improved scanning strategies by means of appropriate training materials while having them verbalize such strategies aloud. (3 p ref) (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Article
Full-text available
Suggests that intelligence can best be understood through the study of nonentrenched (i.e., novel) tasks that require Ss to use concepts or form strategies that differ from those they are accustomed to. It is suggested that the limited success of the cognitive-correlates and cognitive-components approaches to intelligence are due in part to the use of tasks that are more entrenched (familiar) than would be optimal for the study of intelligence. Two nonentrenched tasks are described, one requiring projection into the future of states of objects, the other requiring complex analogical reasoning where multiple terms of analogies can be replaced by alternative answer options. Research with adult Ss into the 1st task focused on performance components of task solution; research into the 2nd task focused on metacomponents of task solution. Correlations of task and component latencies were generally higher than those obtained in most contemporary information-processing research on the nature of intelligence. Implications for educational theory and practice are discussed. (39 ref) (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Book
What is intelligence? Can it be increased by teaching? If so, how, and what difference would an increase make? Before we can answer these questions, we need to clarify them. Jonathan Baron argues that when we do so we find that intelligence has much to do with rational thinking, and that the skills involved in rational thinking are in fact teachable, at least to some extent. Rationality and Intelligence develops and justifies a prescriptive theory of rational thinking in terms of utility theory and the theory of rational life plans. The prescriptive theory, buttressed by other assumptions, suggests that people generally think too little and in a way that is insufficiently critical of the initial possibilities that occur to them. However these biases can be - and sometimes are - corrected by education.
Article
We tested a prediction of Baron's (1985) rationality theory: that reflectiveness is directly related to creative problem-solving performance. In two experiments, subjects solved a series of four induction problems involving conventional rules, followed by an induction problem involving an unconventional rule. Subjects who had been extremely reflective or extremely impulsive on successfully solving conventional problems performed more poorly on solving the unconventional problem than did subjects who had been moderately reflective or moderately impulsive on conventional problems. This U-shaped relationship between degree of reflectiveness/impulsiveness on conventional problems and problem-solving performance on an unconventional problem conflicts with predictions of rationality theory.
Article
Dewey (1933) proposed that “reflective thinking” ought to be encouraged by education. This is a type of thinking that considers options and reasons before choosing a course of action or adopting a belief. I argue here that Dewey's proposal can serve as the basis for a domain-independent theory of intelligent thinking. Following Dewey, I propose a general normative (prescriptive) model of the phases of reflective thinking: problem recognition, enumeration of possibilities, reasoning, revision, and evaluation. Associated with each phase is at least one parameter governing the operation of that phase, e.g., sensitivity to evidence for the “revision” phase, and at least one rule for setting the optimum value of that parameter. People may tend to deviate from the optimum in a particular direction; for example, people may be generally too insensitive to evidence against favored beliefs. Some people may be more prone to such biases than others. Such individual differences are a matter of propensities rather than capacities, because the setting of the parameter is under voluntary control—either directly, through the explicit use of the rules, or indirectly, through the use of heuristics. The measurement of individual differences in these parameters is best done under typical conditions, rather than optimal conditions. Although the general rules may provide goals for education (descriptions of what a good thinker should do), they do not tell us how to achieve those goals. The setting of a parameter is likely to be affected by beliefs, values, emotions, and habits; and education for reflective thinking may have to deal with all of these.
Cognitive style and its improvement: A normative approach Advances in the psychology of human intelligence
  • J Baron
  • P C Badgio
  • I W Gaskins
  • J. Baron
  • P. C. Badgio
  • I. W. Gaskins
Cognitive style and its improvement: A normative approach
  • J Baron
  • P C Badgio
  • I W Gaskins
Baron, J., Badgio, P. C. & Gaskins, I. W. (1986). Cognitive style and its improvement: A normative approach. In R, Sternberg (Ed.), Advances in the psychology of hitman intelligence (Vol. 3, pp. 173-220). Hillsdale, NJ; Erlbaum.