Content uploaded by Rodrigo Dal Ben
Author content
All content in this area was uploaded by Rodrigo Dal Ben on Dec 05, 2017
Content may be subject to copyright.
BA OUTSIDE THE BOX 1
Dal Ben, R., Calixto, F. C., & Ferreira, A. L. (2016). Are Brazilian Behavior Analysts Publishing
Outside the Box? A Survey of General Science Media. Behavior Analysis in Practice. doi.
10.1007/s40617-016-0152-x
Title: Are Brazilian Behavior Analysts Publishing Outside the Box? A Survey of General Science Media
Recent studies have stressed the importance of disseminating behavior analysis to a more diverse audience and have
provided ways to do so effectively. General science publications offer an attractive venue for communicating with a
scientifically educated public. The present study examines behavior analysis research published in Science Today
and Research Fapesp, monthly general science publications published by the Brazilian Society for the Advancement
of Science and São Paulo Research Foundation, respectively. Behavior analytic terms were searched in issues
published from 2003 to 2014, along with psychoanalytic terms as a comparative measure. Only 13 behavior analysis
articles were found, while psychoanalytic articles totaled 150. Six of the behavior analysis articles misconstrue
fundamental concepts of behavior analysis. The study recommends that behavior analysis researchers extend the
dissemination of their findings outside the box.
Keywords: dissemination, general science, publication, behavior analysis
BA OUTSIDE THE BOX 2
It has been more than eight decades since Skinner established the foundations for the science of behavior
analysis (Skinner, 1938). Since then, behavior analysts have investigated subjects such as memory, language,
decision making, pharmacology, gerontology, and developmental disabilities from empirical and theoretical
perspectives (Madden, Dube, Hackenberg, Hanley, & Lattal, 2013a, 2013b). By taking a closer look at the
antecedents to consequences of present and past behaviors and their contingencies, behavior analysis has broken
with the ancient custom of seeking behavioral causes within individuals and introduced a revolutionary way of
thinking into psychology.
In view of the potential social impact of such a circumstantial approach, it is reasonable to ask how, when,
and whether the findings of behavior analysis (BA) research are being disseminated to the broad spectrum that could
benefit from them. At the same time, it is important to note that the discipline itself can be positively affected by
disseminating its findings to a more diverse audience, in other words, by getting out of its box. In addition to the
well documented and widely acknowledged advancements that behavior analysis has contributed to the treatment of
people diagnosed with autism spectrum disorder (Foxx, 2008; Hayward, Gale, & Eikeseth, 2009; Matson, Tureck,
Turygin, Beighley, & Rieske, 2012; Peters-Scheffer, Didden, Korzilius, & Sturmey, 2011; Virués-Ortega, 2010),
two further examples illustrate this impact, and an additional uncommon case can be found in Maple and Segura
(2015).
First, prompted by Mischel, Ebbesen, and Raskoff Zeiss (1972), behavior analysts Grosch and Neuringer
(1981) performed an experiment in which Mischel’s well-known marshmallow paradigm was successfully tested
with non-human subjects, indicating the significance of environmental variables in self-controlled behavior. Such
findings encouraged the behavioral study of self-control, a line of research that has proven invaluable (Rachlin,
2009). Second, behavior analysis can contribute to the study of complex behavioral phenomena such as corruption,
traditionally a domain of economists and political scientists (Abbink, 2000; Armantier & Boly, 2008; Frank &
Schulze, 2000). Its contribution can involve elucidating controlling variables of operant behavioral classes that
compose corrupt behavior at individual and cultural levels, thus facilitating the dissemination of the operant
approach to areas primarily grounded in cognitive processes (Agbota, Sandaker, & Ree, 2015; Fernandes & Pezzato,
2015; Goldstein & Pennypacker, 1998). In return, behavior analysis may attain greater visibility and influence the
political process, perhaps to the point of informing public policies (Hursh & Roma, 2013; Thaler & Sunstein, 2009).
BA OUTSIDE THE BOX 3
Following this path, wider dissemination may yield at least three highly desirable outcomes. First, it can
empower BA scholars in academic and political settings by highlighting the relevance of their research. Second, it
can enhance the impact of their published work among scholars from different disciplines interested in the topics
they treat. Finally, it can expand employment opportunities for behavior analysts based on increased public
acceptance of their approach to dealing with social challenges (Michael, 1980; Normand, 2014; Schlinger, 2014a).
Despite the evident benefits of wider dissemination, however, behavior analysis has a paradoxical history in
this regard, as shown in a detailed historical analysis by Cruz (in press). On the one hand, BA practitioners represent
a growing community with broad international representation (ABAI, 2016) and reputable professional certification
(BCBA, 2016). On the other, since its foundation, behavior analysis has been haunted by the specter of isolation
(Catania, 2008; Herrnstein, 1987; Laties, 1987, 2008; Lindsley, 1987; Skinner, 1987). Isolation occurs inside the BA
community, for example, when researchers from different areas and practitioners are unaware of each other’s
studies, methodologies, and practices (Diller, Salters-Pedneault, & Gallagher, 2014; Elliott, Morgan, Fuqua,
Ehrhardt, & Poling, 2005; Poling, Alling, & Fuqua, 1994; Poling, Picker, Grossett, Hall-Johnson, & Holbrook,
1981). A more optimistic perspective, however, can be found in Virues-Ortega, Hurtado-Parrado, Cox, and Pear
(2014). Isolation also occurs between behavior analysis and general psychology (Coleman & Mehlman, 1992;
Hearst, 1967; Hineline, 1980; Krantz, 1971, 1972). As a consequence, critics of the former have characterized BA as
a closed, restrictive, and even perishing community (Hearst, 1967; Rutherford, 2009; Wendt, 1949), although some
have rebutted such claims (Roediger, 2004). Such isolation strongly influences persistent discussions on BA life
expectancy (Baum, 2000; Carr, 1996; Fantino, 2008; Hayes & Fryling, 2015; Michael, 1980; Poling, 2010; Vyse,
2013; for an entire issue on the topic, see Holth, 2014) and calls for equipping and encouraging behavior analysts to
disseminate their findings more broadly (Bailey, 1991; Freedman, 2015; Smith, 2016).
Recently, ten articles reflecting on the benefits and challenges of disseminating BA research were published.
Becirevic (2014) surveyed respondents on BA social media websites and found many agree that it is imperative to
address misrepresentations and misunderstandings of their field. They failed, however, to indicate any concrete steps
to do so effectively. In response, three experts shared maxims for dealing with BA misunderstandings, e.g., be
evidence based (Critchfield, 2014); draw on relevant sources to craft an effective response (Todd, 2014); and use
strategic approaches, such as determining the context in which misconceptions have emerged and correcting them in
BA OUTSIDE THE BOX 4
a non-argumentative manner (Zarcone, 2015). Another expert highlighted the importance of high-quality graduate
training in developing communication skills (Schlinger, 2014b).
Another five case studies address the benefits and challenges of publishing outside the box. The authors
provide valuable advice and indicate pertinent publications for BA researchers to consider in disseminating their
findings to a more diverse audience (Morris, 2014; Reed, 2014). One option to reach scholars from different fields is
to publish articles in scientific journals of other disciplines (Friman, 2014b). Another, targeting an even broader
readership, is to publish books in the popular press that provide a comprehensive panorama of BA principles and
procedures in language that is more accessible than the abstruse jargon that too often marks scientific literature
(Vyse, 2014). Yet another option that could reach both scholars and well-educated laymen is to disseminate BA
advances via general science publications, magazines, and newspapers (Schlinger, 2014a).
General science publications are particularly attractive venues given that their readership is largely composed
of scholars, practitioners from diverse disciplines, and others readers interested in science. It is an effective means of
disseminating behavior analysis’ empirical discoveries and its philosophical comparisons and contrasts with other
approaches (Schlinger, 2014a).
Among Brazilian general science publications, two merit particular attention: Science Today and Research
Fapesp. The first is published by the Brazilian Society for the Advancement of Science which constitutes Brazil’s
major scientific society, comprising over one hundred associations from all scientific disciplines. The second is
published by the São Paulo Research Foundation, Brazil’s major scientific research foundation, which promotes
national and international scientific collaboration and funds research at multiple levels, with a budget exceeding
$300 million US dollars in 2015.
Brazil’s BA community is second only to the United States in size, with high-quality researchers that publish
in national and international scientific journals (Todorov & Hanna, 2010). Considering only national publications, a
search of the principal BA journal and book databases (viz., Behavior under Focus
1
; Brazilian Journal of Behavior
Analysis; Brazilian Journal of Behavioral and Cognitive Therapy; Perspectives in Behavior Analysis), indicates
some 450 published articles over the past decade (2006 to 2015). Despite this considerable academic productivity
and initial BA dissemination during the1960s (Matos, 1998), isolation also impacts Brazil (Andery, 2012; Cruz,
Strapasson, & Rebecca, in press; Rodrigues, 2006).
1
Comportamento em Foco – Authors translation.
BA OUTSIDE THE BOX 5
With this contrast of growth and isolation in mind, it is reasonable to assume that Brazilian behavior analysts
have relevant material to share with a broader audience and could benefit from doing so. Moreover, as previously
indicated, Science Today and Research Fapesp are optimal venues to achieve these ends. Accordingly, the present
study examines BA research published in Science Today and Research Fapesp.
Method
To identify BA articles published between 2003 and 2014, searches of Science Today’s and Research
Fapesp’s online databases were conducted. While two issues from the former (numbers 220 and 297) were not
analyzed due to problems in the database, the remaining 130 and all 132 issues from the latter were analyzed.
Occurrences that did not relate substantively to behavior analysis, e.g., behavior of chemical compounds, were not
analyzed.
Search terms were selected using a Brazilian BA vocabulary index (Teixeira Junior & Souza, 2006). Twelve
commonly used technical terms (behavior, behaviorism, behavioral therapy, cognition, conditioning, contingency,
operant, punishment, reflex, reinforcement, respondent, stimulus control) and four leading researchers (Hull,
Skinner, Tolman, Watson) were selected. In a preliminary phase, the terms were searched in 30% (78) of the Science
Today issues. Only two technical terms (behavior, behaviorism) and one researcher (Skinner) were found in all
retrieved instances. Accordingly, these terms were searched in the 262 issues of Science Today and Research
Fapesp.
As a comparative measure, using terms common to psychoanalysis derived from a psychoanalytic vocabulary
index (Laplanche, 2001) and a general dictionary (Houaiss, 2008), viz., “psych,” “psychoanalysis,” and “Freud”
were searched. As an additional control measure, 35% (92) of the issues were then searched using the term
“psychology.” However, this search did not indicate any publications not previously retrieved using the original BA
and psychoanalytic search terms. The occurrences were grouped into four categories: psychoanalysis – Research
Fapesp, psychoanalysis – Science Today, behavior analysis – Research Fapesp, and behavior analysis – Science
Today.
Following these analyses, 40% of the reviewed issues (52 from Science Today and 53 from Research Fapesp)
were analyzed to establish interobserver agreement by comparing BA and psychoanalytic occurrences identified by
two independent observers. When a disagreement occurred, it was discussed and the article was included only if
BA OUTSIDE THE BOX 6
both observers concurred. The rate of agreement was calculated by dividing total agreements by total agreements
plus disagreements, and the result converted to a percentage. The total interobserver agreement for both publications
was 93%, with four disagreements pertaining to psychoanalysis and none to behavior analysis. Regarding the
disciplines reflected in Figure 2, occurrences from 20% of the reviewed issues (26 from Science Today and 26 from
Research Fapesp) were analyzed to establish interobserver agreement. Following the procedure previously
described, the total interobserver agreement for both publications was 98%, with one disagreement pertaining to the
discipline assigned to a psychiatrist that is associated to a psychology department.
Results and Discussion
During the study period, 13 BA articles were published (six in Science Today and seven in Research Fapesp).
Figure 1 depicts the cumulative number of publications involving the selected terms over the study period for each
category. In regard to the six articles published in Science Today, two were published in the section titled
“Memory”, which is devoted to discussions about significant scientific events. The first notes the importance of
Pavlov’s findings on respondent conditioning in development of the experimental analysis of behavior (Pessoti,
2003). The second offers reflections on the impact that Watson’s manifest (Watson, 1913) had on rejection of
introspection and development of alternative methodologies to investigate psychological phenomena in an objective,
and experimental fashion (Cirino, 2013). Another is a letter to the editor written by the present study’s first author in
response to a physicist’s article about the limitations of science. The letter elucidates the advantages of identifying
science as the behavior of scientists in relation to measurable and controllable environmental contingencies (Dal
Ben, 2014).
_________________
Insert Figure 1
_________________
The remaining three articles misportrayed Skinner’s proposals on language and verbal behavior (Skinner,
1957), while embracing Chomsky’s proposals on universal grammar (Chomsky, 1959). Szczesniak (2004, 2007) and
Balão (2005) present Skinner’s proposal as being grounded in the stimulus-response paradigm, instead of the
multiple-controlled operant paradigm, and developments in verbal behavior analysis (e.g., empirical and theoretical
BA OUTSIDE THE BOX 7
research published in the journal The Analysis of Verbal Behavior) were not discussed. Although no letters were
published in subsequent issues of Science Today in response to these articles — ironically resembling Skinner’s
silence in regard to Chomsky’s criticism, publically addressing such misunderstandings provides an excellent
opportunity to educate authors and readers by correcting published errors and indicating reliable sources of
information (Becirevic, 2014; Critchfield, 2014; Friman, 2014b; Hobbs, Cornwell, & Chiesa, 2010; Schlinger,
2014b; Todd & Morris, 1983; Todd, 2014; Zarcone, 2015).
Regarding the seven BA articles published in Research Fapesp, two were published in the section titled
“Research”, which announces scientific discoveries. Zorzetto (2013) reports advances in the treatment of obsessive-
compulsive disorder, in which the use of medication and behavioral therapy is the recommended practice for
changing how a person perceives and acts out the disorder. Zolnerkevic (2013) reports findings from a collaborative
endeavor among Brazilian and Australian researchers on differing abilities to perform simple and conditional
discriminations by diverse species of bees that raise questions regarding the role of survival contingencies in such
distinctions.
An unattributed article (FAPESP, 2004b) pays tribute to Carolina Bori’s labors to establish psychology as a
scientific discipline and profession in Brazil. In so doing, it recognizes her efforts to enhance teaching methods for
spreading scientific critical thinking to the general public, which, she believed, is the primary social contribution of
science. The remaining three articles concern a curriculum to develop children’s social abilities; an open access
digital collection of classical psychology authors, including Skinner; and activities of the National Institute of
Science and Technology for Behavior, Cognition and Teaching, which focus on behavior analysis (FAPESP, 2004a,
2007; Marques, 2010 respectively). Finally, in the section titled “Tales”, a historical fiction about an unhappy
psychology graduate student depicts Skinner’s and Pavlov’s experimental control and basic research with non-
humans as a denial of human superiority and freedom as compared to the concepts of self-realization and personal
freedom advanced by Carl Rogers and Wilhelm Reich (Castelo, 2012).
The number of psychoanalytic articles published during the study period was 6.5 and 14 times higher than
their BA counterparts in Science Today and Research Fapesp, respectively. An average of 4.3 and 8.1
psychoanalytic articles were published annually in Science Today and Research Fapesp. In some years (2010, 2011,
2014 for Science Today and 2014 for Research Fapesp), the number of psychoanalytic articles spiked; however, no
specific reasons for this occurrence, such as a special section or issue, were identified. Psychoanalytic mentions
BA OUTSIDE THE BOX 8
were present in virtually all sections of both publications (Articles, Interviews, Letters, Memory, Research, Tales,
etc.).
In summary, during the study period, there was only one published article reporting BA basic research
findings (Zolnerkevic, 2013), one letter to the editor describing BA approaches (Dal Ben, 2014), and two articles
related to BA as a means of clinical and educational intervention (Zorzetto, 2013; FAPESP, 2004a, respectively).
Four of the articles were related to BA history, generally recalling significant discoveries derived from the
respondent paradigm (Cirino, 2013; FAPESP, 2004b, 2007; Pessoti, 2003). On the other hand, Balão (2005), Castelo
(2012), and Szczesniak (2004, 2007) presented misconstrued and outdated information regarding behavior analysis,
but did not receive a single response from behavior analysts. In view of the dearth of published articles on scientific
and technological advancements derived from the operant paradigm, unanswered misinterpretations, and the
disproportion between psychoanalytic and behavior analysis representation, it is reasonable to suggest that behavior
analysts have underused Science Today and Research Fapesp as outlets for disseminating BA research to a broader
audience.
Critics might present at least four arguments suggesting limitations to the present study. First, it is possible
that the selected terms did not retrieve all BA and psychoanalytic articles. Second, the study may not provide a
comprehensive picture of BA dissemination in Brazil, given its focus on general science media, while excluding
other dissemination strategies, such as publishing in journals from other disciplines or popular press books. Third,
the topics addressed by the publications analyzed in the study may be unrelated to subjects of interest to behavior
analysis, thus limiting opportunities for dissemination. Fourth, comparing publication of BA and psychoanalytic
research may be misplaced as instances of the latter likely exceed those of the former for several reasons, such as
greater number of researchers, studies, and broader acceptance in the popular culture.
Regarding the first argument, an alternative means of selecting search terms would be to use a word-counter,
such as Coh-Metrix (McNamara, Louwerse, Cai, & Graesser, 2013), which indicates such aspects as concreteness,
imageability, and meaningfulness (Diller, Salters-Pedneault, & Gallagher, 2014). Such tools, however, are not
culturally relevant to Brazil as their sources are based on a culture quite distinct from its own. For instance, behavior
analysis is far more prevalent in America’s popular culture than Brazil’s (e.g., Seinfeld, The Big Bang Theory,
Breaking Bad; for a top-10 list see, McColloch, 2015). Furthermore, as previously delineated, the search terms used
were selected on the basis of analysis of relevant indexes and their efficacy was tested in pilot searches.
BA OUTSIDE THE BOX 9
Concerning the second critique, the authors agree that the study’s data should be combined with data from
other dissemination strategies to provide a broader spectrum of BA dissemination in Brazil. Nonetheless, no
substantive change in the low dissemination scenario presented in this study would be anticipated. As noted, BA
isolation, diversity, and survival are persistent topics of concern (Baum, 2000; Carr, 1996; Fantino, 2008; Hayes &
Fryling, 2015; Holth, 2014; Lindsley, 1987; Michael, 1980; Poling, 2010; Vyse, 2013). However, as previously
mentioned, at least ten articles on BA dissemination strategies intending to equip and stimulate behavior analysts to
augment such scarce endeavors have been published (Becirevic, 2015; Normand, 2014).
In response to the third argument, a random search on any issue of the surveyed publications will reveal
several topics to which behavior analysis could contribute, such as climate change, aging, memory, language, human
development, evolution, and cultural organization. In addition, during the study period, Science Today and Research
Fapesp published articles (numbers 270 and 184, respectively) on autism spectrum disorder, a major topic in applied
BA research, whose contributions to effective interventions is well documented (Foxx, 2008; Hayward, Gale, &
Eikeseth, 2009; Ingvarsson, Cammilleri, & MacIas, 2012; Matson, Tureck, Turygin, Beighley, & Rieske, 2012;
Peters-Scheffer, Didden, Korzilius, & Sturmey, 2011; Rivard, Terroux, & Mercier, 2014; Virués-Ortega, 2010).
Despite this record, however, psychoanalysts were the only representatives of the psychology profession selected for
interviews.
In regard to the premises posited in the fourth argument concerning disproportionate coverage of
psychoanalytic versus BA research in the general science publications reviewed, three dimensions may help frame
our analysis: the number of Brazilian psychoanalysts and behavior analysts, the academic production of each
community, and the disciplines represented by the published articles. Given that both behavior analysis and
psychoanalysis are psychological approaches that guide professional practice in Brazil, the most direct way to
measure the relative numbers of their practitioners would be to consult the affiliation directory of the Brazilian
Federal Council of Psychology, which regulates psychology as a profession. Unfortunately, the Council does not
record this data, nor does it provide related information such as type of interest group (e.g., such as APA divisions)
that could facilitate identification of their affiliates’ disciplines (Federal Council of Psychology, personal
communication, July 1, 2016). Moreover, while efforts are underway in Brazil to establish a certification process for
behavior analysts, presently there are no well-established certifications for either behavior analysts or
psychoanalysts. Accordingly, as an alternative measure, albeit less reliable, the memberships of BA and
BA OUTSIDE THE BOX 10
psychoanalytic associations were tallied. For the study period, aggregate memberships totaled 1196 (ABPMC, 2016;
ACBr, 2016) and 1578 (FEBRAPSI, 2016), respectively. In other words, while psychoanalytic membership was
slightly larger than BA membership, the number of members was relatively equivalent, and thus adequate for the
study’s comparison.
Despite their similar numbers, however, it is possible that studies of psychoanalysts are more prevalent in
peer-reviewed journals than those of behavior analysts. As previously stated, approximately 450 articles were
published in Brazilian BA journals over the last decade. A search of the Scielo database
2
for the same period, using
the term “psychoanalysis” yields approximately 500 articles, a number comparable to the figure cited in the prior
sentence. Using these numbers as denominators, the aggregate of peer-reviewed psychoanalytic articles was
followed by 0.33 occurrences in the general science publications reviewed in this study, as compared to only 0.03
occurrences for BA articles.
Although their community size and academic production are similar, it could be the case that psychoanalysts
are more engaged in addressing the public and disseminating their findings than behavior analysts. To assess this,
the disciplines related to all articles reviewed were identified, as depicted in Figure 2. Behavior analysis was cited
by authors of four disciplines, primarily, psychologists (50%) and linguists (25%), and, as noted, in one instance in
an unattributed article. Psychoanalysis, on the other hand, was mentioned in editorials (21%) and by authors from 20
disciplines, primarily, psychology (11%) and psychiatry (9%). The marked difference in dissemination across
disciplines is further highlighted when comparing the percentage of articles by disciplines directly related to
behavior analysis, viz., psychology and psychiatry (58%), to those related to psychoanalysis, to wit, psychology,
psychiatry, and psychoanalysis (28%). It is worth noting that most psychoanalytic articles (72%) arise from
disciplines not directly related to psychoanalysis.
____________
Insert Figure 2
____________
As in the Brazilian context, BA and psychoanalytic community size and academic production are similar,
these three dimensions enable us to frame and evaluate the study’s comparison. At the same time, the fact that most
2
Scielo – Scientific Electronic Library Online is the main scientific database in Brazil that includes more than 3,000 Brazilian scientific journals.
BA OUTSIDE THE BOX 11
psychoanalytic articles were written by authors from disciplines not directly related to psychoanalysis reflects its
broader cultural acceptance. This phenomenon is not limited to Brazil. For instance, in their analysis of thousands of
digital books, Michel et al. (2011) found that Freud was cited more frequently than Galilei, Darwin, and Einstein.
This prevalence provides compelling evidence for the imperative of disseminating the findings of BA research to a
broader audience that extends beyond the comparatively limited readership of scientific journals.
In this sense, as Normand (2014) aptly described, behavior analysis has redefined psychology and redesigned
its experiments. As it has renamed and expanded the vocabulary of psychology, its scientific precision and
specialized lexicon may render dissemination of its research more challenging than that of other psychological
disciplines (Hineline, 1980). Nevertheless, interacting with mass media is an increasing practice within sciences
with comparable rigor and terminology, such as epidemiology and stem cell research (Peters et al., 2008).
If behavior analysts agree that disseminating a scientific explanation of human behavior that enables us to
address social challenges, such as climate change, effectively is a worthwhile endeavor, they are faced with two
options. They can bemoan the fact that popular culture disregards their views and thus perpetuate the isolation
specter, or they can adopt a proactive approach to remedy the situation by disseminating their findings more broadly.
Indeed, as Carr (1996, p. 263) has affirmed, “Until we make it clear that we too cherish society's highest values,
speak its language, and are sensitive to its political yearnings, we should expect to be ignored; and, we will be.”
Disseminating reliable data and effective interventions that address society’s challenges is a sound way to
gain cultural acceptance. Fortunately, we can climb the shoulders of prominent authors, whose advice is invaluable
in pursuing such an endeavor (Allen, Barone, & Kuhn, 1993; Critchfield, 2014; Freedman, 2015; Friman, 2014a;
Morris, 1985, 2014; Normand, 2014; Reed, 2014; Schlinger, 2014a; Smith, 2016; Todd, 2014; Vyse, 2014; Zarcone,
2015). The reason why Brazilian behavior analysts do not publish outside the box, however, does not lie primarily in
their unawareness of BA isolation, potential media, or dissemination strategies, but in the absence of contingencies
of reinforcement for dissemination. Given the publish-or-perish imperative (Waters, 2004), professors and
postgraduate students, who are in optimal position to disseminate their research, tend to focus on peer-reviewed
publications, i.e., inside the box.
In the spirit of Don Quixote, we could propose structural changes to academic practices that would promote
more universal dissemination. However, the authors believe there are three practical ways to attain this end within
direct reach of Brazilian behavior analysts. First, researchers from other disciplines should be invited more
BA OUTSIDE THE BOX 12
frequently to BA conferences, as is done in ABAI conferences. Second, discussion of BA isolation and
dissemination strategies should be included in postgraduate curricula. Third, course credits should be awarded for
such dissemination.
The present study indicates that there is ample room for disseminating behavior analysis in Brazil. The
authors strongly recommend that behavior analysts take a close look into contingencies of reinforcement that
promote dissemination and take advantage of the previously cited studies to initiate serious and sustained outreach
outside the box. Although this may prove to be an arduous task, it is clearly worth the effort and will undoubtedly
generate unforeseen dividends.
References
*An asterisk indicate references for the 13 examined behavior analysis publications.
Abbink, K. (2000). Fair salaries and the moral costs of corruption. Bonn Graduate School of Economics.
Agbota, T. K., Sandaker, I., & Ree, G. (2015). Verbal Operants of Corruption: A Study of Avoidance in Corruption
Behavior. Behavior and Social Issues, 24, 141. http://doi.org/10.5210/bsi.v24i0.5864
Allen, K. D., Barone, V. J., & Kuhn, B. R. (1993). A behavioral prescription for promoting applied behavior
analysis within pediatrics. Journal of Applied Behavior Analysis, 26(4), 493–502.
http://doi.org/10.1901/jaba.1993.26-493
Andery, M. A. P. A. (2012). Interview: Maria Amália Pie Abib Andery. Boletim Paradigma, 7, 21–27.
Armantier, O., & Boly, A. (2008). Can corruption be studied in the lab? Comparing a field and a lab experiment.
Comparing a Field and a Lab Experiment (September 1, 2008). CIRANO-Scientific Publications, (2008s-26).
Associação Brasileira de Análise do Comportamento - ACBr (July, 2016).
http://www.analisedocomportamento.org.br/
Associação Brasileira de Psicologia e Medicina Comportamental - ABPMC (July, 2016). http://www.abpmc.org.br/
Association for Behavior Analysis International - ABAI (July, 2016).
https://www.abainternational.org/welcome.aspx
Bailey, J. S. (1991). Marketing behavior analysis requires different talk. Journal of Applied Behavior Analysis,
24(3), 445–448. http://doi.org/10.1901/jaba.1991.24-445
*Balão, J. G. P. (2005, July). O inatismo da linguagem humana. Ciência Hoje, 37 (217), 81-83.
BA OUTSIDE THE BOX 13
Baum, W. (2000). Alive And Kicking: A Review Of Handbook Of Behaviorism, Edited By William O’Donohue
And Richard Kitchener. Journal of Applied Behavior Analysis, 33(2), 263–270.
http://doi.org/10.1901/jaba.2000.33-263
Becirevic, A. (2014). Ask the Experts: How Can New Students Defend Behavior Analysis from Misunderstandings?
Behavior Analysis in Practice, 7(2), 138–140. http://doi.org/10.1007/s40617-014-0019-y
Becirevic, A. (2015). The Experts Have Spoken!: A Reply to Four Commentaries. Behavior Analysis in Practice,
8(1), 113–113. http://doi.org/10.1007/s40617-014-0038-8
Behabior Analyst Certification Board - BACB (July, 2016). http://www.bacb.com/
Carr, E. G. (1996). The Transfiguration of Behavior Analysis : Strategies for Survival. Journal of Behavioral
Education, 6(3), 263–270.
*Castelo, C. (2012, November). Estímulo e resposta. Pesquisa Fapesp, 201, 90-91.
Catania, a C. (2008). The Journal of The Experimental Analysis of Behavior at Zero, Fifty, and One Hundred.
Journal of the Experimental Analysis of Behavior, 89(1), 111–118. http://doi.org/10.1901/jeab.2008.89-111
Chomsky, N. (1959). A review of B.F. Skinner Verbal Behavior. Language, 35(1), 26–58.
*Cirino, S. (2013, September). Por uma nova Psicologia. Ciência Hoje, 52 (307), 58-59.
Coleman, S. R., & Mehlman, S. E. (1992). An empirical update (1969-1989 ) of D. L. Krantz’s thesis that the
Experimental Analysis of Behavior is isolated. The Behavior Analyst, 15(1), 43–49.
Critchfield, T. S. (2014). Ten Rules for Discussing Behavior Analysis. Behavior Analysis in Practice, 7(2), 141–
142. http://doi.org/10.1007/s40617-014-0026-z
Cruz, R. N. da. (in press). A fundação do JEAB e o isolamento histórico da Análise do Comportamento: da
expansão ao isolamento. Psicologia: Teoria e Pesquisa.
Cruz, R. N. da, Strapasson, B. A., & Rebecca, P. (in press). O isolamento da Análise do Comportamento no Brasil:
uma análise bibliométrica. Psicologia: Reflexão e Crítica.
*Dal Ben, R. (2014, October). Limites da ciência [letter to the editor]. Ciência Hoje, 54 (319), 62.
Diller, J. W., Salters-Pedneault, K., & Gallagher, A. R. (2014). Effective Dissemination Requires Effective Talk: a
Comparison of Behavior-Analytic Journals. Behavior Analysis in Practice, 7, 103–106.
http://doi.org/10.1007/s40617-014-0020-5
Elliott, A. J., Morgan, K., Fuqua, R. W., Ehrhardt, K., & Poling, A. (2005). Self- and cross-citations in the Journal of
BA OUTSIDE THE BOX 14
Applied Behavior Analysis and the Journal of the Experimental Analysis of Behavior: 1993-2003. Journal of
Applied Behavior Analysis, 38(4), 559–563. http://doi.org/10.1901/jaba.2005.133-04
Fantino, E. (2008). Behavior Analysis: Thriving, But How About Its Future? Journal of the Experimental Analysis
of Behavior, 89(1), 125–127. http://doi.org/10.1901/jeab.2008.89-125
*FAPESP (2004a, May). Classics in the History of Psychology. Pesquisa Fapesp, 99, 24.
*FAPESP (2004b, November). Engajamento incansável. Pesquisa Fapesp, 105, 35.
*FAPESP (2007, June). Psicologia: Habilidades sociais. Pesquisa Fapesp, 136, 59.
Federação Brasileira de Psicanálise - FEBRAPSI (July, 2016). http://www.febrapsi.org.br/
Fernandes, D. M., & Pezzato, F. A. (2015). Creativity, Brazilian “jeitinho”, and cultural practices: A behavioral
analysis. Behavior Analysis: Research and Practice, 15(1), 28–35.
Foxx, R. M. (2008). Applied Behavior Analysis Treatment of Autism: The State of the Art. Child and Adolescent
Psychiatric Clinics of North America, 17(4), 821–834. http://doi.org/10.1016/j.chc.2008.06.007
Frank, B., & Schulze, G. G. (2000). Does economics make citizens corrupt? Journal of Economic Behavior &
Organization, 43(1), 101–113.
Freedman, D. H. (2015). Improving public perception of behavior analysis. The Behavior Analyst, 1–7.
http://doi.org/10.1007/s40614-015-0045-2
Friman, P. C. (2014a). Behavior Analysts to the Front! A 15-Step Tutorial on Public Speaking. The Behavior
Analyst, 37, 109–118. http://doi.org/10.1007/s40614-014-0009-y
Friman, P. C. (2014b). Publishing in Journals Outside the Box: Attaining Mainstream Prominence Requires
Demonstrations of Mainstream Relevance. The Behavior Analyst, 37, 73–76. http://doi.org/10.1007/s40614-
014-0014-1
Goldstein, M. K., & Pennypacker, H. S. (1998). From Candidate to Criminal: The Contingencies of Corruption in
Elected Public Office. Behavior and Social Issues, 8(1). http://doi.org/10.5210/bsi.v8i1.317
Grosch, J., & Neuringer, A. (1981). Self-control in pigeons under the Mischel paradigm. Journal of the
Experimental Analysis of Behavior, 35(1), 1333016. http://doi.org/10.1901/jeab.1981.35-3
Hayes, L. J., & Fryling, M. J. (2015). A Historical Perspective on the Future of Behavior Science. The Behavior
Analyst, 38(2), 149–161. http://doi.org/10.1007/s40614-015-0030-9
Hayward, D. W., Gale, C. M., & Eikeseth, S. (2009). Intensive behavioural intervention for young children with
BA OUTSIDE THE BOX 15
autism: A research-based service model. Research in Autism Spectrum Disorders, 3(3), 571–580.
http://doi.org/10.1016/j.rasd.2008.12.002
Hearst, E. (1967). The behavior of Skinnerians. Contemporary Psychology, 12, 402–404.
Herrnstein, R. . J. . (1987). Reminiscences already? Journal of the Experimental Analysis of Behavior, 48(3), 448–
453. http://doi.org/10.1901/jeab.1987.48-448
Hineline, P. (1980). The language of behavior analysis: Its Community, its functions, and its limitations.
Behaviorism, 8(1), 67–86. http://doi.org/10.2307/27758952
Hobbs, S., Cornwell, D., & Chiesa, M. (2010). Telling Tales About Behavior Analysis: Textbooks, Scholarship, and
Rumor. In J. C. Leslie & D. E. Blackman (Eds.), Experimental and applied analysis of human behavior (pp.
251–270). Context Press.
Holth, P. (2014). Introduction. European Journal of Behavior Analysis, 15(1), 7–10.
http://doi.org/10.1080/15021149.2014.11434468
Houaiss, A. (2008). Grande dicionário Houaiss da língua portuguesa. Rio de Janeiro: Objetiva.
Hursh, S. R., & Roma, P. G. (2013). Behavioral Economics and Empirical Public Policy. Journal of the
Experimental Analysis of Behavior, 99(1), 98–124. http://doi.org/10.1002/jeab.7
Ingvarsson, E. T., Cammilleri, A. P., & MacIas, H. (2012). Emergent listener responses following intraverbal
training in children with autism. Research in Autism Spectrum Disorders, 6(2), 654–664.
http://doi.org/10.1016/j.rasd.2011.09.009
Krantz, D. L. (1971). The separate worlds of operant and non-operant psychology1. Journal of Applied Behavior
Analysis, 4(1), 1310669. http://doi.org/10.1901/jaba.1971.4-61
Krantz, D. L. (1972). Schools and systems: The mutual isolation of operant and non-operant psychology as a case
study. Journal of the History of the Behavioral Sciences, 8(1), 86–102. http://doi.org/10.1002/1520-
6696(197201)8:1<86::AID-JHBS2300080104>3.0.CO;2-B
Laplanche, J. (2001). Vocabulário da psicanálise: Laplanche e Pontalis. (D. Lagache, Ed.) (4th ed.). São Paulo:
Martins Fontes.
Laties, V. G. (1987). Society for the Experimental Analysis of Behavior: The first thirty years (1957–1987). Journal
of the Experimental Analysis of Behavior, 48(3), 495–512. http://doi.org/10.1901/jeab.1987.48-495
Laties, V. G. (2008). The Journal of The Experimental Analysis of Behavior at Fifty. Journal of the Experimental
BA OUTSIDE THE BOX 16
Analysis of Behavior, 89(1), 95–109. http://doi.org/10.1901/jeab.2008.89-95
Lindsley, O. R. (1987). Collecting the first dollars for JEAB. Journal of the Experimental Analysis of Behavior,
48(3), 469–471. http://doi.org/10.1901/jeab.1987.48-469
Madden, G. J., Dube, W. V., Hackenberg, T. D., Hanley, G. P., & Lattal, K. A. (Eds.). (2013a). APA handbook of
behavior analysis, Vol. 1: Methods and principles. Washington: American Psychological Association.
http://doi.org/10.1037/13937-000
Madden, G. J., Dube, W. V., Hackenberg, T. D., Hanley, G. P., & Lattal, K. A. (Eds.). (2013b). APA handbook of
behavior analysis, Vol. 2: Translating principles into practice. Washington: American Psychological
Association. http://doi.org/10.1037/13938-000
Maple, T. L., & Segura, V. D. (2015). Advancing Behavior Analysis in Zoos and Aquariums. Behavior Analyst,
38(1), 77–91. http://doi.org/10.1007/s40614-014-0018-x
*Marques (2010, September). As redes na berlinda. Pesquisa Fapesp, 175, p. 30-35.
Matos, M. A. (1998). Contingências para a Análise Comportamental no Brasil. Psicologia USP, 9(1), 89–100.
http://doi.org/10.1590/S0103-65641998000100014
Matson, J. L., Tureck, K., Turygin, N., Beighley, J., & Rieske, R. (2012). Trends and topics in Early Intensive
Behavioral Interventions for toddlers with autism. Research in Autism Spectrum Disorders, 6(4), 1412–1417.
http://doi.org/10.1016/j.rasd.2012.02.010
McColloch, E. (2015). The 10 Best Pop-Culture Video Clips Demonstrating Behavioral Principles. Retrieved June
29, 2016, from http://www.bsci21.org/the-10-best-pop-culture-video-clips-demonstrating-behavioral-
principles/
McNamara, D. S., Louwerse, M. M., Cai, Z., & Graesser, A. (2013). Coh-Metrix vervession 3.0. Retrieved June 29,
2016, from www.cohmetrix.com
Michael, J. (1980). Flight From Behavior Analysis Presidential Address ABA 1980. The Behavior Analyst, 3(2), 1–
22.
Michel, J.-B., Shen, Y. K., Aiden, A. P., Veres, A., Gray, M. K., Pickett, J. P., … Aiden, E. L. (2011). Quantitative
analysis of culture using millions of digitized books. Science (New York, N.Y.), 331(6014), 176–82.
http://doi.org/10.1126/science.1199644
Mischel, W., Ebbesen, E. B., & Raskoff Zeiss, A. (1972). Cognitive and attentional mechanisms in delay of
BA OUTSIDE THE BOX 17
gratification. Journal of Personality and Social Psychology, 21(2), 204–218. http://doi.org/10.1037/h0032198
Morris, E. K. (1985). Public information, dissemination, and behavior analysis. The Behavior Analyst, 8(1), 95–110.
Retrieved from
http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2741776&tool=pmcentrez&rendertype=abstract
Morris, E. K. (2014). Stop Preaching to the Choir, Publish Outside the Box: A Discussion. The Behavior Analyst,
37, 87–94. http://doi.org/10.1007/s40614-014-0011-4
Normand, M. P. (2014). Opening Skinner’s Box: an Introduction. The Behavior Analyst, 37, 67–68.
http://doi.org/10.1007/s40614-014-0016-z
*Pessoti, I. (2003, July). Pavlov e o reflexo condicionado. Ciência Hoje, 33 (195), 86-87.
Peters, H. P., Brossard, D., de Cheveigné, S., Dunwoody, S., Kallfass, M., Miller, S., & Tsuchida, S. (2008). Science
communication. Interactions with the mass media. Science (New York, N.Y.), 321(July), 204–205.
http://doi.org/10.1126/science.1157780
Peters-Scheffer, N., Didden, R., Korzilius, H., & Sturmey, P. (2011). A meta-analytic study on the effectiveness of
comprehensive ABA-based early intervention programs for children with Autism Spectrum Disorders.
Research in Autism Spectrum Disorders, 5(1), 60–69. http://doi.org/10.1016/j.rasd.2010.03.011
Poling, A. (2010). Looking to the future: will behavior analysis survive and prosper? The Behavior Analyst, 33(1),
7–17. Retrieved from
http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2867507&tool=pmcentrez&rendertype=abstract
Poling, A., Alling, K., & Fuqua, R. W. (1994). Self- and cross-citations in the Journal of Applied Behavior Analysis
and the Journal of the Experimental Analysis of Behavior: 1983—1992. Journal of Applied Behavior Analysis,
27(4), 729–731. http://doi.org/10.1901/jaba.1994.27-729
Poling, A., Picker, M., Grossett, D., Hall-Johnson, E., & Holbrook, M. (1981). The schism between experimental
and applied behavior analysis: Is it real and who cares? 1. The Behavior Analyst, 4(2), 93–102.
Rachlin, H. (2009). The science of self-control. Cambridge: Harvard University Press.
Reed, D. D. (2014). Determining How, When, and Whether You Should Publish Outside the Box: Sober Advice for
Early Career Behavior Analysts. The Behavior Analyst, 37, 83–86. http://doi.org/10.1007/s40614-014-0012-3
Rivard, M., Terroux, A., & Mercier, C. (2014). Effectiveness of early behavioral intervention in public and
mainstream settings: The case of preschool-age children with autism spectrum disorders. Research in Autism
BA OUTSIDE THE BOX 18
Spectrum Disorders, 8(9), 1031–1043. http://doi.org/10.1016/j.rasd.2014.05.010
Rodrigues, M. E. (2006). Behaviorismo: Discordâncias, Conceitos e preconceitos. Educere et Educare, 1(2), 141–
164.
Roediger, H. L. (2004). What Happened to Behaviorism. APS Observer, 19(3).
Rutherford, A. (2009). Beyond the box: B. F. Skinner’s technology of behavior from laboratoryto life, 1950-1970s.
Toronto: University of Toronto Press.
Schlinger, H. D. (2014a). Publishing Outside the Box: Unforeseen Dividends of Talking to Strangers. The Behavior
Analyst, 37, 77–81. http://doi.org/10.1007/s40614-014-0010-5
Schlinger, H. D. (2014b). Training Graduate Students to Effectively Disseminate Behavior Analysis and to Counter
Misrepresentations. Behavior Analysis in Practice, 110–112. http://doi.org/10.1007/s40617-014-0028-x
Skinner, B. F. (1938). The behavior of organisms. New York: Appleton-Century-Crofts.
Skinner, B. F. (1957). Verbal behavior. East Norwalk, CT, US: Appleton-Century-Crofts.
http://doi.org/10.1037/11256-000
Skinner, B. F. (1987). Reminiscences of Jeab. Journal of the Experimental Analysis of Behavior, 48(3), 447–493.
http://doi.org/10.1901/jeab.1987.48-447
Smith, J. M. (2016). Strategies to Position Behavior Analysis as the Contemporary Science of What Works in
Behavior Change. The Behavior Analyst, 39(1), 75–87. http://doi.org/10.1007/s40614-015-0044-3
*Szczesniak, K. (2004, August). Palavras-relâmpago. Ciência Hoje, 35 (207), 16-20.
*Szczesniak, K. (2007, December). Revolução na linguística. Ciência Hoje, 41 (244), 84-86.
Teixeira Junior, R. R., & Souza, M. A. O. de. (2006). Vocabulário de Análise do Comportamento: manual de
consulta para termos usados na área (1st ed.). Santo André: ESETec Editores Associados.
Thaler, R. H., & Sunstein, C. R. (2009). Nudge: Improving decisions about health, wealth, and happiness. New
York: Penguin Group.
Todd, J. T. (2014). Some Useful Resources for Students Who Are Tempted to Bring Enlightenment to Errant Non-
Behaviorists. Behavior Analysis in Practice, 7(2), 143–144. http://doi.org/10.1007/s40617-014-0027-y
Todd, J. T., & Morris, E. K. (1983). Misconception and miseducation: Presentations of radical behaviorism in
psychology textbooks. The Behavior Analyst / MABA, 6(2), 153–60. Retrieved from
http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2741965&tool=pmcentrez&rendertype=abstract
BA OUTSIDE THE BOX 19
Todorov, J. C., & Hanna, E. S. (2010). Análise do comportamento no Brasil. Psicologia: Teoria E Pesquisa,
26(spe), 143–153. http://doi.org/10.1590/S0102-37722010000500013
Virués-Ortega, J. (2010). Applied behavior analytic intervention for autism in early childhood: Meta-analysis, meta-
regression and dose–response meta-analysis of multiple outcomes. Clinical Psychology Review, 30(4), 387–
399. http://doi.org/10.1016/j.cpr.2010.01.008
Virues-Ortega, J., Hurtado-Parrado, C., Cox, A. D., & Pear, J. J. (2014). Analysis of the interaction between
experimental and applied behavior analysis. Journal of Applied Behavior Analysis, 47(2), 380–403.
http://doi.org/10.1002/jaba.124
Vyse, S. (2013). Changing Course. The Behavior Analyst, 36(1), 119–131.
Vyse, S. (2014). Publishing Outside the Box: Popular Press Books. The Behavior Analyst, 37, 69–72.
http://doi.org/10.1007/s40614-014-0013-2
Waters, L. (2004). Enemies of promise: Publishing, perishing, and the eclipse of scholarship. Chicago: Prickly
Paradigm.
Watson, J. B. (1913). Psychology as the behaviorist views it. Psychological Review, 20(2), 158–177.
http://doi.org/10.1037/h0074428
Wendt, G. R. (1949). The Development of a Psychological Cult. American Psychologist, 4(10), 426–426.
http://doi.org/10.1037/h0058923
Zarcone, J. (2015). Ask the Experts: Answer to: How Can New Students Defend Behavior Analysis from
Misunderstandings? Behavior Analysis in Practice, 8(1), 109–109. http://doi.org/10.1007/s40617-014-0037-9
*Zolnerkevic, I. (2013, April). Doce aprendizado. Pesquisa Fapesp, 206, 53-55.
*Zorzetto, R. (2013, March). As muitas faces da obsessão. Pesquisa Fapesp, 205, 18-25.
BA OUTSIDE THE BOX 20
Figure 1. Occurrences of Psychoanalysis and Behavior Analysis terms on Science Today (ST) and Research Fapesp
(RF).
Figure 2. Percentage disciplines and sections that where found the occurrences on Science Today and Research
Fapesp.
98
52
7
6
0
20
40
60
80
100
2003 2005 2007 2009 2011 2013
Ocurrences (n)
Year
Psychoanalysis - RF
Psychoanalysis - ST
Behavior Analysis - RF
Behavior Analysis - ST
0
10
20
30
40
50
60
%
Disciplines
Psychoanalysis
Behavior Analysis
