ArticlePDF Available

Scientific Observation Is Socio-Materially Augmented Perception: Toward a Participatory Realism

MDPI
Philosophies
Authors:

Abstract and Figures

There is an overlooked similarity between three classic accounts of the conditions of object experience from three distinct disciplines. (1) Sociology: the “inversion” that accompanies discovery in the natural sciences, as local causes of effects are reattributed to an observed object. (2) Psychology: the “externalization” that accompanies mastery of a visual–tactile sensory substitution interface, as tactile sensations of the proximal interface are transformed into vision-like experience of a distal object. (3) Biology: the “projection” that brings forth an animal’s Umwelt, as impressions on its body’s sensory surfaces are reconfigured into perception of an external object. This similarity between the effects of scientific practice and interface-use on the one hand, and of sensorimotor interaction on the other, becomes intelligible once we accept that skillful engagement with instruments and interfaces constitutes a socio-material augmentation of our basic perceptual capacity. This enactive interpretation stands in contrast to anti-realism about science associated with constructivist interpretations of these three phenomena, which are motivated by viewing them as the internal mental construction of the experienced object. Instead, it favors a participatory realism: the sensorimotor basis of perceptual experience loops not only through our body, but also through the external world. This allows us to conceive of object experience in relational terms, i.e., as one or more subjects directly engaging with the world. Consequently, we can appreciate scientific observation in its full complexity: it is a socio-materially augmented process of becoming acquainted with the observed object that—like tool-use and perceiving more generally—is irreducibly self, other-, and world-involving.
This content is subject to copyright.


Citation: Froese, T. Scientific
Observation Is Socio-Materially
Augmented Perception: Toward a
Participatory Realism. Philosophies
2022,7, 37. https://doi.org/
10.3390/philosophies7020037
Academic Editors:
Gordana Dodig-Crnkovic and Marcin
J. Schroeder
Received: 28 February 2022
Accepted: 29 March 2022
Published: 30 March 2022
Publisher’s Note: MDPI stays neutral
with regard to jurisdictional claims in
published maps and institutional affil-
iations.
Copyright: © 2022 by the author.
Licensee MDPI, Basel, Switzerland.
This article is an open access article
distributed under the terms and
conditions of the Creative Commons
Attribution (CC BY) license (https://
creativecommons.org/licenses/by/
4.0/).
philosophies
Essay
Scientific Observation Is Socio-Materially Augmented
Perception: Toward a Participatory Realism
Tom Froese
Embodied Cognitive Science Unit, Okinawa Institute of Science and Technology Graduate University,
1919-1 Tancha, Onna 904-0495, Okinawa, Japan; tom.froese@oist.jp
Abstract:
There is an overlooked similarity between three classic accounts of the conditions of object
experience from three distinct disciplines. (1) Sociology: the “inversion” that accompanies discovery
in the natural sciences, as local causes of effects are reattributed to an observed object.
(2) Psychology
:
the “externalization” that accompanies mastery of a visual–tactile sensory substitution interface, as
tactile sensations of the proximal interface are transformed into vision-like experience of a distal
object. (3) Biology: the “projection” that brings forth an animal’s Umwelt, as impressions on its
body’s sensory surfaces are reconfigured into perception of an external object. This similarity
between the effects of scientific practice and interface-use on the one hand, and of sensorimotor
interaction on the other, becomes intelligible once we accept that skillful engagement with instruments
and interfaces constitutes a socio-material augmentation of our basic perceptual capacity. This
enactive interpretation stands in contrast to anti-realism about science associated with constructivist
interpretations of these three phenomena, which are motivated by viewing them as the internal mental
construction of the experienced object. Instead, it favors a participatory realism: the sensorimotor
basis of perceptual experience loops not only through our body, but also through the external world.
This allows us to conceive of object experience in relational terms, i.e., as one or more subjects directly
engaging with the world. Consequently, we can appreciate scientific observation in its full complexity:
it is a socio-materially augmented process of becoming acquainted with the observed object that—like
tool-use and perceiving more generally—is irreducibly self, other-, and world-involving.
Keywords:
mind–body problem; sensory substitution; direct perception; enactive cognition; tool-use;
fact–value gap; philosophy of mind; cognitive science; philosophy of science; consciousness
I would just like to leave you with this reminder: when we adopt a paradigm in cognitive
science, we enact a shared world—and enact ourselves into the bargain.
John Stewart (1942–2021)
1. Introduction
In this essay, I pay homage to John Stewart’s contributions to the philosophy of science,
by tracing the subject–object relationship through his interdisciplinary reflections. Stewart
was fond of provocatively claiming that a value-neutral science would be without value
(for a recent statement, see [
1
]). Even the production of mere instrumental value, such as
technological gimmicks, would not be enough. Science should aspire to be an intellectual
authority that provides guidance as to the layout of reality and affords inspiration for the
future of humanity. Striving for these deeper values means that, ultimately, we cannot
ignore the most foundational problem of all: how do we, ourselves, as we subjectively live
our own existence, fit into this scientific worldview [2]?
In modern science there is little, if any, room for subjectivity in the material universe.
In particular, advances in biology and neuroscience are highlighting tensions with our lived
experience, including undermining our otherwise recognized status of being persons who
act for reasons [
3
]. However, if a scientific worldview were to eliminate our subjectivity
from reality, like a naïve realism that only assigns reality to objects fully describable by
Philosophies 2022,7, 37. https://doi.org/10.3390/philosophies7020037 https://www.mdpi.com/journal/philosophies
Philosophies 2022,7, 37 2 of 13
physics, it would have the self-defeating consequence that there can be nothing rational
about that scientific enterprise! This is because, like the human lifeworld more generally,
science depends essentially on our capacity for consciousness—to perceive the world
and to collectively reason to decisions accordingly. However, in much of science, there
is little recognition of the importance of this foundational problem, i.e., that we still do
not understand how subjects and objects can meaningfully coexist, such that our lived
mental life as such can make a difference in the objective world, and vice versa. Without
substantial progress on this core problem, we are faced by a failure of science to understand
the conditions of its own possibility. In other words, the stakes are high, both scientifically
and existentially.
In response to this situation, this essay aims to motivate an alternative position to
naïve realism in the philosophy of science, namely, by assigning a constitutive role to the
observing subject, but without thereby falling into the opposite extreme of an agnostic or
even anti-realist stance. It aims to overcome the traditional dispute between this kind of
anti-realism and realism by developing a middle ground—a kind of participatory realism,
which is a realism that is both subject- and world-involving.
2. A Stalemate in the Philosophy of Science
Two major approaches in the philosophy of science, which we will refer to as objec-
tivism and constructivism following Stewart’s analysis [
4
], have been in a long-standing
stalemate regarding how to best conceive the subject–object relationship. Worse, when their
assumptions are unpacked and pushed to their logical extremes, each approach turns out
to have drawbacks that make them less than ideal for scientific worldviews.
Objectivism aims to explain our experience of reality in completely observer-independent
terms. However, if the subjectivity of the observer continues to be left out of the natural
order—e.g., by being identified with just another objective mechanism, or even eliminated
completely—we give up the essentially subjective quality of our own existence too soon.
There should also be room in the natural world for human subjects who can make a
difference to unfolding events based on their normative evaluations, and who can hence be
held accountable for their actions and decisions. This is especially evident if we do not want
science to be in tension with practices of responsible decision making, be they in politics,
daily life, or even in science itself [
1
]. Granted, we may never completely understand the
basis of our own agency, or fully solve the mind–body problem, but it is also important
to note that an acceptance of the possible limits of our scientific understanding is not the
source of this tension with lived experience. What we need to avoid is objectivism’s overly
narrow conception of reality, i.e., a naturalism that excludes subjectivity by definition, and
which thereby already rules out in principle the mere possibility of a subject being able to
make a difference in their own right [5,6].
Constructivism aims to explain our experience of reality in completely observer-
dependent terms [
7
]. However, if a place for subjectivity in naturalism is bought at the
expense of the notion of objectivity, such that it can no longer transcend the domain of
our experience, we go too far to the other extreme and undermine science in a different
way. It becomes hard to explain why science advances the way it does, why there is a
difference between facts and opinions, why there can be broad consensus about scientific
knowledge among people with diverse personal and cultural backgrounds, and why scien-
tific knowledge translates into technology that works [
8
]. Constructivism, especially in its
“radical” constructivist formulations, does grant that not everything goes, and that there are
observer-independent constraints, yet it remains agnostic about these constraints, nor does
it allow that our lived experience can be directly constituted or shaped by the world or by
other people [
9
]. However, if we do not make conceptual space for non-subjective reality to
be part of the basis of our experience even in principle, we give up on the hard problem of
consciousness prematurely [
10
]. More disturbingly, we would place an insurmountable gap
between the reality our own stream of consciousness—ourselves—and the reality of others
and of the world. Again, granted, we may never completely understand the nature and
Philosophies 2022,7, 37 3 of 13
boundaries of consciousness, but this relative ignorance should not impel us to accept an
overly narrow conception of subjectivity that ignores the possibility of a world-involving
basis of subjective experience; this would be in direct tension with our everyday experience
that we can engage with objects (and, more importantly, other people!) that exist beyond
our personal experience of them.
In sum, despite the starkly opposing orientations of these two approaches regarding
the relationship between subject and world, they share some deeper undesirable premises
and implications. Each in their own way fails to do justice to the full complexities of our
lived experience of reality—namely, of being conscious subjects embodied in an objective
world. In essence, while objectivism rejects the possibility that subjectivity plays a role
in the observer-independent world, radical constructivism leaves out the possibility that
the observer-independent world plays a role in subjectivity. These approaches thereby
promote two distinct one-sided pictures of reality, each with its own theoretical blind
spots. Ultimately, their schism prevents them from better grappling with the complex
entanglements of natural and human factors that are inherent in reality, and hence makes
them unsuitable perspectives for making substantial progress in science.
It is helpful to think of these impoverished visions of reality as two sides of the same
old Cartesian dualist coin; they are symptoms arising from the same scientifically unre-
solved mind–matter problem [
11
]. Objectivism tries to overcome that substance dualism by
reducing everything to observer-independent matter, while constructivism tries to overcome
that substance dualism by reducing everything to the observer-dependent mind; and yet,
each side cannot fully reduce the other into itself: objectivism must always access the
world from an observer-dependent perspective, while constructivism must always appeal
to observer-independent constraints.
Given this shared diagnosis of philosophical ashes of a failed dualism, I propose that
we need to step outside of the original dualist binary trap altogether. We need to search for
an alternative starting point from which to develop a scientific account that respects the
existence of both human subjectivity and worldly objectivity, whereby they are irreducibly
and meaningfully related to one another, jointly participating in shaping reality. In the
following I will offer some steps in this direction.
I propose that a fruitful path toward this alternative starting point is to address the
unresolved mind–matter dualism indirectly—namely, by way of overcoming its contempo-
rary, metaphysically sanitized heir: cognitivist internalism. Descartes famously thought
the linkage between the conscious mind and physical matter was to be found inside the
brain, and this localization is still the default assumption for the majority of cognitive
scientists today. Both objectivism and constructivism—each in its own way—also assume
that the basis of experience is restricted to the inside of the brain/subject. It is this premise
of internalism regarding the basis of our experience that motivates objectivism’s ideal to
recover an external universe that is in itself observer-independent, just as it motivates
constructivism’s insistence that this is an impossible ideal, given that we could never step
outside of the internal to confirm whether it matches the external; but what if the core of the
mind–body problem, dating back to the origins of modern science, is the expulsion of the
mind from the “external” world into a hidden “internal” realm? What if the basis of mind,
and of perceptual experience more specifically, is actually relational and world-involving?
The rest of cognitive science has been developing more inclusive alternatives, com-
monly known as radical embodied or enactive cognition (e.g., [
12
16
]). From the per-
spective of these theoretical advances, the subject’s living body is necessary—but not
sufficient—for experience, and the environment plays a necessary role as well. This leads
to a rejection of brain-centrism in cognitive science, and to the adoption of a more en-
compassing framework, which treats an agent’s behavior as a relational property of the
agent’s brain–body–environment system as a whole [
17
]. The rejection of internalism also
breaks down the oversimplified separation between observer-dependence and observer-
independence, as the mind is instead treated as a regulated form of organism–environment
Philosophies 2022,7, 37 4 of 13
interaction, such that the world itself can make a difference to our experience [
18
], and our
experience can make a difference to the world [5].
3. Three Case Studies of Object Experience
The beginnings of a philosophy of science that seeks to go beyond these classic oppo-
sitions can be found in Stewart’s contributions to enactive cognitive science (e.g.,
[6,19]
),
which centers on the idea that the mind is realized by embodied interaction in the world.
Varela had started to develop this new approach, following on from his more constructivist
work with Maturana, with a radical guiding vision: “to the extent that we move from
an abstract to a fully embodied view of knowledge, facts and values become inseparable
([
20
], p. 260). In other words, the stated ambition of the enactive approach is to overcome
the fact–value gap—which has haunted modernist intellectual life at least since the work
of David Hume [
21
]—while similarly avoiding the collapse of the fact–value distinction
altogether, as has occasionally happened in constructivist or postmodern discourse.
However, we can also see in Varela a lingering bias for the internal over the external,
as he continues: “To know is to evaluate through our living, in a creative circularity”
([
20
], p. 260). Much will hang on precisely where the boundaries of “our living” are
conceived, especially since Maturana and Varela had traditionally identified the boundary
of an autopoietic system with its material surface [
22
]. If so, then brain-centrism would be
extended into an organism-centrism, but nonetheless it would stop short of extending into
the world and, hence, would remain a form of internalism. Indeed, there has been sufficient
ambiguity on this point that some critics have attributed an internalist/subjectivist stance
to this line of work [
23
25
]. More recently, proponents of the enactive approach have
started to spell out in what sense this is better understood as a world-involving account,
e.g., [
3
,
26
28
], and this conceptual clarification has gone hand in hand with a fruitful
encounter with the concept of direct realism, as developed by some branches of analytic
philosophy and by ecological psychology, e.g., [29,30].
Stewart’s philosophy of science defends a stance that “is neither ‘internalist,’ nor
‘externalist,’ but rather seeks to go beyond the opposition between them” ([
19
], p. 18).
Indeed, this ambition to go beyond the internalism/externalism dichotomy is one of the
key motivations for why the enactive approach adopted phenomenological philosophy
as an alternative to radical constructivist philosophy [
31
,
32
], and without this dichotomy,
nothing stands in the way of the natural world itself participating in the process by which an
object shows up in our perceptual experience and, by extension, in scientific observation. In
this way, clarifying that perception is world-involving is of broader relevance, as it pertains
to how we should understand the scientific process, including our interactions with other
people. Indeed, Varela had long emphasized that it is more accurate to explicitly refer to
an observer community rather than an observer [
33
], and as Stewart liked to highlight,
cognitive science is inherently reflexive, as we are scientific observers investigating the basis
of observation; therefore, a change in paradigm in this field has implications for science
as a whole, e.g., [
4
]. In order to make these reflections more concrete, in the following I
will develop this notion of world-involvement as it pertains to our experience of objects in
terms of three of Stewart’s favorite conceptual “hobby-horses” [34].
3.1. Latours Concept of Inversion
Latour and Woolgar’s [
35
] classic sociological and ethnographic study of modern
laboratory life found that the problem faced by scientists is that “at the frontier of science,
statements are constantly manifesting a double potential: they are either accounted for
in terms of local causes (subjectivity or artefact) or are referred to as a thing ‘out there’
(objectivity and fact)” (p. 180). Accordingly, they investigated the process of scientific
discovery, during which the double potential of a statement becomes stabilized into a fact:
“Once the statement begins to stabilise, however, an important change takes place.
The statement becomes a split entity. On the one hand, it is a set of words which
represents a statement about an object. On the other hand, it corresponds to an
Philosophies 2022,7, 37 5 of 13
object in itself which takes on a life of its own. [
. . .
] Consequently, an inversion
takes place: the object becomes the reason why the statement was formulated in
the first place. [
. . .
] Once splitting and inversion have occurred, even the most
cynical observers and committed relativists will have difficulty in resisting that
the “real” [object] has been found [ . . . ].”
([35], pp. 176–177)
However, Latour and Woolgar’s aim is precisely to provide a constructivist position
that resists such appeals to reality. A key contribution of their research is to highlight the
role of socio-material practices in the scientific creation of facts. They make it evident that
facts are the product of a complex process in the lab. However, they emphasize this role
of the socio-material practices to the extent that they end up provocatively concluding
that factual statements match external objects because “they are the same thing”. Latour
and Woolgar realize that this threatens to collapse the objective into the subjective, and
they hasten to clarify that they reject a simple relativist position, and do not wish to say
“that facts do not exist nor that there is no such thing as reality” (ibid., p. 180). Their main
point is, rather, that a scientific object’s appearance of “‘out-there-ness’ is the consequence of
scientific work rather than its cause (ibid., p. 182). As such, their primary aim is to account
for an experiential change during the process of scientific discovery.
It is an important insight that scientific work can change our perception of the world,
and that this process is itself amenable to scientific investigation. However, we do not
need to fully subscribe to their interpretation. A more reasonable interpretation of the
socio-material conditions necessary for the appearance of “out-there-ness”, in combination
with their concession that facts and reality may exist after all, is that scientific access to
objects does not come for free; when science makes contact with aspects of reality outside
of our everyday spatiotemporal scales, this is a complex achievement that requires both
mastery and the use of the appropriate concepts and equipment. Both the subjective and
objective aspects of scientific activity have to come together in just the right ways such that
a statement about the world can become recognized as a fact by the observer community.
However, Latour and Woolgar insist on a more extreme interpretation, as they advise
that “it is important to eschew arguments about the external reality and outside efficacy
of scientific products to account for the stabilization of facts” (p. 183). This kind of
bracketing may be a useful ethnographic technique if one’s aim is to reveal the socio-
material conditions of scientific discovery, but Latour and Woolgar take it too far, and
thereby end up with a one-sided account. This prevents them from recognizing that
rightfully granting a more prominent role to the “local causes” they identified does not
require excluding the world itself from contributing to the establishment of a sense of
reality “out there”.
In addition, they appeal to the fragility of facts to defend their rejection of such a
world-involving account of scientific discovery, but it does not follow from the possibility
that statements can be mistaken that facts cannot be world-involving. On the contrary, the
fallibility of statements is an essential part of science’s capacity for self-correction, which
arguably improves its grip on the world and, hence, increases its world-involvement.
Interestingly, Latour and Woolgar’s skeptical argument from the fragility of scientific
facts has the same form as the classic “argument from illusion” against direct realism in the
philosophy of perception. In response to the latter, we can similarly reject its unjustified
attempt at a generalization of fallibility: that we sometimes do misperceive does not
entail that perception is never world-involving [
28
]. Conversely, the similarity of these
arguments suggests a comparable similarity between observation and perception; scientific
observation could then be fruitfully conceived as a socio-material augmentation of the basic
perceptual process, rather than only as a socio-material construct.
The development of this conceptual connection could have already occurred in the
context of Stewart’s work, but unfortunately it remained a latent potential and, hence, is
important future work for the enactive approach. Stewart’s [
36
] brief reply to Beaton’s [
30
]
world-involving account of the sensorimotor basis of perceptual experience only rehashes
Philosophies 2022,7, 37 6 of 13
Latour and Woolgar’s classic constructivist account of the scientific processes. He thereby
misses the opportunity to confront the internalist assumptions of that constructivist ac-
count with Beaton’s world-involving proposal, which is actually quite similar in spirit
to Stewart’s [
19
] own call to go beyond the opposition between internalism and exter-
nalism. Stewart and Beaton both reject the postulation of internal constructs as the sole
basis of perceived reality, in favor of basing perception directly in distributed organism–
environment interaction. Accordingly, we still need to better articulate the consequences of
this enactive, world-involving account of perception for our understanding of the scientific
process. A step in the right direction is to reconsider the role of technology in perception in
a world-involving way.
3.2. Bach-y-Rita’s Concept of Externalization
It will be useful to further bring out this latent connection between scientific observa-
tion and perceptual experience by considering an intermediate case, namely, the way in
which tool-use generally tends to shape the user’s perceptual experience, as particularly
exemplified by sensory substitution devices. Importantly for our comparison with scientific
observation, the Compiegne group, of which Stewart was a part, has long argued that such
interfaces perform the role of “perceptual supplementation” rather than “sensory substi-
tution” [
37
], and that this makes them illustrative of a broader class of “mind-enhancing”
tools [
38
], including pen and paper, sketchpads, or calculators [
39
]. Thus, we have not
moved far from the kind of scientific activity analyzed by Latour.
Sensory substitution devices were first studied by Bach-y-Rita et al. [
40
] using the
Tactile Vision Substitution System, which translated an array of black/white pixels obtained
from a camera into an array of on/off vibratory actuators placed on their back. They found
that a user’s mastery of this device gives rise to perceptual experience, whereby the local
causes of sensory stimuli are externalized to distal objects:
“Our subjects spontaneously report the external localization of stimuli, in that sen-
sory information seems to come from in front of the camera, rather than from the
vibrotactors on their back. Thus, after sufficient experience, the use of the vision
substitution system seems to become an extension of the sensory apparatus.”
([40], p. 964)
This account of the externalization of local stimuli is strikingly similar to Latour
and Woolgar’s account of scientific observation as involving splitting and inversion. It
is suggestive of the possibility that scientific instrumentation may similarly become an
extension of our perceptual processes. Indeed, for Stewart [
10
], the value of sensory
substitution devices is precisely that they can be used as a scientific instrument—one that
enables us to examine the embodied sensorimotor dynamics involved in perceiving, and
to do so under minimalist conditions (see, e.g., Figure 1), thereby allowing us to make an
informative comparison with the sensorimotor activity of simpler creatures, such as the
tick (more on this below).
For the moment, let us consider in more detail Bach-y-Rita’s pioneering research with
the Tactile Vision Substitution System, which for the Compiegne group provided two
fundamental results that inspired their own research program:
“(i) If the camera is immobile, placed on a table, the discriminatory capacities of
the subjects remain very limited; and the stimuli are perceived on the surface of
the skin.
(ii) If the camera is actively manipulated by the subject, the subjects exhibit
spectacular capacities to recognize shapes; and the objects are perceived in a
distal space, “out there” in front of the subject.”
([31], p. 941)
Philosophies 2022,7, 37 7 of 13
Philosophies 2022, 7, x FOR PEER REVIEW 7 of 13
Figure 1. The augmented sensorimotor relation of perception spans the organism, coupling devices,
and the environment. The coupling device could be any kind of tool, but the extension of perceptual
experience becomes more marked with the skilled use of mind-enhancing tools, including sensory
substitution devices and the advanced instrumentation used in scientific observation. Figure re-
drawn from Lenay and Steiner [31].
For the moment, let us consider in more detail Bach-y-Rita’s pioneering research with
the Tactile Vision Substitution System, which for the Compiegne group provided two fun-
damental results that inspired their own research program:
“(i) If the camera is immobile, placed on a table, the discriminatory capacities of
the subjects remain very limited; and the stimuli are perceived on the surface of
the skin.
(ii) If the camera is actively manipulated by the subject, the subjects exhibit spec-
tacular capacities to recognize shapes; and the objects are perceived in a distal
space, “out there” in front of the subject.([31], p. 941)
This phenomenon of externalization or distal attribution to something “out there”
has been systematically studied, and can occur even when observers do not have any prior
knowledge of the link between their actions with the device and the resulting variations
of stimulations [41]. Accordingly, like Latour and Woolgar’s analysis of the discovery of
a previously unknown scientific object, we find that in the case of using a sensory substi-
tution interface there are local/subjective aspects that, under suitable conditions, give rise
to the experience of an outer/objective entity. Crucially, this distal attribution does not
come for free; for a distal object to be perceived as such requires the subjects acquisition
and active deployment of user expertise:
“During the initial phase when the device is first employed, the attention of the
user is drawn to the tactile stimuli on the skin. In fact, as long as the stimuli are
controlled by the experimenter, the user remains unable to detach his attention
from the stimuli. However, if the user himself is able to move the camera, then
progressively, after 10–15 h of practice, he comes to perceive objects situated at
a distance in front of him. At this point, there is a clear distinction for the subject
between the tactile stimuli (which are sometimes a source of irritation) on one
hand, and on the other the perception of an object out there in front of him.”
([31], p. 941)
A comparison with Latours own status as a novice in the lab, and as someone who
insisted on remaining a detached observer, is instructive. Latour was thus in the classic
position of the ethnographer sent to a completely foreign environment ([35], p. 273). As
Lynch ([42], p. 503) has argued, Latour’s approach will “sever the transivity of technical
practices to their real-world objects of study”; hence, we can understand why for Latour
it seemed that “a scientist’s activity is directed, not toward ‘reality,’ but toward these op-
erations on statements. ([35], p. 273). In fact, the expert scientists also had this response
to his apprenticeship. With respect to his difficulty with understanding reports, “they ar-
gued that the observer was baffled because of his obsessive interest in literature had
Figure 1.
The augmented sensorimotor relation of perception spans the organism, coupling devices,
and the environment. The coupling device could be any kind of tool, but the extension of perceptual
experience becomes more marked with the skilled use of mind-enhancing tools, including sensory
substitution devices and the advanced instrumentation used in scientific observation. Figure redrawn
from Lenay and Steiner [31].
This phenomenon of externalization or distal attribution to something “out there” has
been systematically studied, and can occur even when observers do not have any prior
knowledge of the link between their actions with the device and the resulting variations of
stimulations [
41
]. Accordingly, like Latour and Woolgar’s analysis of the discovery of a
previously unknown scientific object, we find that in the case of using a sensory substitution
interface there are local/subjective aspects that, under suitable conditions, give rise to the
experience of an outer/objective entity. Crucially, this distal attribution does not come for
free; for a distal object to be perceived as such requires the subject’s acquisition and active
deployment of user expertise:
“During the initial phase when the device is first employed, the attention of the
user is drawn to the tactile stimuli on the skin. In fact, as long as the stimuli are
controlled by the experimenter, the user remains unable to detach his attention
from the stimuli. However, if the user himself is able to move the camera, then
progressively, after 10–15 h of practice, he comes to perceive objects situated at a
distance in front of him. At this point, there is a clear distinction for the subject
between the tactile stimuli (which are sometimes a source of irritation) on one
hand, and on the other the perception of an object out there in front of him.”
([31], p. 941)
A comparison with Latour’s own status as a novice in the lab, and as someone who
insisted on remaining a detached observer, is instructive. Latour “was thus in the classic
position of the ethnographer sent to a completely foreign environment” ([
35
], p. 273). As
Lynch ([
42
], p. 503) has argued, Latour’s approach will “sever the transivity of technical
practices to their real-world objects of study”; hence, we can understand why for Latour
it seemed that “a scientist’s activity is directed, not toward ‘reality,’ but toward these
operations on statements.” ([
35
], p. 273). In fact, the expert scientists also had this response
to his apprenticeship. With respect to his difficulty with understanding reports, “they
argued that the observer was baffled because of his obsessive interest in literature had
blinded him to the real importance of the papers: only by abandoning his interest in the
papers themselves could the observer grasp the ‘true meaning’ of the ‘facts’ which the
paper contained.” (ibid., p. 75). The same consideration of the need for transparency
regarding the basis of experience applies to the use of lab equipment: “The material setting
both makes possible the phenomenon and is required to be easily forgotten” (ibid., p. 69).
In analogy with the sensory substitution case, if the user is intent on focusing on the
local stimulations produced by the interface in a detached manner, and/or puts the control
of the interface into the hands of the experimenter, then from the perspective of that naïve
Philosophies 2022,7, 37 8 of 13
user the proximal device will not become transparent, and the distal object will fail to
become present in experience. In general, what is required for object perception to occur
is that the subject is skillfully engaged in a world-directed interaction. This perceptual
process can be supported in various ways, and sensory substitution devices serve as an
illustrative example of the role that tools—and our socio-material practices in general—can
play in shaping how subject and object relate to one another. Lenay et al. also point to the
importance of a user community in constituting a meaningful perceptual experience when
using such devices [
43
], similar to the role of an observer community in science. In this
way, we again start to see that the discovery process identified by Latour and Woolgar may
be a variation of the externalization process identified by Bach-y-Rita et al. Ultimately, both
are forms of socio-materially augmented perception.
3.3. Von Uexküll’s Concept of Projection
If the preceding analysis is on the right track, then we are close to securing the
foundations of an account of science that does justice to both subject and object. Scientific
observation is a socio-materially augmented form of object perception, yet for this to be a
solid account, more conceptual work still must be done to fully stabilize the foundations,
meaning to clarify the world-involving basis of perception.
As we have already discussed, despite the fact that the enactive approach has always
emphasized the importance of organism–environment interaction, when it comes to a
detailed explanation of the perceptual process, emphasis has typically been placed on the
side of the organism [
44
]. To be fair, the basis of perception is no longer said to be within
the brain, but it is often not quite clear how far the basis extends instead. Often it seems as
if the basis has only extended to the outer boundary of the body, such that what matters to
perception is the internal constitution of the organism—and especially the input–output
pattern that plays across its sensorimotor surface. We can see this ambiguity in Stewart’s
work when he claims that “what the world ‘is’ for the organism amounts to neither more
nor less than the consequences of its actions for its sensory inputs; this, in turn, clearly
depends on the repertoire of possible actions.” ([
45
], p. 3). The basis of perception certainly
includes changes in sensory organs, but if it only includes those changes then it cannot
be world-involving in any meaningful sense. It is possible that Stewart inherited this
ambiguity regarding the status of the lived world from von Uexküll’s [
46
] classic analysis
of the sensorimotor basis of the Umwelt. One of his favorite examples was the tick:
“Here is the story. The female tick climbs to the end of a branch, and
. . .
waits.
If she gets a whiff of butyric acid, she lets herself fall; if she does not fall onto
a hairy surface, she climbs up again onto a branch and starts over. If she does
fall onto a hairy surface, she crawls until she finds a smooth surface. When she
does find a smooth surface, she sticks her proboscis into the surface. If she finds
underneath a liquid at roughly 37 C, she sucks up the liquid to satiety.”
([47], p. 57)
Interestingly, for von Uexküll each of these different functional circles involves a
process of externalization (in German: Hinausverlegung, occasionally also translated as
transposition, reassignment, or projection). Here is an example:
“The skin glands of the mammal are the bearers of perceptual meaning in the
first cycle, since the stimulus of butyric acid releases specific receptor signs in
the tick’s receptor organ, and these receptor signs are projected outside as an
olfactory cue.”
([48], p. 324)
Exactly how von Uexküll conceived of this process of projection is ambiguous, and
the status of his concept of the Umwelt therefore remains an active area of debate [
49
].
Certainly, interpretations of the Umwelt that are compatible with the participatory realism
promoted by the enactive approach and ecological psychology are possible [
29
]. On the
other hand, it could also be interpreted in purely internalist, subjectivist terms. As Fultot
Philosophies 2022,7, 37 9 of 13
and Turvey [
50
] argue, it is likely that von Uexküll considered externalization to consist of
a two-step process, whereby local activation of a receptor sign leads to the internal creation
of a perceptual cue, which is then attributed to the environment in such a way that the
organism can use it as standing for that external stimulus.
The form of this two-step process is similar to Bach-y-Rita et al.’s account of the change
in experience associated with mastering a sensory substitution device, and it matches even
more closely Latour and Woolgar’s account of the change in status of a statement into a
fact during the process of scientific discovery, which also involves a two-step process of
the “doubling” of a scientific statement into a scientific object, followed by an “inversion”
of the causal order such that the object “out there” ends up being given precedence over
the local causes. Thus, we arrive again at the conclusion that these accounts derive their
argumentative force from their logical consistency with an internalist starting point, rather
than from doing justice to the empirical phenomena that they aim to describe.
However, once we reject internalism, an alternative account suggests itself: during
these successful perceptual processes, the quality of the agent–environment interaction is
transformed; the agent’s grip on a specific aspect of the world is improved, and this allows
that aspect to be grasped as a distal object. From this point of view, the local activity is still
a necessary part of the process, but its role is fundamentally different: it no longer serves
as the input for the internal construction of a putative object, but rather becomes part of
the coupling through which the object is disclosed to experience. Of course, precisely how
the object will make its appearance in experience will depend on how it is approached;
experience is always perspectival, and this much of constructivism is retained. However, as
Stewart also recognizes, this is not the only relevant dependence: “A point worth making
here is that an Umwelt is not created by the organism alone, nor by the environment, but
through the characteristic relation between the organism and its environment.” ([
47
], p. 58).
It is this insistence on an organism–environment relation, without an internal doubling
or other intermediaries, that enables us to conceive of an enactive, world-involving, and
world-directed account of perception without double-talk [51].
Noë [
18
] has long been developing such an enactive account; he argues that a per-
ceptual relation must satisfy the conditions of both movement-dependence and object-
dependence—that is, “we are perceptually in touch with an object when our relation to
the object is highly sensitive to how things are with the object and to the way what we do
changes our relation to the object” (pp. 22–23). In this way, the subjective and objective
aspects of perception can be integrated into a unified account of how we find ourselves in
the world: perceptual experience not only discloses how things are (objectivity), but also
reflects how the perceiver relates to how things are (subjectivity): “When we encounter
the world, we do so by encountering how it perceptually appears from here. We experience
how things are, and we experience how they merely seem to be.” (p. 68). For example, we
perceive a whole coffee cup even if we always only ever immediately see one of its profiles
from our perspective. It is our skillful engagement with the world that enables this contri-
bution of subject- and world-involvement to become integrated into object perception, and
it is our awareness of others’ possible complementary perspectives that plays a constitutive
role in our perception of the object being “out there” in the world [52].
4. From Perception to Scientific Practice
This enactive theory of perception is a productive middle ground for the philosophy
of science—a sensorimotor basis of perception that loops through the body and the world
makes it reasonable to accept the constructivist insight that object perception is always
perspectival, while also accommodating the objectivist’s appeal to the world’s reality such
that the object transcends this perspective. In addition, the basic perceptual relation through
which we get a grip on the world can be transformed and empowered in different ways,
which is a consideration especially relevant for a theory of scientific practice. It is beyond
the scope of this essay to systematically develop this consideration in detail, but there is
room for a few pointers for future work.
Philosophies 2022,7, 37 10 of 13
For the case of human perception, technics plays a particularly important constitutive
role, but one that is already prefigured in other forms of life in the inventive creativity at
play in organismic adaptation [
53
]. For our purposes, we are specifically interested in how
the scope of the perceptual relation can be augmented with the skilled use of certain kinds
of coupling devices, as illustrated in Figure 1.
Despite their many differences, sensory substitution devices and scientific instruments
belong to the same broad category of coupling devices that augment our perception of the
world. They do so by enabling skilled users to become sensitive to changes in their relation
to the world that would otherwise remain inaccessible to them, and when these changes are
responded to appropriately, they permit the user to get a grip on a previously inaccessible
aspect of the world. This contact is experienced qualitatively as more perceptual when
the contact is more direct, but even highly spatiotemporally, socially, and technologically
mediated forms of sensorimotor interaction are never completely severed from the world.
On the contrary, the kind of detached object perception that is most relevant for scientific
observation is arguably a social achievement, which essentially depends on participatory
sense-making [
54
]. In addition, it seems advisable to consider the scientific instruments
supporting observation as participating in the coupled agent–environment system, and to
treat the resulting observation as a relational property of that system [
55
]. The mediation
afforded by scientific tools has long been a topic of post-phenomenology [
56
], but it remains
to be seen how the enactive approach can address these specific forms of mediation on
its own terms. More generally, it is crucial to explicitly include this irreducibly relational
perspective in the interpretation of observations; the enactive approach to the philosophy
of science is a situated approach [57].
Another important outstanding topic is how to include linguistic thought processes
into such a world-involving account of the scientific process. One attractive possibility is
to scale up basic perception–action loops by appealing to the right kind of socio-material
affordances, such that they become linguistically enabled [
58
]. Noë similarly argues that
some forms of thinking, at their core, retain a perceptual relation to the world: “Thought can
be extended perception when one deploys sensorimotor skills (presumably in conjunction
with other sorts of skills and knowledge) to achieve access to something or someone very
remote.” (2012, p. 27). An intriguing implication of conceptualizing thought in this manner
is that, for Noë, such world-involvement places strict constraints on the form that the
thought process can take. For example, he observes that “in the way I am now thinking of
[something absent], it would not be possible to think of something nonactual.” (p. 27). If
so, then we could expect that scientists are forced to change their way of thinking once a
statement changes its status from positing a possibly nonactual object to connecting with
an actual object, and this is indeed what Latour and Woolgar observed to occur on such
occasions, when “even the most cynical observers and committed relativists will have
difficulty in resisting that the ‘real’ [object] has been found” (p. 177). This possibility of
world-involving thought as another form of augmented perception is an exciting topic for
future research.
5. Conclusions and Outlook
In the end, human experience of the world is a subject-, other-, and world-involving
achievement, and this co-dependent basis of experience means that its limits are not within
our brain–body and its supposed internal constructs—we genuinely relate to the worldly
objects of our perception. We are at home in the world, and science is a sophisticated
socio-material elaboration of this more basic situatedness.
Accordingly, no one-dimensional account of scientific facts will do; the scientific
process cannot be reduced to the subjective perspectives and social conditions that enable
it, nor can we take ourselves completely out of this process in the hope of elevating the
targets of scientific investigation to observer-independent objects, as if they were uncovered
by a “view from nowhere”. This enactive approach to the philosophy of science is more
humane because it does not undermine the lifeworld that makes science possible in the
Philosophies 2022,7, 37 11 of 13
first place, and it does not stop there, given the reflexivity of the sciences of the mind. If this
world-involving theory of observation is on the right track, then it also promises to lead to
better science in practice. We need to explicitly incorporate the fact that our experience of
the world—including during scientific observation—is always perspectival:
“When we try to understand reality by focusing only on physical things outside
of us, we lose sight of the experiences they point back to. The deepest puzzles
can’t be solved in purely physical terms, because they all involve the unavoidable
presence of experience in the equation.” [59]
Importantly, an anti-realist interpretation of this irreducible presence of experience is
blocked by the complementary insight that experience is also world-involving. The next
step is to put this enactive approach to observation to the test and to turn it into a workable
research program, including stepping outside of the traditional disciplines of cognitive
science altogether—it is time for an enactive approach to physics.
For example, following phenomenological philosophy, Noë highlights that a defining
characteristic of the reality of the world is that it is inexhaustible in principle from any and
all perspectives, no matter the scale: “In the large, in the small, no experienced quality is so
simple that it can be taken in all at once. The world is structured and complex and it always
outstrips what can be taken in a glance” ([
18
], p. 95). The fact that the objects of experience
transcend our perspective in this way is most parsimoniously explained by appealing to
their dual status as being a part of the world while participating in the basis of experience.
This transcendence of the real is characteristic of our everyday perceptual experience, but it
similarly applies to scientific observation.
Consequently, it becomes intelligible why physics runs up against irreducible unob-
servables and indeterminacy when it socio-materially augments our perceptual relation
with the world to its smallest and largest scales. At these scales, the limitations on ex-
perience imposed by the transcendence of the real can no longer be ignored, such as at
the scale of cosmology when we try to grasp the entire universe as a whole [
60
], or at the
quantum scale when we try to grasp the properties of an elementary particle all at once [
61
].
The discovery that the world in principle escapes our grasp in these extreme situations of
scientific observation ceases to be mysterious. Instead, such observational limitations are
an expected consequence of the world-involving basis of perception; hence, they come to
be seen as reassuring evidence in support of a participatory realism [
62
]: we are real, so is
the world, and so is our interaction.
Funding: This research received no external funding.
Institutional Review Board Statement: Not applicable.
Informed Consent Statement: Not applicable.
Data Availability Statement: Not applicable.
Acknowledgments:
Maria Gohlke drew the illustration of Figure 1. Pierre Steiner provided detailed
constructive feedback on an earlier draft of this manuscript. Members of the Embodied Cognitive
Science Unit helped to fine-tune the final version.
Conflicts of Interest: The authors declare no conflict of interest.
References
1. Stewart, J. Science is not value-free. Constr. Found. 2014,10, 28–29.
2. Froese, T. Epilogue to “Questioning Life and Cognition” by John Stewart. Adapt. Behav. 2021,29, 523–527. [CrossRef]
3. Fuchs, T. Ecology of the Brain: The Phenomenology and Biology of the Embodied Mind; Oxford University Press: Oxford, UK, 2018.
4. Stewart, J. Radical constructivism in biology and cognitive science. Found. Sci. 2001,6, 99–124. [CrossRef]
5.
Froese, T.; Taguchi, S. The problem of meaning in AI and robotics: Still with us after all these years. Philosophies
2019
,4, 14.
[CrossRef]
6.
Stewart, J. Neurophenomenology, enaction, and autopoïesis. In Behavioral Neuroscience; Palermo, S., Morese, R., Eds.; IntechOpen:
London, UK, 2019; pp. 1–8.
7. Von Glasersfeld, E. The radical constructivist view of science. Found. Sci. 2001,6, 31–43. [CrossRef]
Philosophies 2022,7, 37 12 of 13
8. Stewart, J. Life as a process of bringing forth a world. Constr. Found. 2011,7, 21–22.
9. Di Paolo, E.A. A mind of many. Constr. Found. 2008,3, 89–91.
10. Stewart, J. What is it like to be conscious? Towards solving the hard problem. Constr. Found. 2017,12, 155–156.
11. Dreyfus, H.; Taylor, C. Retrieving Realism; Harvard University Press: Cambridge, MA, USA, 2015.
12. Chemero, A. Radical Embodied Cognitive Science; The MIT Press: Cambridge, MA, USA, 2009.
13. Hutto, D.D.; Myin, E. Radicalizing Enactivism: Basic Minds without Content; The MIT Press: Cambridge, MA, USA, 2013.
14.
Di Paolo, E.A.; Buhrmann, T.; Barandiaran, X. Sensorimotor Life: An Enactive Proposal; Oxford University Press: Oxford, UK, 2017.
15.
Noë, A. Out of Our Heads: Why You Are Not Your Brain, and Other Lessons from the Biology of Consciousness; Hill and Wang:
New York
,
NY, USA, 2009.
16.
Kirchhoff, M.; Kiverstein, J. Extended Consciousness and Predictive Processing: A Third Wave View; Routledge: Abingdon, UK, 2019.
17. Beer, R.D. Dynamical approaches to cognitive science. Trends Cogn. Sci. 2000,4, 91–99. [CrossRef]
18. Noë, A. Varieties of Presence; Harvard University Press: Cambridge, MA, USA, 2012.
19. Stewart, J. The mind is not in the brain. Constr. Found. 2008,4, 17–18.
20.
Varela, F.J. Whence perceptual meaning? A cartography of current ideas. In Understanding Origins; Varela, F.J., Dupuy, J.-P., Eds.;
Springer: Dordrecht, The Netherlands, 1992; pp. 235–263.
21. Froese, T. Hume and the enactive approach to mind. Phenomenol. Cogn. Sci. 2009,8, 95–133. [CrossRef]
22.
Villalobos, M.; Razeto-Barry, P. Are living beings extended autopoietic systems? An embodied reply. Adapt. Behav.
2019
,28, 3–13.
[CrossRef]
23. Wheeler, M. Mind in life or life in mind? Making sense of deep continuity. J. Conscious. Stud. 2011,18, 148–168.
24.
Pascal, F.; O’Regan, K. Commentary on Mossio and Taraborelli: Is the enactive approach really sensorimotor? Conscious. Cogn.
2008,17, 1341–1342. [CrossRef] [PubMed]
25.
Seth, A.K. A predictive processing theory of sensorimotor contingencies: Explaining the puzzle of perceptual presence and its
absence in synaesthesia. Cogn. Neurosci. 2014,5, 97–118. [CrossRef] [PubMed]
26. Di Paolo, E.A. The worldly constituents of perceptual presence. Front. Psychol. 2014,5, 450. [CrossRef]
27.
Ramirez-Vizcaya, S. Behavioral autonomy and a meshwork of habits: Review of Sensorimotor Life: An Enactive Proposal by Ezequiel
Di Paolo, Thomas Buhrmann, and Xabier Barandiaran. Adapt. Behav. 2022,30, 205–208.
28. Beaton, M. Phenomenology and embodied action. Constr. Found. 2013,8, 298–313.
29. Baggs, E.; Chemero, A. Radical embodiment in two directions. Synthese 2021,198, 2175–2190. [CrossRef]
30. Beaton, M. Sensorimotor direct realism: How we enact our world. Constr. Found. 2016,11, 265–297.
31.
Lenay, C.; Steiner, P. Beyond the internalism/externalism debate: The constitution of the space of perception. Conscious. Cogn.
2010,19, 938–952. [CrossRef] [PubMed]
32.
Froese, T.; Stewart, J. Enactive cognitive science and biology of cognition: A response to Humberto Maturana.
Cybern. Hum. Knowing
2012,19, 61–74.
33.
Froese, T. From second-order cybernetics to enactive cognitive science: Varela’s turn from epistemology to phenomenology.
Syst. Res. Behav. Sci. 2011,28, 631–645. [CrossRef]
34. Di Paolo, E.A. Bridges and hobby-horses: John Stewart’s adventure of ideas. Adapt. Behav. 2021,29, 437–440. [CrossRef]
35. Latour, B.; Woolgar, S. Laboratory Life: The Construction of Scientific Facts; Princeton University Press: Princeton, NJ, USA, 1986.
36. Stewart, J. Realities in the plural. Constr. Found. 2016,11, 277–278.
37.
Lenay, C.; Tixier, M. From sensory substitution to perceptual supplementation. In Living Machines: A Handbook of Research in
Biomimetics and Biohybrid Systems; Prescott, T.J., Lepora, N., Verschure, P.F.M.J., Eds.; Oxford University Press: Oxford, UK, 2018;
pp. 552–559.
38.
Clark, A. Natural-Born Cyborgs: Minds, Technologies, and the Future of Human Intelligence; Oxford University Press: New York, NY,
USA, 2003.
39.
Auvray, M.; Myin, E. Perception with compensatory devices: From sensory substitution to sensorimotor extension. Cogn. Sci.
2009,33, 1036–1058. [CrossRef]
40.
Bach-y-Rita, P.; Collins, C.C.; Saunders, F.A.; White, B.; Scadden, L. Vision substitution by tactile image projection. Nature
1969,221, 963–964. [CrossRef]
41.
Auvray, M.; Hanneton, S.; Lenay, C.; O’Regan, J.K. There is something out there: Distal attribution in sensory substitution, twenty
years later. J. Integr. Neurosci. 2005,4, 505–521. [CrossRef]
42.
Lynch, M.E. Technical work and critical inquiry: Investigations in a scientific laboratory. Soc. Stud. Sci.
1982
,12, 499–533.
[CrossRef]
43.
Lenay, C.; Gapenne, O.; Hanneton, S.; Marque, C.; Genouëlle, C. Sensory substitution: Limits and perspectives. In Touching for
Knowing: Cognitive Psychology of Haptic Manual Perception; Hatwell, Y., Streri, A., Gentaz, E., Eds.; John Benjamins: Amsterdam,
The Netherlands, 2003; pp. 275–292.
44. Heft, H. Ecological psychology and enaction theory: Divergent groundings. Front. Psychol. 2020,11, 991. [CrossRef]
45.
Stewart, J. Foundational issues in enaction as a paradigm for cognitive science: From the origin of life to consciousness and
writing. In Enaction: Toward a New Paradigm for Cognitive Science; Stewart, J., Gapenne, O., Di Paolo, E.A., Eds.; The MIT Press:
Cambridge, MA, USA, 2010; pp. 1–31.
46. Von Uexküll, J. Umwelt und Innenwelt der Tiere; Julius Springer: Berlin, Germany, 1909.
Philosophies 2022,7, 37 13 of 13
47. Stewart, J. Breathing Life into Biology; Cambridge Scholars Publishing: Newcastle upon Tyne, UK, 2019.
48.
Von Uexküll, J. A stroll through the worlds of animals and men: A picture book of invisible worlds. Semiotica
1992
,89, 319–391.
[CrossRef]
49. Feiten, T.E. Mind after Uexküll: A foray into the worlds of ecological psychologists and enactivists. Front. Psychol. 2020,11, 480.
[CrossRef] [PubMed]
50.
Fultot, M.; Turvey, M.T. von Uexküll’s theory of meaning and Gibson’s organism-environment reciprocity. Ecol. Psychol.
2019,31, 289–315. [CrossRef]
51.
Steiner, P. Steering a middle course between intentionality and representation: Some remarks about John Stewart’s enactive
stance. Adapt. Behav. 2021,29, 471–483. [CrossRef]
52. Gallagher, S. Intersubjectivity in perception. Cont. Philos. Rev. 2008,41, 163–178. [CrossRef]
53.
Dereclenne, E. Simondon and enaction: The articulation of life, subjectivity, and technics. Adapt. Behav.
2021
,29, 449–458.
[CrossRef]
54. Di Paolo, E.A. Participatory object perception. J. Conscious. Stud. 2016,23, 228–258.
55.
Barad, K. Meeting the Universe Halfway: Quantum Physics and the Entanglement of Matter and Meaning; Duke University Press:
Durham, UK, 2007.
56. Ihde, D. Husserl’s Galileo Needed a Telescope! Philos. Technol. 2011,24, 69–82. [CrossRef]
57. Bitbol, M. Science as if situation mattered. Phenomenol. Cogn. Sci. 2002,1, 181–224. [CrossRef]
58. Kiverstein, J.; Rietveld, E. Scaling-up skilled intentionality to linguistic thought. Synthese 2021,198, 175–194. [CrossRef]
59.
Frank, A.; Gleiser, M.; Thompson, E. The Blind Spot. In Aeon; 2019. Available online: https://aeon.co/essays/the-blind- spot-of-
science-is-the-neglect- of-lived-experience (accessed on 27 March 2022).
60.
Unger, R.M.; Smolin, L. The Singular Universe and the Reality of Time: A Proposal in Natural Philosophy; Cambridge University Press:
Cambridge, UK, 2015.
61.
Smolin, L. Einstein’s Unfinished Revolution: The Search for What Lies Beyond the Quantum; Penguin Press: New York, NY, USA, 2019.
62.
Fuchs, C.A. On participatory realism. In Information and Interaction; Durham, I.T., Rickles, D., Eds.; Springer: Cham, Switzerland,
2017; pp. 113–134.
... In other words, we perceive as an external reality those aspects of the world which we interrogate, while those aspect of the world which enable our inquiry by integrating our embodied engagement with the world become as transparent as are our eyes and ears. [29] describes the process by which agents construct the boundaries of what they experience as an external reality. As agents engage with their environment and progressively master their tools, the means through which they perceive reality become transparent. ...
... In the general case, the conception of material engagement as being enabled by the internalization of regimes of embedded normativity entails the much more radical view that the outcome of any observation is relative to specific biologically grounded and enculturated modes of navigating the world. As a means to alleviate the tensions which emerge from this view, we point toward the more general epistemological and ontological position of participatory realism which entails that cognitive agents (or, in other contexts, physical observers) construct reality by their very activity of engaging with the world in order to understand it [29,32]. ...
Chapter
We introduce and motivate the concept of embedded normativity to account for the externalization of social norms in the material environment through human social activity. We ground this notion in the Active Inference framework, and more specifically through the derived Skilled Intentionality framework of ecological perception and action. This framework considers that skilled agents experience their world as a landscape of affordances, or opportunities for action. This landscape is inherently normative, as its experience is tied to the agent’s anticipations over its own behaviour (and therefore, indirectly, to its motivations). We emphasize that given this framework, normativity does not exist inside or outside the agent’s boundaries, but is brought about by its engagement with the world. We discuss the dynamics of internalization and externalization by which agents come to project normativity onto elements of their environment, and experience this normativity as a simple attraction toward favoured states. Given this account, we revisit earlier descriptions of the shared material and sociocultural niche enable the broadcasting and integration of norms. Finally, we discuss how embedded normativity can be brought into existence by the perception of humans, and relate our discussion to the ontological stance of participatory realism. We hope that our argument contributes to a variety of debates ranging from social ontology to epistemology, but most notably those regarding the relation between cognitive and material culture and the localization of cognition.
... In other words, we perceive as an external reality those aspects of the world which we interrogate, while those aspect of the world which enable our inquiry by integrating our embodied engagement with the world become as transparent as are our eyes and ears. [29] describes the process by which agents construct the boundaries of what they experience as an external reality. As agents engage with their environment and progressively master their tools, the means through which they perceive reality become transparent. ...
... In the general case, the conception of material engagement as being enabled by the internalization of regimes of embedded normativity entails the much more radical view that the outcome of any observation is relative to specific biologically grounded and enculturated modes of navigating the world. As a means to alleviate the tensions which emerge from this view, we point toward the more general epistemological and ontological position of participatory realism which entails that cognitive agents (or, in other contexts, physical observers) construct reality by their very activity of engaging with the world in order to understand it [29,32]. ...
Preprint
We introduce and motivate the concept of \emph{embedded normativity} to account for the externalization of social norms in the material environment through human social activity. We ground this notion in the Active Inference framework, and more specifically through the derived Skilled Intentionality framework of ecological perception and action. This framework considers that skilled agent experience the world as a landscape of affordances, or opportunities for action. This landscape is inherently normative, as its experience is tied to the agent's anticipations over its own behaviour (and therefore, indirectly, to its motivations). We emphasize that given this framework, normativity does not exist inside or outside the agent's boundaries, but is brought about by its engagement with the world. We discuss the dynamics of \emph{internalization} and \emph{externalization} by which agents come to project normativity onto elements of their environment, and experience this normativity as a simple attraction toward favoured states. Given this account, we revisit earlier descriptions of the shared material and sociocultural niche enable the broadcasting and integration of norms. Finally, we discuss how embedded normativity can be brought into existence by the perception of humans, and relate our discussion to the ontological stance of participatory realism.
... Several authors have drawn an explicit link between the ontic regime of Participatory Realism, as formalized in the context of qBism, and the nature of perception and cognition[29, 33]. The argument can be summarized as follows.The constraints of online perception-action regulation do not aord a full topdown representation of all possible states in the world followed by an explicit inference of external states & planication of motor command. ...
Preprint
Full-text available
We revisit existing criticism of the Free Energy Principle and Active Inference through the concept of cognitive contextuality. Contextuality describe the property of physical states which are brought about by the very act of their observation, such as the position or momentum of individual particles in quantum settings. Based on conceptual and physical argument, we propose that contextuality drives the construction of cognitive semiotics. As such, it constitutes a fundamental component of cognition which any formal theory thereof must capture. At a conceptual level, Active Inference seems to capture the inherently contextual nature of cognitive engagement with the world. However, the Free Energy Principle cannot formalize this intuition due to its definition in terms of Dynamical Systems Theory, which comes with a well-defined space of possible states with no contextual properties. We describe the duality between agent-driven interaction and the construction of cognitive spaces which is implicit in the very concept of cognitive contextuality. In consequence, we emphasize the importance of the ontic regime called "Participatory Realism", and consider some ways that the FEP could integrate it.
... The paper by M.S. Almarcha et al. [21] examined various theoretical and methodological approaches to research in sociology, drawing attention to teaching a set of concepts in dynamical systems theory through the experience of body motion. T. Froese [22] reported that there is an undetected similarity between three classical descriptions of object experience conditions that belong to three different disciplines. In sociology, this similarity is manifested through a phenomenon that can be described as "inversion" -the process of transferring local causes of consequences to the object of observation itself. ...
Article
Relevance Scientific cognition is the basis for the development of scientific disciplines, including sociology, and contributes to the understanding and explanation of complex social phenomena, political processes, clarification of causal relationships, identification of trends, understanding the structure and functioning of social phenomena, which is achieved through a systematic and methodological approach to the study of social reality. Sociology plays an important role in solving social problems, identifying social imbalances, studying social interactions and transformations, and developing social policies and strategies.Purpose. The purpose of this study is to consider scientific cognition in sociology and identify its features, methods, and results.Methodology. In the course of the research, the following theoretical methods were used: analogy � for comparing and analysing sociological phenomena using similar phenomena from other branches of knowledge; historical method � for studying the development of sociology as a science and the concept of scientific cognition over time; systematisation � to organise concepts and theories into a logical and structured system.Results. In the course of the research, the following theoretical methods were used: analogy � for comparing and analysing sociological phenomena using similar phenomena from other branches of knowledge; historical method � for studying the development of sociology as a science and the concept of scientific cognition over time; systematisation � to organise concepts and theories into a logical and structured system. The study analysed the features of scientific cognition in sociology and its methodological foundations that contribute to understanding social phenomena. In particular, it was found that scientific cognition in sociology requires an interdisciplinary approach, cooperation with other sciences. Attention was focused on the methodological foundations of scientific cognition in sociology. The concept of a scientific approach in sociological research was also systematised, which provides objective results and expands the understanding of the social world.Conclusions. The paper highlights the results and new approaches to the study of social phenomena. The challenges and problems faced by sociologists in the process of scientific cognition were identified, and possible ways to solve them were proposed. The study results make a practical contribution for sociologists, scientists and practitioners in the social sciences, creating the basis for the further development of sociological theory, methodology, and research approaches.
... Consider how theoretical physicists implicitly adopt the classic internalist-representationalist response to the mind-body problem as a starting point of their own work: "A hard lesson to learn is that our sensations are partly caused by reality, but are fully constructed by our brains to present the world to us in just the form we need to make our way in nature" (Smolin [16], p. xiii). What would be the consequence for physics if this problematic account of the origins of perceptual content turns out to be misguided [17]? What if we need to rethink the relation between the material and mental by e.g., acknowledging that intentions and experiences cannot be "fully" reduced to brains in the way that Smolin envisions here? ...
Article
Full-text available
Cognitive science is confronted by several fundamental anomalies deriving from the mind–body problem. Most prominent is the problem of mental causation and the hard problem of consciousness, which can be generalized into the hard problem of agential efficacy and the hard problem of mental content. Here, it is proposed to accept these explanatory gaps at face value and to take them as positive indications of a complex relation: mind and matter are one, but they are not the same. They are related in an efficacious yet non-reducible, non-observable, and even non-intelligible manner. Natural science is well equipped to handle the effects of non-observables, and so the mind is treated as equivalent to a hidden ‘black box’ coupled to the body. Two concepts are introduced given that there are two directions of coupling influence: (1) irruption denotes the unobservable mind hiddenly making a difference to observable matter, and (2) absorption denotes observable matter hiddenly making a difference to the unobservable mind. The concepts of irruption and absorption are methodologically compatible with existing information-theoretic approaches to neuroscience, such as measuring cognitive activity and subjective qualia in terms of entropy and compression, respectively. By offering novel responses to otherwise intractable theoretical problems from first principles, and by doing so in a way that is closely connected with empirical advances, irruption theory is poised to set the agenda for the future of the mind sciences.
... Moreover, touching on the cognitive phenomenology debate, productive metacognitive feelings and the differentiation of four micro-activities establish a performative phenomenality that does not seem to be reducible to sensory input, reactive emotions, or other state-like mental contents, as they independently describe the conscious process quality of changing or holding a certain percept. In sum, this can be seen as strengthening agentive self-awareness in cognition in the context of participatory reality formation (Froese, 2022;Steiner, 1988;Witzenmann, 2022). ...
Article
Full-text available
Speech perception plays a key role in many fields of human development and social life but is often impaired by ambiguities on various levels of processing. While these phenomena have been extensively researched in the cognitive (neuro-) sciences according to empirical paradigms that adhere to the third-person perspective of externally measurable behavior, their first-personal and agentive dimensions remain mostly elusive. However, particularly the latter should not be neglected as they can in principle not completely be mapped on quantitative data but are crucial for people in lifeworld situations. We explored this point in the contexts of cognitive penetrability and mental action and conducted a mixed-methods study with qualitative reports on speech perceptual reversal (N = 63) as part of a series of related studies on other modalities. Exposed to respective stimuli, one half of the participants was instructed to voluntarily change their verbal percept, while the other half were told to hold a deliberately chosen word. Qualitative data analysis revealed four typical forms of mental activity, various strategies, and accompanying forms of intention and metacognitive feelings. On the one hand, this activity structure replicates that found in already published studies on vision and non-linguistic audition and thus lends itself to refinement of Posner and Petersen’s (Annual Reviews in Neuroscience, 13, 25–42, 1990) classic model of attentional shift. On the other hand, statistical testing of the quantified data strengthened our hypotheses about mental activities across conditions and modalities, thus also arguing for a cultivable agentive attention awareness in speech perception that even penetrates early stages of speech processing.
... Moreover, quantum physics has introduced fascinating and revolutionary perspectives on the potential interconnectedness of consciousness and the physical world. As elucidated by Stapp (2007), the quantum theory presents the concept of a participatory universe where the conscious observer plays a vital role in manifesting physical realities (Froese, 2022). These theories resonate with Bohm's concept of 'holomovement', which proposes a holographic Qeios, CC-BY 4.0 · Article, January 10, 2024 ...
Article
Full-text available
This interdisciplinary exploration discusses the intricate conceptual linkages among Buddhism’s Eighth State of Consciousness, Quantum Holography, and the Jungian Collective Unconscious. Central to this study is examining the Eighth Consciousness in Buddhist thought—a realm that transcends the conventional sensory and mental states to connect with a more universal and profound awareness. Drawing parallels, Quantum Holography posits that every part of the universe retains information about the whole, much like a hologram. This notion seemingly mirrors the Jungian concept of the Collective Unconscious, which postulates a shared reservoir of memories and ideas across humanity. The paper contends that the intricate dance of photons, oscillating between particle and wave states, mediates perception through resonance and hints at a multi-layered consciousness stratum that mirrors the vast, enigmatic quantum reality expanse. The study illuminates the intersections and divergences among these frameworks through meticulous comparative analysis, positing that an integrative understanding of quantum theories and Buddhist wisdom can unravel the human psyche’s profound depths. By weaving Eastern philosophies with the Western psychological and quantum theoretical tapestry, the discourse unveils a multifaceted consciousness comprehension, championing integrative approaches as invaluable tools for decoding the mind and universe's enigmatic interplay from a quantum viewpoint.
... The duality between dynamical structure and information offered by the FEP-PIF may lead to profound insight in that domain. However, its commitment to statespace embedding and dynamical structure as the static background from which information emerges does not allow it to account for "participatory realism", understood as the production of novel possibilities by physical observers or cognitive agents (Fuchs 2017;Froese 2022;Guénin--Carlut 2022b). For foundational reasons, it is therefore unable to offer a coherent representation of cognition and biological self-organization. ...
Article
Full-text available
I discuss the latest formulation of the Free Energy Principle as described by Friston, Karl, Lancelot Da Costa, Dalton A. R. Sakthivadivel, Conor Heins, Grigorios A. Pavliotis, Maxwell Ramstead, and Thomas Parr. 2023. “Path Integrals, Particular Kinds, and Strange Things.”. In particular, I acknowledge the progress entailed by the explicit path integral formulation of the article. However, I argue that this feature still does not allow the representation of the creation of meaning or the construction of "adjacent possibles" by biological / cognitive agents due to the statespace embedding of the theory.
... Some of these can be seen as pursuing step d in Maturana and Varela's formulation cited above, identifying additional phenomena (including those part of scientific practice) that follow from the enactive starting point. Other noteworthy substantive examples that focus on particular dimensions of scientific practice include work taking the enactive explanatory system to elucidate the nature of model-based research as an embodied practice (Rolla & Novaes, 2022) as well as work on scientific observation, understood as "socio-materially augmented" cognition and as "irreducibly self, other-, and world-involving" (Froese, 2022). ...
Chapter
Full-text available
Explanatory diversity is a salient feature of the sciences of the mind, where different projects focus on neural, psychological, cognitive, social or other explanations. The same happens within embodied cognitive science, where ecological, enactive, dynamical, phenomenological and other approaches differ from each other in their explanations of the embodied mind. As traditionally conceived, explanatory diversity is philosophically problematic, fueling debates about whether the different explanations are competing, compatible, or tangential. In contrast, this paper takes the perspective of embodied cognitive science as its starting point and accordingly approaches explanatory diversity not as a problem to be solved, but as a phenomenon to be understood. Recent work has explored how the view of cognition as embodied motivates reflexively viewing science as a situated embodied cognitive practice. Here I argue that this reflexive turn motivates adopting a pluralistic stance when it comes to questions about theoretical and methodological disagreements. In particular, it motivates moving away from thinking in terms of explanations as disembodied entities that compete with one another, and instead thinking in terms of different explanatory styles as embodied practices of explaining, many of which might be legitimate and warranted independently of whether and how the explanations themselves relate to one another.
Article
Full-text available
I briefly reflect on the work of John Stewart and his instrumental role in the development of enactive cognitive science, his outstanding ability to communicate across disciplines, and his research obsessions.
Article
Full-text available
Both ecological psychology and enaction theory offer an alternative to long-standing theoretical approaches to perception that invoke post-perceptual supplemental processes or structures, e.g., mental representations, to account for perceptual phenomena. They both do so by taking actions by the individual to be essential for an account of perception and cognition. The question that this paper attempts to address is whether ecological psychology and enaction theory can be integrated into a stronger non-representational alternative to perception than either one can offer on its own. Doing so is only possible if most of the basic tenets and concepts of ecological psychology and enaction theory are compatible. Based on an examination of the role that sensations play within each approach; the manner in which each treats the concept of information; and how each conceptualizes an organism’s boundaries, it is concluded that a synthesis of the two approaches is not possible. Particular attention is paid to the concept of sensations, the limitations of which were an impetus for the development of ecological psychology.
Article
Full-text available
For several decades, a diverse set of approaches to embedded, embodied, extended, enactive and affective cognition has been challenging the cognitivist orthodoxy. Recently, the prospect of a combination of ecological psychology and enactivism has emerged as a promising candidate for a single unified framework that could rival the established cognitivist paradigm as “a working metatheory for the study of minds” (Baggs and Chemero, 2018, p. 11). One obstacle to such an ecological-enactive approach is the conceptual tension between the firm commitment to realism of those following James Gibson’s ecological approach and the central tenet of enactivism that each living organism enacts its own world, interpreted as a constructivist or subjectivist position. Baggs and Chemero (2018) forward the concept of Umwelt, coined by the biologist Jakob von Uexküll, as a conceptual bridge between the two approaches. Inspired by Kant, Uexküll’s Umwelt describes how the physiology of an organism’s sensory apparatus shapes its active experience of the environment. Baggs and Chemero use this link between the subject and its objective surroundings to argue for a strong compatibility between ecological psychology and enactivism. Fultot and Turvey on the other hand view Umwelt as steeped in representationalism, the rejection of which is a fundamental commitment of radical embodied cognition (Fultot and Turvey, 2019). Instead, they advance Uexküll’s “compositional theory of nature” as a conceptual supplement for Gibson’s ecological approach (von Uexküll, 2010, p. 171; Fultot and Turvey, 2019). In this paper, I provide a brief overview of Uexküll’s thought and distinguish a crucial difference between two ways of using his term Umwelt. I argue that only one of these ways, the one which emphasizes the role of subjective experience, is adequate to Uexküll’s philosophical project. I demonstrate how the two ways of using Umwelt are employed in the philosophy of cognitive science, show how this distinction matters to recent debates about an ecological-enactive approach, and provide some critical background to Uexküll’s compositional theory of meaning.
Article
Full-text available
Cognition has traditionally been understood in terms of internal mental representations, and computational operations carried out on internal mental representations. Radical approaches propose to reconceive cognition in terms of agent-environment dynamics. An outstanding challenge for such a philosophical project is how to scale-up from perception and action to cases of what is typically called ‘higher-order’ cognition such as linguistic thought, the case we focus on in this paper. Perception and action are naturally described in terms of agent-environment dynamics, but can a person’s thoughts about absent, abstract or counterfactual states of affairs also be accounted for in such terms? We argue such a question will seem pressing so long as one fails to appreciate how richly resourceful the human ecological niche is in terms of the affordances it provides. The explanatory work that is supposedly done by mental representations in a philosophical analysis of cognition, can instead be done by looking outside of the head to the environment structured by sociomaterial practices, and the affordances it makes available. Once one recognizes how much of the human ecological niche has become structured by activities of talking and writing, this should take away at least some of the motivation for understanding linguistic thinking in terms of content-bearing internal representations. We’ll argue that people can think about absent, abstract or counterfactual because of their skills for engaging with what we will call “enlanguaged affordances”. We make use of the phenomenological analysis of speech in Merleau-Ponty to show how the multiple affordances an individual is ready to engage with in a particular situation will typically include enlanguaged affordances.
Article
In 2012, John Stewart contributed a book manuscript entitled “ Questioning Life and Cognition: Some Foundational Issues in the Paradigm of Enaction” to the Enaction Series in Online Collaborative Publishing, edited by Olivier Gapenne and Bruno Bachimont. Along with Mattéo Mossio, I was invited by Olivier to serve as a glossator of this text. The purpose was to thereby continue our long and fruitful dialogues with John that began when we were both students. I took advantage of the opportunity to also express my gratitude to John for his participation in that formative stage of my personal academic journey. My reflections were included as an epilogue to his book. In memoriam, the epilogue is reproduced in this report unchanged. I will always be grateful to John for making the research community of enaction feel like family to me and for helping me recognize that there is a place for my diverse interests in the continued pursuit of an academic career.