ArticlePDF Available

The interpretation of complex spatial relations by integrating frames of reference

Authors:

Abstract and Figures

This paper presents an analysis of German expressions such as 'links unterm Schrank' (left below the cupboard). In this structure, two projective terms (an adverb and a preposition) are combined to give a complex description of a spatial constellation. We argue that there are mainly two strategies for interpreting these combinations, usually resulting in different models. One of them relates both terms to the same frame of reference. The other strategy involves the integration of two independently determinable frames of reference. Therefore, both selection and integration of frames of reference have to be taken into account.
Content may be subject to copyright.
P. Olivier (1997) (ed.), Working Notes of the Workshop on „Language and Space“ (AAAI-97) (pp. 45–56).
Providence/Rhode Island.
The interpretation of complex spatial relations
by integrating frames of reference*
Carola Eschenbach, Christopher Habel & Annette Leßmöllmann
University of Hamburg, Germany
{eschenbach, habel, lessmoellmann}@informatik.uni-hamburg.de
Abstract
This paper presents an analysis of German expressions such as ‘links unterm Schrank’ (left
below the cupboard). In this structure, two projective terms (an adverb and a preposition) are
combined to give a complex description of a spatial constellation. We argue that there are
mainly two strategies for interpreting these combinations, usually resulting in different
models. One of them relates both terms to the same frame of reference. The other strategy
involves the integration of two independently determinable frames of reference. Therefore,
both selection and integration of frames of reference have to be taken into account.
1. Introduction
Expressions such as over, under, in front of, behind, to the left of, to the right of are used to
describe spatial constellations between two objects. Although the expressions mentioned are
comparable with respect to their usage, they need not be of a uniform syntactic category.
Therefore we will use ‘projective term’ to refer to such expressions, focusing on their function
and conceptual background rather than their syntactic category. To differentiate between the
roles of the two related objects we use the term ‘reference object’ for the role filled by the
cupboard in (1) and the terms ‘target’, ‘located object’ or ‘localized object’ for the role of the
mosquito in (1) (cf. Miller & Johnson-Laird, 1976; Talmy, 1983; Habel, 1990).
(1) The mosquito is under the cupboard.
As is well known, projective terms relate the reference object and the target relative to a
system of directions, axes or regions, i.e., a ‘spatial frame of reference’. The frame of
reference is a structure induced on space that allows to identify a direction and locates the
target in that direction relative to the reference object. Although frames of reference are
discussed in Linguistics, Artificial Intelligence and Cognitive Science and there are intensive
debates about classes of frames and frame selection, the question what the constituents and
the properties of a frame of reference are is less prominent in the actual discussion.1
* The research reported in this paper was supported by the Deutsche Forschungsgemeinschaft (DFG) in the
project ‘Axiomatik räumlicher Konzepte’ (Ha 1237/7). We would like to thank Lars Kulik, Emile van der Zee
and two anonymous reviewers for their helpful comments. Authors’ address: FB Informatik (AB WSV) and
Graduiertenkolleg Kognitionswissenschaft, Universität Hamburg, Vogt-Kölln-Str. 30, D-22527 Hamburg.
1 See, e.g., the papers in part I (‘Frames of reference’) in Eilan, McCarthy and Brewer (1993) and Levinson’s
critical discussion (1996, p. 126). An overview of various sources of frames of reference is given by Retz-
Schmidt (1988). There are also different terms used (e.g., ’reference system’). But up to now it is not clear to
what extent such terminological differences reflect theoretical differences.
46
The main function of a frame of reference is to introduce a structure in a spatial
constellation, for instance via a system of regions or of axes, its origin coinciding with the
reference object, such that the target is localized with respect to an axis or in a corresponding
region (Franklin & Tversky, 1990; Herskovits, 1986; Tversky, 1996). Usually the bias to axes
leads to a view which identifies ‘frames of reference’ with ‘systems of co-ordinates’ (cf.
Levinson (1996), who emphasizes the importance of co-ordinate systems). In contrast to this,
Eschenbach and Kulik (1997) present an axiomatic approach to the analysis of the projective
terms in the plane that is based on ordered geometry, i.e., that is not committed to co-
ordinates. Assuming that frames of reference can be specified in spatial structures that are
weaker than geometries with co-ordinates, e.g. topology or ordered geometry,2 allows to
integrate other types of spatial expressions, for instance topological prepositions, in the
framework of frames of reference.
In the present paper we start without being committed to a specific concept of frame of
reference, i.e., what it is and how it should be formalised. E.g., we will employ both axes and
regions in our explanation without assuming one of them to be simpler than the other. Rather,
axes and regions correspond to each other, since regions can be defined on the basis of axes.3
Describing and explaining the way projective terms are used in natural language, it is
necessary to determine which frame of reference is used in the interpretation of a speaker or
hearer. The frame of reference can be introduced by the reference object itself (intrinsic use)
or by an additional perspective or origo (deictic use), which – in turn – can be given by
different contextual factors like the speaker, the hearer or an (imaginary) observer (Bühler,
1934; Jarvella & Klein, 1982; Vandeloise, 1991; Levelt, 1996). Furthermore, the environment
may introduce an ‘extrinsic’ or ‘environment-centered frame’ (Carlson-Radvansky & Irwin,
1993), and speaker and hearer often take distinct perspectives that induce two different deictic
frames (Schober, 1993).
The discussion of different classes of frames mainly focuses on the question how a frame
of reference is established and how a speaker/hearer selects one from a set of alternatives.
Bryant, Tversky and Franklin (1992) and Franklin, Tversky and Coon (1992) discuss how the
choice between alternative frames is determined. They propose ‘spatial frameworks’ for
describing and explaining the choice of perspective in understanding narrative texts.
The choice between the different classes of frames discussed above will play only a minor
role in the following. One of the aims of the present paper is rather to study how combinations
of projective terms relate to frames of reference.
Studies on the conceptual function of projective terms usually concentrate on the question
which constellation is expressed by a simple expression such as (1). In this paper we will
tackle the question of how projective terms combine to express more complex or more
specific spatial constellations between objects. We will discuss some consequences, leading to
the requirement of an integration of frames of reference.
The syntactic means of combining projective terms to form complex expressions are
different across languages. English uses, among other constructions, co-ordination with and
(2.a). In German, corresponding constructions are syntactically well formed, but there is no
clear intuition as to which spatial constellation is expressed in a case like (2.b). In contrast to
this, (2.c) leads to the interpretation that some mice are to the left of the cupboard while others
are behind it.
2 Levinson (1996, p. 135) excludes topological prepositions from his discussion of frames of reference; his
description of their “complex relation to frames of reference” (p. 161, footnote 29) is due to his commitment to
co-ordinates. To see Topology as a member in the family of Geometries is in agreement with the historical
developement of this branch of mathematics. Topology started as ‘geometria situs’ and is nowadays characterized
as ‘rubber sheet geometry’.
3It should be noted that also the terms ‘axis’ and ‘region’ can be formally specified in different ways.
47
In contrast to English, German allows a combination of projective terms as shown in (3).
(2) a. The mouse was sitting behind and on the left of the cupboard.
b. ??Die Maus saß links von und hinter dem Schrank.
the mouse was sitting left of and behind the cupboard4
c. Die Mäuse saßen links von und hinter dem Schrank.
the mice were sitting left of and behind the cupboard
(3) Die Maus saß links hinterm Schrank.5
the mouse was sitting left behind the cupboard
English expressions combining projective terms are analysed by Herskovits (1986, chap.
10.2). 6 She argues that, e.g., in front and on the left of specifies the intersection of the LEFT-
region and the FRONT-region (see Fig. 1). Concerning German expressions like (3), a similar
analysis has been carried out by Maaß (1996) with respect to sections in route descriptions
and by Gapp (1996) with respect to regions.
FRONT-regionFRONT
BACK
RO
FRONT
BACK
LEFT RIGHT
RO
FRONT-LEFT-
region
Fig. 1: Combination of projective terms (in front and on the left of )
according to the analysis of Herskovits (1986), RO = reference object.
In this paper we will argue that analyses like Herskovits’ (1986) do not apply to complex
expressions in German. Firstly, the relations expressed in (3) do not always denote the same
regions as those expressed by the co-ordinate English expressions. Therefore, a direct
translation is not possible. Secondly, we will show that some of the complex expressions of
German are ambiguous. They have an alternative reading whose extension can only be
determined by the integration of multiple frames of reference.
In order to determine the location of the target based on these complex expressions, two
strategies are available for natural language users: Either two regions are established with
respect to one frame of reference, and the intersection of these regions yields the possible
location of the target. Or, as we will show in sections 2 and 3, two reference frames are
4The English counterparts given in italics serve to illustrate the German examples. They are not meant to be
proper translations.
5‘Hinterm’ is a contracted form of the preposition ‘hinter’ (behind) and the definite article ‘dem’ (gender:
masculine and case: dative). The regularities with respect to the use of the contracted vs. uncontracted form
(‘hinter dem Schrank’) are complex but not related to the subject matter of this paper. Therefore we will ignore
any difference and use both forms interchangeably.
6 As one of the referees pointed out to us, beyond the co-ordination with and discussed by Herskovits it is
possible to combine projective terms in English as in the following expressions ‘behind the cupboard to the left’
and ‘behind the cupboard on the left’. While the differences in interpretation seem to correspond to our findings
concerning the German data, an additional study of these expressions needs to be carried out.
48
established and integrated and regions with respect to these reference frames are used for the
location of the target. In this paper we focus on these strategies rather than on an detailed
analysis of the location and form of the denoted regions.
The German data show that the multiplicity of frames of reference does not only lead to
the problem of selecting one but, at least for complex expressions as considered here, also to
the problem of integrating different frames of reference.
2. Projective Terms and Their Combinations
2.1 Projective Prepositions and Projective Adverbs
Projective terms are usually analysed as relations that localize the target relative to the
reference object with respect to a frame of reference. Projective prepositions like ‘über’
(over), ‘unter’ (under), ‘vor’ (in front of/before), ‘hinter’ (in back of/behind), ‘links von’
(at/on/to/by the left of), and ‘rechts von’ (at/on/to/by the right of)7, can be said to be external,
i.e., the region the target is localized in is external to the reference object.
(4) a. Der Schrank steht links/rechts vom Bett.
the cupboard is standing on the left /on the right of the bed
b. Die Mücke fliegt über/unter dem Schrank.
the mosquito is flying over/under the cupboard
c. Die Katze liegt vor/hinter dem Ofen.
the cat is lying in front of/behind the stove
In German – as in many other languages – there is an additional class of spatial adverbs8:
‘oben’ (above), ‘unten’ (below), ‘vorne’ (in front), ‘hinten’ (at the back), ‘rechts’ (on the
right), ‘links’ (on the left). These projective terms are related to the prepositions
morphologically as well as by their specification of axes. Thus, ‘vorne’ just as ‘vor’ specify
axes which we call here the FRONT-axes.
These projective adverbs seem to depend on frames of reference in much the same way as
the projective prepositions do. However, they differ in two respects. Firstly, an explicit
specification of a reference object is not necessary (Wunderlich & Herweg, 1991), as can be
seen in (5). Here, the reference object is derived contextually. But as shown in (6), an overt
expression is possible.
Secondly, the regions specified by these adverbs are in many cases not external to the
reference object.
(5) a. Der Schrank steht rechts/links.
the cupboard is standing on the right/on the left
b. Die Mücke ist oben/unten.
the mosquito is above/below
c. Das Auto steht vorne/hinten.
the car is standing in front/at the back
7‘links von’/‘rechts von’ are syntactically more complex prepositions than ‘über’/‘unter’/‘vor’/‘hinter’ and
therefore – in principle – a more fine-grained discussion would be appropriate. Since this topic is not relevant for
our present analysis, we do not go into details here.
8We use the term ‘adverb’ in traditional manner, referring to expressions from a certain class of words (or
word forms), but not referring to a specific syntactic position relative to the verb. We apologize for the
possibility of confusion but it seems that proper alternatives are not available.
49
(6) Die Teller stehen oben/hinten/rechts im Schrank.
the plates are standing above/behind/right in the cupboard
In (5.a) ‘rechts’/’links’ denote the RIGHT-region and the LEFT-region, respectively, of the
inner part of a room. In the case of (5.c), the reference object supplied by the context might be
a driveway, a parking lot, or a street. Here, the FRONT-region or BACK-region is denoted
with respect to the position of the observer and particular object properties, which we will not
investigate in detail here.
Strictly speaking, these spatial adverbs do not induce a reference object but regions (we
call them ‘reference regions’).9 This corresponds to the fact that spatial prepositional phrases
(denoting regions) rather than noun phrases (denoting objects) can be added to specify such a
reference region explicitly. In example (6), a projective adverb is combined with a non-
projective spatial prepositional phrase, i.e. ‘im Schrank’. In this case we could analyse the
combination as follows: The projective relation (based on an axial system) specifies a region
that is part of the region specified by the non-projective preposition, see Fig. 2.
reference region
TOP-region
TOP
BOTTOM
Fig. 2: Restriction of the reference region (in this case the denotation of ‘im Schrank’)
by a projective adverb (‘oben’) to the TOP-region
Although simple syntactic tests suggest that expressions such as ‘oben im Schrank’ can be
constituents, their internal structure is not clear and can be analysed in at least three different
ways.10 The first analysis is to assume the prepositional phrase (‘im Schrank’) to be an
optional complement of the adverb (‘oben’). In this case, the adverbs can be classified as
prepositions as well: Semantically, they are as relational as prepositions are. Ignoring this, we
will call them ‘projective adverbs’ in the following in order to avoid confusion with the notion
of projective preposition.
Wunderlich and Herweg (1991) point out two alternative syntactic analyses. In one
analysis, the adverb modifies the prepositional phrase (7.a) (i.e., ‘im’ is head of the phrase), in
the second version, the prepositional phrase modifies the adverb (7.b) (i.e., ‘oben’ is head of
the phrase).
(7) a. [PP oben [PP im Schrank]]
above in the cupboard
b[
PP[PP oben ] im Schrank]
above in the cupboard
9 The concept ‘internal reference region’ requires the topological aspects of reference frames.
10 A fourth syntactic analysis of sentences like (6) is to consider both adverbs and prepositional phrases as
modifiers of the verb. In this case, they do not form a constituent.
50
Wunderlich and Herweg (1991) relate this syntactic ambiguity to a semantic ambiguity.
Although both readings – in this case – yield the same model, the interpretation works
differently based on the syntactic ambiguity. In (7.a), an IN-region is specified, and ‘oben’
restricts the extension of this region. The interpretation is roughly this: In the cupboard, to be
specific, above. In (7.b) ‘im Schrank’ restricts the extension of ‘oben’; the interpretation in
this case is: Above, to be specific, in the cupboard.
Although the approach of Wunderlich and Herweg (1991) to associate syntactic ambiguity
with different procedures of interpretation is quite attractive for the data we will present in the
next section, we will not follow it. To justify the correlation between syntactic structures and
procedures of interpretation, we feel the need of independent evidence for assigning a specific
syntactic structure to the expression under consideration.
2.2 Combinations of Projective Terms
Comparing examples (6) and (3) as well as systematic variations of them in (8), we find that
the combinations of projective terms we are interested in can be syntactically analysed in the
same ways as stated for (6). In addition, the adverbs can combine with each other, which can
be seen in (9). As shown in (10), these constructions allow for overt reference objects the
same way a single adverb does, cf. (6). In contrast to the adverbs, direct combinations of the
prepositions in question are not possible, see (11). The lexical items ‘links’ and ‘rechts’ differ
from the other terms under consideration, since they can appear both as adverbs and as
prepositions.11
(8) a. Die Mücke ist oben vorm Schrank.12
the mosquito is above in front of the cupboard
b. Die Mücke ist hinten unterm Schrank.
the mosquito is behind under the cupboard
c. Die Mücke ist links unterm Schrank.
the mosquito is to the left under the cupboard
d. Die Mücke ist unten links vom Schrank.
the mosquito is below (to the) left of the cupboard
(9) a. Der Schal liegt oben vorne.
the scarf is lying above in front
b. Der Schal liegt links oben.
the scarf is lying (to the) left above
c. Der Schal liegt vorne links.
the scarf is lying in front (to the) left
(10) Der Schal liegt oben vorne im Schrank.
the scarf is lying above in front in the cupboard
(11) *Die Mücke ist über vor dem Schrank.
the mosquito is over in front of the cupboard
11 The exclusion of examples like (11) can be related to syntax, since the prepositions discussed seem to
subcategorize noun phrases and assign (dative) case. The syntactic status of ‘rechts’ and ‘links’ differs from the
other terms considered here and is – generally – unclear.
12 ‘vorm’ is contracted from ‘vor’ (in front of) and the definite article. Be cautious to avoid the confusion for
‘vom’ the contraction of ‘von’ (of) and the definite article.
51
The systematic variation leads to a classification of the combinations according to
acceptability and interpretation of prosodically unmarked combinations. Fig. 3 specifies labes
for the classes of examples we discuss in the following and shows an evaluation of different
constructions in terms of acceptability judgements. The judgements are based on our own
intuitions and on those of several other native speakers. They apply to cases where the textual
and non-textual context is rich enough to provide reference regions and frames of reference as
needed.
rechts von links von über unter vor hinter
rechts * [1] * + [2] + + [3] +
links * *++++
oben (+) [4] (+) + [5] + (+) [6] (+)
unten (+) (+) + + (+) (+)
vorne (+) [7] (+) (+) [8] (+) + [9] +
hinten (+) (+) (+) (+) + +
Fig. 3: Acceptability of combinations of projective terms
‘*’: not acceptable without prosodic hints; ‘+’: acceptable ,‘(+)’: restricted acceptability
The clearest judgements of acceptability are with respect to combinations of the adverbs
‘rechts’ and ‘links’ with any projective preposition, i.e., the classes [1], [2] and [3]. Examples
from class [1] are generally not accepted (cf. example (12)), unless additional prosodic hints –
such as a pause between the two projective terms – is given.13
(12) a. *Die Mücke ist rechts rechts vom Schrank.
the mosquito is (to the) right to the right of the cupboard
b. *Die Mücke ist links rechts vom Schrank.
the mosquito is (to the) left to the right of the cupboard
In contrast to this, examples from class [2] and class [3], such as (13), are most easily
accepted and understood. The interpretation of (13.a) corresponds to the one given for
example (6) above and depicted in Fig. 4: The prepositional phrase ‘vorm Schrank’ specifies a
region based on the vertical axis of the reference frame and ‘links’ selects a part of this region
according to the left-right horizontal axes of the reference frame. We call this interpretation
the ‘sub-region interpretation’.
(13) a. Die Mücke ist links vor dem Schrank.
the mosquito is (to the) left in front of the cupboard
b. Die Mücke ist rechts hinterm Schrank.
the mosquito is (to the) right behind the cupboard
13 In the case of explicit prosodic hints the multiple frame strategy (see below) is chosen.
52
BACK
FRONT
(I)(II)
LEFT RIGHT
RO
Fig. 4: ‘links vorm Schrank’
As a result, the preferred interpretation of (13.a) is illustrated in Fig. 4 as region (I). The
analysis in Herskovits (1986) of the English construction to the left and in front of assumes
region (II) to be the preferred interpretation. Gapp (1996, Chap. 3.3.4) discusses four methods
to compute ‘grades of applicability’ for combined projective relations. This leads to the
computation of the internally structured region (II). Our data show that German speakers
predominantly use the even more complex expression ‘schräg links vor’ (diagonally to the left
in front of / at an angle to the left in front of) to identify region (II).
For the remaining classes, combinations of terms specify the same kind of axes. I.e.,
expressions from classes [5] and [9] are acceptable (cf. (14)) but – in contrast to what might
have been expected comparing them with class [1] – do neither derive pleonastic nor
contradictory interpretations.
(14) a. Die Mücke ist oben über der Tür.
the mosquito is above over the door
b. Die Ratte ist unten unter dem Fußboden.
the rat is below under the floor
c. Die Mücke ist oben unter der Lampe.
the mosquito is above under the lamp
d. Die Mücke ist unten über dem Teppich.
the mosquito is below over the carpet
The preferred interpretation of (14.a) can be paraphrased as: The mosquito is in the TOP-
region of the room and above the door. Fig. 5 depicts the corresponding situation. In this case,
‘über der Tür’ specifies the (external) TOP-region relative to the door (and the vertical axis)
and ‘oben’ specifies the (internal) top part of a contextually provided reference region such as
the inner region of the room.
We call such interpretations ‘detached’.14 They can best be understood as localising the
target in the intersection of two regions that are provided independently of each other. The
same observation applies to (14.d). It can be paraphrased as: The mosquito is in the
BOTTOM-region of the room and in the region over the carpet.
14 We do not claim that in these cases only detached readings are available. Thus, a reading that results in a
conceptual interpretation analogous to the one shown in Fig. 4 is possible. This ‘pleonastic’ reading seems to be
the preferred one in cases such as (1'), where only one frame of reference is available.
(1') Das Auto steht vorne vorm Haus. the car is standing in front in front of the house
53
reference region
TOP
RO
TOP-TOP-region
Fig. 5: Detached interpretation of ‘oben über RO’
Combinations of prepositional ‘rechts / links von’ with adverbs specifying different axes, i.e.,
examples from classes [4] and [7], are predominantly not accepted at first presentation (cf.
(15)). But – as often observable in linguistic tests – little training with examples from class [5]
or [9] leads the informants to get detached interpretations for examples of these classes as
well. As to be expected, (15.a,b) are not understood to be just the inverse constructions of
(13.a,b). The detached interpretations of ‘rechts vom Schrank’ (the RIGHT-region relative to
the cupboard) and of the adverbs ‘unten’ and ‘hinten’ (interpreted relative to a contextually
specified reference region) are derived. Thus, (15.a) can be paraphrased as: The mosquito is in
the BOTTOM-region of the room and to the right of the cupboard.
(15) a. (?)Die Mücke ist unten rechts vom Schrank.
the mosquito is below to the right of the cupboard
b. (?)Die Mücke ist hinten rechts vom Schrank.
the mosquito is behind to the right of the cupboard
The fact that (15) is less acceptable than the examples of classes [2], [3], [5] and [9] does not
concern us here, as an interpretation is possible in principle.
Reconsidering the examples in (13) (i.e., classes [2] and [3]), it becomes obvious that they
allow detached interpretations as well. But in contrast to the examples (14) and (15), an
intonational support – like a short pause – is needed to force the detached interpretation.
In contrast to the cases already discussed, the intuitions about the classes [6] and [8] are
less clear and more dependent on functional aspects of the reference object specified. Take,
e.g., the contrast of (16.b) and (16.c): In (16.c), ‘vorne unter’ yields the region under the front
part of the car. In (16.b), with the cupboard as reference object, no clear intuition is available.
(16) a. Die Mücke ist oben vorm Schrank.
the mosquito is above in front of the cupboard
b. ?Die Mücke ist vorne unterm Schrank.
the mosquito is in front under the cupboard
c. Der Ball ist vorne unterm Auto.
the mosquito is in front under of the car
d. ?Die Mücke ist vorne überm Schrank.
the mosquito is in front over the cupboard
This again gives evidence for the assumption that projective adverbs and projective
preposition have to be analysed in a different way.
In Fig. 6 we summerise the empirical findings with respect to preferences of
interpretations for combined projective terms.
54
rechts / links von über / unter vor / hinter
rechts
links [1]
no interpretation [2]
sub-region or
detached
[3]
sub-region or
detached
oben
unten [4]
detached [5]
detached [6]
unclear
vorne
hinten [7]
detached [8]
unclear [9]
detached
Fig. 6: Preferred interpretations for combined projective terms
3. Multiple Frames of Reference
Projective terms in German form two distinguishable classes that can be combined yielding
complex and specific spatial descriptions. In contrast to English, German uses combinations
of adverbs with adverbs as well as combinations of adverbs followed by prepositional phrases
in order to join projective terms. In this paper, we have concentrated on the latter case.
Although the general pattern of these combinations seems fairly uniform at the surface,
acceptability judgements and the preferred conceptual interpretations of the combined terms
show a more complex pattern. The data discussed in section 2 demonstrate that there is more
than one method of deriving an interpretation for combined projective terms. The method
preferred is determined by diverse factors such as the terms combined, contextual aspects and
intonational patterns. To study all the factors that influence the preferred interpretations of
these terms is not the aim of the paper. We rather want to point out, firstly, that there is more
than one option available and, secondly, that in some cases more than one reference frame is
involved.
The strategy suggested by the analysis of Herskovits (1986) for English expressions such
as (17) locates the target (i.e., the mouse) in a region that does not fall within the typical
regions denoted by ‘to the left of’ and ‘behind’. According to our intuitions and those of our
informants, this interpretation is not used for the German expressions under consideration
here, cf. (18), but rather for the more complex form shown in (19).
(17) The mouse is to the left of and behind the cupboard.
(18) Die Maus saß links hinterm Schrank.
the mouse was sitting left behind the cupboard
(19) Die Maus ist schräg links hinterm Schrank.
the mouse is diagonally left behind the cupboard
The alternative strategy we propose for this case establishes one region corresponding to the
prepositional phrase (‘hinterm Schrank’) and selects a sub-region according to the adverb.
Thus, ‘hinterm Schrank’ denotes the BACK-region of the cupboard and ‘links’ is taken to
specify the left part of it. This interpretation justifies the conclusion that the mouse is behind
the cupboard. But it does not justify the conclusion that it is to the left of the cupboard. In
addition, no conclusion about the location of the cupboard (e.g., in a room) will be derived.
The reading that we called detached is most obvious in examples such as (20). We called
this reading detached, because in contrast to the modificational readings, ‘oben’ keeps its
55
original denotation. It results from a strategy which establishes two regions with respect to
two frames of reference and locates the target within both of them.
(20) Die Fliege ist oben über der Tür.
the fly is above over the door
This interpretation justifies both the conclusion that the fly is in the TOP-region of the room
and that it is above the door. In this case the adverbs keep their capacity of referring to a
contextually provided region. In most of our examples, the adverb refers to the inner region of
a room, i.e., the adverb induces a reference region according to which the target is located.
The projective preposition establishes a region according to the object denoted by its
complement. This region, of course, is not the same as the reference region induced by the
adverb.
Thus, in order to interpret the expression ‘oben über der Tür’, both projective terms
introduce a frame of reference. Thereby, the frame introduced by the projective preposition
‘über’ is located within the frame introduced by the projective adverb ‘oben’. Therefore, the
region denoted by the prepositional phrase ‘über der Tür’ intersects the TOP-region of the
room, and the target is located within this intersection.
The ambiguity of (21) should be clear now. Only in the detached reading, the inference
(22) is valid.
(21) Die Fliege ist rechts über der Tür.
the fly is right over the door
(22) Die Fliege ist rechts.
the fly is to the right
Considering additional examples, we find that by uttering (23) the speaker suggests that the
glass is in the TOP-region as well as the cup. This can be explained if the regions constituted
by ‘hinter’, ‘über’ etc. are bounded (e.g., according to the edges of a circumscribing cuboid as
depicted in Fig. 4 and 5, cf. van der Zee 1996) rather than infinitely extending (as depicted in
Fig. 1): In any model that locates the cups in the TOP-region (of, e.g., a contextually provided
cupboard) and in the BACK-region of the glass, these regions intersect. If the BACK-region is
bounded as suggested, then at least a part of it has to be at the same height as the cup, i.e., in
the TOP-region of the cupboard.
(23) Die Tasse ist oben hinter dem Glas.
the cup is above behind the glass
4. Conclusion
The study of combinations of projective terms in German has led us to the following results:
The complex descriptions under consideration are in general more specific than simpler ones,
i.e., they specify sub-regions of those specified by simpler expressions. Their interpretations
can be described as resulting from two different strategies. Preferences regarding the selection
of one strategy available differ, based on the projective term involved and to properties of the
objects related. One of these strategies integrates multiple frames of reference. The resulting
interpretations tend to include information about the relative position of the origins of the
reference frames involved.
56
The differences in acceptability reported with Fig. 6 are not based on linguistic (i.e.,
syntactic or semantic) properties of the items but are mainly due to conceptual or pragmatic
factors. Expressions are accepted, if they make sense, i.e., if an interpretation strategy is
accessible which yields a consistent model. Finer differences of acceptability can be explained
based on the difficulties of finding such an interpretation. Up to now these hypotheses are
based on purely linguistic evidence, namely acceptability ratings given by the authors and
some informants. Finer and much more precise methods of psycho-linguistics are needed to
test and develop our approach.
The need for finding a consistent interpretation to understand and accept a complex
description and the difficulties observed thereby suggest in addition that the regions
designated by projective terms are not to be described as graded, unbounded structures (e.g.,
according to prototypes or fuzzy sets) but as having boundaries and shape.
References
Bryant, D., Tversky, B. & Franklin, N. (1992). Internal and external spatial frameworks for
representing described scenes. Journal of Memory and Language, 31, 74–98.
Bühler, K. (1934): Sprachtheorie. Die Darstellungsfunktion der Sprache. Fischer: Stuttgart.
[partly reprinted in English as: The deictic field of language and deictic words. In R.J.
Jarvella & W. Klein (eds.) (1982) Speech, place, and action. (pp. 9–30). Chichester:
Wiley.]
Carlson-Radvansky, L. A. & Irwin, D. E. (1993). Frames of reference and vision in language:
where is above? Cognition, 46, 223–244.
Eilan, N., McCarthy, R. & Brewer, B. (eds.) (1993). Spatial representations. Oxford:
Blackwell.
Eschenbach, C. & Kulik, L. (1997). An axiomatic approach to the spatial relations underlying
left–right and in front of–behind. (Manuscript submitted to publication). Hamburg:
University of Hamburg, Comp. Science Dept.
Franklin, N. & Tversky, B. (1990). Searching imagined environments. Journal of
Experimental Psychology, 119, 63–76.
Franklin, N., Tversky, B. & Coon, V. (1992). Switching points of view in spatial mental
models. Memory and Cognition, 20, 507–518.
Gapp, K.-P. (1996). Ein Objektlokalisationssystem zur sprachlichen Raumbeschreibung in
dreidimensionalen Umgebungen. (Doctoral dissertation, Universität des Saarlandes,
Saarbrücken, Germany).
Habel, Ch. (1990). Propositional and depictorial representations of spatial knowledge: The
case of path concepts. In R. Studer (ed.): Natural language and logic. (pp. 94-117).
Lecture Notes in Artificial Intelligence. Berlin: Springer.
Herskovits, A. (1986). Language and spatial cognition. Cambridge: Cambridge University
Press.
Jarvella, R.J. & Klein, W. (eds.) (1982) Speech, place, and action. Chichester: Wiley.
Levelt, W. J. M. (1996). Perspective taking and ellipsis in spatial description. In P. Bloom;
M.A. Peterson; L. Nadel; & M.F. Garrett (eds.), Language and Space (pp. 77–107).
Cambridge, MA: The MIT Press.
Levinson, S.C. (1996). Frames of reference and Molyneux's question: Crosslinguistic
evidence. In P. Bloom; M.A. Peterson; L. Nadel; & M.F. Garrett (eds.) Language and
space. (pp. 109–169). Cambridge, MA: MIT-Press.
57
Maaß, W. (1996). Von visuellen Daten zu inkrementellen Wegbeschreibungen in
dreidimensionalen Umgebungen: Das Modell eines kognitiven Agenten. (Doctoral
dissertation, Universität des Saarlandes, Saarbrücken, Germany).
Miller, G. & Johnson-Laird, P.N. (1976). Language and perception. Cambridge: Cambridge
Univ. Press.
Retz-Schmidt, G. (1988). Various views on spatial prepositions. AI Magazine, 9. 95–105.
Schober, Michael F. (1993). Spatial perspective-taking in conversation. Cognition, 42, 1–24.
Talmy, L. (1983). How language structures space. In H. Pick & L. Acredolo (eds.). Spatial
orientation. (pp. 225–282) New York: Plenum.
Tversky, B. (1996). Spatial perspective in descriptions. In In P. Bloom; M.A. Peterson; L.
Nadel; & M.F. Garrett (eds.) Language and space. (pp. 463–491). Cambridge, MA:
MIT-Press.
Vandeloise, C. (1991). Spatial Prepositions: A case study from french. Chicago: University of
Chicago Press.
van der Zee, E. (1996). Spatial knowledge and spatial language. Ph.D. Dissertation.
Rijksuniversiteit Utrecht.
Wunderlich, D. & Herweg, M. (1991). Lokale und Direktionale. In A. v. Stechow & D.
Wunderlich (Hrsg.): Semantik. Ein internationales Handbuch der zeitgenössischen
Forschung. (pp. 758–785). Berlin/New York: de Gruyter.
... Both adverbs and prepositions are semantically different from adjectives as they are not used to filter objects, but rather denote spatial regions. In some cases they denote spatial regions in relation to a reference object or landmark (Eschenbach et al., 1997). Yet, the split into categories goes even further. ...
Chapter
Full-text available
This chapter presents an operational grammar for German spatial language, in particular German locative phrases, as a case study for processing distributed information. It investigates the complex interplay of syntactic phenomena and spatial semantics, with a specific emphasis on efficient processing of syntactic indeterminacy and semantic ambiguity. Since FCG applies constructions in a sequence one after the other, the main challenge lies in mutual dependencies between constructions, that is, some constructions require pieces of information in order to make decisions that are only later on provided by other constructions. We present solutions and design patterns for dealing with these processing issues, which all have in common the strategy of postponing decisions as long as possible in processing until all the necessary information for making the decision is available.
... The lack of formalization of frames of reference has probably been the major barrier for the inclusion of directional relations in spatial query languages. Early studies on the link between projective terms and frames of reference have been conducted by Eschenbach [17,18] and later by Moratz and Tenbrink [19]. ...
Article
Full-text available
As an intermediate category between metric and topology, directional relations are as much varied as “right of”, “before”, “between”, “in front of”, “back”, “north of”, “east of”, and so on. Directional relations are ambiguous if taken alone without the contextual information described by frames of reference. In this paper, we identify a unifying framework for directional relations and frames of reference, which shows how a directional relation with its associated frame of reference can be mapped to a projective relation of the 5-intersection model. We discuss how this knowledge can be integrated in spatial query languages.
Article
Central for the discussion about the pros and cons of pictorial representations is the indeterminacy problem. Whereas propositional representations can be underdetermined, it is a widespread opinion that pictorial representations are completely determined and committed to details. In contrast to this view, which is held — for example by Dennett, Pylyshyn and Iorger — in the present paper a variable system of commitments is proposed: Users of pictorial representations have alternatives with respect to interpretations and commitments since there are implicit annotations to these representations. The annotations refer to axiomatized geometric systems, which — from a cognitive point of view — can be seen as systems of commitments.
Article
Full-text available
The reading of an excerpt of England, My England (“Tickets, please”) by D. H. Lawrence leads the reader into an adventurous journey where speed and pause, acceleration and slowing down, appeal and repulsion, relief and fear combine into a varied and eventful trip through the Midlands. The author makes use of all his art together with the means offered by language so as to take him/her on a small country train/tramcar. Our goal is to display and study the skilful range of stylistic devices, visual effects, pace, choice of metaphors and lexis implemented to give the story the most evocative dynamics.
Article
Full-text available
This chapter presents an operational grammar for German spatial lan-guage, in particular German locative phrases, as a case study for processing distributed information. It investigates the complex interplay of syntactic phe-nomena and spatial semantics, with a specific emphasis on efficient process-ing of syntactic indeterminacy and semantic ambiguity. Since FCG applies constructions in a sequence one after the other, the main challenge lies in mu-tual dependencies between constructions, that is, some constructions require pieces of information in order to make decisions that are only later on pro-vided by other constructions. We present solutions and design patterns for dealing with these processing issues, which all have in common the strategy of postponing decisions as long as possible in processing until all the neces-sary information for making the decision is available.
Conference Paper
The importance of studying spatial cognition in cognitive science is enforced by the fact that the applicability of spatial concepts and spatial expressions is not limited to the spatial domain. We claim that common structures underlying both concrete, physical space and other domains are the basis for using spatial expressions, e.g., prepositions like between, with respect to space as well as time or other domains. This claim opposes the thesis that the common use is based upon an analogy between concrete space and other domains. The development of geometry from Euclid's Elements to more differentiated systems of diverse geometries and topologies can be perceived of as an example of the transfer from modeling concrete space towards describing abstract spatial structures.
Article
Full-text available
Four experiments explored readers' mental models of described scenes. Environments were described from one of two perspectives, an internal perspective of an observer within the scene, surrounded by objects, or an external perspective of an observer outside the scence, with objects in front. Subjects read narratives describing a scene and were probed for locations of objects. In the general case, reaction times to identify objects were fastest for the head/feet (above/below) axis, then the front/back (front/behind) axis, and then the left/right axis, conforming to the spatial framework analysis which reflects people's conceptions of space based on typical interactions in space. For the internal spatial framework, readers were faster to questions of front than back, reflecting the perceptual and biological asymmetries that favor an observer's front. For the external spatial framework, all objects were in front of the observer and readers were equally fast to questions of front and behind. The difference between internal and external spatial framework reflects the different perceptual experience of observers in the two perspectives. The two variants of the spatial framework allowed us to infer readers' spatial perspective for narratives with unspecified perspectives.
Article
Full-text available
Subjects read narratives describing directions of objects around a standing or reclining observer, who was periodically reoriented. RTs were measured to identify which object was currently located beyond the observer’s head, feet, front, back, right, and left. When the observer was standing, head/feet RTs were fastest, followed by front/back and then right/left. For the reclining observer, front/back RTs were fastest, followed by head/feet and then right/left. The data support the spatial framework model, according to which space is conceptualized in terms of three axes whose accessibility depends on body asymmetries and the relation of the body to the world. The data allow rejection of the equiavailability model, according to which RTs to all directions are equal, and the mental transformation model, according to which RTs increase with angular disparity from front.
Article
Full-text available
In six experiments, subjects read narratives describing varying spatial scenes with more than one point of view. They were probed with questions about objects located in six directions from each character’s point of view. Subjects’ response times were consistent with a one place-one perspective rule. They seemed to form separate mental models for separate places and to take a character’s perspective when there was only one relevant character in a scene, but they seemed to take a neutral perspective when there was more than one probed point of view, rather than switch perspectives.
Article
1.0 What this is all about 2.0 Cross-modal transfer of frame of reference: evidence from Tenejapan Tzeltal 2.1 Tzeltal absolute linguistic frame of reference 2.2. Use of absolute frame of reference in non-verbal tasks
Conference Paper
This chapter is concerned with the structure that is ascribed to space and the objects within it by linguistic “fine structure,” that subdivision of language which provides a fundamental conceptual framework. The primary aim of the chapter is to characterize the general properties of this structuring and the linguistic-cognitive system in which it participates.
Article
Investigated people's descriptions of spatial environments, focusing on perspective. In Exp 1, 67 undergraduates viewed a map of a town, a convention center, or an amusement park and completed recall tasks. In Exp 2, 48 undergraduates studied 4 maps and wrote a description of the map so that someone who was unfamiliar with the environment and had not seen the map would know where the landmarks were. In Exp 3, 67 college students described 1 of 3 environments they would have learned by navigating them through them regularly. Results show that Ss used survey, mixed, and route perspectives. The configuration of an environment seems to affect perspective choice. Ss used language differently when using gaze, route, and survey perspectives, and the perspectives correspond to prototypic relative, intrinsic, and extrinsic frames of reference, respectively. (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Chapter
One essential function of language is to refer to objects and situations in the world. This process is mediated by nonlinguistic mental representations, most prominently by perceptual representations in different modalities. Human minds have the ability to establish systematic relationships between linguistic forms and perceptually based knowledge. This grounding of linguistic symbols in perceptual representations (Harnad, 1990), though often overlooked in linguistics and artificial intelligence, is essential to understanding linguistic abilities and linguistic structure. And a good way to examine it is to investigate our ability to talk about space; the spatial world seems amenable to precise and objective description - unlike, say, the world of smells and feelings - and much is known about visual and spatial perception.
Conference Paper
This paper presents an axiomatic characterization of spatial orderings in the plane and of concepts underlying intrinsic and deictic uses of spatial terms such as in front of, behind, left and right. This characterization differs in several aspects from existing theories that either employ systems of coordinate axes or systems of regions to specify the meaning of such expressions. We argue that the relations given by in front of and behind can be modeled on the basis of linear orders and on the basis of axes, whereas the relations given by left and right can be modeled as planar and on the basis of regions. The explicit characterization of the means necessary to specify the intrinsic and deictic uses thereby sheds light on the structures contributed by different frames of reference and therefore contributes to understanding the deictic/intrinsic-distinction.