Geert Brône

Geert Brône
KU Leuven | ku leuven · Department of Linguistics

Prof.Dr.

About

91
Publications
17,010
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
917
Citations

Publications

Publications (91)
Article
In the present study, informed by insights from cognitive and interactional linguistics, we set out to explore how facial expressions systematically occur as responses in interactional sequences. More specifically, we use FACS-analyses (Facial Action Coding System) to study which Action Units (AU) on the part of the listener co-occur with multimoda...
Article
Full-text available
Performing and understanding conversational irony requires a complex management of multiple viewpoints. To communicate and negotiate these intricate viewpoint shifts, speakers (and addressees) often use nonverbal means (e.g. gaze shifts, shrugs, shifts in body orientation, hand gestures, etc.) next to verbal viewpoint strategies. In the present pap...
Article
Full-text available
Performing and understanding conversational irony requires a complex management of multiple viewpoints. To communicate and negotiate these intricate viewpoint shifts, speakers (and addressees) often use nonverbal means (e.g. gaze shifts, shrugs, shifts in body orientation, hand gestures, etc.) next to verbal viewpoint strategies. In the present pap...
Article
Full-text available
In this contribution, we investigate the transfer of embodied procedural knowledge in two cello master classes, zooming in on what we identify as speech-embedded nonverbal depictions — cases where meaning is communicated nonverbally, iconically, and without temporally co-occurring speech — an overlooked domain in the literature foregrounded by a cr...
Article
When dialogue interpreters render an utterance from one language to the other, this can be viewed as a form of quoting. This is reflected, among others, in the principle of direct translation, according to which the rendered utterance should maximally reflect the original, including the use of the first person perspective of the primary participant...
Article
Full-text available
The framework of depicting put forward by Clark (2016) offers a schematic vantage point from which to examine iconic language use. Confronting the framework with empirical data, we consider some of its key theoretical notions. Crucially, by reconceptualizing the typology of depictions, we identify an overlooked domain in the literature: “speech-emb...
Article
Full-text available
In the introduction to the special issue on ‘Instructing embodied knowledge’, we present a general orientation into this growing field of research, providing the relevant background for the individual contributions. The starting point for the endeavor is the basic observation that practical knowledge or ‘knowing-how’ is typically of a procedural, i...
Preprint
Full-text available
Mobile eye-tracking systems have been available for about a decade now and are becoming increasingly popular in different fields of application, including marketing, sociology, usability studies and linguistics. While the user-friendliness and ergonomics of the hardware are developing at a rapid pace, the software for the analysis of mobile eye-tra...
Article
Full-text available
One basic characteristic of human interaction lies in its tight temporal coordination, i.e. interlocutors manage to achieve smooth turn-transitions and as such minimize the occurrences of gaps and overlaps. To accomplish this rapid exchange of turns-at-talk, interlocutors must not only recognize but also anticipate the end of the current speaker's...
Article
Full-text available
The aim of this article is to explore how affiliation ( Stivers 2008 ) with the patient is displayed and interactionally achieved in the context of an interpreter-mediated therapeutic dialogue. More specifically, we focus on the interplay between affiliative listener responses – especially head nods – and gaze in this setting. Interpreter-mediated...
Conference Paper
Full-text available
Mobile eye-tracking systems have been available for about a decade now and are becoming increasingly popular in different fields of application, including marketing, sociology, usability studies and linguistics. While the user-friendliness and ergonomics of the hardware are developing at a rapid pace, the software for the analysis of mobile eye-tra...
Article
This paper presents a corpus study on the role of gaze for overlap resolution in German and Dutch triadic interactions. The focus is on overlap due to a simultaneous start by two speakers with one speaker abandoning her TCU before reaching a point of completion. The gaze behaviours of all three participants in the conversations were recorded with m...
Article
This paper contributes to the growing line of research that takes a multimodal approach in the study of interpreter-mediated dialogues. Drawing on insights from Conversation Analysis and multimodal analysis, we investigate how extended multi-unit turns unfold with interventions of an interpreter and, more specifically, what is the role of gaze in t...
Article
Full-text available
Few investigations into the nonverbal communication in ensemble playing have focused on gaze behaviour up to now. In this study, the gaze behaviour of musicians playing in trios was recorded using the recently developed technique of mobile eye-tracking. Four trios (clarinet, violin, piano) were recorded while rehearsing and while playing several ru...
Article
This article examines the coordination of listener responses and gaze in the production of dual feedback in triadic interpreter-mediated interaction. The focus is on backchannel responses in turn-medial position accompanied by a gaze shift from the interpreter to the ‘principal’, through which the recipient displays a change in the epistemic stance...
Article
Full-text available
In a variety of research fields, including linguistics, human–computer interaction research, psychology, sociology and behavioral studies, there is a growing interest in the role of gestural behavior related to speech and other modalities. The analysis of multimodal communication requires high-quality video data and detailed annotation of the diffe...
Conference Paper
Full-text available
1 sarah.vandemoortele@luca-arts.be, 2 kurt.feyaerts@arts.kuleuven.be, 3 mark.reybrouck@kuleuven.be, 4 geert.debievre@luca-arts.be, 5 geert.brone@kuleuven.be, 6 thomas.debaets@luca-arts.be ABSTRACT [word count: 500] Investigations into nonverbal behaviour in ensemble playing have often focused on bodily movement. Even though the study of gaze behavi...
Article
This contribution focuses on the shrug as it is used in stance taking contexts in face-to-face conversations. The shrug qualifies as a ‘compound enactment’, in which prototypically different gestures are combined: “the eye-brows (which are being raised), the hands (which are turned so that the palms face up), the forearms (which may be lifted), and...
Article
In this paper, we present an embodiment perspective on viewpoint by exploring the role of eye gaze in face-to-face conversation, in relation to and interaction with other expressive modalities. More specifically, we look into gaze patterns, as well as gaze synchronization with speech, as instruments in the negotiation of participant roles in intera...
Poster
Full-text available
The global obesity epidemic continues to escalate despite decades of international effort. To date, most work in this area has focused on technical requirements and affordances, with little attention to the conceptual structures underlying the framing of health messages received by the general public. We propose that efforts to contain the obesity...
Article
A growing body of evidence shows that dialogue involves a process of synchronization across speakers at different semiotic levels. In this paper, we study which factors predict this synchronization process at the lexical and gestural level. A multifactorial analysis based on a video corpus of dyadic interactions reveals that cumulative priming can...
Conference Paper
Full-text available
The communicative behaviour of musicians is multimodal: it involves gaze behaviour, gesture and musical sound. This study focussed specifically on the function and timing of interactive gaze behaviour in musical duos. As the results show, gaze behaviour may shed a unique light on how musicians deal with synchronisation issues. The interest in music...
Article
On the basis of two empirical case studies, one on indexical and one on iconic co-grammatical gestures, this contribution aims to mark out the status of gesture in grammar. The main idea of this multimodal grammar is that words and gestures, although belonging to two distinct semiotic channels, have to be integrated into one single construction. Th...
Conference Paper
Full-text available
The detection of human hands is of great importance in a variety of domains including research on humancomputer interaction, human-human interaction, sign language and physiotherapy. Within this field of research one is interested in relevant items in recordings, such as for example faces, human body or hands. However, nowadays this annotation is m...
Conference Paper
We present a fast and accurate algorithm for the detection of human hands in real-life 2D image sequences. We focus on a specific application of hand detection, viz. the annotation of egocentric recordings. A well known type of egocentric camera is the mobile eye-tracker, which is often used in research on human-human interaction. Nowadays, this ty...
Article
Full-text available
Usage-based theories hold that the sole resource for language users’ linguistic systems is language use (Barlow & Kemmer, 2000; Langacker, 1988; Tomasello, 1999, 2003). Researchers working in the usage-based paradigm, which is often equated with cognitive-functional linguistics (e.g., Ibbotson, 2013, Tomasello, 2003), seem to widely agree that the...
Article
Interactive language use inherently involves a process of coordination, which often leads to matching behaviour between interlocutors in different semiotic channels. We study this process of interactive alignment from a multimodal perspective: using data from head-mounted eye-trackers in a corpus of face-to-face conversations, we measure which effe...
Conference Paper
Full-text available
Studies on language and cognition in interaction increasingly focus on the role of eye gaze as an important signal in interaction management, reference and grounding (Rossano 2012, Jokinen 2010, Bailly et al. 2010, Richardson et al. 2009). Interlocutors may use eye gaze as a means to take, hold or give the floor in conversation (turn management), t...
Conference Paper
Full-text available
Research on interactive communication increasingly focuses on the role of eye gaze as an important signal in interaction management, reference and grounding. Interlocutors may use eye gaze as a means to take, hold or give the floor in conversation (turn management), to refer to objects or persons in the conversational space (gaze cueing) or to give...
Conference Paper
Full-text available
Research on interactive communication increasingly focuses on the role of eye gaze as an important signal in interaction management, reference and grounding. Interlocutors may use eye gaze as a means to take, hold or give the floor in conversation (turn management), to refer to objects or persons in the conversational space (gaze cueing) or to give...
Conference Paper
It is a well-known fact that managing the flow of a dialogue in terms of sequentially organized speaker turns is a complex undertaking that requires a high degree of synchronized behavior across interlocutors. Early work in conversation analysis (e.g. Schegloff 1972) already pointed at the intrinsic multimodal nature of dialogue management, but nev...
Conference Paper
Full-text available
In this paper we present a highly accurate algorithm for the detection of human hands in real-life 2D image sequences. Current state of the art algorithms show relatively poor detection accuracy results on unconstrained, challenging images. To overcome this, we introduce a detection scheme in which we combine several well known detection techniques...
Book
To what extent can Cognitive Linguistics benefit from the systematic study of a creative phenomenon like humor? Although the authors in this volume approach this question from different perspectives, they share the profound belief that humorous data may provide a unique insight into the complex interplay of quantitative and qualitative aspects of m...
Article
In this paper, we take a Construction Grammar approach to Du Bois' concept of resonance activation. We suggest that the structural mapping relations between juxtaposed utterances in discourse, described in terms of diagraphs in dialogic syntax, can acquire the status of ad hoc constructions or locally entrenched form-meaning pairings within the bou...
Conference Paper
Full-text available
This PhD research focuses on a novel method for the automatic analysis of mobile eye-tracking data in natural environments. Mobile eye-trackers generate large amounts of data, making manual analysis very time-consuming. Available solutions, such as marker-based analysis minimize the manual labour but require experimental control, making real-life e...
Article
Research on the multimodal aspects of interactional language use requires high-quality multimodal resources. In contrast to the vast amount of available written language corpora and collections of transcribed spoken language, truly multimodal corpora including visual as well as auditory data are scarce. In this paper, we first discuss a few notable...
Conference Paper
Full-text available
In this paper we present a novel method for the automatic analysis of mobile eye-tracking data in natural environments. Mobile eye-trackers generate large amounts of data, making manual analysis very time-consuming. Available solutions, such as marker-based analysis minimize the manual labour but require experimental control, making real-life exper...
Article
Full-text available
The various incarnations of cognitive linguistics can be characterized by a common contextualized view on linguistic structure. Emerging from this philosophical cornerstone of the cognitive-linguistic enterprise is a growing body of research that systematically inquires into the intricate interplay of the cognitive, social and situational dimension...
Conference Paper
Full-text available
The recent development of user-friendly plug-and-play mobile eye-tracking technology has paved the way for research into visual behavior and real-life user experience in natural environments, such as public spaces, commercial environments or interpersonal communicative settings. The challenge for this new type of pervasive eye-tracking is the proce...
Chapter
In recent years, cognitive science has started to explore a dimension of language use often relegated to second place in linguistic theorizing, viz. the coordination of individual linguistic acts and broader joint actions between interlocutors as a conditio sine qua non for successful communication (Clark 1996). One of the key features of multi-age...
Conference Paper
Full-text available
In this paper we investigate the integration of object detection algorithms with eye-tracking data. The emerging technology of lightweight mobile eye-trackers enables realistic in-the-wild user experience experiments. Unfortunately, mobile eye-trackers generate a large amount of video data, which up to now requires manual analysis. This time-consum...
Conference Paper
Early work on applied eye tracking investigated gaze as an input modality to interact with a desktop computer and discussed some of the human factors and technical aspects involved in performing common computer tasks with the eyes such as pointing and menu selection. Since then, eye tracking technology has considerably matured. Research on eye-base...
Chapter
This chapter presents an overview of the state of the art in research on humour and irony, both from the perspective of cognitive pragmatics and of the more narrowly defined field of cognitive linguistics. Although irony and humour are not generally considered to be strictly distinguishable categories, the dichotomy will serve to structure the chap...
Article
Full-text available
In this paper we present the outlines of a new project that aims at developing and implementing effective new methods for analyzing gaze data collected with mobile eye-tracking devices. More specifically, we argue for the integration of object recognition algorithms from vision engineering, such as invariant region matching techniques, in gaze anal...
Article
Full-text available
We investigate empirically whether framing in general, and the use of Simplifying Models as a framing tool in particular, has an effect on the way topics are cognitively construed. Existing studies on framing in linguistics have either been theoretical or descriptive. Going beyond such methodologically simple approaches, we use a more rigid test de...
Article
Full-text available
Two experiments investigated the processing and appreciation of double grounding, a form of intentional ambiguity often used in the construction of headlines. For example, in “Russia takes the froth off Carlsberg results,” the key element, “takes the froth off,” is significant both metaphorically, where it refers to the detrimental impact of Russia...
Article
Full-text available
Speakers who engage in the joint activity of a conversation tend to align their utterances with those of their interlocutors by reusing, reinterpreting, hence playing with co-present linguistic material. One dimension of alignment is the activation of resonance, as recently developed within the model of ‘dialogic syntax’ (Du Bois, 2001). When speak...
Book
For more than two decades now, cognitive science has been making overtures to literature and literary studies. Only recently, however, cognitive linguistics and poetics seem to be moving towards a more serious and reciprocal type of interdisciplinarity. In coupling cognitive linguistics and poetics, cognitive poeticians aim to offer cognitive readi...
Article
This paper explores the semantic–pragmatic intricacies of two related types of interactional humor. The two phenomena under scrutiny, hyper-understanding (Veale et al., 2006) and misunderstanding, are categorized as responsive conversational turns as they connect to a previously made utterance. In the first part of the paper, an analytical model is...
Article
Context - In contrast to the vast literature on modality, only few cognitive linguistic studies have been devoted exclusively to the expression of futurity. This paper shows how cognitive linguistics (CL) may contribute to a better understanding of the linguistic form and meaning of futurity in Italian and German.Three theoretical cognitive framewo...
Article
Full-text available
Ever since the publication of Victor Raskin's seminal work on the Semantic Mechanisms of Humor (1985), linguistic humor research has had a decidedly cognitive orientation. The cognitive psychological roots of the Semantic Script Theory of Humor (SSTH) presented in the aforementioned book, have been adopted in a large number of studies that have app...
Article
Full-text available
In this paper, we provide an in-depth cognitive analysis of a specific humor strategy we coin ''trumping'', a multi-agent language game that revolves around the subversion of the linguistic forms of exchange. In particular, we illustrate how, in a conversational setting, agents can ''reflect'' and ''dis- tort'' the linguistic-conceptual construal o...
Article
Full-text available
Metonymy has received renewed attention in recent cognitive linguistic research as a prominent cognitive construal operation underlying many types of everyday language use. However, the same conceptualization mechanism is exploited for the realization of expressivity effects as well. The present paper explores the way in which metonymy contributes...