Hartmut Stöckl’s research while affiliated with University of Salzburg and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (17)


Heike Ortner. 2023. Sprache – Bewegung – Instruktion. Multimodales Anleiten in Texten, audio-visuellen Medien und direkter Interaktion (Sprache im Kontext 48). Berlin, Boston: De Gruyter. 358 S.
  • Article
  • Full-text available

October 2024

·

5 Reads

Zeitschrift für Rezensionen zur germanistischen Sprachwissenschaft

Hartmut Stöckl
Download

Figure 2. WWF, Bolivia, Humano, Santa Cruz (LA 5/2020: 117)
Figure 3. Friends of the earth, UK, Engine, London (LA 6/2019: 108)
Figure 4. Mighty earth, UK, Daughter, London (LA 1/2021: 126)
(continued)
Detecting generic patterns in multimodal argumentation: A corpus-based study of environmental protection print-ads

September 2024

·

55 Reads

·

3 Citations

Journal of Argumentation in Context

The present study devises and puts into practice an annotation scheme for interrogating the patterns of multimodal argumentation found in environmental protection print-advertisements collected between 2018 and 2022. 134 ads featuring the sub-topics climate change, deforestation, pollution, and preservation have been subjected to annotations for various features on four levels: genre/text, image, multimodal argument and multimodal coherence/rhetoric. By contrast with previous, predominantly case-based studies in argumentation, the approach presented here aims not to reconstruct single instances of multimodal argumentation but to identify recurrent patterns along with their typical features. The results show distinct regularities in the way arguments for environmental protection are constructed from large images and short text.



FIGURE Surfrider Foundation, France, Babel, Paris (Lürzer's Archive, ,/////, p. ...).
FIGURE E
Fresh perspectives on multimodal argument reconstruction

February 2024

·

105 Reads

·

5 Citations

Frontiers in Communication

The present contribution exemplifies current models for argument reconstruction on an environmental protection print-ad, identifying deficits in the way the models account for multimodal argumentation. Based on this critical review, three general research perspectives are suggested for making argument reconstruction maximally multimodal: the reach and logic of semiotic modes, multimodal coherence, and genre-specific multimodal discourse structure.


Bold and impactful: a reappraisal of Gunther Kress’s (social) semiotic legacy in the light of current multimodality research

February 2023

·

585 Reads

·

1 Citation

Text & Talk - An Interdisciplinary Journal of Language Discourse Communication Studies

This paper is a critical appreciation of some of Gunther Kress’s central (social) semiotic notions: i.e., motivation, materiality, rhetorical aptness and semiotic mode versus medium. These will be discussed in relation to four landmark models of sign-making and semiosis by Saussure, Peirce, Bühler and Jakobson. Based on these comments, the paper identifies the persistent difficulties current multimodality research faces in defining mode and in devising linguistically unbiased grammars of non-verbal modes. Finally, the argument is advanced that multimodal genre and discourse interpretation in particular deserve to be re-developed. The paper critiques Kress’s insistence on motivation as a universal principle of sign use and his overemphasis on materiality to the detriment of grammar, while praising his overall (social) semiotic legacy for multimodality research as far-sighted and lastingly influential.



Multimodal Coherence Revisited: Notes on the Move From Theory to Data in Annotating Print Advertisements

July 2022

·

244 Reads

·

13 Citations

Frontiers in Communication

The present paper proposes a preliminary annotation framework for the study of multimodal coherence in print ads. The framework is firmly based on a review of current theorizing on multimodal cohesion and coherence. Following guidelines for good empirical practice, the annotation scheme is tested on 50 ad samples, seeking to illustrate genre-specific qualities of multimodal coherence and to identify difficulties in applying conceptual frameworks to data. The paper employs six dimensions of multimodal coherence: layout, cohesive ties, info-linking, relational propositions, mode-centricity and multimodal rhetorical operations. In conclusion, we outline some of the more general challenges that multimodal annotation raises when it makes close contact with data.




Transcript Orchestre de Paris, 1_09022016, 0008, 03:41–04:03 (a) Movement of upper body and arms. (b) Indexes extended upwards. (c) Imitating the bow movement.
Continued.
Extract from the score I.
Extract from the score II.
Modeling multimodal interaction in orchestra rehearsal – levels and relations.
Tam pam pam pam and mi – fa – sol: constituting musical instructions through multimodal interaction in orchestra rehearsals

October 2021

·

69 Reads

·

9 Citations

Multimodal Communication

Using multimodal (inter)action/conversation analysis, the present contribution inventories the repertoire of higher-level actions that constitute musical instruction in orchestra rehearsals. The study describes the modal complexity of the instructional actions as built from a varied combination of speech, gesture, gaze, vocalizing and body posture/movement. A high modal intensity of speech and vocalizing is explained with recourse to their contextually useful modal reaches. While some modes, like vocalizing and body posture appear to be action-specific, others turn out to be pervasive default modes. Besides modal intensity, the study also attends to the transitioning between higher-level actions through gaze and the role of the score as frozen action. The analyses help demystify orchestra rehearsals as a special type of professional communicative interaction, which builds on a rich multimodal texture motivated by recurring instructional functions. The methodological rationale demonstrated will be suited to exploring the social variation of instructional interaction in orchestra rehearsals.


Citations (10)


... In keeping with this, there are many cases in which the entertainment value of advertisements is more impressive than their success providing good reasons for accepting the conclusion that we should buy what they are selling. Our examples show that advertisements can be good arguments but there are cases in which it might seem plausible to treat them as entertainment rather than argument (see Stöckl 2024). ...

Reference:

Auditory arguments, advertising, and argumentation theory: Hitting sour notes or ringing true?
Detecting generic patterns in multimodal argumentation: A corpus-based study of environmental protection print-ads

Journal of Argumentation in Context

... La argumentación multimodal en el aprendizaje del español La integración semiótica de imágenes digitales en el aprendizaje de lenguas promueve un enfoque de aprendizaje activo y participativo(de Luna, 2014) donde el estudiantado puede interactuar epistémicamente con las imágenes aplicando la información de manera creativa, como ocurre en actividades transmodalizadoras que involucran la invención de historias visuales, la descripción de imágenes o la participación en proyectos de diseño con recursos multimedia atractivos, motivadores y significativos(Reyes y Lacorte, 2024). Esta vertiente epistémica es esencial en la enseñanza de idiomas, pues reconoce en la imagen un poder constructivo de conocimiento que permite producir argumentos(Stöckl, 2024) y trabajar en el aprendizaje de una lengua extranjera la expresión discursiva de la argumentación multimodal ensamblando múltiples recursos verbales e icónicos de índole digital(Caro et al., 2023). En relación con el aprendizaje del español, la argumentación multimodal cobra especial relevancia cuando se trata de comunicar ideas de manera convincente o persuadir a los demás. ...

Fresh perspectives on multimodal argument reconstruction

Frontiers in Communication

... 16), and mathematical sensemaking processes such as these are fundamentally aesthetic and embodied (e.g., Jasien & Horn, 2022), as well. Further, this choice to attend to other forms of relationality is also consistent with research suggesting that a reader's interpretation of multi-modal texts is impacted by factors that are not strictly logical (e.g., Stöckl & Bateman, 2022). As detailed previously, aesthetic forces and expectations may direct a reader's attention to certain (culturally constructed) narrative structures and textual modes of organization when making sense of how a narrative hangs together (e.g., Gadanidis & Hoogland, 2003;Shanahan et al., 2011). ...

Editorial: Multimodal coherence across media and genres

Frontiers in Communication

... These layers are designed to reflect the rich symbolic resources that constitute the essence of Cantonese Opera. While emphasizing the specialized knowledge of Cantonese Opera, the annotations are meticulously categorized into distinct layers, each serving a specific purpose (Stöckl and, 2022). The layers include: ...

Multimodal Coherence Revisited: Notes on the Move From Theory to Data in Annotating Print Advertisements

Frontiers in Communication

... Instructive actions aim to encourage others to perform an action, to guide them in their performance, or to achieve a goal through more complex sequences of multimodal actions (Ehmer et al., 2021). They are co-constructive, collaborative achievements with varying degrees of complexity and variability in multimodal configurations, their density, complexity, and intensity (Stoeckl and Messner, 2021), according to recipient design, situational contingencies, and interactional framework. Instructive actions can be distinguished according to several aspects, including the immediacy of the action to be performed, the synchronization between the instruction and the instructed action (whether process-bound or out-of-process), and the coordination load between participants or co-instructors, which depends on spatial arrangements and the balance between static and dynamic perspectives (Haddington et al., 2013). ...

Tam pam pam pam and mi – fa – sol: constituting musical instructions through multimodal interaction in orchestra rehearsals

Multimodal Communication

... Based on a feature article in National Geographic (July, 2015) Pflaeging and Stöckl (2021) demonstrated methods for measuring colour, layout, and typography in an article. In a visual essay they draw attention to essential elements in graphic design, such as colour coding, composition and positioning of graphic shapes, contents, headlines, layout, page/image-flow, salience, structuring devices, and the use of white spaces. ...

Tracing The Shapes of Multimodal Rhetoric: Showing the Epistemic Powers of Visualization

Visual Communication

... As discussed by Pflaeging and Stöckl (2021), multimodality research fully developed in the 1990s, although its scope and concerns are as old and wide-ranging as rhetoric itself. It examines the use of various communicative elements such as speech, writing, images, sound, and other expressive resources, which are present in nearly all forms of human communication, including magazines, radio, films, and social media. ...

The Rhetoric of Multimodal Communication
  • Citing Article
  • June 2021

Visual Communication

... ЖЖ, Facebook 1 , ВКонтакте и др.) к обмену статичными изображениями (Instagram 2 , Pinterest) -англ. shift toward image-centricity [2], то сегодня становится очевидным движение коммуникации от статики к динамике -от неподвижных изображений к видео, причем преимущественно к короткометражным форматам 3 . ...

Shifts toward Image-Centricity in Contemporary Multimodal Practices
  • Citing Chapter
  • January 2020

... oder Normvarianten in Bezug auf die Interpunktion (Androutsopoulos, 2020) im digitalen Diskurs. Mit Schmitz kann man zudem von der Emergenz einer dritten Form von Schriftlichkeit sprechen(Schmitz, 2006: 89), in deren Kontext Sprache und Bild auf derselben visuellen Oberfläche angeordnet werden, was wiederum neue Möglichkeiten der multimodalen Kommunikation eröffnet(Stöckl, 2017; Stöckl, Caple & Pflaeging, 2020), die mittlerweile nicht mehr aus unserem kommunikativen Alltag wegzudenken sind.Die skizzierten Entwicklungen scheinen sich sprachenübergreifend niederzuschlagen und tragen möglicherweise zu einer Nivellierung kultureller Unterschiede im Kontext der globalen digitalen Kommunikation bei(Jereczek-Lipińska, Trybisz, Pozierak- Trybisz & Drzazgowska, 2021). Von Relevanz bleibt dennoch die Frage, inwieweit und auf welche Weise die digitalen Medien die Kommunikation zwischen Kulturen verändert, welche kulturellen Spezifika bestehen bleiben, sich verfestigen oder neu auftreten, und ob sich ggf. ...

Multimodality in a Diachronic Light Tracking Changes in Text-Image Relations within the Genre Profile of the MIT Technology Review
  • Citing Article
  • July 2017

Discourse Context & Media

... For every language two different advertisements are chosen randomly by considering the criteria that they include the following modalities: language, image and typography. The The analysis is based on multimodal oriented text analysis models of Angelika Hennecke (1999), Nina Janich (2010) and Hartmut Stöckl (2011). Furthermore the analysis includes text extern and text intern criteria. ...

Multimodale Werbekommunikation – Theorie und Praxis
  • Citing Article
  • March 2011

Zeitschrift für Angewandte Linguistik