Chapter

Introduction: A call for Multimodal Theory & Developments in Multimodality between 2000 and 2005

December 2015

In book: Multimodality: Critical Concepts in Linguistics (pp.1-2)
Edition: 1
Chapter: Introduction
Publisher: Routledge
Editors: Sigrid Norris

Authors:

Victoria University of Wellington

This introductory chapter is divided into four parts; and throughout, the chapter illuminates research into Text, Image, Interaction, Object, Music, and Colour. First, the chapter discusses a call for multimodal theory positioned in the year 2000. Subsequently, the chapter explicates immediate developments in multimodality between the years 2000 and 2001. Following this, the chapter exemplifies how a strong foundation for research in multimodality was laid during the very important years of 2002, 2003, and 2004. The chapter ends by discussing further developments in the years 2004 and 2005.

ResearchGate has not been able to resolve any citations for this publication.

ResearchGate has not been able to resolve any references for this publication.

Article

Color Texture Classification By Wavelet Energy Correlation Signatures.

June 2000

. In the last decade, multiscale techniques for gray-level texture analysis have been intensively studied. In this paper, we aim on extending these techniques to color images. We introduce wavelet energycorrelation signatures and we derive the transformation of these signatures upon linear color space transformations. Classification experiments demonstrate that the wavelet correlation features ... [Show full abstract] contain more information than the intensity or the energy features of each color plane separately. The influence of image representation in color space is evaluated. 1 Introduction For image analysis, color and texture are two of the most important properties, especially when one is dealing with real world images. Classical image analysis schemes only take into account the pixel gray-levels, which represents the total amount of visible light at the pixels position. The performance of such schemes can be improved by adding color information [1]. The color of a pixel is typically represent...

Article

Generating Interactive Explanation

June 1999

Alison Cawsey

Existing approaches to text generation fail to consider how interactions with the user may be managed within a coherent explanation or description. This paper presents an approach to generating such interactive explanations based on two levels of discourse planning -- content planning and dialogue planning. The system developed allows aspects of the changing context to be monitored with an ... [Show full abstract] explanation, and the developing explanation to depend on this changing context. Interruptions from the user are allowed and dealt with (and resumed from) within the context of that explanation. Introduction Complex explanations and descriptions are required in many existing computer applications. Tutorial, advisory and help systems may all sometimes need to present some complex piece of information, which cannot be reasonably be presented in one `chunk'. In human discourse this may result in complex `explanatory dialogues', where an expert attempts to explain something, checking the novice's unders...

Chapter

Conclusion II: Two Modes of Interpretation

January 2012

Ulrich Pardey

This book is intended to be an introduction to the practice of interpreting philosophical texts. By this I mean that a novice interpreter can take it as an example of the art of philosophical interpretation, using it to observe how an author engages in the practice of interpretation and in this way being introduced to that practice him- or herself. As with any art, it is more important to master ... [Show full abstract] the practice of interpreting than to be able to talk about it in the abstract and theoretically. Being able to say something smart and interesting about piano music might qualify you as a music critic, but it will hardly compensate for the miserable piano performance you gave the night before. This book is to introduce the reader to the practice, not the theory of interpretation (the latter of which is called ‘hermeneutics’).

Conference Paper

Detecting Regular Structures for Invariant Retrieval

March 1999

Dmitry Chetverikov

. Many of the existing approaches to invariant content-based image retrieval rely on local features, such as color or specific intensity patterns (interest points). In some methods, structural content is introduced by using particular spatial configurations of these features, which are typical for the pattern considered. Such approaches are limited in their capability to deal with regular ... [Show full abstract] structures when high degree of invariance is required. Recently, we have proposed a general measure of pattern regularity [2] that is stable under weak perspective of non-flat patterns and varying illumination. In this paper we apply this measure to invariant detection of regular structures in aerial imagery. 1 1 Introduction This paper addresses the problem of invariant search of structured (repetitive) intensity patterns, e.g., regular textures, in arbitrary scenes. Structure-based image retrieval is an unsolved and challenging task. The basic problem is the computational complexity of structure d...

Article

Detecting Changes in Scenes

July 1997

Ovidiu Marina

Introduction Contrary to popular belief, the ability of people to detect single changes in a scene can be very poor, even when all the information is visibly available to them (Grimes, 1996). Some types of changes are more easily detected than others; however, what constitutes a change sufficiently significant to be detected is unclear (O'Regan, 1992). Changes usually made to images are the ... [Show full abstract] removal of an object, the change in location or structure of an object, or the change of the color of an object. In a recent experiment, Rensink et al. (1997) showed that subjects are faster at determining the exact change if it is a color change than if it is a disappearance change, and in turn subjects are faster at determining an object disappearance change than an object location change. The poor ability of people to detect changes in visual scenes has been shown in experiments in which images are altered during saccades (Grimes, 1996), and in experiments in which the original image and its alte

Article

Full-text available

A Colour Object Search Algorithm

September 1998

In this paper a colour object search algorithm is presented. Given an image, areas of interest are generated (for each database model) by isolating regions whose colours are similar to model colours. Since the model may exist at one or more of these region locations, each is examined individually. At each region location the object size is estimated and a growing process initiated to include all ... [Show full abstract] pixels with model colours. Growing is terminated when a match measure (based on object size and the number of pixels with each model colour) is maximised; if it exceeds a predefined threshold then the object is assumed to be present. Several experiments are presented which demonstrate the algorithm's robustness to scale, affine object distortion, varying illumination, image clutter and occlusion. 1 Introduction Object search requires two capabilities: the ability to recognise an object when it comes into view and a mechanism that brings the object into view. The first of these probl...

Article

Full-text available

A Hardware-Software Partitioning Algorithm for Minimizing Hardware

April 1998

Partitioning a system's functionality among interacting hardware and software components is an important part of system design. We introduce a new partitioning algorithm that caters to the main objective of the hardware/software partitioning problem, i.e. minimizing hardware for given performance constraints. We demonstrate results superior to those of previously published algorithms intended for ... [Show full abstract] hardware/software partitioning. Contents 1 Introduction 2 2 Problem Definition 4 3 Solving the hardware/software partitioning problem 5 3.1 Greedy algorithms : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : 5 3.2 Hill-climbing algorithms : : : : : : : : : : : : : : : : : : : : : : : : : : : : : 6 3.3 A new algorithm based on constraint-search : : : : : : : : : : : : : : : : : : 8 3.3.1 Foundation : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : 8 3.3.2 Algorithm : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : 10 3.3.3 Reducing runtime in p...

Article

Research of accurate control color of CRT display in small range

July 2007

The present accuracy of CRT characterization is about 0.5ΔE* ab. In some experiments of measurement of color difference, color appearance, image appearance, contrast sensitivity function, accurate control color in small range around color centers is necessary. A method of color control in experiment is presented, which adopts the linear interpolation and takes into account the interaction of ... [Show full abstract] three channels in small range. With this method, the experimental results show that characterization accuracies are 0.14, 0.082, 0.103 for L*, a*, b* respectively, and 0.18, 0.18, 0.22 for three kinds of color differences of CIELAB, CIE94, CIEDE2000.

Article

Object Recognition Using Colour, Shape and Affine Invariant Ratios

November 1999

Paul Walcott

This paper describes a spectral-spatial model (for colour object recognition) which exploits the shape, colour and position of regions on the surface of a rigid object in describing it. Given a model and test image (with colour constancy pre-processing) suitably segmented into colour regions, model and test regions with similar shape and colour are identified. If at least three model regions have ... [Show full abstract] matching test regions then the consistency of these matches are verified using distance/area affine invariant ratios. Subsequently, model regions are affine transformed into image space for matching, from which a match probability is determined. Experimental results demonstrate that this model is significantly invariant to illumination changes, affine deformity and partial occlusion. 1 Introduction In [12] a spectral-spatial model (which was used for colour object recognition) called the colour landmark model (CLM) was presented which was significant invariant to illumination chan...

Article

Full-text available

Using Colour for Image Indexing

December 1999

Image colour is often thought to be an intrinsic correlate of surface reflectance and so is a common feature for image indexing. In this paper we point out that image colour is actually a function of surface reflectance and imaging geometry and the colour of the viewing illuminant. Fortunately methods exist for normalizing away these dependencies. Pixel based and colour channel-based ... [Show full abstract] normalizations remove dependency on geometry and light colour respectively. Unfortunately, neither method removes both dependencies simulataneously and so a single normalization must be chosen. Common practice dictates that pixel-based normalization is the most useful. In contrast experiments that we carried out, on a variety of image databases cited in the computer vision literature, favour colour channel normalization. 1 Introduction At first glance, image colour would appear to be an ideal feature for image indexing by image content. For example, because images of `beach scenes' typically comprise sea...

Article

Full-text available

«La nieve arder». La retórica afectiva en el universo petrarquista de la zarzuela Acis y Galatea

December 2004 · Revista de Literatura

Lucía Díaz Marroquín

«La nieve arder» analyses the zarzuela Acis y Galatea , with music by Jose de Literes on a libretto by Antonio de Canizares, in the context of the Petrarchan-inherited aesthetics. It focuses on the rhetorical aspects expressed both in text and music, strongly influenced by the Aristotelian tradition, and re-interpreted in several textual and musical treatises: Robortello, Herrera, Lope de Vega ... [Show full abstract] and, within a musical context, those by Zarlino, Caccini, Galilei, Kircher, Bermudo and Nasarre, amongst others. This article also takes into account the historical aspects relevant for the first performances of Literes and Canizares' zarzuela , as well as the social and political circumstances which influenced the introduction of the Italian dramma per musica in 17 th century Spain.

Article

EFFECTS OF AN ORGANIZER ON MEMORY FOR PROSE

January 1984 · Journal of Educational Psychology

SJ DERRY

One hundred twelve undergraduates read a literature text preceded by either a comparative advance organizer or a placebo introduction. Three hypotheses regarding the interactive effects of the organizer treatment and reasoning skills were tested as follows: the assimilation, the schema + correction, and the assimilation + correction hypotheses. Findings favored the assimilation + correction view, ... [Show full abstract] which holds that schema-implied text units are assimilated and obscured in the final text encoding, whereas ideas representing unexpected, schema-modifying information are enhanced. The dominant treatment effect was assimilatory loss of detail associated with implied information. Positive effects on schema-modifying information were observed for subjects with good reasoning skills.