PosterPDF Available

Can you draw me a question?

August 2019

DOI:10.13140/RG.2.2.15700.14729

Conference: ICPhS 2019
At: Melbourne, Australia
Affiliation: University of Cologne

Authors:

University of Cologne

University of Cologne

Poster for the 2nd Prosody Visualisation Challenge (PVC2)

Content uploaded by Martine Grice

Content may be subject to copyright.

Content uploaded by Aviad Albert

Content may be subject to copyright.

F0 (Hz)

Periodic energy

F0 (Hz)

Periodic energy

Can you draw me a question?

F0 (Hz)

Periodic energy

Periograms:Modulating F0 trajectories with

corresponding periodic energy to reflect gradual

strength of pitch perception [1,2]

Sources: (main+image) Morning Joe, MSNBC 2014; (top) Glenn Beck,

Fox News 2009; (bottom) Morning Joe, MSNBC 2013.

Projecting controversy

Bird pattern

: global F0 fall + global rise

Sources: (main+image) Washington Journal, CSPAN 2015; (top) Right This

Minute, Fox KTVU 2015; (bottom) San Francisco Government TV, 2012.

Polite preliminary (request)

Global rising F0

Aviad Albert, Francesco Cangemi and Martine Grice (IƒL-Phonetik, University of Cologne)

Floor taking (attention grab)

Initial local F0 rise + global fall

Sources: (main+image) Tucker Carlson Tonight, Fox News 2019; (top)

Morning Joe, MSNBC 2012; (bottom) Morning Joe, MSNBC 2009.

Motivation:Conventional fixed expressions

and catchphrases rely on prosody to communicate

systematic functionality, as well as uniqueness

Conclusions:By emphasising the relation between F0 and

periodic energy, periograms can intuitively display different

phonetic realisations of the same phrase in different interactional

settings, while accounting for pervasive syllabic reduction in

naturally occurring speech [6,7].

Periograms of spontaneous speech indicate that tonal events

might not have to be associated to canonical syllables as docking

sites, paving the way for an intonational phonology of

spontaneous speech [8,9].

References: [1] Deshmukh, O., C. Y. Espy-Wilson, A. Salomon & J. Singh.2005.Use of

temporal information:Detection of periodicity, aperiodicity, and pitch in speech.IEEE Transa cti on s on

Speech and Audio Processing 13 (5): 776-786. [2] Albert, A., F. Cangemi, M. Grice.2018.Using

periodic energy to enrich acoustic representations of pitch in speech: A demonstration.Proceedings

of the 9th Speech Prosody Conference,June 2018,Poznan. [3] Schegloff,E.A.1980.Preliminaries to

preliminaries:‘Can Iask you aquestion?’.Sociological Inquiry 50:104–152. [4] TV News Archive (2012).

https://archive.org/details/tv,accessed July 2019. [5] Winter, B., M. Perlman & T. Matlock.2013.Using

space to talk and gesture about numbers:Evidence from the TV News Archive.Gesture 13(3): 377-408.

[6] Ernestus, M., N. Warner (eds.) 2011.Speech Reduction.Journal of Phonetics 39(3): 253-452. [7]

Cangemi, F., M. Clayards,O.Niebuhr, B. Schuppler,M.Zellers (Eds.) 2018.Rethinking reduction:

Interdisciplinary perspectives on conditions, mechanisms, and domains for phonetic variation.Berlin:

De Gruyter Mouton. [8] Cangemi, F., A. Albert, M. Grice.2019.Modelling intonation:Beyond

segments and tonal targets.Proceedings of the 19th International Congress of Phonetic Sciences,

August 2019,Melbourne. [9] Ward,N.G.2019.Prosodic Patterns in English Conversation.Cambridge:

Cambridge University Press.

Data: Naturally occurring ‘can I ask you a question?’ [3] from the TV News Archive [4,5] and as a unique catchphrase

Source: Alaska's Can I Asssk You A Question -

RuPaul's Drag Race Season 8 Grand Finale, World of

Wonder 2016.

Catchphrase

Trademark rendition, using

prosody to achieve uniqueness

F0 (Hz)

Periodic energy

Prosody Visualisation Challenge 2 (ICPhS 2019, Melbourne Australia)

ResearchGate has not been able to resolve any citations for this publication.

Using space to talk and gesture about numbers: Evidence from the TV News Archive

Article

Full-text available

Jul 2014

This paper examines naturally occurring gestures produced in descriptions of numbers and quantities in television newscasts. The results of our analysis show that gestures reveal the metaphorical and spatial nature of numerical thinking. That is, speakers’ hands mimic known spatial mappings between space and quantity, including horizontal mappings (smaller quantities left, larger quantities right), vertical mappings (smaller quantities down, larger quantities up) and size-based mappings (smaller quantities “small”, larger quantities “large”). Speakers frequently switch between these different spatial mappings, and they sometimes combine them within the same gesture. This points to the flexibility of how metaphors can become expressed in gesture, and how domains such as number and quantity can be conceptualized through multiple compatible source domains.

Rethinking reduction: Interdisciplinary perspectives on conditions, mechanisms, and domains for phonetic variation

Jan 2018

F Cangemi
M Clayards
O Niebuhr
B Cangemi
A Albert
M Grice

Cangemi, F., M. Clayards, O. Niebuhr, B. Schuppler, M. Zellers (Eds.) 2018. Rethinking reduction: Interdisciplinary perspectives on conditions, mechanisms, and domains for phonetic variation. Berlin: De Gruyter Mouton. [8] Cangemi, F., A. Albert, M. Grice. 2019. Modelling intonation: Beyond segments and tonal targets. Proceedings of the 19th International Congress of Phonetic Sciences, August 2019, Melbourne. [9] Ward, N. G. 2019. Prosodic Patterns in English Conversation. Cambridge: Cambridge University Press.

Conference Paper

A Layout Technique for Storyline-based Visualization of Consecutive Numerical Time-varying Data

August 2015

We commonly represent time-varying values as polyline charts or heatmaps; however, both type of techniques are difficult to simultaneously observe short-term features of time-varying values and cluster transitions. This poster proposes storyline-based visualization technique for consecutive numerical time-varying data. Storyline is a visualization technique to show associative feature among ... [Show full abstract] elements over time. Our technique measures similarity of each elements and draw similar elements as proximity storyline. The technique also reflects differential values on storyline as a visual variable to emphasize the amount of line changes.

Conference Paper

DSAsketch: Data structures and algorithms drawing game

November 2012

Lasse Hakulinen

Visualizations are often used to teach abstract concepts like algorithms and data structures. In this poster, we present a drawing game, DSAsketch, that can be used to practice a wide range of concepts related to data structures and algorithms. During the game, the players are viewing, constructing and presenting their own visualizations. Thus, players are required to engage with the ... [Show full abstract] visualizations in many different ways.

Conference Paper

Full-text available

Using periodic energy to enrich acoustic representations of pitch in speech: A demonstration

June 2018

This paper aims to strengthen the link between acoustic and perceptual representations of intonation, a link that has been weakened by the over-reliance on the F0 trajectory, which can only be interpreted in relation to landmarks in the segmental string, placed manually or semi-automatically at a separate stage in the analysis. Only then can F0 events be identified as linguistically relevant ... [Show full abstract] (e.g. early, medial or late peaks, accentual tones or edge tones etc.). We provide an analysis and visualization of two acoustic dimensions contributing towards the perceived pitch contour, F0 over time and, crucially, periodic energy. Periodic energy reflects the degree to which pitch is intelligible, a higher value representing a stronger F0 signal that is consequently more easily perceived. A representation of F0 that includes periodic energy is thus able to flag portions of the speech signal that are relevant for the analysis of intonation, without the need for a separate segmentation of the signal into phones and syllables. Index Terms: intonation, pitch perception, periodic energy, tonal alignment, segmentation, data visualization, sonority

Conference Paper

Full-text available

Modelling intonation: Beyond segments and tonal targets

August 2019

A widespread approach to research on intonation categories involves extracting relevant landmarks in the tune (e.g. F0 turning points) and relating them to relevant landmarks in the text (e.g. phone boundaries). This approach is problematic, both in theoretical terms (e.g. no consensus as to what is a relevant landmark in either domain) and in practical terms (e.g. locating segments and F0 ... [Show full abstract] turning points with either error prone automatic annotations or time-consuming manual annotations). We propose and test an alternative approach that overcomes both types of problem. The tune is modelled taking into account the shape of F0 contours, and the text is modelled by means of periodic energy curves. We exploit the interaction between these two dynamic trajectories to observe and quantify intonation. Compared to the standard approach, our method requires less manual work and makes fewer theoretical assumptions, but nonetheless has similar descriptive power.

Article

Full-text available

The Importance of a Distributional Approach to Categoriality in Autosegmental-Metrical Accounts of I...

June 2016 · Laboratory Phonology

When annotating a speech signal using an autosegmental-metrical model of intonation, transcribers associate portions of the F0 contour with labels from a fnite inventory of tonal categories. In the models we are concerned with here, these categories have the status of phonological units (phonological form), bridging the intrinsic variability of the speech signal (substance) with the intrinsic ... [Show full abstract] fuzziness of post-lexical function (meaning). This, together with the relatively small size of the label inventory, precludes a one-to-one relationship between form and substance, and/or between form and function. A Neapolitan Italian corpus of read speech is used to investigate the distributional properties of two pitch accents that have been studied extensively with respect to substance (the alignment of F0 peaks) and meaning (sentence modality). Although there is a general consensus that peaks in this variety are aligned earlier in declaratives than in interrogatives, evidence is provided of contexts in which the converse is true, i.e., in which interrogative peaks are even earlier than their declarative counterparts. In this respect, interrogatives have a richer internal structure than declaratives. We argue that differences in how variably a prosodic category is encoded can be dealt with in an intonation transcription system, as long as this system relates phonological form (the choice of pitch accent in this case) both to phonetic substance and to meaning in a transparent way.

Conference Paper

Full-text available

Prosodic Marking of Information Status in Adults with Autism Spectrum Disorders

June 2018

When referring to an object or person, speakers select a referring expression along with an appropriate prosody. This choice is a highly context-dependent, listener-oriented aspect of language that has been reported to be difficult for individuals with Autism Spectrum Disorders (ASD) and associated mentalizing deficits [1, 2]. In a picture-based story-telling task, we investigated the encoding of ... [Show full abstract] a referent’s givenness, focusing on prosodic choices. When new referents were introduced (or reintroduced) into the discourse, adults with ASD were similar to typically developed adults in their pitch accent placement, but differed in their choice of accent type. On new referents, the ASD group produced accents which are less prominent and which have a non-committal nature (H*), while the control group made greater use of more prominent accents (L+H*, L*+H). Thus, selecting the appropriate pitch accent type to mark a newly introduced referent is problematic for individuals with ASD.