Hongwei Ding

Hongwei Ding
Shanghai Jiao Tong University | SJTU · Department of English

Dr. phil. et Ing. habil.

About

117
Publications
17,445
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
410
Citations
Citations since 2017
70 Research Items
292 Citations
2017201820192020202120222023020406080100120
2017201820192020202120222023020406080100120
2017201820192020202120222023020406080100120
2017201820192020202120222023020406080100120
Introduction
Current research interests include Emotional Prosody and Mental Disorders; Psycholinguistic, Cognitive, and Neural Correlates of Prosody; Tonal Aspects of Prosody; Phonology and Phonetics of Prosody; Prosody and First and Second Language Acquisition

Publications

Publications (117)
Article
In response to uncovering brain mechanisms underlying vocal communication and searching for biomarkers for mental illnesses, speech prosody has been increasingly studied in recent years in multiple disciplines, including psycholinguistics. In this article, we provide an up-to-date synthesis of the theoretical foundation and empirical evidence to pr...
Article
Full-text available
How language mediates emotional perception and experience is poorly understood. The present event-related potential (ERP) study examined the explicit and implicit processing of emotional speech to differentiate the relative influences of communication channel, emotion category and task type in the prosodic salience effect. Thirty participants (15 w...
Article
Purpose: Pitch plays an important role in auditory perception of music and language. This study provides a systematic review with meta-analysis to investigate whether individuals with autism spectrum disorder (ASD) have enhanced pitch processing ability and to identify the potential factors associated with processing differences between ASD and neu...
Preprint
Full-text available
Objectives: Although pitch reception poses a great challenge for individuals with cochlear implants (CIs), formal auditory training (e.g., high variability phonetic training, HVPT) has been shown to provide direct benefits in pitch-related perceptual performances such as lexical tone recognition for CI users. As lexical tones in spoken language are...
Preprint
Full-text available
Purpose: This study aimed to examine how aging and modifications of critical acoustic parameters may affect the perception of whispered speech as a degraded signal. Method: Forty Mandarin-speaking adults were included in the study. Part 1 of the study compared the perception of Mandarin lexical tones, vowels, and syllables in older and younger adul...
Preprint
Full-text available
How language mediates emotional perception and experience is poorly understood. The present event-related potential (ERP) study examined the explicit and implicit processing of emotional speech to differentiate the relative influences of communication channel, emotion category and task type in the prosodic salience effect. Thirty participants (15 w...
Article
Purpose Cochlear implants (CIs) provide significant benefits for profoundly deaf children in their language and cognitive development. However, it remains unclear whether Mandarin-speaking young children with early implantation can develop age-equivalent phonological awareness (PA) skill and working memory (WM) capacity as their normal hearing (NH)...
Article
Full-text available
Consonant perception in older adults has been widely explored in recent years. However, how aging affects the identification of Mandarin consonants, especially in whispered condition, are under studied. Mandarin consonants and whispering speech have unique features, which may result in different identification difficulties for older adults. The cur...
Article
Full-text available
Previous studies have reported the “emotional congruency effect (ECE)” in cross-modal emotion processing, claiming that multimodal congruent emotional signals will enhance the emotion processing, yet few studies have shown how this effect is dynamically processed over time and whether it is achieved in the same way across language and cultural back...
Article
Background: Inconsistent results have been reported about the affective prosody recognition (APR) ability in patients with bipolar (BD) and depressive (DD) disorders. We aimed to (i) evaluate the magnitude of APR dysfunction in BD and DD patients, (ii) identify moderators for heterogeneous results, and (iii) highlight research trends in this field...
Preprint
Purpose: Pitch plays an important role in auditory perception of music and language. This study provides a systematic review with meta-analysis to investigate whether individuals with autism spectrum disorder (ASD) have enhanced pitch processing ability and identify the potential factors associated with processing differences between ASD and neurot...
Article
This study examines the effect of preceding tones on tone perception within Mandarin disyllabic utterances and the underlying mechanism that causes such an effect. Listeners were presented with a series of tone targets varying perceptually from Mandarin Tone 3 to Tone 4 following Tone 1, Tone 2, or Tone 4. The results showed that the targets were m...
Article
Full-text available
The worldwide rising trend of autism spectrum disorder (ASD) calls for innovative and efficacious techniques for assessment and treatment. Virtual reality (VR) technology gains support from rehabilitation and pedagogical theories and offers a variety of capabilities in educational and interventional contexts with affordable products. VR is attracti...
Article
Full-text available
Lay abstract: Differences in understanding others' emotions and attitudes through features in speech (e.g. intonation) have been observed in individuals with autism spectrum conditions, which contribute greatly to their social communication challenges. However, some studies reported that individuals with autism spectrum condition performed compara...
Article
No PDF available ABSTRACT Prelinguallydeafened Mandarin-speaking children with cochlear implants (CI) encounter a significant challenge in perceiving lexical tones accurately due to their limited language experience and insufficient pitch information provided by CI devices. To facilitate their tonal perception, we examined the role of pitch gesture...
Article
Purpose Numerous studies have identified individuals with autism spectrum disorder (ASD) with deficits in unichannel emotion perception and multisensory integration. However, only limited research is available on multichannel emotion perception in ASD. The purpose of this review was to seek conceptual clarification, identify knowledge gaps, and sug...
Preprint
Virtual reality (VR) technology gains theoretical support from rehabilitation and pedagogical theories and offers a variety of capabilities in educational and interventional contexts with affordable products. VR is attracting increasing attention in the medical and healthcare industry as it provides fully interactive three-dimensional simulations o...
Article
No PDF available ABSTRACT The present study employed electrophysiological and behavioral measures to examine the modulatory effects of communication channels, emotion categories and attentional requirements on the timing, neural oscillatory activities and behavioral performances of emotional speech processing. Thirty participants (15 women and 15 m...
Article
Full-text available
Purpose This study aimed to examine the Stroop effects of verbal and nonverbal cues and their relative impacts on gender differences in unisensory and multisensory emotion perception. Method Experiment 1 investigated how well 88 normal Chinese adults (43 women and 45 men) could identify emotions conveyed through face, prosody and semantics as thre...
Article
Full-text available
Purpose The nature of gender differences in emotion processing has remained unclear due to the discrepancies in existing literature. This study examined the modulatory effects of emotion categories and communication channels on gender differences in verbal and nonverbal emotion perception. Method Eighty-eight participants (43 females and 45 males)...
Article
This study compared the f0 of 14 German vowels in monosyllabic words (/dVt/) embedded in carrier sentences produced by 30 native speakers and 30 Mandarin Chinese learners. Appropriate techniques were employed to robustly measure f0 values and reliably analyze f0 profiles. The results showed that Mandarin learners produced the vowels bearing sentenc...
Article
Full-text available
Purpose Lexical tone perception is known to be persistently difficult for individuals with cochlear implants (CIs). The purpose of this study was to evaluate the efficacy of high-variability phonetic training (HVPT) in improving Mandarin tone perception for native-speaking children with CIs. Method A total of 28 Mandarin-speaking pediatric CI reci...
Article
Full-text available
The presence of vowel exaggeration in infant‐directed speech (IDS) may adapt to the age‐appropriate demands in speech and language acquisition. Previous studies have provided behavioral evidence of atypical auditory processing towards IDS in children with autism spectrum disorders (ASD), while the underlying neurophysiological mechanisms remain unk...
Article
Purpose The purpose of this study was to examine the aging effects on the categorical perception (CP) of Mandarin lexical Tones 1–4 and Tones 1–2 in noise. It also investigated whether listeners' categorical tone perception in noise correlated with their general tone identification of 20 natural vowel-plus-tone signals in noise. Method Twelve youn...
Article
Full-text available
Purpose Pitch reception poses challenges for individuals with cochlear implants (CIs), and adding a hearing aid (HA) in the nonimplanted ear is potentially beneficial. The current study used fine-scale synthetic speech stimuli to investigate the bimodal benefit for lexical tone categorization in Mandarin-speaking kindergarteners using a CI and an H...
Article
Full-text available
Three tasks were reported to examine the effect of ambiguity awareness on Chinese-speaking English learners’ use of prosody in resolving prepositional-phrase attachment ambiguity. In the first (Task 1) and second (Task 2) tasks, listeners were not informed of the syntactic ambiguity. In the third task (Task 3), listeners were given the specific inf...
Article
Full-text available
This study analyzed the durational and spectral differences and their interaction in the production of seven German tense-lax vowel pairs between 30 German native speakers and 30 Mandarin learners of German. The results showed that Mandarin speakers differed significantly from the German speakers in producing the German tense-lax contrast. The gene...
Article
Full-text available
Multisensory integration (MSI) of emotion has been increasingly recognized as an essential element of schizophrenic patients’ impairments, leading to the breakdown of their interpersonal functioning. The present review provides an updated synopsis of schizophrenics’ MSI abilities in emotion processing by examining relevant behavioral and neurologic...
Article
Full-text available
Pitch perception is known to be difficult for individuals with cochlear implant (CI), and adding a hearing aid (HA) in the non-implanted ear is potentially beneficial. The current study aimed to investigate the bimodal benefit for lexical tone recognition in Mandarin-speaking preschoolers using a CI and an HA in opposite ears. The child participant...
Article
Aphasic discourse has been investigated through two major approaches: a micro-linguistic approach and a macro one, but the separate analysis of the micro and macro aspects of aphasic discourse has led to a noticeable gap between them. Cohesion analysis is one of the possible ways that can directly connect these two aspects. However, few studies hav...
Article
Full-text available
Purpose: Emotional speech communication involves multisensory integration of linguistic (e.g., semantic content) and paralinguistic (e.g., prosody and facial expressions) messages. Previous studies on linguistic versus paralinguistic salience effects in emotional speech processing have produced inconsistent findings. In this study, we investigated...
Article
Full-text available
目的 探讨“多人言语声”语音训练法对人工耳蜗植入术后声调感知能力康复训练效果。方法 研究对象为16例3-7岁双耳重度、极重度感音神经性听力损失并植入单侧人工耳蜗的儿童,其中干预组8例,平均年龄为5.99±0.63,听觉年龄为4.36±0.86;对照组8例,平均年龄为5.95±0.49,听觉年龄为3.77±1.27。采用自编声调测试材料,分别于干预前、干预后和干预结束3个月后对两组儿童进行声调感知能力测试。使用“多人言语声”语音训练方法对干预组儿童进行声调感知干预训练,对照组儿童作为参照对象,不参与干预训练。语音训练周期为一个月,干预组儿童以个训的形式分五次完成对10位发音人共600个语音样本的声调识别训练。结果 前测结果表明二声-三声所有受试儿童平均分辨正确率为47.11%,显著低于其他声调...
Conference Paper
Full-text available
Bimodal hearing with the combined use of a cochlear implant (CI) and a contralateral hearing aid (HA) has been demonstrated beneficial for deaf individuals in many aspects of speech perception. However, it remains inconsistent whether CI users can obtain bimodal benefit in lexical tone perception. To disentangle this question, Mandarin-speaking chi...
Conference Paper
Full-text available
It is widely accepted that vowels are longer before voiced consonants than before voiceless ones in many languages (such as English). However, neither voiced-voiceless stop contrasts nor long-short vowel contrasts exist in Mandarin Chinese. This study investigates whether the Chinese learners exhibit a difference in vowel duration as a function of...
Article
Full-text available
Background The employment of clinical databases in the study of mental disorders is essential to the diagnosis and treatment of patients with mental illness. While text corpora obtain merely limited information of content, speech corpora capture tones, emotions, rhythms and many other signals beyond content. Hence, the design and development of spe...
Conference Paper
Full-text available
First language phonological categories strongly influence the late learn-ers' perception of second language (L2) categories. In the present study, we examined whether duration or vowel quality is more important for Mandarin Chinese learners of German to distinguish German tense and lax vowels compared to Ger-man native speakers. In order to have go...
Article
Full-text available
Emotional prosody (EP) has been increasingly recognized as an important area of schizophrenic patients’ dysfunctions in their language use and social communication. The present review aims to provide an updated synopsis on emotional prosody processing (EPP) in schizophrenic disorders, with a specific focus on performance characteristics, the influe...
Conference Paper
Full-text available
We investigated 14 German politicians to systematically analyze typical boundary conditions in the perceptive charisma assessment, such as age and gender of speakers and evaluators. Beyond, we surveyed the correlation between the perceptive results and some prosodic correlates. The test data included 84 speech samples of 7 female and 7 male speaker...
Conference Paper
Full-text available
In this study we investigated whether native and non-native speakers demonstrate a similar preference in the selection of a pleasant voice, and how their preference rankings correlate with the voice quality and the prosodic features. 50 Chinese without prior knowledge of German and 10 native German listeners participated in a pair comparison test t...
Conference Paper
Full-text available
We investigated 14 German politicians to systematically analyze typical boundary conditions in the perceptive charisma assessment, such as age and gender of speakers and evaluators. Beyond, we surveyed the correlation between the perceptive results and some prosodic correlates. The test data included 84 speech samples of 7 female and 7 male speaker...
Conference Paper
Full-text available
Chinese words written partly or fully in roman letters have gained popularity in Mandarin Chinese in the last few decades and an appendix of such Mandarin Alphabetical Words (MAWs) is included in the authoritative dictionary of Standard Mandarin. However, no transcription of MAWs has been provided because it is not clear whether we should keep the...
Conference Paper
Full-text available
To find a pleasant voice for speech synthesis is of vital importance to the system. In this study we investigated the influence of prosodic parameters on voice preference from a cross-linguistic perspective. We conducted two voice preference tests. 24 German and 50 Chinese listeners took part in the first test on German speaker selection; while 25...
Article
Speech in tone languages requires listeners to identify not only phonemes but also tones. As non-tone language users, Korean-native speakers may have difficulty in identifying tones and vowels and processing both tonal and phonemic information at the same time, which are not presented in their mother tongue. The goal of the present study was to inv...
Article
The goal of this study was to investigate the informational masking (IM) of Mandarin six-talker babble on Mandarin vowel and tone perception for native Chinese and Korean speakers with high and medium Mandarin proficiency. Mandarin Chinese speech sounds (vowel plus tone) were presented in quiet and two noises: six-talker babble and babble-modulated...
Article
The production and perception of prosodic boundary have been well studied in English, but the research regarding to English as a second language (L2) is sparse. It has been shown that Chinese and English employ different acoustic features to mark prosodic boundary in production. Thus, this study aims to find out whether the Chinese learners of Engl...
Conference Paper
Full-text available
OMProDat is an open multilingual prosodic database, which aims to collect, archive and distribute recordings and annotations of directly comparable data from different languages representing different prosodic typological characteristics. OMProDat contains recordings of 40 five-sentence passages read by 5 male and 5 female speakers of each language...
Conference Paper
Full-text available
In this study we analyse 18 metrics which were extracted fully automatically from the acoustic signal to describe the melodic characteristics of recordings of English read by L2 Chinese speakers from Shanghai. The metrics were compared to those of native English speakers recording the same material and also to comparable Chinese recordings read by...
Chapter
The present study investigates the possible prosodic deviance due to foreign accent in the German speech by Chinese speakers. German has lexical stress and has been described as stress-timed, while Mandarin Chinese has lexical tone and has been described as syllable-timed. It is by now well documented that the prosody of the second language can be...
Conference Paper
Full-text available
Although glottalization has often been associated with low pitch, evidence from a number of sources supports the assertion that this association is not obligatory, and is likely to be language-specific. Following a previous study testing perception of glottalization by German, English, and Swedish listeners, the current research investigates the in...