K. Evanini’s scientific contributions

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (1)


Automated speech scoring for non-native middle school students with multiple task types
  • Article

January 2013

·

59 Reads

·

41 Citations

K. Evanini

·

X. Wang

This study presents the results of applying automated speech scoring technology to English spoken responses provided by non-native children in the context of an English proficiency assessment for middle school students. The assessment contains three diverse task types designed to measure a student's English communication skills, and an automated scoring system was used to extract features and build scoring models for each task. The results show that the automated scores have a correlation of r = 0.70 with human scores for the Read Aloud task, which matches the human-human agreement level. For the two tasks involving spontaneous speech, the automated scores obtain correlations of r = 0.62 and r = 0.63 with human scores, which represents a drop of 0.08 - 0.09 from the humanhuman agreement level. When all 5 scores from the assessment for a given student are aggregated, the automated speaker-level scores show a correlation of r = 0.78 with human scores, compared to a human-human correlation of r = 0.90. The challenges of using automated spoken language assessment for children are discussed, and directions for future improvements are proposed.

Citations (1)


... Previous work in automated speech scoring (Witt and Young 1997;Ai 2015;Evanini and Wang 2013) have examined phone level scores derived from GMM-HMM (Gaussian Mixture Model − Hidden Markov Model) based speech recognizer outputs. With the proliferation of deep learning techniques, more recent studies (Ying 2019;Hu et al. 2015;Sudhakara et al. 2019) have used acoustic models trained using a Deep Neural Network to improve mispronunciation detection & diagnosis (MDD). ...

Reference:

Towards Building a Language-Independent Speech Scoring Assessment
Automated speech scoring for non-native middle school students with multiple task types
  • Citing Article
  • January 2013