Conference Paper

Evaluation of Japanese Dialogue Processing Method Based on Similarity Measure Using tf· AoI.

DOI: 10.1007/978-3-540-24630-5_45 Conference: Computational Linguistics and Intelligent Text Processing, 5th International Conference, CICLing 2004, Seoul, Korea, February 15-21, 2004, Proceedings
Source: DBLP

ABSTRACT In this paper, we propose a Japanese dialogue processing method based on a similarity measure using tf· AoI(termfrequency × Amountof
Information). Keywords are specially used in a spoken dialogue system because a user utterance includes an erroneous recognition, filler
and a noise. However, when a system uses keywords for robustness, it is difficult to realize detailed differences. Therefore,
our method calculates similarity between two sentences without deleting any word from an input sentence, and we use a weight
which multiplies term frequency and amount of information(tf · AoI). We use 173 open data sets which are collected from 12,095 sentences in SLDB. The experimental result using our method has
a correct response rate of 67.1%. We confirmed that correct response rate of our method was 11.6 points higher than that of
the matching rate measure between an input sentence and a comparison sentence. Furthermore that of our method was 7.0 points
higher than that of tf · idf.