Evaluation of Japanese Dialogue Processing Method Based on Similarity Measure Using tf· AoI
DOI: 10.1007/978-3-540-24630-5_45 Conference: Computational Linguistics and Intelligent Text Processing, 5th International Conference, CICLing 2004, Seoul, Korea, February 15-21, 2004, Proceedings
In this paper, we propose a Japanese dialogue processing method based on a similarity measure using tf· AoI(termfrequency × Amountof
Information). Keywords are specially used in a spoken dialogue system because a user utterance includes an erroneous recognition, filler
and a noise. However, when a system uses keywords for robustness, it is difficult to realize detailed differences. Therefore,
our method calculates similarity between two sentences without deleting any word from an input sentence, and we use a weight
which multiplies term frequency and amount of information(tf · AoI). We use 173 open data sets which are collected from 12,095 sentences in SLDB. The experimental result using our method has
a correct response rate of 67.1%. We confirmed that correct response rate of our method was 11.6 points higher than that of
the matching rate measure between an input sentence and a comparison sentence. Furthermore that of our method was 7.0 points
higher than that of tf · idf.
Data provided are for informational purposes only. Although carefully collected, accuracy cannot be guaranteed. The impact factor represents a rough estimation of the journal's impact factor and does not reflect the actual current impact factor. Publisher conditions are provided by RoMEO. Differing provisions from the publisher's actual policy or licence agreement may be applicable.