Example Phrase Adaptation Method for Customized, Example-Based Dialog System Using User Data and Distributed Word Representations
Example Phrase Adaptation Method for Customized, Example-Based Dialog System Using User Data and Distributed Word Representations
复制标题
DOI：
10.1587/transinf.2020edp7066
复制
发表时间：
2020-11
期刊：
影响因子：
--
通讯作者：
N. Kitaoka;E. Seto;Ryota Nishimura
中科院分区：
文献类型：
--
作者：
N. Kitaoka;E. Seto;Ryota Nishimura
我们开发了一种自适应方法，通过对使用word2vec方法获得的分布式表示应用“加号”和“减号”操作，允许为单个用户定制基于示例的对话系统。在从Web检索与用户相关的概要信息之后，将命名实体提取应用于检索结果。然后采用高词频-逆文档频率（TF-IDF）分数的词作为用户相关词。接下来，我们使用word2vec嵌入计算现有示例短语中所选用户相关单词和名词的分布式表示之间的相似度。然后，我们通过将原始示例短语中高度相似的单词替换为与用户相关的单词，从而生成适合用户的短语。Word2vec还有一个特殊的属性，它允许将算术运算“加号”和“减号”应用于分布式单词表示。通过将这些操作应用于原始短语中使用的单词，我们能够确定哪些与用户相关的单词可以用来替换原始单词。然后替换与用户相关的单词以创建定制的示例短语。我们对生成的短语的自然度进行了评估，发现系统可以生成自然短语。
SUMMARY We have developed an adaptation method which allows the customization of example-based dialog systems for individual users by applying “plus” and “minus” operations to the distributed representations obtained using the word2vec method. After retrieving user-related profile information from the Web, named entity extraction is applied to the retrieval results. Words with a high term frequency-inverse document frequency (TF-IDF) score are then adopted as user related words. Next, we calculate the similarity between the distrubuted representations of selected user-related words and nouns in the existing example phrases, using word2vec embedding. We then generate phrases adapted to the user by substituting user-related words for highly similar words in the original example phrases. Word2vec also has a special property which allows the arithmetic operations “plus” and “minus” to be applied to distributed word representations. By applying these operations to words used in the original phrases, we are able to determine which user-related words can be used to replace the original words. The user-related words are then substituted to create customized example phrases. We evaluated the naturalness of the generated phrases and found that the system could generate natural phrases.