Study for Spontaneous Spoken Dialogue Understanding System

点击翻译按钮获取中文摘要

In a spontaneous spoken dialogue understanding system, real-time response and robustness to the environment are required.To realize these requirements, we propose a multi-agent system as the system architecture. Each agent has its own function, e.g.phoneme recognition, input utterance structure reasoning from prosody, input utterance forecasting, word reasoning, parsing, etc. The output of this system is the result of co-operation of individual agents that adjust their own behavior to the environment or the input data independency. We propose the co-operation processes.A reinforcement learning method is proposed for a phoneme recognition agent as a sample agent, and adopted a continuous dynamic programming technique to deal with continuous phoneme recognition. To clarify the fundamental characteristics of the proposed method, we define some simple quasi conditions for the experiments, and confirm favorable results.The prosodic structure of the input utterance is represented as a tree form and constructed using FO, duration and pause information of each phrase of the utterance. The tree structure shows how strong successive phrases are concerned with each other.The forecasting the next input utterance uses the handling of two status transfer tables ; controlling for the dialogue in progress and for the dialogue in future.The system can be expected to achieve high adaptability to the environment(e.g., variation of speakers and tasks)and robustness. Some application systems(e.g.WWW voice browser)ware developed.