Grounded speech communication
Grounded speech communication
复制标题
接地语音通信
DOI：
10.21437/icslp.2000-753
复制
发表时间：
2000
期刊：
影响因子：
--
通讯作者：
D. Roy
中科院分区：
文献类型：
--
作者：
D. Roy
语言是建立在感觉运动经验基础上的。扎根将概念与物理世界联系起来，使人类能够在上下文中获得和使用单词和句子。目前，处理文本和口语的机器并不是以人类的方式为基础的。相反，机器中的语义表示是高度抽象的，只有在人类解释时才有意义。我们感兴趣的是开发计算系统，这些系统代表了感觉运动经验中的单词，话语和基本概念，从而使机器的理解水平更丰富。受婴儿认知理论的启发，我们提出了一个从未转录的多感官输入中学习的计算模型。获得的词汇是以听觉和视觉感官经验之间的联系来表示的。该系统已经在支持交互式语言学习和理解的机器人实施例中进行了测试。成功的学习也被证明使用in-fant-directed语音和图像。
Language is grounded in sensory-motor experience. Grounding connects concepts to the physical world enabling humans to acquire and use words and sentences in context. Currently, machines which process text and spoken language are not grounded in human-like ways. Instead, semantic representations in machines are highly abstract and have meaning only when interpreted by humans. We are interested in developing computational systems which represent words, utterances, and underlying concepts in terms of sensory-motor experiences, leading to richer levels of understanding by machines. Inspired by theories of infant cognition, we present a computational model which learns from untranscribed multisensory input. Acquired words are represented in terms associations between acoustic and visual sensory experience. The system has been tested in a robotic embodiment which supports interactive language learning and understanding. Successful learning has also been demonstrated using in-fant-directed speech and images.