Multimodal Integration A Biological View
Multimodal Integration A Biological View
复制标题
多模式整合的生物学观点
DOI：
--
复制
发表时间：
2001
期刊：
影响因子：
--
通讯作者：
M. Coen
中科院分区：
文献类型：
--
作者：
M. Coen
我们提出了一种构建高度集成的多通道系统的新方法。我们的方法是受到人类和动物感官知觉的神经学和行为学理论的推动。我们认为，多通道系统中的知觉整合需要发生在个体感知过程的所有层面上。我们不是将每一种形式视为一个单独处理的、日益抽象的管道--在其中，抽象感觉表征的整合发生在最后一步--我们认为，感知信息的整合和共享也必须发生在感觉加工的最早阶段。本文介绍了我们构建多通道系统的方法，并对其理论动机进行了检验。我们遵循这种方法创建了称为智能房间的高度交互环境的最新版本，我们认为这样做为智能房间提供了独特的感知能力，并使我们能够深入了解如何构建类似的复杂多通道系统。
We present a novel methodology for building highly integrated multimodal systems. Our approach is motivated by neurological and behavioral theories of sensory perception in humans and animals. We argue that perceptual integration in multimodal systems needs to happen at all levels of the individual perceptual processes. Rather than treating each modality as a separately processed, increasingly abstracted pipeline – in which integration over abstract sensory representations occurs as the final step – we claim that integration and the sharing of perceptual information must also occur at the earliest stages of sensory processing. This paper presents our methodology for constructing multimodal systems and examines its theoretic motivation. We have followed this approach in creating the most recent version of a highly interactive environment called the Intelligent Room and we argue that doing so has provided the Intelligent Room with unique perceptual capabilities and gives insight into building similar complex multimodal systems.