Scene interpretation for sensory substitution and intelligent agents: a neurocomputational approach

感觉替代和智能代理的场景解释：一种神经计算方法

• 批准号: RGPIN-2017-06218
• 负责人: ROUAT, Jean
• 金额: $ 1.75万
• 依托单位: Université de Sherbrooke
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2017
• 资助国家: 加拿大
• 起止时间: 2017-01-01 至 2018-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=637426
• 关键词: Scene; interpretation; sensory; substitution; intelligent

The long-term goal of my research is the development of assistive technologies with sensory substitution devices. Thanks to the great plasticity of the brain and the densely interconnected cortical areas, it is possible to complement and substitute one sensory modality with another. However current sensory substitution systems are not able to analyze visual or auditory scenes as they are essentially describing the environment without interpretation. Therefore they overload the audition or the vision of the user which might be uncomfortable or unhealthy. Interpretation of auditory, visual and multimodal scenes is also of great need to the development of intelligent agents that interact with their environment and human beings. But actually scene interpretation for intelligent agents is more or less a limited description of scenes and restraints to very specific applications.

我的研究的长期目标是开发具有感觉替代装置的辅助技术。由于大脑的可塑性和紧密相连的皮层区域，我们可以用另一种感觉方式来补充和替代一种感觉方式。然而，目前的感觉替代系统不能分析视觉或听觉场景，因为它们本质上是在没有解释的情况下描述环境。因此，它们使用户的听觉或视觉过载，这可能是不舒服或不健康的。听觉，视觉和多模态场景的解释也是非常需要的智能代理，与他们的环境和人类的发展。但实际上，智能代理的场景解释或多或少是对场景的有限描述和对非常特定应用的限制。