Scene interpretation for sensory substitution and intelligent agents: a neurocomputational approach
感觉替代和智能代理的场景解释:一种神经计算方法
基本信息
- 批准号:RGPIN-2017-06218
- 负责人:
- 金额:$ 1.75万
- 依托单位:
- 依托单位国家:加拿大
- 项目类别:Discovery Grants Program - Individual
- 财政年份:2019
- 资助国家:加拿大
- 起止时间:2019-01-01 至 2020-12-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
The long-term goal of my research is the development of assistive technologies with sensory substitution devices. Thanks to the great plasticity of the brain and the densely interconnected cortical areas, it is possible to complement and substitute one sensory modality with another. However current sensory substitution systems are not able to analyze visual or auditory scenes as they are essentially describing the environment without interpretation. Therefore they overload the audition or the vision of the user which might be uncomfortable or unhealthy. Interpretation of auditory, visual and multimodal scenes is also of great need to the development of intelligent agents that interact with their environment and human beings. But actually scene interpretation for intelligent agents is more or less a limited description of scenes and restraints to very specific applications.***Through this research program I want to push as much as possible the research in multimodal scene interpretation for the next 5 coming years.***To maximize the impact and while doing the research, I will frequently transfer results to applications in sensory substitution (FQRNT équipe) and in artificial intelligence for interacting agents (CHIST-ERA IGLU).***To minimize the environmental footprint, the design and realization of the algorithms will favour architectures with the lowest power consumption. To this end, I will focus during the last 2 years on implementations with networks of spiking neurons. ***I am restricting the research program to sources that are visual (they are moving sources of given shapes, texture earning of simple features to coarsely segregate in a first pass the multimodal objects inside the scene.***2) Perceptual learning to build multimodal complex features and representations that preserve the perceptive organization of characteristics (shapes, timbre, pitch);***3) Semantic characterization of objects;***4) Scene analysis and interpretation.***5) Low-power neuromorphic implementations.***Sensory substitution has a very strong potential for "exercises" and rewiring of the brain along with development of new brain prosthesis. Intelligent agents that can perceive their environment through scene analysis is a corner stone to the new AI economy and industry. Also, there is a strong need to develop the Canadian industry of spiking neural networks and neuromorphic systems.
我研究的长期目标是开发具有感官替代装置的辅助技术。由于大脑的巨大可塑性和紧密相连的皮质区域,有可能用一种感觉模式来补充和替代另一种感觉模式。然而,目前的感觉替代系统不能分析视觉或听觉场景,因为它们本质上是在没有解释的情况下描述环境。因此,它们使用户的试听或视觉过载,这可能会使用户感到不舒服或不健康。听觉、视觉和多通道场景的解释对于开发与环境和人类交互的智能代理也是非常必要的。但实际上,智能代理的场景解释或多或少是对场景的有限描述和对非常具体应用的限制。*通过这个研究计划,我想在未来5年内尽可能地推动多模式场景解释的研究。*为了最大化影响,在进行研究的同时,我将经常将结果转移到感官替代(FQRNTéquipe)和交互代理的人工智能(CHIST-ERA Iglu)应用中。*为了最大限度地减少环境足迹,算法的设计和实现将有利于具有最低功耗的体系结构。为此,在过去的两年里,我将重点介绍尖峰神经元网络的实现。*我将研究计划限制在视觉来源上(它们是给定形状的移动来源,简单特征的纹理获得,以便在第一次通过场景中粗略地分离多模式对象。*2)感知学习,以构建多模式复杂特征和表示,以保持特征(形状、音色、音调)的可感知组织;*3)对象的语义表征;*4)场景分析和解释。*5)低功率神经形态实现。*随着新大脑假体的开发,感觉替代具有非常强大的潜力来“练习”和重新布线大脑。能够通过场景分析感知环境的智能代理是新的人工智能经济和产业的基石。此外,加拿大迫切需要发展尖峰神经网络和神经形态系统行业。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Rouat, Jean其他文献
Voltage-dependent synaptic plasticity: Unsupervised probabilistic Hebbian plasticity rule based on neurons membrane potential.
- DOI:
10.3389/fnins.2022.983950 - 发表时间:
2022 - 期刊:
- 影响因子:4.3
- 作者:
Garg, Nikhil;Balafrej, Ismael;Stewart, Terrence C.;Portal, Jean-Michel;Bocquet, Marc;Querlioz, Damien;Drouin, Dominique;Rouat, Jean;Beilliard, Yann;Alibart, Fabien - 通讯作者:
Alibart, Fabien
P-CRITICAL: a reservoir autoregulation plasticity rule for neuromorphic hardware
- DOI:
10.1088/2634-4386/ac6533 - 发表时间:
2022-06-01 - 期刊:
- 影响因子:0
- 作者:
Balafrej, Ismael;Alibart, Fabien;Rouat, Jean - 通讯作者:
Rouat, Jean
Robust localization and tracking of simultaneous moving sound sources using beamforming and particle filtering
- DOI:
10.1016/j.robot.2006.08.004 - 发表时间:
2007-03-31 - 期刊:
- 影响因子:4.3
- 作者:
Valin, Jean-Marc;Michaud, Francois;Rouat, Jean - 通讯作者:
Rouat, Jean
A Flexible Bio-Inspired Hierarchical Model for Analyzing Musical Timbre
- DOI:
10.1109/taslp.2016.2530405 - 发表时间:
2016-05-01 - 期刊:
- 影响因子:5.4
- 作者:
Adeli, Mohammad;Rouat, Jean;Plourde, Eric - 通讯作者:
Plourde, Eric
Structural plasticity for neuromorphic networks with electropolymerized dendritic PEDOT connections.
- DOI:
10.1038/s41467-023-43887-8 - 发表时间:
2023-12-08 - 期刊:
- 影响因子:16.6
- 作者:
Janzakova, Kamila;Balafrej, Ismael;Kumar, Ankush;Garg, Nikhil;Scholaert, Corentin;Rouat, Jean;Drouin, Dominique;Coffinier, Yannick;Pecqueur, Sebastien;Alibart, Fabien - 通讯作者:
Alibart, Fabien
Rouat, Jean的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Rouat, Jean', 18)}}的其他基金
Analyse et traitement objet des signaux pour des applications en interfaces homme/machine
在人/机接口上分析应用信号的对象和特征
- 批准号:
42386-2012 - 财政年份:2015
- 资助金额:
$ 1.75万 - 项目类别:
Discovery Grants Program - Individual
Analyse et traitement objet des signaux pour des applications en interfaces homme/machine
在人/机接口上分析应用信号的对象和特征
- 批准号:
42386-2012 - 财政年份:2014
- 资助金额:
$ 1.75万 - 项目类别:
Discovery Grants Program - Individual
Analyse et traitement objet des signaux pour des applications en interfaces homme/machine
在人/机接口上分析应用信号的对象和特征
- 批准号:
42386-2012 - 财政年份:2013
- 资助金额:
$ 1.75万 - 项目类别:
Discovery Grants Program - Individual
Analyse et traitement objet des signaux pour des applications en interfaces homme/machine
在人/机接口上分析应用信号的对象和特征
- 批准号:
42386-2012 - 财政年份:2012
- 资助金额:
$ 1.75万 - 项目类别:
Discovery Grants Program - Individual
Robust signal analysis and recognition techiques for man-machine interaction
用于人机交互的鲁棒信号分析和识别技术
- 批准号:
42386-2006 - 财政年份:2010
- 资助金额:
$ 1.75万 - 项目类别:
Discovery Grants Program - Individual
Robust signal analysis and recognition techiques for man-machine interaction
用于人机交互的鲁棒信号分析和识别技术
- 批准号:
42386-2006 - 财政年份:2009
- 资助金额:
$ 1.75万 - 项目类别:
Discovery Grants Program - Individual
Robust signal analysis and recognition techiques for man-machine interaction
用于人机交互的鲁棒信号分析和识别技术
- 批准号:
42386-2006 - 财政年份:2008
- 资助金额:
$ 1.75万 - 项目类别:
Discovery Grants Program - Individual
Robust signal analysis and recognition techiques for man-machine interaction
用于人机交互的鲁棒信号分析和识别技术
- 批准号:
42386-2006 - 财政年份:2007
- 资助金额:
$ 1.75万 - 项目类别:
Discovery Grants Program - Individual
Image processing with a neuro-computational dynamic link matcher
使用神经计算动态链接匹配器进行图像处理
- 批准号:
334047-2005 - 财政年份:2007
- 资助金额:
$ 1.75万 - 项目类别:
Idea to Innovation
Robust signal analysis and recognition techiques for man-machine interaction
用于人机交互的鲁棒信号分析和识别技术
- 批准号:
42386-2006 - 财政年份:2006
- 资助金额:
$ 1.75万 - 项目类别:
Discovery Grants Program - Individual
相似国自然基金
基于观测角度的汉语名词性隐喻逻辑释义和评价方法研究
- 批准号:61075058
- 批准年份:2010
- 资助金额:25.0 万元
- 项目类别:面上项目
相似海外基金
Multiphon imaging for understanding social brain function in tadpoles
多声子成像用于了解蝌蚪的社交脑功能
- 批准号:
10717610 - 财政年份:2023
- 资助金额:
$ 1.75万 - 项目类别:
The impact of extra effort and accumulated fatigue in listeners who wear a cochlear implant
额外努力和累积疲劳对佩戴人工耳蜗的听众的影响
- 批准号:
10677929 - 财政年份:2023
- 资助金额:
$ 1.75万 - 项目类别:
Spinal Cord Innovation in Pediatrics to Treat Cerebral Palsy (SCiP Clinical Study)
儿科脊髓创新治疗脑瘫(SCiP 临床研究)
- 批准号:
10760810 - 财政年份:2023
- 资助金额:
$ 1.75万 - 项目类别:
Interrogating the pathophysiological mechanisms of constipation in patients with systemic sclerosis
探讨系统性硬化症患者便秘的病理生理机制
- 批准号:
10659640 - 财政年份:2023
- 资助金额:
$ 1.75万 - 项目类别:
Optimization of Neurophysiologic Biomarkers for Rehabilitation Interventions in Veterans with Chronic Psychosis
慢性精神病退伍军人康复干预的神经生理学生物标志物的优化
- 批准号:
10753415 - 财政年份:2023
- 资助金额:
$ 1.75万 - 项目类别:
Bringing the clinic to the lab: the effects of forced and non-forced rehabilitation on functional recovery after spinal cord injury
将临床带入实验室:强制和非强制康复对脊髓损伤后功能恢复的影响
- 批准号:
10641259 - 财政年份:2023
- 资助金额:
$ 1.75万 - 项目类别:
Understanding the Conceptual Priority Map Guiding Naturalistic Visual Attention for Autistic Individuals
了解指导自闭症患者自然视觉注意力的概念优先级图
- 批准号:
10829114 - 财政年份:2023
- 资助金额:
$ 1.75万 - 项目类别:
Virus and olfactory system interactions accelerate Alzheimer's disease pathology
病毒和嗅觉系统相互作用加速阿尔茨海默病病理学
- 批准号:
10669880 - 财政年份:2023
- 资助金额:
$ 1.75万 - 项目类别:
The Neural Mechanisms Underlying Categorical Decision Making
分类决策背后的神经机制
- 批准号:
10750000 - 财政年份:2023
- 资助金额:
$ 1.75万 - 项目类别:
Dissemination of the Human Neocortical Neurosolver (HNN) software for circuit level interpretation of human MEG/EEG
传播用于人类 MEG/EEG 电路级解释的人类新皮质神经解算器 (HNN) 软件
- 批准号:
10726032 - 财政年份:2023
- 资助金额:
$ 1.75万 - 项目类别: