权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

Cocktail party effect procesor using audio-visual sensor fusion technique

采用视听传感器融合技术的鸡尾酒会效果处理器

基本信息

批准号：
08455194
负责人：
TAKAHASHI Kota
金额：
$ 5.25万
依托单位：
The University of Electro-Communications
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (B)
财政年份：
1996
资助国家：
日本
起止时间：
1996 至 1997
项目状态：
已结题

来源：
https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-08455194/
关键词：
image processing parallel processing FPGA

项目摘要

The term "Cocktail party effect" means biological special ability to extract an important signal from other ambient noises. In this research, the cocktail party effect is focused on in order to construct a new type of sensing system. Two dimensional array of logic elements for sensor fusion, i.e., two dimensional sensor fusion system which integrate audio signals and sequential images on time-space coordinates, is proposed in this research. Summaries of the research are as followas.A small prototype system wiht an array of 8x8, which had been made as preliminary system, was extended to a larger system with an array of 24x16 inthis year. Results of experiments using the revised system demonstraed the advantages of the concept of the new system, especially in the case of multiplexed data.Automatic pitch tracking algorithm was also developed in this year, which was used as a preliminary step of sound source localization. Using this algorithm, improvements in the source localization subsystem were demonstrated experimentally.The other subsystem is an image processing part. In this part, a new algorithm using feature points was developed, which wa based on the theory of independent component analysis. Using this type of feature points, improvements in the stereo vision subsystem were demonstrated experimentally.As the consequence of these results, the advantages of the concept of two dimensional logic elements for sensor fusion on time-space coordinates were shown. In the future, the system will be revised in order to evaluate the efficiency of the algorithm more quantitatively.

“鸡尾酒会效应”是指从其他环境噪声中提取重要信号的生物特殊能力。本研究以鸡尾酒会效应为研究对象，以建构一种新型的感测系统。用于传感器融合的逻辑元件的二维阵列，即，本文提出了一种在时空坐标系上融合音频信号和序列图像的二维传感器融合系统。本论文的研究内容如下：首先，在初步研制的8 × 8阵列的小型原型系统基础上，于今年将其扩展为24 × 16阵列的大型系统。实验结果显示，新系统的概念，特别是在多路复用数据的情况下，具有优势。自动音高跟踪算法也在今年开发，这是作为声源定位的初步步骤。利用该算法对声源定位子系统进行了改进，实验证明了改进的效果。在这一部分中，提出了一种基于独立分量分析理论的特征点提取算法。利用这种特征点，对立体视觉子系统进行了实验验证，结果表明，在时空坐标系下，二维逻辑元概念在传感器融合中的优越性。在未来，该系统将被修改，以更定量地评估算法的效率。