Fusion of array signal processing and facial image proccessing for hands-free robust communication and authenticaion

阵列信号处理和面部图像处理的融合，实现免提稳健通信和身份验证

• 批准号: 11680426
• 负责人: MATSUMURA Masafumi
• 金额: $ 1.73万
• 依托单位: Osaka Electro-Communication University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 1999
• 资助国家: 日本
• 起止时间: 1999 至 2001
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-11680426/
• 关键词: Authentication; Array signal processing; Color image processing; Facial image; 3D shape of vocal tract; Articulatory model; Dialog system; hands-free rebust communication; 整合フィルタ; 音声強調; カラー顔画像; 三次元声道; 有限要素法

Human speech sounds with speaker characteristics involve complex interactions of the larynx, nasal cavity, oral cavity, and oropharynx. Authentication technique can be used to verify the identity claimed by people accessing systems ; that is, it enables access control of various services by voice and face imagesIn conventional approach, however, there is few study on fusion of array signal processing and facial image processing for hands-free robust communication and authentication. The primary aim of our research is to develop new techniques for automatically recognizing who is speaking by using speaker-specific information included in speech wave and facial image. Intelligent audiovisual sensing system with four-microphone-array and CCD camera has been developed for hands-free robust communication and authentication. Array signal processing performed accurate estimatio fo mouth position. An articulatory model of three-dimensional vocal tract obtained by magnetic resonance imaging was proposed for extraction of speaker-specific information. A Color image pocessing technique was proposed for face segmentation and facial feature detection. Our group has successfully developed and tested the intellignet audiovisual sensing system for hands-free robust communication and authentication. The proposed techniques have wide application in the areas of speech communication and in the study of human interaction

具有说话者特征的人类语音涉及喉、鼻腔、口腔和口咽的复杂相互作用。认证技术可以用来验证访问系统的人所声称的身份，也就是说，它可以通过语音和人脸图像访问控制的各种服务，在传统的方法，但是，很少有研究的阵列信号处理和人脸图像处理融合的免提鲁棒通信和认证。我们的研究的主要目的是开发新的技术，自动识别谁是说话者通过使用特定的信息，包括在语音波和面部图像。智能视听传感系统与四个麦克风阵列和CCD摄像头已经开发的免提强大的通信和认证。阵列信号处理实现了嘴部位置的精确估计。提出了一种基于磁共振成像的三维声道发音模型，用于说话人特定信息的提取。提出了一种用于人脸分割和特征检测的彩色图像处理技术。我们的团队成功开发并测试了智能视听传感系统，用于免提强大的通信和认证。所提出的技术在语音通信领域和人类交互研究中具有广泛的应用

项目成果

Matsumura,Masafumi: "Measurement of palatolingual contact pressure and tongue force using a force-sensor-mounted palatal plate"Technical report, Information science center, Osaka Electro-Communication university. (発表予定). (2001)

Matsumura，Masafumi：“使用安装力传感器的腭板测量腭舌接触压力和舌头力”技术报告，大阪电气通信大学信息科学中心（即将提交）。

Niikawa,Takuya: "Modeling of a speech production system during fricative consonant phonation."Technical report, Information science center, Osaka Electro-Communication university. (発表予定). (2001)

Niikawa，Takuy​​a：“摩擦辅音发声过程中的语音产生系统的建模”。技术报告，大阪电气通信大学信息科学中心（即将提交）。

Takuya Niikawa: "Esimation of vocal-tract length based on distribution of sound pressure in the production of vowel phonations"Information science center, Osaka Electro-Cmmunication University, Technical report. ISC2001-01. (2002)

Takuy​​a Niikawa：“基于元音发音过程中声压分布的声道长度估计”，大阪电气通信大学信息科学中心，技术报告。

新川拓也: "母音生成時における声道内音圧分布に基づく声道長の推定"Technical report, Information science center, Osaka Electro-Communication university. ISC2001-01. 1-11 (2002)

Takuy​​a Shinkawa：“根据元音产生时声道中的声压分布来估计声道长度”技术报告，大阪电气通信大学信息科学中心ISC2001-01（2002）。