Construction of computational theories of audition and the application to sound signal processing

本计画的目的是建立听觉的计算理论，并将其应用于各种声音信号处理技术。有四个子目标：1)开发可靠的听觉滤波器组；2)听觉大小形状感知计算理论的实验验证；3)使用声码器的语音处理方法的发展；4)检查各种语音应用并调查其原理。1)通过对上千个人类掩蔽数据进行定量拟合，确定了压缩伽马机（cGC）听觉滤波器的合理参数集。设计了动态版本的cGC滤波器组（dcGC），以在分析/合成框架内考虑耳蜗的非线性特征，这对于各种应用都是必不可少的。dcGC软件将作为听觉外围处理的实际标准在网页上向公众开放。2)我们进行了知觉实验，以支持听觉大小形状知觉的计算理论。该实验将成为这一新领域夹具研究的一个里程碑。2005年5月，我们在美国声学学会（ASA）的春季会议上组织了一个名为“语言和动物叫声中的大小信息”的特别会议。我们邀请了12位演讲者（我们组中的7位）来介绍相关工作。3)我们改进了用于语音分离的听觉声码器，并对其进行了客观和主观测量。我们开发了准确和稳健的基频方法，这对该系统非常重要。我们改进了高质量的分析/合成系统，STRAIGHT，将其应用于听觉变形，并开发了一个实时版本。4)我们开发了几种语音/声学处理方法：使用音素假设的语音识别模型；多麦克风语音增强系统；一种新的鲁棒声学测量信号“翘曲- tsp”；讨论了语音对话系统中情绪语音信号和意外噪声的处理方法。我们开始使用统计方法来识别方向灵敏度的神经回路。少

The purpose of this project was to construct computational theories of audition and to apply them to various sound signal processing techniques. There were four sub-goals : 1) The development of reliable auditory filterbanks ; 2) The experimental verification of a computational theory of auditory size-shape perception ; 3) The development of speech processing methods using vocoders ; and 4) Examining various speech applications and surveying their principles.1)We determined a reasonable parameter set of compressive gammachirp (cGC) auditory filters by quantitatively fitting them to a thousand of human masking data. A dynamic version of the cGC filterbank (dcGC) was designed to account for the nonlinear characteristics of the cochlea within an analysis/synthesis framework, which is essential for various applications. The dcGC software will be available to the public on a web page as a de facto standard for auditory peripheral processing.2)We performed perceptual experiments supporting t … More he computational theory of auditory size-shape perception. The experiments would be a milestone for the fixture studies in this new field. We organized a special session entitled "Size information in speech and animal calls" at the spring meeting of the Acoustical Society of America (ASA) in May 2005. We invited twelve speakers (seven from our group) to present the related works.3)We improved an auditory vocoder for speech segregation and evaluated it with both objective and subjective measurements. We developed accurate and robust fundamental frequency methods that are important for this system. We improved the high quality analysis/synthesis system, STRAIGHT, applied it to auditory morphing, and developed a real-time version.4)We developed several speech/acoustic processing methods : a speech recognition model using phoneme hypotheses ; a multi-microphone speech enhancement system ; a new robust acoustic measurement signal called "warped-TSP" ; and methods to deal with emotional speech signals and unexpected noise in a speech dialog system. We began using a statistical method to identify the neural circuits for directional sensitivity. Less