A study on auditory aiding by digital hering aid and an efficient adding method of the visual/tactile information

简要总结如下。助听器：我们提出了一种复合压缩滤波方法，在波形处理中实现了频谱压缩。音节偏好测试和音质评价测试由感音神经性听障患者进行，其中使用数字助听器实时实现该方法。结果表明，与传统的多频带压缩相比，该方法取得了较好的效果。在语音特征提取方面：提出了一种频谱归一化、元音向量表示和频谱图语音特征提取方法，目的是通过非听觉感知系统传递音位信息。它的规范化效果被许多说话者发出的元音识别测试所证实，其中振动触觉显示已经被使用。将语音特征应用于视觉识别测试，其效果逐渐显现。韵律及其触感图像：采用触感表征对单词重音类型进行识别测试。结果表明，通过将语音音高转换为电脉冲序列和增加语音强度，可以传输与听觉相似的韵律图像。语音特征提取系统：采用双DSP芯片开发了实时语音特征提取系统，实现了上述各项处理。在这项研究中，我们研究了使用单个系统的语音感知，即助听器，触觉设备等。在同时使用这些系统的情况下，其影响尚不清楚。在未来，我们将根据实验结果、处理方法和本研究获得的系统，系统地评估这些效果。

Brief summary is as follows.Hearing aid : We proposed a composite compression filtering method which implemented the spectral compression in the waveform processing. The syllabic preference tests and the evaluation tests on suond quatilty were carried out by the sensorineural hearing impaired, where a digital hearing aid to realize the method in real-time has been used. As result, the favorable results were obtained in comparison with the conventional multiband compression.On the speech feature extractions : A spectral normalization, its vowel vector representation and a speech features extraction from spectral figures were proposed in order to trasmit the phonemic information via non-auditory sensory systems. The effects of its normalization was confirmed by the identification test of vowels uttered by many speakers, where a vibro-tactile display has been used. The speech features were used in the visual discrimination test and then its effects became clear.Prosody and its electrotactile image : Te identification tests on the accent types of words were carried out using an electrotactlile representation. It showed that it was possible to transmit the prosodic image similar to auditory one by taking account of both a conversion the voice pitch into the electrical pulse train and an addition of the speech intensity.A speech feature extraction system : A real-time speech feature extraction system was developed with dual DSP chips and the above mentioned various processings were realized.On this study, we have investigated the speech perception using an individual system, that is, a hearing aid, a tactile device and so on. The effects in the case using those systems simultaneously could not be become clear. In future, we will evaluate such effects systematically, based on the experimental results, the proccesing methods and the systems obtained in this study.