A study on auditory aiding by digital hering aid and an efficient adding method of the visual/tactile information

助听器：提出了一种复合压缩滤波方法，实现了波形处理中的频谱压缩。用数字助听器对感音神经性听力障碍者进行了音节偏好测试和音质评价测试，并实现了该方法的实时性。在语音特征提取方面：提出了语音的谱归一化、元音矢量表示和谱图特征提取方法，以便通过非听觉系统传递语音信息。它的正常化的影响，证实了由许多扬声器发出的元音识别测试，其中振动触觉显示器已被使用。语音特征被用于视觉辨别测试，其效果变得明显。韵律及其电触觉图像：用电触觉表征进行单词重音类型的识别测试。它表明，通过考虑将语音音高转换为电脉冲串和增加语音强度，可以传输与听觉相似的韵律图像。本文采用双DSP芯片设计了一个实时语音特征提取系统，实现了上述各种处理。我们已经研究了使用单独的系统，即助听器、触觉设备等的言语感知。2同时使用这些系统的情况下的效果还不清楚。今后，我们将根据实验结果、处理方法和本研究所获得的系统，系统地评估这种效果。

Brief summary is as follows.Hearing aid : We proposed a composite compression filtering method which implemented the spectral compression in the waveform processing. The syllabic preference tests and the evaluation tests on suond quatilty were carried out by the sensorineural hearing impaired, where a digital hearing aid to realize the method in real-time has been used. As result, the favorable results were obtained in comparison with the conventional multiband compression.On the speech feature extractions : A spectral normalization, its vowel vector representation and a speech features extraction from spectral figures were proposed in order to trasmit the phonemic information via non-auditory sensory systems. The effects of its normalization was confirmed by the identification test of vowels uttered by many speakers, where a vibro-tactile display has been used. The speech features were used in the visual discrimination test and then its effects became clear.Prosody and its electrotactile image : Te identification tests on the accent types of words were carried out using an electrotactlile representation. It showed that it was possible to transmit the prosodic image similar to auditory one by taking account of both a conversion the voice pitch into the electrical pulse train and an addition of the speech intensity.A speech feature extraction system : A real-time speech feature extraction system was developed with dual DSP chips and the above mentioned various processings were realized.On this study, we have investigated the speech perception using an individual system, that is, a hearing aid, a tactile device and so on. The effects in the case using those systems simultaneously could not be become clear. In future, we will evaluate such effects systematically, based on the experimental results, the proccesing methods and the systems obtained in this study.