Identification of Words and Phrases Through a Phonemic-Based Haptic Display: Effects of Inter-Phoneme and Inter-Word Interval Durations

Identification of Words and Phrases Through a Phonemic-Based Haptic Display: Effects of Inter-Phoneme and Inter-Word Interval Durations
复制标题

通过基于音素的触觉显示识别单词和短语:音素间和单词间间隔持续时间的影响

DOI:
10.1145/3458725
复制
发表时间:
2021
影响因子:
1.6
通讯作者:
Wilson, E. Courtenay
Wilson, E. Courtenay
中科院分区:
计算机科学4区
文献类型:
--
作者:
Reed, Charlotte M.;Tan, Hong Z.;Jiao, Yang;Perez, Zachary D.;Wilson, E. Courtenay

文献摘要

相似文献

用于触觉语音接收的独立设备满足了作为具有严重感觉障碍的人的通信辅助的需要,以及在诸如人机接口和远程通信的应用中,当正常的听觉和视觉通道受到损害或过载时。目前的研究是关于感知评价的音素为基础的触觉语音通信设备,其中一个独特的触觉代码被分配给每个24个辅音和15个元音的英语。触觉音位显示器通过刺激前臂背侧和腹侧表面的24个触觉器的阵列来传达。实验研究了作为音素间间隔的函数的单个单词的识别(研究1)和作为词间间隔的函数的两个单词的短语的识别(研究2)。在音素和单词识别任务上平均训练4.3小时后,研究1中单个单词识别的平均得分范围从87.7%正确到74.3%正确,因为音素间间隔从300减少到0 ms。在研究2中,在两个单词短语任务上平均训练2.5小时后,使用1秒的词间间隔和150毫秒的音素间间隔,以75%的正确准确度识别短语中的两个词。估计在该任务中实现的有效传输速率在30到35个词/分钟的量级。
Stand-alone devices for tactile speech reception serve a need as communication aids for persons with profound sensory impairments as well as in applications such as human-computer interfaces and remote communication when the normal auditory and visual channels are compromised or overloaded. The current research is concerned with perceptual evaluations of a phoneme-based tactile speech communication device in which a unique tactile code was assigned to each of the 24 consonants and 15 vowels of English. The tactile phonemic display was conveyed through an array of 24 tactors that stimulated the dorsal and ventral surfaces of the forearm. Experiments examined the recognition of individual words as a function of the inter-phoneme interval (Study 1) and two-word phrases as a function of the inter-word interval (Study 2). Following an average training period of 4.3 hrs on phoneme and word recognition tasks, mean scores for the recognition of individual words in Study 1 ranged from 87.7% correct to 74.3% correct as the inter-phoneme interval decreased from 300 to 0 ms. In Study 2, following an average of 2.5 hours of training on the two-word phrase task, both words in the phrase were identified with an accuracy of 75% correct using an inter-word interval of 1 sec and an inter-phoneme interval of 150 ms. Effective transmission rates achieved on this task were estimated to be on the order of 30 to 35 words/min.