Biosignal-Based Spoken Communication: A Survey
Biosignal-Based Spoken Communication: A Survey
复制标题
DOI：
10.1109/taslp.2017.2752365
复制
发表时间：
2017-12-01
影响因子：
5.4
通讯作者：
Brumberg, Jonathan S.
中科院分区：
文献类型：
--
作者：
Schultz, Tanja;Wand, Michael;Brumberg, Jonathan S.
语音是一个复杂的过程，涉及广泛的生物信号，包括但不限于声学。这些生物信号来自发音、发音肌肉活动、神经通路和大脑本身，可以用来绕过传统语音处理的限制，并从总体上洞察语音产生的过程。基于生物信号的语音处理研究是工程学、计算机科学、电子学和机器学习到医学、神经科学、生理学和心理学等多学科交叉的一个广泛而活跃的领域。因此，已经使用了各种方法和途径来研究共同的目标，即创建基于生物信号的语音处理设备，用于日常情况下的通信应用和语音康复，以及获得对口语通信的更深层次的理解。本文概述了基于生物信号的口语交流的各种模式、研究方法和目标。
Speech is a complex process involving a wide range of biosignals, including but not limited to acoustics. These biosignals-stemming from the articulators, the articulator muscle activities, the neural pathways, and the brain itself-can be used to circumvent limitations of conventional speech processing in particular, and to gain insights into the process of speech production in general. Research on biosignal-based speech processing is a wide and very active field at the intersection of various disciplines, ranging from engineering, computer science, electronics and machine learning to medicine, neuroscience, physiology, and psychology. Consequently, a variety of methods and approaches have been used to investigate the common goal of creating biosignal-based speech processing devices for communication applications in everyday situations and for speech rehabilitation, as well as gaining a deeper understanding of spoken communication. This paper gives an overview of the various modalities, research approaches, and objectives for biosignal-based spoken communication.