Multi-modal recording and modeling of vocal tract movements
Multi-modal recording and modeling of vocal tract movements
复制标题
声道运动的多模式记录和建模
DOI：
10.1007/s11042-015-3040-4
复制
发表时间：
2016-05
影响因子：
3.6
通讯作者：
Dang, Jianwu
中科院分区：
文献类型：
--
作者：
Lu, Wenhuan;Hou, Qingzhi;Fang, Qiang;Dang, Jianwu
由于声道运动的复杂性，很难记录到语音过程中声道的全部信息。动态清晰度已经通过实施各种仪器获得，其中每一种都有其优点和缺点。然而，使用一种类型的记录技术来完成声道运动的测量是一项困难的任务，这导致了多种乐器的同时应用。因此，我们使用超声系统结合电磁关节造影（EMA）系统来记录舌头的多模态运动。利用自行研制的基于超声的语音记录系统，同步记录超声图像和同步音频信号，获得声带运动的数据。EMA系统还用于与音频同时收集发音数据。将EMA和超声数据配准并匹配到相同的音频信号，之后针对每个时间点融合这两组数据。此外，还提出了一种基于主动形状模型的超声数据集声道形状重建和建模方法。平均重建误差不超过1.26 mm。
The complexity of vocal tract movement causes the difficult to record whole information of vocal tract during speech. Dynamic articulation has been acquired by implementing a variety of instruments, each of which has its advantages and shortcomings. However, the measurement of vocal tract movements is a difficult task to accomplish using one type of recording technique, and this has led to the simultaneous application of multiple instruments. Thus, we used an ultrasound system in combination with the electromagnetic articulography (EMA) system to record the multi-modality movement of the tongue. Data of the vocal tract movements were obtained by the ultrasound-based speech recording system developed by us, with which ultrasound images and synchronized audio signals are recorded synchronously. The EMA system is also used for the simultaneous collection of articulatory data with the audio. The EMA and ultrasound data were registered and matched to the same audio signal, after which these two sets of data were fused for each time point. In addition, a method for vocal tract shape reconstruction and modeling is proposed for the ultrasound dataset by using an active shape model. The averaged reconstruction error does not exceed 1.26 mm.
登录
查看更多内容
影响因子：
2.4
作者：
PERKELL, JS;COHEN, MH;JACKSON, MTT
通讯作者：
JACKSON, MTT
影响因子：
6.6
作者：
Prabhat Verma;Raghuraj Singh;Avinash Kumar Singh
通讯作者：
Prabhat Verma;Raghuraj Singh;Avinash Kumar Singh
影响因子：
2.4
作者：
Victoria M. Florescu;L. Crevier-Buchman;B. Denby;Thomas Hueber;Antonia Colazo-Simon;C. Pillot-Loiseau;P. Roussel-Ragot;Cédric Gendrot;S. Quattrocchi
通讯作者：
Victoria M. Florescu;L. Crevier-Buchman;B. Denby;Thomas Hueber;Antonia Colazo-Simon;C. Pillot-Loiseau;P. Roussel-Ragot;Cédric Gendrot;S. Quattrocchi
DOI：
--
发表时间：
2005
期刊：
--
影响因子：
--
作者：
Jeff Mielke;Adam Baker;D. Archangeli;Sumayya Racy
通讯作者：
Jeff Mielke;Adam Baker;D. Archangeli;Sumayya Racy
DOI：
10.1016/s0923-5965(98)00006-x
发表时间：
1998-09
期刊：
Signal Process. Image Commun.
影响因子：
--
作者：
S. Lepsøy;S. Curinga
通讯作者：
S. Lepsøy;S. Curinga