The Dynamics of Audiovisual Behavior in Speech
The Dynamics of Audiovisual Behavior in Speech
复制标题
言语中视听行为的动态
DOI：
--
复制
发表时间：
1996
期刊：
影响因子：
--
通讯作者：
Demetri Terzopoulos
中科院分区：
文献类型：
--
作者：
E. Vatikiotis;K. Munhall;M. Hirayama;Y. Lee;Demetri Terzopoulos
While it is well-known that faces provide linguistically relevant information during communication, most efforts to identify the visual correlates of the acoustic signal have focused on the shape, position and luminance of the oral aperture. In this work, we extend the analysis to full facial motion under the assumption that the process of producing speech acoustics generates linguistically salient visual information, which is distributed over large portions of the face. Support for this is drawn from our recent studies of the eye movements of perceivers during a variety of audiovisual speech perception tasks. These studies suggest that perceivers detect visual information at low spatial frequencies and that such information may not be restricted to the region of the oral aperture. Since the biomechanical linkage between the facial and vocal tract systems is one of close proximity and shared physiology, we propose that physiological models of speech and facial motion be integrated into one audiovisual model of speech production. In addition to providing a coherent account of audiovisual motor control, the proposed model could become a useful experimental tool, providing synthetic audiovisual stimuli with realistic control parameters.
DOI：
10.1037//0096-1523.10.6.812
发表时间：
1984-12
期刊：
Journal of experimental psychology. Human perception and performance
影响因子：
--
作者：
J. Kelso;B. Tuller;Eric Vatikiotis-Bateson;Carol A. Fowler
通讯作者：
J. Kelso;B. Tuller;Eric Vatikiotis-Bateson;Carol A. Fowler
DOI：
10.1121/1.392790
发表时间：
1985
期刊：
The Journal of the Acoustical Society of America
影响因子：
--
作者：
Munhall,KG
通讯作者：
Munhall,KG
重新审视言语感知的运动理论。
影响因子：
3.5
作者：
Massaro,DominicW;Chen,TrevorH
通讯作者：
Chen,TrevorH