Does movement on the lips mean movement in the mind
Does movement on the lips mean movement in the mind
复制标题
嘴唇上的运动是否意味着心灵上的运动
DOI：
--
复制
发表时间：
1996
期刊：
影响因子：
--
通讯作者：
C. Abry
中科院分区：
文献类型：
--
作者：
Marie;M. Lallouache;C. Abry
有人提出，听觉和视觉言语感知之间的共同尺度可能只是运动学(比如动力学)，这是一个有点古老的吉布森理论，直到最近才通过移动的点光显示器进行了说明。这里报道的结果在另一种范式的框架下解决了同样的问题，而不是移动的点。面部的完整图像是在运动和静态条件下沿着自然无声的元音到元音的圆滑手势(我们的“无声停顿唇读范式”)呈现的。为了比较运动与形状的优势，我们将人脸感知角度范式的改变用于特征/手势识别。那么，问题是：以观众为中心的舍入手势投影的优化是否会比动作更有利？为轮廓找到的这种饱和效果支持由运动形状系统增强的用于前视图的形状从阴影处理，这种系统在欠采样(点光源)的情况下或用于变形投影时被招募。这些计算方法避免了要求直接的感知解释，即在所有情况下运动与运动之间的关系。此外，它们为表现形式留下了选择的余地：运动或来自非最佳、甚至不可识别的运动形状的形状。因此，形状仍然是静态和动态刺激的一种可能的形式，至少对于语音的一组类别特征来说是如此，在我们的例子中，主要的可见元音手势是舍入。
It has been proposed that the common metric between audio and visual speech perception could be just kinematics (say dynamics), a somewhat rather old gibsonian proposal illustrated until recently by moving point-lights displays. Results reported here address the same question in the frame of another paradigm than moving dots. Full images of the face were presented in moving and static conditions along a naturally silent vowel-to-vowel rounding gesture (our “silent pause lipreading paradigm”). In order to compare the benefit of motion vs. shape, the change in angle paradigm for face perception was used for feature/gesture identification. The question is then: Does viewer-centred optimisation of the projection of the rounding gesture override motion benefit? Such a saturation effect found for profiles supports a shape-from-shading processing for front views, enhanced by the shape-from-motion system, such systems being recruited in case of undersampling (point-lights) or for out of shape projections. These computational approaches avoid calling for a direct perception account, i.e. motion-from-motion in all cases. Moreover they leave open the alternative for representational formats: motion or shape from a non optimal, or even non recognisable, shape put in motion. So shape remains a possible format for static as well as for dynamic stimuli, at least for a set of category features of speech sounds, in our case the main visible vowel gesture, rounding.