Encoding of dynamic facial information in the middle dorsal face area.
Encoding of dynamic facial information in the middle dorsal face area.
复制标题
DOI：
10.1073/pnas.2212735120
复制
发表时间：
2023-02-21
影响因子：
11.1
通讯作者：
Freiwald, Winrich A.
中科院分区：
文献类型：
--
作者：
Yang, Zetian;Freiwald, Winrich A.
脸部通过形状和动作两个渠道传递社交信息。这些被认为是由两条不同的处理路径处理的。虽然已经有很多研究致力于处理面部形状的途径，但对于面部运动还没有类似的机械性理解。在这里，为了获得这样的见解，我们进行了单单位电生理记录从中部背侧面部，MD。MD包含的细胞对自然主义的面部形状-动作组合具有高度的选择性，将表征转移到更高维度的空间。MD人群对小但重要的脸部运动很敏感，如凝视移动，并使用单独的参照系，可以分离头部、嘴巴和眼睛的运动分量。因此，异质MD群体生成捕获复杂面部运动的可分离代码。运动中的面孔通过视觉动力学揭示了过多的信息。面孔可以在改变脸型的同时以复杂的模式移动，例如，在产生不同的情感表情期间。虽然运动和形状加工已经在独立的研究企业中得到了广泛的研究，但对它们在生物运动中的结合却知之甚少。在这里，我们利用脑成像研究中的发现，对猕猴颞上沟(STS)背侧部分的一个区域--面部中部背侧区域(MD)--进行了选择性的自然脸部运动。为了获得对面部运动编码的机械性见解，我们记录了MD的单个单位活动，测试MD细胞是否以及如何编码面部运动。MD人群对自然的面部运动和面部形状高度敏感。一些MD细胞只对面部形状和动作的结合做出反应，另一些细胞即使没有动作也对面部形状有选择性，还有一些细胞受到面部动作的抑制。我们发现，这种异质的MD群体将脸部运动转换到更高维度的活动空间，这一表现将允许对相关的小规模运动具有高度的敏感性。事实上，我们发现许多MD细胞对眼球运动具有这样的敏感性。我们进一步发现，MD细胞以一种可分离的方式编码头部、嘴巴和眼睛的运动，需要使用多个参考帧。因此，MD是一个真正的面部运动区域，它使用高度异质的细胞群来创建代码，甚至可以捕捉复杂的面部运动轨迹。
Faces signal social information through two channels, shape and motion. These are thought to be processed by two separate processing pathways. While much research has been devoted to the pathway processing facial shape, no similarly mechanistic understanding exists for facial motion. Here, to gain such insights, we conduct single-unit electrophysiological recordings from the middle dorsal face area, MD. MD contains cells that are highly selective for naturalistic facial shape-motion combinations, shifting the representation into a higher dimensional space. The MD population is sensitive to small but important face motion like gaze shifts and, using separate reference frames, can separate motion components of head, mouth, and eyes. Thus, a heterogeneous MD population generates separable codes that capture complex face motion. Faces in motion reveal a plethora of information through visual dynamics. Faces can move in complex patterns while transforming facial shape, e.g., during the generation of different emotional expressions. While motion and shape processing have been studied extensively in separate research enterprises, much less is known about their conjunction during biological motion. Here, we took advantage of the discovery in brain-imaging studies of an area in the dorsal portion of the macaque monkey superior temporal sulcus (STS), the middle dorsal face area (MD), with selectivity for naturalistic face motion. To gain mechanistic insights into the coding of facial motion, we recorded single-unit activity from MD, testing whether and how MD cells encode face motion. The MD population was highly sensitive to naturalistic facial motion and facial shape. Some MD cells responded only to the conjunction of facial shape and motion, others were selective for facial shape even without movement, and yet others were suppressed by facial motion. We found that this heterogeneous MD population transforms face motion into a higher dimensional activity space, a representation that would allow for high sensitivity to relevant small-scale movements. Indeed, we show that many MD cells carry such sensitivity for eye movements. We further found that MD cells encode motion of head, mouth, and eyes in a separable manner, requiring the use of multiple reference frames. Thus, MD is a bona fide face–motion area that uses highly heterogeneous cell populations to create codes capturing even complex facial motion trajectories.
登录
查看更多内容
影响因子：
13.9
作者：
Freiwald W;Duchaine B;Yovel G
通讯作者：
Yovel G
DOI：
10.1126/science.1194908
发表时间：
2010-11-05
期刊：
Science (New York, N.Y.)
影响因子：
--
作者：
Freiwald WA;Tsao DY
通讯作者：
Tsao DY
影响因子：
25
作者：
Freiwald, Winrich A.;Tsao, Doris Y.;Livingstone, Margaret S.
通讯作者：
Livingstone, Margaret S.
影响因子：
25
作者：
Mathis, Alexander;Mamidanna, Pranav;Bethge, Matthias
通讯作者：
Bethge, Matthias
影响因子：
3.2
作者：
Jellema, T;Perrett, DI
通讯作者：
Perrett, DI