The effects of dynamic facial information on sensitivity to facial expressions.

动态面部信息对面部表情敏感度的影响。

• 批准号: ES/T009098/1
• 负责人: Abigail Webb
• 金额: $ 12.19万
• 依托单位: University of Essex
• 依托单位国家: 英国
• 项目类别: Fellowship
• 财政年份: 2019
• 资助国家: 英国
• 起止时间: 2019 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=ES%2FT009098%2F1
• 关键词: effects; dynamic; facial; information; sensitivity

Facial emotion recognition is viewed as one of the defining aspects of human visual perception. However, for some members of the population extracting emotion-related information from faces is a challenging task. Deficits in facial emotion recognition are particularly prominent in autism spectrum disorders (ASD), and in certain mood-disorders. Behavioural intervention programmes have been used to facilitate facial emotion learning by utilising interactive games with computer generated agents. Exposure therapy using VR has had positive effects on reducing social phobias and effects of post-traumatic stress disorder. The objective of the present study is pilot novel stimuli that reflect naturalistic facial emotion perception within VR, with a long-term view for using this as a model for behavioural intervention programmes within clinical populations. This has been of particular interest to Sinewave; software developers whom the primary mentor of the project is already in connection with. A notable drawback facing current behavioural paradigms is their use of synthetic and 3D animated characters whose qualities do not reflect the fluid nature of human expression as it emerges in real time. This presents a gap within literature and industry that requires a realistic set of real-life, dynamic human facial expressions. If piloted now, such a stimulus set would lend itself to an expanse of areas, from clinical research areas, to cutting-edge user software development. The second mentor on the project will offer their expertise in this particular area, and possess the research background and hardware required to develop and pilot such a face set using VR. For facial stimuli to be effective tools used for measuring and improving facial emotion recognition, they must be realistic enough to simulate natural social perception: these objectives bring together expertise from both Abigail Webb and Peter Scarfe. The project will be the first to address how real-life, dynamic facial information in videos of human faces contributes to observers' emotion recognition accuracy. This is yet to be tested using an immersive VR platform; a cost-effective and novel technique for assessing and promoting the practice of facial emotion recognition in clinical populations. Such dynamic, real-time facial stimuli may be more effective when measuring natural facial emotion recognition, an advantage that is bolstered by using immersive VR. Our pilot study uses a non-clinical population, and will serve as a preliminary investigation of the efficacy of our model for immersive facial recognition. This is a particular source of interest to Sinewave. Using specialised 3D facial scanning techniques at the University of Reading (Peter Scarfe), it will be possible to create real human facial stimuli that are both 3D and dynamic, changing expression in real time. This will be investigated both outside of and within immersive VR, to measure the relative effects of VR context on facial emotion recognition. Software companies for service users, including Facebook Reality Labs (another pre-existing relationship with mentors) are now emphasising the importance of such research input, in order to develop the hardware and software necessary for relaying the nuances of such socially complex interactions. These applications are vast, and lend themselves equally well to clinical research, empirical areas of cognitive psychology, sociology, industry, and business. This area of research now taking off in areas outside of academia. We see this is the case with Facebook Reality Labs -another pre-existing relationship that exists with the primary mentor of the project- where the construction of cutting-edge immersive software is becoming increasingly informed by expert researchers within face perception. Together, this project unifies experts across psychophysics and face perception (AW), VR (LvD), creation of real-life human facial stimuli (PS).

人脸情绪识别被认为是人类视觉感知的重要方面之一。然而，对于一些人来说，从面部提取与情绪相关的信息是一项具有挑战性的任务。面部情绪识别缺陷在自闭症谱系障碍(ASD)和某些情绪障碍中尤为突出。行为干预计划已经被用来通过利用与计算机生成的代理的互动游戏来促进面部情绪的学习。VR暴露疗法在减少社交恐惧症和创伤后应激障碍方面起到了积极作用。本研究的目标是试行新颖的刺激，在虚拟现实中反映自然主义的面部情绪感知，并着眼于将其用作临床人群中行为干预计划的模型。SineWave对此特别感兴趣；该项目的主要导师已经与软件开发人员建立了联系。目前的行为模式面临的一个显著缺陷是，它们使用的是合成的和3D动画角色，这些角色的品质不能反映出人类表情实时出现时的流动性。这在文学和行业中呈现出一种鸿沟，需要一套逼真的、动态的人类面部表情。如果现在试行，这样的刺激方案将扩展到从临床研究领域到尖端用户软件开发的广泛领域。该项目的第二位导师将提供他们在这一特定领域的专业知识，并拥有使用VR开发和试验这样的人脸集所需的研究背景和硬件。面部刺激要成为测量和改善面部情绪识别的有效工具，它们必须足够现实，以模拟自然的社会感知：这些目标汇集了阿比盖尔·韦布和彼得·斯卡夫的专业知识。该项目将首次解决人脸视频中真实、动态的面部信息如何有助于观察者情绪识别的准确性。这还有待使用沉浸式VR平台进行测试；沉浸式VR平台是一种经济高效的新技术，用于评估和促进临床人群的面部情绪识别实践。当测量自然的面部情感识别时，这种动态、实时的面部刺激可能会更有效，这一优势通过使用沉浸式VR得到了支持。我们的试点研究使用了非临床人群，并将作为对我们的沉浸式面部识别模型的有效性的初步调查。这是SineWave特别感兴趣的一个来源。使用雷丁大学(Peter Scarfe)专门的3D面部扫描技术，将有可能创造出真实的人类面部刺激，既是3D的，也是动态的，实时改变表情。这将在沉浸式VR之外和内部进行调查，以衡量VR环境对面部情感识别的相对影响。为服务用户服务的软件公司，包括Facebook Reality Labs(另一家与导师建立的关系)，现在正强调此类研究投入的重要性，以便开发必要的硬件和软件，以传递这种复杂的社交互动的细微差别。这些应用是广泛的，也同样适用于临床研究、认知心理学、社会学、工业和商业的经验领域。这一领域的研究目前正在学术界以外的领域展开。我们看到Facebook Reality Labs就是这种情况--另一种与项目主要导师存在的预先存在的关系--在那里，尖端沉浸式软件的构建越来越多地得到脸部感知领域的专家研究人员的帮助。该项目将心理物理学和面部感知(AW)、虚拟现实(LVD)、真实面部刺激(PS)等领域的专家结合在一起。

项目成果

Reversing luminance polarity: control faces are harder to recognise but easier to see

反转亮度极性：控制面更难识别，但更容易看到

• DOI: 10.31234/osf.io/zw3nb
• 发表时间: 2020
• 作者: Webb A

Saccadic eye movements are deployed faster for salient facial stimuli, but are relatively indifferent to their emotional content

对于显着的面部刺激，眼球扫视运动的部署速度更快，但对其情感内容相对漠不关心

• DOI: 10.31234/osf.io/j9c2e
• 发表时间: 2021
• 作者: Webb A

Contrast normalisation masks natural expression-related differences and artificially enhances the perceived salience of fear expressions.

对比度标准化掩盖了与自然表达相关的差异，并人为地增强了恐惧表达的感知显着性。

• DOI: 10.31219/osf.io/hkrd9
• 发表时间: 2020
• 作者: Webb A

Conference Paper

• DOI: 10.1016/s0987-7983(98)80087-x
• 发表时间: 2009
• 作者: Peter Chan

sychology of Aesthetics, Creativity, and the Arts Immersive-360° theatre: user experience in the virtual auditorium and platform efficacy for current and underserved audiences

美学、创造力和艺术心理学沉浸式 360° 剧院：虚拟礼堂的用户体验以及当前和服务不足的观众的平台功效

• DOI: 10.31234/osf.io/2fyv7
• 发表时间: 2023
• 作者: Webb A