Attentional-Perceptual Scanpath for Emotion Recognition: A New Framework

面部具有传递有关我们情绪状态的信息的功能价值。对情绪面部表情的识别至关重要，这让我们能够相应地调整自己的行为。目前的项目集中在情绪面部表情的处理和识别上。对快乐、愤怒、厌恶、恐惧、惊讶、悲伤等基本情绪表达的识别率较高，超过了偶然性水平。然而，并不是所有的情绪都能得到同样好的识别。人们观察到不同情绪之间的差异，其中幸福是最准确识别的，其次是愤怒、惊讶、厌恶、悲伤，最后是恐惧。虽然错误的模式和总体识别率似乎很清楚，但潜在的过程并没有得到很好的理解。目前这个项目的主要目标是测试我开发的一个新的综合框架，称为用于情感识别的注意-感知扫描路径(APSER)。根据APSER的说法，情绪面部表情的识别是通过依次关注面部表情的个别特征来完成的。各个要素将集成到统一表示中，并处理新要素，直到选择标签为止。研究计划的第一个轴包括探索注意-知觉机制的实验。实际上，虽然注意-知觉机制在情绪面部表情识别中的作用是毋庸置疑的，但它们是如何运作的仍不清楚。第二个轴将测试APSER的新假设，该假设规定，识别是基于对面部表情个体特征的顺序关注和感知，这些特征是情绪表达的函数，直到选择了准确的标签。该项目的第三个轴从发展的角度关注APSER的适用性，因为研究表明，儿童处理情绪面部表情的方式与成年人不同。对识别和处理非语言行为的基本机制的理解是更好地理解社会互动和干预的关键支柱。

The face has a functional value transmitting information about our emotional state. Recognition of emotional facial expressions is crucial, allowing us to adapt our behaviour accordingly. The current program is centered on the processing and recognition of emotional facial expressions. The recognition rates for the expressions of the basic emotions such as happiness, anger, disgust, fear, surprise and sadness are high, surpassing chance level. However, not all emotions are recognized equally well. Variations are observed between emotions with happiness being the most accurately recognized, followed by anger, surprise, disgust, sadness, and finally, fear. While the pattern of errors and general recognition rates seem clear, the underlying processes are not well understood. The main goal of the current program is to test a new comprehensive framework called the Attentional-Perceptual Scan-path for Emotion Recognition (APSER) that I have developed. According to APSER, recognition of emotional facial expressions is accomplished by sequentially attending to individual features of the facial expression. Individual features are integrated into a unified representation and new features are processed until a label is selected. The first axis of the research program includes experiments to explore attentional-perceptual mechanisms. In effect, while the role of attentional-perceptual mechanisms in the recognition of emotional facial expressions is undisputable, it remains unclear how they operate. The second axis will test the new assumptions of APSER, which stipulate that recognition is based on the sequential attention to and perception of individual features of the facial expression as a function of the emotion expressed until the accurate label is selected. The third axis of the program focuses on the applicability of APSER from a developmental perspective as research has shown that children process emotional facial expressions differently than adults. The understanding of basic mechanisms in the recognition and processing of non-verbal behaviour are crucial pillars for a better understanding of social interactions and interventions.