Towards new Realms of Human Computer Interaction Using Affective Computing and Persuasive Technology

拟议的研究计划探索了人机交互(HCI)领域的两个新想法：情感计算和说服技术。这些范式考虑了在交互过程中人与计算机之间情感的双向交流。因此，它们涉及赋予计算机情商和说服力，这两个属性以前是人类保留的。*情感计算方法的目的是让计算机不仅能够欣赏和回应传统的输入，而且还能对用户的情感做出反应。(请注意，情感指的是感觉或情感的体验。)事实上，这个领域的范围很广，涉及到计算机对人类影响的识别、解释、响应和模拟。*我们建议开发情感识别方法，包括分析可以从视听传感器推断的几种形式的信息。与以往的工作不同，我们打算在分析中使用从视频信号中提取的生理信息。我们假设这种方法将提高使用视听传感器进行情感识别的准确率。*此外，我们还提出了将开发的情感识别方法用于评估人机交互质量。因此，我们打算开发一个可用性检查框架，该框架支持对通过人机交互引起的情感进行经验测量。这将使交互设计师更容易识别引发用户负面情绪的问题领域。*劝说技术关注的是使用计算机来改变用户的思维和行为方式。他们的目标是通过人机交互的社会影响，吸引人类积极地改变他们的态度。*我们建议在游戏应用程序中整合有说服力的概念。特别是，我们对动态调整游戏场景感兴趣，以便在考虑用户的情感状态和环境背景的同时高效地呈现有说服力的内容。用户的情感状态可以反映她/他对特定劝说策略的反应水平。*这项研究的长期目标是在人类和计算机之间实现一种进化的关系，模仿为人类之间的交流保留的一些社会特征。短期目标可概括如下：*开发多模式机制，通过音视频捕获有效检测情感信息，而不依赖生物传感器。*设计使用情感信息进行经验可用性测试的方法，并开发一个完整的框架来支持这种评估形式。*通过调整游戏场景，构思能够动态适应玩家情感状态和上下文的说服性游戏。**

The proposed research program explores two novel ideas in the realm of Human Computer Interaction (HCI): Affective Computing and Persuasive Technology. These paradigms consider the bi-directional communication of emotions between humans and computers during interaction. Hence, they involve giving computers emotional intelligence and persuasive abilities, two attributes that were previously reserved for humans. ***Affective computing methods are aimed at allowing computers to appreciate and respond not only to traditional inputs, but also to users' affects. (Note that affect refers to the experience of feeling or emotion.) In fact, the field has a wide scope and is concerned with the recognition, interpretation, response and simulation of human affects by computers. ***We propose the development of affect recognition methods that involve the analysis of several modalities of information that can be inferred from audio visual sensors. As opposed to previous works, we intend to use physiological information extracted from a video signal in our analysis. We hypothesise that this approach will increase the accuracy of affect recognition using audio visual sensors.***Also, we propose the use of the affect recognition methods that will be developed in the evaluation of the HCI quality. Hence, we intend to develop a usability inspection framework that supports the empirical measurement of emotions evoked through HCI. This would allow interaction designers to more easily identify problematic areas that provoke users' negative emotions.***Persuasive technologies are concerned with the use of computers to change how users think and behave. Their goal is to entice humans to positively change their attitudes through social influence as a result of human-computer interaction. ***We propose to integrate persuasive concepts within gaming applications. In particular, we are interested in the dynamic modulation of gaming scenarios to efficiently present persuasive contents while considering the user's affective status and environmental context. The user's affective status can reflect her/his level of response to a particular persuasive strategy. ***The long-term goal of this research is to attain an evolved relationship between humans and computers that mimics some of the social characteristics reserved for inter-human exchanges. The short-term objectives can be summarized as follows:*** Develop multi-modal mechanisms to effectively detect affective information through audio-video capture without relying on bio-sensors. *** Devise methods for empirical usability testing using affective information and develop a complete framework to support such form of evaluation.*** Conceive persuasive games that can be dynamically adapted to gamers' affective state and context by modulating the gaming scenario.**