Cloud-based multi-modal visualization technique for emotional response in human-computer interaction

基于云的人机交互中情绪反应的多模态可视化技术

• 批准号: 500166-2016
• 负责人: Léger, PierreMajorique
• 金额: $ 4.37万
• 依托单位: HEC Montréal
• 依托单位国家: 加拿大
• 项目类别: Idea to Innovation
• 财政年份: 2018
• 资助国家: 加拿大
• 起止时间: 2018-01-01 至 2019-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=657131
• 关键词: Cloud; based; multi; modal; visualization

Summary****The objective of this proposal is to investigate the commercial potential of a cloud-based visualisation technique of the emotional state of users interacting with computer software. The novelty lies in the triangulation of multiple data sources and the utilization of machine learning techniques. This technique can help usability experts make a more comprehensive diagnostic of the user experience and of the ergonomic characteristics of an interface by identifying, for example, which parts of an interface generate positive and negative emotions. The benefits of the usability testing technique under investigation were demonstrated with a prototype system and were described in published scientific papers in various contexts, such as websites and mobile applications evaluation. The current prototype of Photobooth has been successfully used in a collaborative research context by Canadian companies across a number of industries.**Traditional gaze heatmaps are used in eye tracking as intuitive representations of aggregated gaze data. Their main use is to help answer the question: "Where in the interface do people tend to look?" In our visualization method, the users' gaze now serves as a means of mapping emotional signals onto the user interface. The resulting heatmaps represent emotions on the interface, and can help answer the following question: "Where in the interface do people tend to react emotionally?" **************

摘要 * 本提案的目的是调查与计算机软件交互的用户的情绪状态的基于云的可视化技术的商业潜力。新颖之处在于多个数据源的三角测量和机器学习技术的利用。这种技术可以帮助可用性专家对用户体验和界面的人体工程学特征进行更全面的诊断，例如，通过识别界面的哪些部分会产生积极和消极的情绪。正在调查的可用性测试技术的好处是证明了一个原型系统，并在各种情况下，如网站和移动的应用程序评估发表的科学论文中进行了描述。Photobooth目前的原型已被加拿大多个行业的公司成功地用于合作研究。**传统的凝视热图在眼动跟踪中用作聚合凝视数据的直观表示。它们的主要用途是帮助回答这样一个问题：“人们倾向于看界面的哪里？“在我们的可视化方法中，用户的目光现在可以作为将情感信号映射到用户界面上的一种手段。由此产生的热图代表了界面上的情绪，可以帮助回答以下问题：“在界面中，人们倾向于在哪里做出情绪反应？" **************