Intelligent Multimedia Entertainment: Online monitoring of affective and cognitive states

智能多媒体娱乐：情感和认知状态的在线监控

• 批准号: 484608-2015
• 负责人: Tremblay, Sébastien
• 金额: $ 1.81万
• 依托单位: Université Laval
• 依托单位国家: 加拿大
• 项目类别: Engage Grants Program
• 财政年份: 2015
• 资助国家: 加拿大
• 起止时间: 2015-01-01 至 2016-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=584425
• 关键词: Intelligent; Multimedia; Entertainment; Online; monitoring

The entertainment industry is faced with major changes such as the diversification of electronic platforms as well as the rapid increase of people's consumption of games and digital media, and their fluctuating interests and moods. To address these challenges, media entertainment industries must now develop next-generation adaptive systems; that is, in order to tailor content and provide the most positive user-centered experience, they must include online monitoring of entertainees' cognitive and affective state based on biometric and behavioral markers. Key innovations are needed in terms of identifying reliable markers and their integration within the interactivity of the media. Our approach combines experimental psychology and cognitive ergonomics to investigate physiological and behavioural metrics as online markers of workload, information seeking patterns, engagement, and mood of the entertainee interacting with the Liveshout social platform. First, the proposed project will allow the initial development of an entertainee's functional state (EFS) based on the integration of electrocardiography (e.g., heart rate), eye-tracking (e.g., fixation duration and pupil dilation) and face-reading (e.g., joy and sadness) features. Second, the project aims to contribute to the development of IAS-based interactive entertainment through the conceptualization of an architecture that enables the real-time adaptation of the Liveshout platform content to the EFS. Results of this proposed project will define guidelines and recommendations for designing adaptive and interactive social media, and will positively impact the Canadian technological, financial and education sectors. The outcomes of the project will also have beneficial impacts on other areas such as intelligent tutoring, transportation and public security.

娱乐行业正面临着重大变化，例如电子平台的多样化以及人们对游戏和数字媒体的消费迅速增加，以及他们的兴趣和情绪波动。为了应对这些挑战，媒体娱乐行业现在必须开发下一代自适应系统;也就是说，为了定制内容并提供最积极的以用户为中心的体验，它们必须包括基于生物特征和行为标记的娱乐者认知和情感状态的在线监测。在确定可靠的标记和将其纳入媒体的互动性方面，需要进行关键的创新。我们的方法结合了实验心理学和认知人体工程学，来研究生理和行为指标，作为与Liveshout社交平台互动的娱乐人员的工作量、信息寻求模式、参与度和情绪的在线标记。首先，所提出的项目将允许基于心电图的整合的娱乐对象的功能状态（EFS）的初始开发（例如，心率），眼睛跟踪（例如，注视持续时间和瞳孔扩张）和面部阅读（例如，快乐和悲伤）。第二，该项目旨在通过一个能够使Liveshout平台内容实时适应EFS的架构的概念化，促进基于IAS的互动娱乐的发展。这一拟议项目的结果将为设计适应性和互动性的社交媒体确定指导方针和建议，并将对加拿大的技术、金融和教育部门产生积极影响。该项目的成果也将对智能辅导、交通和公共安全等其他领域产生有益的影响。