Study on Controlling Emotion of a Multimedia Viewer Based on Interactive Evolutionary Computation and Physiological Analysis

基于交互式进化计算和生理分析的多媒体观看者情绪控制研究

基本信息

批准号：
17300073
负责人：
TAKAGI Hideyuki
金额：
$ 10.32万
依托单位：
Kyushu University
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (B)
财政年份：
2005
资助国家：
日本
起止时间：
2005 至 2007
项目状态：
已结题

项目摘要

We conducted this research with three steps in 2005-2007 fiscal years.In the first step, “extracting possible movie features that may influence physiological responses, “we firstly cut 60 scenes of 20 seconds from several varieties of movies and extracted 78 physical movie features. Secondly, we constructed a 2-D psychological space, called an emotional space, consisting of(tension-relax)axis and(refreshing-gloomy)axis, and narrowed 30 from 78 possible movie features not using a physiological experiment but a psychological one.In the second step, “extracting relationship between movie features and physiological responses, “we firstly made abstract experimental movie scenes with 20 different variables of one feature that shown the highest correlation among 30 features. Since movie context, i.e. story, deeply influences to human emotion, we made the abstract movie scenes to avoid its effect. Secondly, we measured physiological data by displaying the abstract movies. Measured data are EEG at two side points and two back side, ECG, sweating rate, blood pressure level, and finger pulse volume. However, the difference of measured data among subjects was bigger than the difference of values of physical movie features, we have not found out the significant relationship between the movie features and physiological responses yet.In the third step," establishing driving emotion using extended interactive evolutionary computation(IEC),"we aimed to establish a technique to optimize movie features to drive a movie viewer's physiological condition to a given target condition. Since we have not found out the movie features that surely drive human physiology in the second step, we focused on improving IEC technique. What we did was combining IEC with evolutionary multi-objective optimization, introducing Particle Swarm Optimization instead of evolutionary computation, introducing IEC user's evaluation model, and others.

我们在2005-2007财政年度进行了三个步骤进行了这项研究。在第一步中，“提取可能影响身体反应的可能的电影功能，“我们首先从电影的几种变体中删除了60秒的20秒，并提取了78个物理电影功能。 Secondly, we constructed a 2-D psychological space, called an emotional space, consisting of(tension-relax)axis and(refreshing-gloomy)axis, and narrowed 30 from 78 possible movie features not using a physical experiment but a psychological one.In the second step, “extracting relationship between movie features and physical responses, “we first made abstract experimental movie scenes with 20 different variables of one feature that showed the highest correlation among 30 features.由于电影上下文（即故事）对人类情感产生了深远的影响，因此我们制作了抽象的电影场景以避免其效果。其次，我们通过显示抽象电影来测量物理数据。测得的数据在两个侧点和两个背面的脑电图，ECG，出汗率，血压水平和手指脉冲体积。但是，受试者之间测量数据的差异大于物理电影特征的值差异，我们还没有发现电影特征与身体响应之间的重要关系。在第三步骤，“使用扩展的交互式进化计算（IEC）建立驱动情绪”，我们旨在建立一种技术来建立电影特征以驱动电影观众的身体状况，以驱动电影的身体状况。由于我们还没有发现在第二步中肯定会推动人类生理的电影功能，因此我们专注于改进IEC技术。我们所做的就是将IEC与进化的多目标优化相结合，引入了粒子群优化而不是进化计算，引入了IEC用户的评估模型等。