SmartVideoRanking: Video Search by Mining Emotions from Time-Synchronized Comments
SmartVideoRanking: Video Search by Mining Emotions from Time-Synchronized Comments
复制标题
DOI：
10.1109/icdmw.2016.0140
复制
发表时间：
2016-12
期刊：
影响因子：
--
通讯作者：
Kosetsu Tsukuda;Masahiro Hamasaki;Masataka Goto
中科院分区：
文献类型：
--
作者：
Kosetsu Tsukuda;Masahiro Hamasaki;Masataka Goto
许多人在视频共享网站上搜索和观看视频，用户在那里输入查询并根据观看次数和评级等指标对视频进行排名。然而，使用传统搜索并不总是很容易找到所需的视频。使用户能够更直观地搜索他们想要的视频的一种方法是根据情绪对它们进行索引。以前的研究使用了几个预先定义的情感类别，如“恐惧”和“有趣”，用于此目的。然而，观众的情绪往往更加多样化和具体化。在本文中，我们根据输入查询动态检测情感，并实现SmartVideoRanking，使用户能够根据检测到的情感搜索视频。我们估计观众的情绪，从时间同步的评论上的视频和估计的有用性，每一种情绪，通过usingsupport vector machine regression。实验结果表明：（1）斯皮尔曼的等级相关性之间的估计有用性分数和黄金标准数据是0.7547，（2）与视频相关的情绪从一个查询到另一个不同，因此它是有意义的检测情绪根据输入查询，和（3）排名基于观众的情绪使用户能够浏览视频，不出现在传统的搜索结果的顶部。我们还进行了一项用户研究，展示了SmartVideoRanking搜索视频的能力。
Many people search for and watch videos on videosharing Web sites, where users input a query and rank videos onthe basis of metrics such as view count and rating. However, it isnot always easy to find the desired video with a conventionalsearch. One approach that enables users to more intuitivelysearch for videos they desire is to index them according toemotions. Previous studies have used several predefined emotioncategories, such as "fear" and "funny", for this purpose. However, viewers' emotions tend to be more diverse and specific. In thispaper, we dynamically detect emotions in accordance with aninput query and implement SmartVideoRanking, which enablesusers to search for videos on the basis of the detected emotions. We estimate viewer emotions from time-synchronized commentson videos and estimate the usefulness of each emotion by usingsupport vector machine regression. Experimental results showthat: (1) Spearman's rank correlation between the estimatedusefulness scores and gold standard data was 0.7547, (2) emotions associated with videos vary from one query to anotherand it is therefore meaningful to detect emotions according to aninput query, and (3) rankings based on viewer emotions enableusers to browse videos that do not appear at the top ofconventional search results. We also conduct a user study anddemonstrate SmartVideoRanking's capability to search for videos.