Web Multimedia Mining for Learning Verb and Noun Concepts and Their Relations

用于学习动词和名词概念及其关系的网络多媒体挖掘

• 批准号: 23650044
• 负责人: YANAI Keiji
• 金额: $ 2.41万
• 依托单位: The University of Electro-Communications
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Challenging Exploratory Research
• 财政年份: 2011
• 资助国家: 日本
• 起止时间: 2011 至 2013
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-23650044/
• 关键词: 動作認識; ビデオ認識; Webマルチメディアマイニング; Web動画; 画像認識; 一般物体認識; Web動画分類; Web動画マイニング; 動画像認識; 時空間特徴量; 動作分類; 物体認識

After the three-year research activities on this research grant, we have obtained the following results: (1) A new method to collect video shots corresponding to the given keywords from the Web video sharing site such as YouTube. (2) A method to improve (1) by using results of Web image search engines additionally. (3) A novel method, VisualTextualRank, for efficient use of relations between words and video shots. (4) A method to extract new spatio-temporal features by paying attention to human hands motion, which helps effectively recognize and analyze interactions between objects and human hands.

经过三年的研究活动，我们获得了以下成果：（1）一种新的方法，从Web视频共享网站，如YouTube收集对应于给定的关键字的视频镜头。(2)一种通过额外使用Web图像搜索引擎的结果来改进（1）的方法。(3)一种新颖的方法，VisualTextualRank，用于有效地使用单词和视频镜头之间的关系。(4)提出了一种关注人手运动的时空特征提取方法，有效地识别和分析了物体与人手之间的相互作用。

项目成果

Large-scale Web Video Shot Ranking Based on Visual Features and Tag Co-occurrence

基于视觉特征和标签共现的大规模网络视频镜头排序

• DOI: 10.1145/2502081.2502139
• 发表时间: 2013
• 期刊: Proceedings of the 21st ACM international conference on Multimedia
• 作者: Kento Sugiura;Arata Hayashi;Ting Ting Dong;Yoshiharu Ishikawa;Do Hang Nga and Keiji Yanai
• 通讯作者: Do Hang Nga and Keiji Yanai

World seer: a realtime geo-tweet photo mapping system

World seer：实时地理推文照片映射系统

• DOI: 10.1145/2324796.2324870
• 发表时间: 2012
• 期刊: Proceedings of the 2nd ACM International Conference on Multimedia Retrieval
• 作者: Keiji Yanai

Real-time Mobile Recipe Suggestion System using Food Ingredient Recognition

使用食品成分识别的实时移动食谱建议系统

• 发表时间: 2012
• 作者: 杉浦 健人;早矢仕 新，石川 佳治;Yuji Matsuda and Keiji Yanai;Takuma Maruyama and Keiji Yanai
• 通讯作者: Takuma Maruyama and Keiji Yanai

A Dense SURF and Triangulation based Spatio-Temporal Feature for Action Recognition

基于密集冲浪和三角测量的时空特征的动作识别

• 作者: Tingting Dong;Xi Guo;Yoshiharu Ishikawa;Chuan Xiao;Do Hang Nga and Keiji Yanai;董ていてい，郭茜，石川佳治，肖川;加藤翔，董ていてい，早矢仕新，石川佳治;Do Hang Nga and Keiji Yanai
• 通讯作者: Do Hang Nga and Keiji Yanai

Rapid Mobile Food Recognition using Fisher Vector

使用 Fisher Vector 进行快速移动食品识别

• 发表时间: 2013
• 作者: 杉浦健人;早矢仕新;石川佳治;Yoshiyuki Kawano and Keiji Yanai
• 通讯作者: Yoshiyuki Kawano and Keiji Yanai