Multi-modal Content Retrieval and Presentation and Broadcast Content Generation for Mobile Environment

移动环境的多模式内容检索和演示以及广播内容生成

• 批准号: 14208036
• 负责人: TANAKA Katsumi
• 金额: $ 25.04万
• 依托单位: Kyoto University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (A)
• 财政年份: 2002
• 资助国家: 日本
• 起止时间: 2002 至 2004
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-14208036/
• 关键词: cross-media retrieval; search engine; query relaxation; content composition; hypermedia; image retrieval; mobile information retrieval; query language; モバイル機器; WWW; 情報検索; ユーザ対話; SMIL; 情報統合; メタサーチ; クロスメディア; ユーザインタフェース; プレゼンテーション; 話題構造分析

The aim of the research is to realize advanced mobile content services by developing new software technologies for retrieving and presenting contents on mobile terminals. We have mainly researched and developed the following five technologies :(1)Research on autonomous content presentation :We have developed a passive-viewing method by automatically acquiring by mobile terminals and transforming operation manual information of appliance devices or Web retrieval results in general into CG animation content with synthesized speech. Also, in order to realize multi-modal retrieval of video data, we developed a querying method by sketching moving objects trace.(2)Research on cross-media meta-search engine :In order to retrieve heterogeneous media-type contents by simply giving a few keywords, we developed a meta-search engine based on the method called "query relaxation". The method relaxes a given query into two subqueries, and these subqueires are given to a text-based Web search engine a … More nd an image search engine, respectively. The intersection of these two search engines' retrieval results is returned as an answer The evaluation work shows that our method improves the recall ratio three times than conventional image search engine with loss of 20 % precision ratio.(3)Topic structure extraction from users' dialogue :We developed a Web retrieval system which retrieves related pages by the dialogue's topic structure extracted from users' dialogue such as chat and e-mails by mobile phones. As for Blog information, we developed a method to compute the "trust" degree of retrieved Web pages by analyzing their related Blog informatioa Also, we implemented a Blog listening system by which user can browse Web pages and listen to their related Blog information.(4)Dynamic composition of multimedia contents for mobile broadcasting :We designed and implemented a scripting language called MetaSMIL which aims to describe the way of composing several stream contents. The major characteristics of MetaSMIL are the expressive power of query embedding and integrity-constraint specification for composition. Also, in order to realize composition of Web pages and photo images captured by digital cameras or mobile phones, we developed a way to interconnect photo images and Web pages that are regarded as images.(5)Adding autonomous retrieval and presentation capabilities to Web :We developed a method to add autonomous retrieval and presentation capabilities to Web pages that are displayed on multiple screens, by which Web pages are autonomously presented and their related pages are retrieved by pasting a Web page to some screen devices. Less

研究的目的是通过开发在移动终端上检索和呈现内容的新软件技术，实现先进的移动内容服务。我们主要研究和开发了以下五项技术：(1)自主内容呈现的研究：我们开发了一种被动观看方法，通过移动终端自动获取，将家电设备的操作手册信息或一般的Web检索结果转换为具有合成语音的CG动画内容。此外，为了实现视频数据的多模态检索，我们提出了一种通过绘制运动目标轨迹的查询方法。(2)跨媒体元搜索引擎的研究：为了通过简单输入几个关键词就能检索到异构媒体类型的内容，我们开发了一种基于“查询松弛”方法的元搜索引擎。该方法将一个给定的查询分解为两个子查询，并将这两个子查询分别提供给基于文本的Web搜索引擎和图像搜索引擎。评估工作表明，我们的方法比传统的图像搜索引擎提高了3倍的查全率，但准确率下降了20%。(3)从用户对话中提取话题结构：我们开发了一个Web检索系统，通过手机从用户的聊天、电子邮件等对话中提取对话的话题结构来检索相关页面。对于博客信息，我们开发了一种通过分析相关博客信息来计算检索到的网页的“信任”度的方法，并实现了一个博客收听系统，用户可以通过该系统浏览网页并收听相关博客信息。(4)移动广播多媒体内容的动态组合：我们设计并实现了一种名为MetaSMIL的脚本语言，该语言旨在描述多个流内容的组合方式。MetaSMIL的主要特点是查询嵌入的表达能力和组合的完整性约束规范。此外，为了实现网页与数码相机或手机拍摄的照片图像的组合，我们开发了一种将照片图像与作为图像的网页相互连接的方法。(5)为Web添加自主检索和表示功能：我们开发了一种方法，为显示在多个屏幕上的Web页面添加自主检索和表示功能，通过这种方法，Web页面可以自动显示，并且通过将Web页面粘贴到某些屏幕设备上来检索其相关页面。少

项目成果

Querying Video Data by Spatio-Temporal Relationships of Moving Object Traces

通过运动物体轨迹的时空关系查询视频数据

• 发表时间: 2002
• 期刊: Visual and Multimedia Information Management (X.Zhou and P.Pu Eds.) (Kiuwer Academic Publishers)
• 作者: Chikashi Yajima;Yoshihiro Nakanishi;Katsumi Tanaka
• 通讯作者: Katsumi Tanaka

赤星祐平, 小山聡, 角谷和俊, 田中克己: "携帯端末による電子メール交換に基づくWeb検索"日本データベース学会Letters. 2・1. 111-114 (2003)

Yuhei Akahoshi、Satoshi Koyama、Kazutoshi Kakutani、Katsumi Tanaka：“基于使用移动终端的电子邮件交换的网络搜索”日本数据库协会 111-114 (2003)。

Kazutoshi Sumiya, Minori Takahashi, Katsumi Tanaka: "Summarization and Presentation for Web Documents using Context Paths"Proceeding of The IASTED Information Systems and Database Conference(ISDB2002). 169-177 (2002)

Kazutoshi Sumiya、Minori Takahashi、Katsumi Tanaka：“使用上下文路径的 Web 文档的摘要和演示”IASTED 信息系统和数据库会议 (ISDB2002) 论文集。

MWM : Retrieval and Automatic Presentation of Manual Data for Mobile Terminals

MWM：移动终端手动数据的检索和自动呈现

• 发表时间: 2002
• 期刊: Proceeding of The 13th International Conference on Database and Expert Systems Applications (DEXA2UQ2) (LNCS, Springer) 2453
• 作者: Masaki Shikata;Akiyo Nadamoto;Kazutoshi Sumiya;Katsumi Tanaka
• 通讯作者: Katsumi Tanaka

灘本 明代, 角谷 和俊, 田中 克己: "携帯電話によるWebコンテンツの検索・視聴システム"日本データベース学会 Letters. 1・1. 19-22 (2002)

Akiyo Nadamoto、Kazutoshi Kakutani、Katsumi Tanaka：“使用移动电话的网络内容搜索和查看系统”日本数据库协会 1・1（2002 年）。