Multi-modal Content Retrieval and Presentation and Broadcast Content Generation for Mobile Environment

移动环境的多模式内容检索和演示以及广播内容生成

• 批准号: 14208036
• 负责人: TANAKA Katsumi
• 金额: $ 25.04万
• 依托单位: Kyoto University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (A)
• 财政年份: 2002
• 资助国家: 日本
• 起止时间: 2002 至 2004
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-14208036/
• 关键词: cross-media retrieval; search engine; query relaxation; content composition; hypermedia; image retrieval; mobile information retrieval; query language; モバイル機器; WWW; 情報検索; ユーザ対話; SMIL; 情報統合; メタサーチ; クロスメディア; ユーザインタフェース; プレゼンテーション; 話題構造分析

The aim of the research is to realize advanced mobile content services by developing new software technologies for retrieving and presenting contents on mobile terminals. We have mainly researched and developed the following five technologies :(1)Research on autonomous content presentation :We have developed a passive-viewing method by automatically acquiring by mobile terminals and transforming operation manual information of appliance devices or Web retrieval results in general into CG animation content with synthesized speech. Also, in order to realize multi-modal retrieval of video data, we developed a querying method by sketching moving objects trace.(2)Research on cross-media meta-search engine :In order to retrieve heterogeneous media-type contents by simply giving a few keywords, we developed a meta-search engine based on the method called "query relaxation". The method relaxes a given query into two subqueries, and these subqueires are given to a text-based Web search engine a … More nd an image search engine, respectively. The intersection of these two search engines' retrieval results is returned as an answer The evaluation work shows that our method improves the recall ratio three times than conventional image search engine with loss of 20 % precision ratio.(3)Topic structure extraction from users' dialogue :We developed a Web retrieval system which retrieves related pages by the dialogue's topic structure extracted from users' dialogue such as chat and e-mails by mobile phones. As for Blog information, we developed a method to compute the "trust" degree of retrieved Web pages by analyzing their related Blog informatioa Also, we implemented a Blog listening system by which user can browse Web pages and listen to their related Blog information.(4)Dynamic composition of multimedia contents for mobile broadcasting :We designed and implemented a scripting language called MetaSMIL which aims to describe the way of composing several stream contents. The major characteristics of MetaSMIL are the expressive power of query embedding and integrity-constraint specification for composition. Also, in order to realize composition of Web pages and photo images captured by digital cameras or mobile phones, we developed a way to interconnect photo images and Web pages that are regarded as images.(5)Adding autonomous retrieval and presentation capabilities to Web :We developed a method to add autonomous retrieval and presentation capabilities to Web pages that are displayed on multiple screens, by which Web pages are autonomously presented and their related pages are retrieved by pasting a Web page to some screen devices. Less

研究的目的是通过开发新的软件技术来检索和呈现移动的终端上的内容，以实现先进的移动的内容服务。主要研究开发了以下五项技术：（1）自主内容呈现研究：开发了通过移动的终端自动获取，将家电设备的操作手册信息或一般的Web检索结果转换为合成语音的CG动画内容的被动观看方法。同时，为了实现视频数据的多模态检索，提出了一种基于运动目标轨迹的查询方法。（2）跨媒体元搜索引擎的研究：为了通过简单地给出几个关键字就能检索到异构媒体类型的内容，我们开发了一个基于“查询松弛”方法的元搜索引擎。该方法将一个给定的查询松弛为两个子查询，并将这些子查询提供给基于文本的Web搜索引擎， ...更多信息 和图像搜索引擎。结果表明，该方法在查准率损失20%的情况下，查全率比传统图像搜索引擎提高了3倍。（3）从用户对话中提取主题结构：我们开发了一个Web检索系统，该系统从用户通过移动的手机进行的聊天、电子邮件等对话中提取主题结构，并根据主题结构检索相关页面。对于Blog信息，我们提出了一种通过分析检索到的Web页面的相关Blog信息来计算其“信任度”的方法。同时，我们实现了一个Blog监听系统，用户可以通过该系统浏览Web页面并监听其相关Blog信息。（4）面向移动的广播的多媒体内容动态合成：设计并实现了一种脚本语言MetaSMIL，用于描述多个流媒体内容的合成方法。MetaSMIL的主要特点是查询嵌入和组合的完整性约束规范的表达能力。此外，为了实现由数码相机或移动的电话捕获的网页和照片图像的合成，我们开发了一种将照片图像和被视为图像的网页互连的方式。（5）在Web上添加自主检索和呈现功能：我们开发了一种方法，可以为显示在多个屏幕上的Web页面添加自主检索和呈现功能，通过该方法，Web页面可以自主呈现，并且通过将Web页面粘贴到某些屏幕设备来检索其相关页面。少

项目成果

Querying Video Data by Spatio-Temporal Relationships of Moving Object Traces

通过运动物体轨迹的时空关系查询视频数据

• 发表时间: 2002
• 期刊: Visual and Multimedia Information Management (X.Zhou and P.Pu Eds.) (Kiuwer Academic Publishers)
• 作者: Chikashi Yajima;Yoshihiro Nakanishi;Katsumi Tanaka
• 通讯作者: Katsumi Tanaka

赤星祐平, 小山聡, 角谷和俊, 田中克己: "携帯端末による電子メール交換に基づくWeb検索"日本データベース学会Letters. 2・1. 111-114 (2003)

Yuhei Akahoshi、Satoshi Koyama、Kazutoshi Kakutani、Katsumi Tanaka：“基于使用移动终端的电子邮件交换的网络搜索”日本数据库协会 111-114 (2003)。

Kazutoshi Sumiya, Minori Takahashi, Katsumi Tanaka: "Summarization and Presentation for Web Documents using Context Paths"Proceeding of The IASTED Information Systems and Database Conference(ISDB2002). 169-177 (2002)

Kazutoshi Sumiya、Minori Takahashi、Katsumi Tanaka：“使用上下文路径的 Web 文档的摘要和演示”IASTED 信息系统和数据库会议 (ISDB2002) 论文集。

MWM : Retrieval and Automatic Presentation of Manual Data for Mobile Terminals

MWM：移动终端手动数据的检索和自动呈现

• 发表时间: 2002
• 期刊: Proceeding of The 13th International Conference on Database and Expert Systems Applications (DEXA2UQ2) (LNCS, Springer) 2453
• 作者: Masaki Shikata;Akiyo Nadamoto;Kazutoshi Sumiya;Katsumi Tanaka
• 通讯作者: Katsumi Tanaka

灘本 明代, 角谷 和俊, 田中 克己: "携帯電話によるWebコンテンツの検索・視聴システム"日本データベース学会 Letters. 1・1. 19-22 (2002)

Akiyo Nadamoto、Kazutoshi Kakutani、Katsumi Tanaka：“使用移动电话的网络内容搜索和查看系统”日本数据库协会 1・1（2002 年）。