Multi-modal Content Retrieval and Presentation and Broadcast Content Generation for Mobile Environment

研究的目的是通过开发新的软件技术来检索和呈现移动的终端上的内容，以实现先进的移动的内容服务。主要研究开发了以下五项技术：（1）自主内容呈现研究：开发了通过移动的终端自动获取，将家电设备的操作手册信息或一般的Web检索结果转换为合成语音的CG动画内容的被动观看方法。同时，为了实现视频数据的多模态检索，提出了一种基于运动目标轨迹的查询方法。（2）跨媒体元搜索引擎的研究：为了通过简单地给出几个关键字就能检索到异构媒体类型的内容，我们开发了一个基于“查询松弛”方法的元搜索引擎。该方法将一个给定的查询松弛为两个子查询，并将这些子查询提供给基于文本的Web搜索引擎， 关于我们 和图像搜索引擎。结果表明，该方法在查准率损失20%的情况下，查全率比传统图像搜索引擎提高了3倍。（3）从用户对话中提取主题结构：我们开发了一个Web检索系统，该系统从用户通过移动的手机进行的聊天、电子邮件等对话中提取主题结构，并根据主题结构检索相关页面。对于Blog信息，我们提出了一种通过分析检索到的Web页面的相关Blog信息来计算其“信任度”的方法。同时，我们实现了一个Blog监听系统，用户可以通过该系统浏览Web页面并监听其相关Blog信息。（4）面向移动的广播的多媒体内容动态合成：设计并实现了一种脚本语言MetaSMIL，用于描述多个流媒体内容的合成方法。MetaSMIL的主要特点是查询嵌入和组合的完整性约束规范的表达能力。此外，为了实现由数码相机或移动的电话捕获的网页和照片图像的合成，我们开发了一种将照片图像和被视为图像的网页互连的方式。（5）在Web上添加自主检索和呈现功能：我们开发了一种方法，可以为显示在多个屏幕上的Web页面添加自主检索和呈现功能，通过该方法，Web页面可以自主呈现，并且通过将Web页面粘贴到某些屏幕设备来检索其相关页面。少

The aim of the research is to realize advanced mobile content services by developing new software technologies for retrieving and presenting contents on mobile terminals. We have mainly researched and developed the following five technologies :(1)Research on autonomous content presentation :We have developed a passive-viewing method by automatically acquiring by mobile terminals and transforming operation manual information of appliance devices or Web retrieval results in general into CG animation content with synthesized speech. Also, in order to realize multi-modal retrieval of video data, we developed a querying method by sketching moving objects trace.(2)Research on cross-media meta-search engine :In order to retrieve heterogeneous media-type contents by simply giving a few keywords, we developed a meta-search engine based on the method called "query relaxation". The method relaxes a given query into two subqueries, and these subqueires are given to a text-based Web search engine a … More nd an image search engine, respectively. The intersection of these two search engines' retrieval results is returned as an answer The evaluation work shows that our method improves the recall ratio three times than conventional image search engine with loss of 20 % precision ratio.(3)Topic structure extraction from users' dialogue :We developed a Web retrieval system which retrieves related pages by the dialogue's topic structure extracted from users' dialogue such as chat and e-mails by mobile phones. As for Blog information, we developed a method to compute the "trust" degree of retrieved Web pages by analyzing their related Blog informatioa Also, we implemented a Blog listening system by which user can browse Web pages and listen to their related Blog information.(4)Dynamic composition of multimedia contents for mobile broadcasting :We designed and implemented a scripting language called MetaSMIL which aims to describe the way of composing several stream contents. The major characteristics of MetaSMIL are the expressive power of query embedding and integrity-constraint specification for composition. Also, in order to realize composition of Web pages and photo images captured by digital cameras or mobile phones, we developed a way to interconnect photo images and Web pages that are regarded as images.(5)Adding autonomous retrieval and presentation capabilities to Web :We developed a method to add autonomous retrieval and presentation capabilities to Web pages that are displayed on multiple screens, by which Web pages are autonomously presented and their related pages are retrieved by pasting a Web page to some screen devices. Less