Multi-modal Content Retrieval and Presentation and Broadcast Content Generation for Mobile Environment

研究的目的是通过开发在移动终端上检索和呈现内容的新软件技术，实现先进的移动内容服务。我们主要研究和开发了以下五项技术：(1)自主内容呈现的研究：我们开发了一种被动观看方法，通过移动终端自动获取，将家电设备的操作手册信息或一般的Web检索结果转换为具有合成语音的CG动画内容。此外，为了实现视频数据的多模态检索，我们提出了一种通过绘制运动目标轨迹的查询方法。(2)跨媒体元搜索引擎的研究：为了通过简单输入几个关键词就能检索到异构媒体类型的内容，我们开发了一种基于“查询松弛”方法的元搜索引擎。该方法将一个给定的查询分解为两个子查询，并将这两个子查询分别提供给基于文本的Web搜索引擎和图像搜索引擎。评估工作表明，我们的方法比传统的图像搜索引擎提高了3倍的查全率，但准确率下降了20%。(3)从用户对话中提取话题结构：我们开发了一个Web检索系统，通过手机从用户的聊天、电子邮件等对话中提取对话的话题结构来检索相关页面。对于博客信息，我们开发了一种通过分析相关博客信息来计算检索到的网页的“信任”度的方法，并实现了一个博客收听系统，用户可以通过该系统浏览网页并收听相关博客信息。(4)移动广播多媒体内容的动态组合：我们设计并实现了一种名为MetaSMIL的脚本语言，该语言旨在描述多个流内容的组合方式。MetaSMIL的主要特点是查询嵌入的表达能力和组合的完整性约束规范。此外，为了实现网页与数码相机或手机拍摄的照片图像的组合，我们开发了一种将照片图像与作为图像的网页相互连接的方法。(5)为Web添加自主检索和表示功能：我们开发了一种方法，为显示在多个屏幕上的Web页面添加自主检索和表示功能，通过这种方法，Web页面可以自动显示，并且通过将Web页面粘贴到某些屏幕设备上来检索其相关页面。少

The aim of the research is to realize advanced mobile content services by developing new software technologies for retrieving and presenting contents on mobile terminals. We have mainly researched and developed the following five technologies :(1)Research on autonomous content presentation :We have developed a passive-viewing method by automatically acquiring by mobile terminals and transforming operation manual information of appliance devices or Web retrieval results in general into CG animation content with synthesized speech. Also, in order to realize multi-modal retrieval of video data, we developed a querying method by sketching moving objects trace.(2)Research on cross-media meta-search engine :In order to retrieve heterogeneous media-type contents by simply giving a few keywords, we developed a meta-search engine based on the method called "query relaxation". The method relaxes a given query into two subqueries, and these subqueires are given to a text-based Web search engine a … More nd an image search engine, respectively. The intersection of these two search engines' retrieval results is returned as an answer The evaluation work shows that our method improves the recall ratio three times than conventional image search engine with loss of 20 % precision ratio.(3)Topic structure extraction from users' dialogue :We developed a Web retrieval system which retrieves related pages by the dialogue's topic structure extracted from users' dialogue such as chat and e-mails by mobile phones. As for Blog information, we developed a method to compute the "trust" degree of retrieved Web pages by analyzing their related Blog informatioa Also, we implemented a Blog listening system by which user can browse Web pages and listen to their related Blog information.(4)Dynamic composition of multimedia contents for mobile broadcasting :We designed and implemented a scripting language called MetaSMIL which aims to describe the way of composing several stream contents. The major characteristics of MetaSMIL are the expressive power of query embedding and integrity-constraint specification for composition. Also, in order to realize composition of Web pages and photo images captured by digital cameras or mobile phones, we developed a way to interconnect photo images and Web pages that are regarded as images.(5)Adding autonomous retrieval and presentation capabilities to Web :We developed a method to add autonomous retrieval and presentation capabilities to Web pages that are displayed on multiple screens, by which Web pages are autonomously presented and their related pages are retrieved by pasting a Web page to some screen devices. Less