Multi-modal Content Retrieval and Presentation and Broadcast Content Generation for Mobile Environment

研究的目的是通过开发用于在移动终端上检索和呈现内容的新软件技术来实现先进的移动内容服务。主要研究和开发了以下五项技术：(1)自主内容呈现研究：通过移动终端自动获取家电设备的操作手册信息或一般的Web检索结果，并将其转化为带有合成语音的CG动画内容，从而开发出一种被动观看方法。此外，为了实现视频数据的多模式检索，我们提出了一种基于运动物体轨迹的查询方法。(2)跨媒体元搜索引擎研究：为了通过简单地给出几个关键词来检索不同媒体类型的内容，我们开发了一个基于查询松弛方法的元搜索引擎。该方法将一个给定的查询放松为两个子查询，并将这些子查询提供给基于文本的网络搜索引擎…更多和图像搜索引擎，分别。将这两个搜索引擎的检索结果的交集作为答案返回，评估工作表明，该方法的查全率比传统的图像搜索引擎提高了三倍，准确率损失了20%。(3)用户对话中的主题结构提取：我们开发了一个Web检索系统，通过从手机聊天和电子邮件等用户对话中提取对话的主题结构来检索相关页面。对于博客信息，我们提出了一种通过分析相关博客信息来计算检索到的网页的“信任度”的方法，并实现了一个博客收听系统，用户可以通过该系统浏览网页并收听相关的博客信息。(4)面向移动广播的多媒体内容的动态合成：设计并实现了一种脚本语言MetaSMIL，用于描述多个流内容的合成方式。MetaSMIL的主要特点是查询嵌入的表达能力和组合的完整性约束规范。此外，为了实现数码相机或手机拍摄的Web页面和照片图像的合成，我们开发了一种将照片图像和被视为图像的Web页面互联的方法。(5)在Web上增加自主检索和呈现能力：我们开发了一种方法，在多个屏幕上显示的Web页面上添加自主检索和呈现能力，通过在一些屏幕设备上粘贴一个Web页面来自主呈现Web页面及其相关页面。较少

The aim of the research is to realize advanced mobile content services by developing new software technologies for retrieving and presenting contents on mobile terminals. We have mainly researched and developed the following five technologies :(1)Research on autonomous content presentation :We have developed a passive-viewing method by automatically acquiring by mobile terminals and transforming operation manual information of appliance devices or Web retrieval results in general into CG animation content with synthesized speech. Also, in order to realize multi-modal retrieval of video data, we developed a querying method by sketching moving objects trace.(2)Research on cross-media meta-search engine :In order to retrieve heterogeneous media-type contents by simply giving a few keywords, we developed a meta-search engine based on the method called "query relaxation". The method relaxes a given query into two subqueries, and these subqueires are given to a text-based Web search engine a … More nd an image search engine, respectively. The intersection of these two search engines' retrieval results is returned as an answer The evaluation work shows that our method improves the recall ratio three times than conventional image search engine with loss of 20 % precision ratio.(3)Topic structure extraction from users' dialogue :We developed a Web retrieval system which retrieves related pages by the dialogue's topic structure extracted from users' dialogue such as chat and e-mails by mobile phones. As for Blog information, we developed a method to compute the "trust" degree of retrieved Web pages by analyzing their related Blog informatioa Also, we implemented a Blog listening system by which user can browse Web pages and listen to their related Blog information.(4)Dynamic composition of multimedia contents for mobile broadcasting :We designed and implemented a scripting language called MetaSMIL which aims to describe the way of composing several stream contents. The major characteristics of MetaSMIL are the expressive power of query embedding and integrity-constraint specification for composition. Also, in order to realize composition of Web pages and photo images captured by digital cameras or mobile phones, we developed a way to interconnect photo images and Web pages that are regarded as images.(5)Adding autonomous retrieval and presentation capabilities to Web :We developed a method to add autonomous retrieval and presentation capabilities to Web pages that are displayed on multiple screens, by which Web pages are autonomously presented and their related pages are retrieved by pasting a Web page to some screen devices. Less