Multi-modal Content Retrieval and Presentation and Broadcast Content Generation for Mobile Environment

点击翻译按钮获取中文摘要

The aim of the research is to realize advanced mobile content services by developing new software technologies for retrieving and presenting contents on mobile terminals. We have mainly researched and developed the following five technologies :(1)Research on autonomous content presentation :We have developed a passive-viewing method by automatically acquiring by mobile terminals and transforming operation manual information of appliance devices or Web retrieval results in general into CG animation content with synthesized speech. Also, in order to realize multi-modal retrieval of video data, we developed a querying method by sketching moving objects trace.(2)Research on cross-media meta-search engine :In order to retrieve heterogeneous media-type contents by simply giving a few keywords, we developed a meta-search engine based on the method called "query relaxation". The method relaxes a given query into two subqueries, and these subqueires are given to a text-based Web search engine a … More nd an image search engine, respectively. The intersection of these two search engines' retrieval results is returned as an answer The evaluation work shows that our method improves the recall ratio three times than conventional image search engine with loss of 20 % precision ratio.(3)Topic structure extraction from users' dialogue :We developed a Web retrieval system which retrieves related pages by the dialogue's topic structure extracted from users' dialogue such as chat and e-mails by mobile phones. As for Blog information, we developed a method to compute the "trust" degree of retrieved Web pages by analyzing their related Blog informatioa Also, we implemented a Blog listening system by which user can browse Web pages and listen to their related Blog information.(4)Dynamic composition of multimedia contents for mobile broadcasting :We designed and implemented a scripting language called MetaSMIL which aims to describe the way of composing several stream contents. The major characteristics of MetaSMIL are the expressive power of query embedding and integrity-constraint specification for composition. Also, in order to realize composition of Web pages and photo images captured by digital cameras or mobile phones, we developed a way to interconnect photo images and Web pages that are regarded as images.(5)Adding autonomous retrieval and presentation capabilities to Web :We developed a method to add autonomous retrieval and presentation capabilities to Web pages that are displayed on multiple screens, by which Web pages are autonomously presented and their related pages are retrieved by pasting a Web page to some screen devices. Less