STIMULATE: Multimodal Indexing, Retrieval, and Browsing: Combining Content-Based Image Retrieval with Text Retrieval

* 在迅速兴起的多媒体信息系统领域，有效的索引和检索技术至关重要。 在这个项目中，智能中心 信息检索 （CIIR） 将 研究算法和机制，促进索引和检索图像，视频和相关文本的过程。 具体而言，CIIR将：1）开发按内容浏览和检索图像和视频的技术。 图像索引 是一项新兴技术， 是 不太了解。 新的和强大的技术将被开发用于索引图像和视频使用视觉属性，如颜色，纹理和“外观”; 2）开发技术索引图像和视频使用文本中存在的图像。 还将研究辅助图像手动注释的方法。 文本索引方法将是 结合使用INQUERY概率检索引擎; 3)开发和评估用于图像、视频和文本检索的交互式检索和浏览界面。 这些界面将基于CIIR所做的新颖的可视化和用户界面工作。中心会进行用户研究，以评估界面的吸引力和成效。 在 总结，该项目将 集成了创新图像匹配、复杂文本检索以及新的查询公式和可视化方法，为索引和检索图像、视频和文本创建了一个强大的平台。*

*** In the rapidly emerging area of multimedia information systems, effective indexing and retrieval techniques are critically important. In this project, the Center for Intelligent Information Retrieval (CIIR) will study algorithms and mechanisms that facilitate the.process of indexing and retrieving images, video, and associated text. Specifically, the CIIR will: 1) Develop techniques for browsing and retrieving images and videos by content. Image indexing is an emerging technology which is poorly understood. New and powerful techniques will be developed for indexing images and videos using visual attributes such as color, texture and 'appearance'; 2) Develop techniques for indexing images and videos using text present in the images. Methods of assisting with manual annotation of images will also be studied. The text indexing methods will be combined using the INQUERY probabilistic retrieval engine; 3) Develop and evaluate interactive retrieval and browsing interfaces for image, video, and text retrieval. These interfaces will be based on novel visualization and user interface work done at CIIR. The CIIR will perform user studies to evaluate the appeal and effectiveness of the interfaces. In summary, the project will integrate innovative image matching, sophisticated text retrieval and new query formulation and visualization methods to create a powerful platform for indexing and retrieving images, video, and text.***