STIMULATE: An Environment for Illustrated Briefing and Follow-up Search Over Live Multimedia Information

STIMULATE：通过实时多媒体信息进行图解简报和后续搜索的环境

• 批准号: 9619124
• 负责人: Kathleen McKeown
• 金额: $ 73.21万
• 依托单位: Columbia University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 1997
• 资助国家: 美国
• 起止时间: 1997-03-01 至 2001-02-28
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=9619124&HistoricalAwards=false
• 关键词: STIMULATE; Environment; Illustrated; Briefing; Follow

This project proposes an environment to provide up-to-the-minute briefings on topics of interest, linking the user into an integrated collection of related multimedia documents. On the basis of a user profile or query, the proposed system filters multimedia information to match the user interests and automatically generates a summary of the set of matching documents to provide the user with an overview of the relevant information. The system also provides a representative set of images or video that match user interests as well as hypertext links into the documents themselves. The user can follow up with multimedia queries to refine the search for related images, video, or additional articles. The research has three main components: summarization, multimedia search and manipulation, and event tracking. Results will provide advances in summarization using language generation over information extracted from multiple live sources of news, in multimedia search and classification over compressed images using visual features, and in tracking of events by detecting surface differences between documents. Research will also result in technologies to aid a user in tracking multimedia information in specific news domains, reducing the number of documents end users such as journalists must access.

该项目提出了一个环境，可以提供有关感兴趣主题的最新简报，将用户链接到相关多媒体文档的集成集合中。 基于用户简档或查询，所提出的系统过滤多媒体信息以匹配用户兴趣，并自动生成匹配文档集的摘要，以向用户提供相关信息的概述。 该系统还提供了一组符合用户兴趣的代表性图像或视频，以及文档本身的超文本链接。用户可以通过多媒体查询来优化对相关图像、视频或其他文章的搜索。该研究包括三个主要组成部分：总结、多媒体搜索和操作以及事件跟踪。 结果将在使用语言生成对从多个实时新闻源提取的信息进行摘要、使用视觉特征对压缩图像进行多媒体搜索和分类、以及通过检测文档之间的表面差异来跟踪事件方面取得进展。 研究还将开发出帮助用户跟踪特定新闻领域的多媒体信息的技术，从而减少记者等最终用户必须访问的文档数量。