Knowledge-Based Document Image Understanding

基于知识的文档图像理解

• 批准号: 9014110
• 负责人: Sargur Srihari
• 金额: $ 18.89万
• 依托单位: SUNY at Buffalo
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 1991
• 资助国家: 美国
• 起止时间: 1991-06-01 至 1993-05-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=9014110&HistoricalAwards=false
• 关键词: Knowledge; Based; Document; Image; Understanding

Understanding printed documents is an intelligent activity. This research is about automating one aspect of analyzing a document image and deriving a high-level representation of its visual content. Documents contain photographs and accompanying text. This effort is concerned with arriving at an integrated interpretation of the communicative unit consisting of photographs and their captions. When text describes salient aspects of a photograph, it is possible to use the text to direct a vision system in understanding the photograph. There are two components to this research: the first deals with language issues and the second with development of a vision subsystem. Methods of extracting visual information from text, specifically cues required to identify salient objects, are to be studied; such information may be present in a variety of forms, based on both syntax and semantics. The role of textually extracted visual cues in performing visual object recognition is also to be studied. As a test of the theory, it is proposed to develop a system where the result of parsing a caption of a newspaper photograph is used to identify human faces in the photograph. The face location subsystem will incorporate scale invariant techniques, and filters that characterize faces based on the presence of distinguishing visual features. //

理解印刷文档是一项智能活动。 这 研究是关于自动化分析文档的一个方面 图像并导出其视觉的高级表示 内容 文件包含照片和随附文本。 这一努力涉及到达成一个综合的 解释由以下组成的通信单元： 照片及其说明。 当文本描述突出时 一张照片的各个方面，有可能使用文字来指导 视觉系统来理解照片。 有两 本研究的组成部分：第一个涉及语言 第二个是视觉子系统的开发。 从文本中提取视觉信息的方法，特别是 需要研究识别显著物体的线索; 这种信息可以基于以下因素以各种形式呈现 包括语法和语义。 文本提取的作用 在执行视觉对象识别中的视觉线索也将被 研究了 作为对该理论的测试，建议开发一个 一种系统，其中解析报纸标题的结果 照片用于识别照片中的人脸。 人脸定位子系统将结合尺度不变量 技术和过滤器，根据 有明显的视觉特征。 //