SGER: Intermediate-level Structural Categories from Visual Complexity Analysis

SGER：视觉复杂性分析的中级结构类别

• 批准号: 9714331
• 负责人: Steven Zucker
• 金额: $ 5万
• 依托单位: Yale University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 1997
• 资助国家: 美国
• 起止时间: 1997-06-01 至 1998-05-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=9714331&HistoricalAwards=false
• 关键词: SGER; Intermediate; level; Structural; Categories

This award funds an initial exploration of a theoretical basis for visual image structure, to aid in supporting queries to image archives. Digital image archives are proliferating, which raises the question of how to retrieve specific images from them. However, while queries are naturally posed in high-level, functional terms, the realizations of such queries are based on low-level image operators. An intermediate-level theory of visual structure is necessary to close this gap, which is precisely what this research addresses. Based on an interpretation of edge elements as tangent estimates, it is derived from geometric measure and complexity theory. Viewed from below, the theory provides an organization for edge elements according to dimension. They are either bound into extended (1-dimensional) groups, into (2-dimensional) structural classes that abstract different types of texture, or (0-dimensional) orientation discontinuities. Viewed from above, the representation induces equivalence classes of structure, such as bounding contours, texture flows for hair and grass patterns, and ``T''-junctions for points of occlusion. Thus queries involving forests can be differentiated from those involving fur patterns or turbulent water, and multiple, overlapping objects can be separated into components. Furthermore, images and drawings can be segmented from pages of text.

该奖项资助了对视觉图像结构的理论基础的初步探索，以帮助支持对图像档案的查询。数字图像档案正在激增，这就提出了如何从其中检索特定图像的问题。然而，尽管查询自然地以高级功能术语提出，但这种查询的实现是基于低级图像运算符的。为了缩小这一差距，视觉结构的中级理论是必要的，这正是本研究要解决的问题。基于对边缘元素作为切线估计的解释，它是从几何度量和复杂性理论推导出来的。从下面看，该理论提供了一种按维度组织边缘元素的方法。它们要么被绑定到扩展的(1维)组中，要么被绑定到抽象不同类型纹理的(2维)结构类中，或者被绑定到(0维)方向间断中。从上面看，该表示引入了等价的结构类，例如边界轮廓、毛发和草图案的纹理流，以及咬合点的“T”-连接。因此，可以将涉及森林的查询与涉及毛皮图案或湍急的水的查询区分开来，并且可以将多个重叠的对象分成组件。此外，图像和图画可以从文本页面中分割出来。