Unified Object and Image Representation in 3D Frequency Domain

3D 频域中的统一对象和图像表示

• 批准号: 9876904
• 负责人: Jezekiel Ben-Arie
• 金额: $ 24.09万
• 依托单位: University of Illinois at Chicago
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 1999
• 资助国家: 美国
• 起止时间: 1999-08-01 至 2002-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=9876904&HistoricalAwards=false
• 关键词: Unified; Object; Image; Representation; 3D

Abstract IIS-9876904Ben-Arie, JezekielUniversity of Illinois$76,672 - 12 mos.Unified Object and Image Representation in 3D Frequency DomainThe proposed research is to develop a frequency domain object representation and related methodology for several major vision problems. Specifically, a volumetric frequency domain object representation (VFR) introduced by the PI will be used, which encapsulates both viewer centered and object centered representations. The VFR includes a continuum of the views of the objects as 2-D slices of the original representation. This view representation is based on the Fourier Slice Theorem. Previous frequency domain representations were developed for two dimensional images and did not consider the three dimensional object structure. Conventional 2-D frequency domain or spatial domain image representations for vision tasks is limited to 2-D interpretation. On the other hand, the proposed approach considers the full three dimensional object structure and therefore can handle diverse problems such as viewpoint orillumination independent recognition, articulated 3-D motion, etc. The VFR includes not only a continuum of object appearances but also 3-D structural information. Thus, 3-D object structure can be derived from single images. Pose invariant and illumination invariant object recognition can be implemented using the VFR by directly indexing into a complex (real and imaginary) volumetric eigenvector space. Two approaches are proposed for motion estimation. The result would be either a temporal sequence of 3-D poses which explicitly define the motion or a 3-D motion flow field. This 3-D approach avoids the problems of 2-D flow fields, especially in the estimation of 3-D rotational motions where the actual motion vectors exhibit themselves as projections onto the image plane. It is also planned to extend the VFR model towards several vision applications, such as image segmentation based on 3-D structure, pose invariant and illumination invariant object and face recognition, 3-D surface recovery from single image and articulated motion recognition.

摘要 IIS-9876904Ben-Arie, Jezekiel 伊利诺伊大学$76,672 - 12 mos。3D 频域中的统一对象和图像表示提出的研究是为几个主要视觉问题开发频域对象表示和相关方法。 具体来说，将使用 PI 引入的体积频域对象表示（VFR），它封装了以观察者为中心的表示和以对象为中心的表示。 VFR 包括作为原始表示的二维切片的对象视图的连续体。该视图表示基于傅里叶切片定理。以前的频域表示是针对二维图像开发的，没有考虑三维对象结构。用于视觉任务的传统二维频域或空间域图像表示仅限于二维解释。另一方面，所提出的方法考虑了完整的三维对象结构，因此可以处理各种问题，例如独立于视点或照明的识别、铰接式 3D 运动等。VFR 不仅包括对象外观的连续体，还包括 3D 结构信息。因此，3D 对象结构可以从单个图像中导出。 可以使用 VFR 通过直接索引到复杂（实数和虚数）体积特征向量空间来实现姿势不变和光照不变的对象识别。提出了两种运动估计方法。 结果将是明确定义运动的 3D 姿势的时间序列或 3D 运动流场。这种 3-D 方法避免了 2-D 流场的问题，特别是在估计 3-D 旋转运动时，其中实际运动矢量将其自身呈现为图像平面上的投影。 还计划将 VFR 模型扩展到多种视觉应用，例如基于 3D 结构的图像分割、姿态不变和光照不变的物体和人脸识别、从单个图像恢复 3D 表面以及关节运动识别。