Collaborative Research: CI-P: ShapeNet: An Information-Rich 3D Model Repository for Graphics, Vision and Robotics Research

合作研究：CI-P：ShapeNet：用于图形、视觉和机器人研究的信息丰富的 3D 模型存储库

• 批准号: 1729971
• 负责人: Thomas Funkhouser
• 金额: $ 3.3万
• 依托单位: Princeton University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-09-01 至 2018-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1729971&HistoricalAwards=false
• 关键词: Collaborative; Research; CI; ShapeNet; Information

The goal of this project is to plan the development of a richly annotated repository of 3D models called ShapeNet that currently exists only in a preliminary form. ShapeNet will include 3-4 million 3D models of everyday objects in 4-5 thousand categories, in a variety of representations. Models in the ShapeNet repository will be annotated with multiple annotation types: geometric (parts, symmetries), semantic (keywords for the shape and its parts), physical (weight, size), and functional (affordances, scene context). The availability of ShapeNet data, capturing the 3D geometry of a significant fraction of object categories in the world, together with associated detailed meta-data and semantic information, will catalyze major developments in graphics, vision and robotics by providing adequate data against which new proposed techniques and methodologies for shape or scene analysis and synthesis can be vetted -- and with which machine learning algorithms can be trained. ShapeNet can be considered an encyclopedia that facilitates the creation of intelligent systems and agents capable of operating autonomously in the world --- because they can have deep knowledge of that world.While most of the ShapeNet models will be initially found on the Web, the annotations will be obtained through an active learning combination of modest human input (including crowd-sourcing), extensive algorithmic transport, and human verification. During the planning period the effort will focus on mathematical representations of the semantic knowledge associated with 3D models, as well as on a design framework for key algorithms allowing knowledge transport from one model to another. Further challenges to be addressed include the quantification of data quality issues and the specification of all the multimodal (3D, image, language) UIs and APIs needed for users to be able to exploit and search this wealth of data, or to contribute additional models and annotations to it.

该项目的目标是计划开发一个名为ShapeNet的具有丰富注释的3D模型存储库，目前该存储库仅处于初步形式。ShapeNet将包括400-5000个类别的300-400万个日常物品的3D模型，以不同的表示形式。ShapeNet存储库中的模型将使用多种注释类型进行注释：几何(部件、对称性)、语义(形状及其部件的关键字)、物理(重量、大小)和功能(启示、场景环境)。ShapeNet数据的可用性，捕捉了世界上很大一部分对象类别的3D几何图形，以及相关的详细元数据和语义信息，将通过提供足够的数据来催化图形、视觉和机器人学的重大发展，以对照这些数据来审查新提出的形状或场景分析和合成的技术和方法，并利用这些数据来训练机器学习算法。ShapeNet可以被认为是一本百科全书，它有助于创建能够在世界上自主运行的智能系统和代理-因为他们可以对那个世界有深刻的了解。虽然大多数ShapeNet模型最初会在Web上找到，但注释将通过适度的人工输入(包括众包)、广泛的算法传输和人工验证的主动学习组合来获得。在规划期间，工作重点将放在与3D模型相关的语义知识的数学表示上，以及允许知识从一个模型传输到另一个模型的关键算法的设计框架上。需要解决的其他挑战包括数据质量问题的量化以及用户能够利用和搜索这些丰富的数据或提供更多的模型和注释所需的所有多模式(3D、图像、语言)用户界面和API的规范。