3D object manipulation

3D 对象操作

• 批准号: 484408-2015
• 负责人: Li, ZeNian
• 金额: $ 1.82万
• 依托单位: Simon Fraser University
• 依托单位国家: 加拿大
• 项目类别: Engage Grants Program
• 财政年份: 2015
• 资助国家: 加拿大
• 起止时间: 2015-01-01 至 2016-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=584295
• 关键词: 3D; object; manipulation

LNG Productions, Inc. is interested in developing a method to identify objects within a 2D space (i.e., photographs, images) and to have the ability to manipulate them in a 3D realm. Manipulation will include moving the object around within the image, editing the object's physical characteristics and changing/swapping out the object for another. The challenge is that current photo editing software restricts the control of objects in a photograph to the 2D image plane. We are looking to create a solution that enables users to perform the full range of 3D manipulations, including scaling, rotation, and translation to an object in a photograph. Additionally, we are trying to develop a platform whereby users can interact and immerse themselves in a 3D architectural environment from a first person perspective. The users would have the ability to manipulate various materials, including but not limited to furniture, appliances, flooring, fixtures, etc. The software would be easily accessible via mobile/tablet devices (app) and over the Internet. The proposed project will involve three research topics: (i) Object detection and extraction aided by user interactions; (ii) 3D object manipulation; and (iii) Inpainting - to fill the holes left behind by moved objects. All three topics are active and important computer vision and computer graphics research problems. If the proposed research is successful, LNG Productions, Inc. will be one of the first companies to combine object recognition in a photo and manipulation of 3D assets that a user can select from to modify their captured spaces. Any Canadian manufacturer of raw materials, furniture, appliances, etc. could benefit from having their products digitally reproduced in 3D. An e-commerce platform or a platform for informational purposes could be developed so users could directly purchase or find out more information about the manufacturers' products.

LNG Productions，Inc.感兴趣的是开发一种识别2D空间内的对象的方法(即， 照片、图像)，并具有在3D领域中操作它们的能力。操纵将包括 在图像内移动对象、编辑对象的物理特征以及改变/交换 把这个物体拿出来换另一个。挑战在于，当前的照片编辑软件限制了对 将照片添加到2D图像平面。我们希望创建一种解决方案，使用户能够全面执行 3D操作的范围，包括缩放、旋转和平移到照片中的对象。 此外，我们正在努力开发一个平台，让用户可以在3D中进行互动和沉浸 第一人称视角下的建筑环境。用户将有能力操纵 各种材料，包括但不限于家具、电器、地板、固定装置等。该软件将 通过移动/平板设备(APP)和互联网轻松访问。 提出的项目将涉及三个研究主题：(I)用户辅助的目标检测和提取 互动；(Ii)3D对象操作；以及(Iii)修复--填补移动对象留下的洞。 这三个主题都是活跃而重要的计算机视觉和计算机图形学研究问题。 如果拟议的研究成功，LNG Productions，Inc.将成为首批合并的公司之一 照片中的对象识别和用户可以从中选择以修改其捕获的3D资产的操作 空格。任何加拿大的原材料、家具、家电等制造商都可以受益于 他们的产品以3D形式进行了数字复制。电子商务平台或信息平台 可以开发，以便用户可以直接购买或了解有关制造商的更多信息 产品。