3D object manipulation

点击翻译按钮获取中文摘要

LNG Productions, Inc. is interested in developing a method to identify objects within a 2D space (i.e., photographs, images) and to have the ability to manipulate them in a 3D realm. Manipulation will include moving the object around within the image, editing the object's physical characteristics and changing/swapping out the object for another. The challenge is that current photo editing software restricts the control of objects in a photograph to the 2D image plane. We are looking to create a solution that enables users to perform the full range of 3D manipulations, including scaling, rotation, and translation to an object in a photograph. Additionally, we are trying to develop a platform whereby users can interact and immerse themselves in a 3D architectural environment from a first person perspective. The users would have the ability to manipulate various materials, including but not limited to furniture, appliances, flooring, fixtures, etc. The software would be easily accessible via mobile/tablet devices (app) and over the Internet. The proposed project will involve three research topics: (i) Object detection and extraction aided by user interactions; (ii) 3D object manipulation; and (iii) Inpainting - to fill the holes left behind by moved objects. All three topics are active and important computer vision and computer graphics research problems. If the proposed research is successful, LNG Productions, Inc. will be one of the first companies to combine object recognition in a photo and manipulation of 3D assets that a user can select from to modify their captured spaces. Any Canadian manufacturer of raw materials, furniture, appliances, etc. could benefit from having their products digitally reproduced in 3D. An e-commerce platform or a platform for informational purposes could be developed so users could directly purchase or find out more information about the manufacturers' products.