An Interactive Perspective Scene Completion Framework Guided by Complanate Mesh
An Interactive Perspective Scene Completion Framework Guided by Complanate Mesh
复制标题
平面网格引导的交互式透视场景完成框架
DOI：
10.3837/tiis.2020.01.011
复制
发表时间：
2020
影响因子：
1.5
通讯作者：
Chen Yadang
中科院分区：
文献类型：
--
作者：
Hao Chuanyan;Jin Zilong;Yang Zhixin;Chen Yadang
本文提出了一种用于透视场景补全和编辑任务的高效交互框架，该框架在现实世界中大部分可用，但在图像补全领域很少研究。考虑到从单个图像中提取透视信息相当困难，本工作从一个友好且便携的交互平台开始获取基本的透视数据。然后，为了使该界面不那么敏感，更容易和更灵活，提出了一种基于透视校正的校正机制来迭代更新用户选择的初始点的位置。最后，通过这些校正后的初始位置的几何计算生成平面网格。该网格必须尽可能逼近透视方向和结构拓扑，以便在原始图像透视效果的约束下进行填充过程。我们的实验显示了具有良好品质和性能的结果，并通过各种透视场景和图像证明了我们方法的有效性。
This paper presents an efficient interactive framework for perspective scene completion and editing tasks, which are available largely in the real world but rarely studied in the field of image completion. Considering that it is quite hard to extract perspective information from a single image, this work starts from a friendly and portable interactive platform to obtain the basic perspective data. Then, in order to make this interface less sensitive, easier and more flexible, a perspective-rectification based correction mechanism is proposed to iteratively update the locations of the initial points selected by users. At last, a complanate mesh is generated by the geometry calculations from these corrected initial positions. This mesh must approximate the perspective direction and the structure topology as much as possible so that the filling process can be conducted under the constraint of the perspective effects of the original image. Our experiments show the results with good qualities and performances, and also demonstrate the validity of our approaches by various perspective scenes and images.