Material Editing Using a Physically Based Rendering Network
Material Editing Using a Physically Based Rendering Network
复制标题
使用基于物理的渲染网络进行材质编辑
DOI：
10.1109/iccv.2017.248
复制
发表时间：
2017
期刊：
影响因子：
--
通讯作者：
Jyh
中科院分区：
文献类型：
--
作者：
Guilin Liu;Duygu Ceylan;Ersin Yumer;Jimei Yang;Jyh
许多内容创建者都希望能够编辑图像中对象的材料。然而，这是一项极具挑战性的任务，因为它需要解开图像的内在物理属性。我们提出了一个端到端网络架构，它复制了前向图像形成过程来完成这项任务。具体来说，给定一张图像，网络首先预测内在属性，即形状，照明和材料，然后将其提供给渲染层。该层执行网络内图像合成，从而使网络能够理解图像形成过程背后的物理原理。所提出的渲染层是完全可微分的，支持漫射和高光材料，因此可以适用于各种问题设置。我们展示了一套丰富的视觉上似是而非的材料编辑示例，并提供了广泛的比较研究。
The ability to edit materials of objects in images is desirable by many content creators. However, this is an extremely challenging task as it requires to disentangle intrinsic physical properties of an image. We propose an end-to-end network architecture that replicates the forward image formation process to accomplish this task. Specifically, given a single image, the network first predicts intrinsic properties, i.e. shape, illumination, and material, which are then provided to a rendering layer. This layer performs in-network image synthesis, thereby enabling the network to understand the physics behind the image formation process. The proposed rendering layer is fully differentiable, supports both diffuse and specular materials, and thus can be applicable in a variety of problem settings. We demonstrate a rich set of visually plausible material editing examples and provide an extensive comparative study.