Fluid Volume Modeling from Sparse Multi-view Images by Appearance Transfer
Fluid Volume Modeling from Sparse Multi-view Images by Appearance Transfer
复制标题
DOI：
10.1145/2766958
复制
发表时间：
2015-08-01
影响因子：
6.2
通讯作者：
Onai, Rikio
中科院分区：
文献类型：
--
作者：
Okabe, Makoto;Dobashi, Yoshinori;Onai, Rikio
我们提出了一种从稀疏的多视图图像（例如，只有一个视图输入或一对正面和侧面视图输入）对体积流体现象进行三维（3D）建模的方法。使用以前的方法从这些稀疏输入中确定的体积在新的视图中显得模糊和不自然；然而，我们的方法通过将输入图像的外观信息传输到新的视角来保留新视角的外观。对于外观信息，我们使用图像强度直方图和可操纵系数。我们将体积建模描述为具有统计硬约束的能量最小化问题，并使用类似期望最大化（EM）的迭代算法求解。我们的算法首先从输入图像建模的初始体积的粗略估计开始，然后是一个迭代过程，在这个过程中，我们首先以新的视角渲染当前体积的图像。然后，我们通过从输入图像中传递外观信息来修改渲染图像，然后基于修改后的图像对改进的体进行建模。我们迭代这些操作，直到体积收敛。我们演示了我们的方法成功地从稀疏的多视图视频中提供了自然的流体体积序列（即，火，烟，爆炸和水花）。为了创建生产就绪的流体动画，我们进一步提出了一种使用市售流体模拟器渲染和编辑流体的方法。
We propose a method of three-dimensional (3D) modeling of volumetric fluid phenomena from sparse multi-view images (e.g., only a single-view input or a pair of front- and side-view inputs). The volume determined from such sparse inputs using previous methods appears blurry and unnatural with novel views; however, our method preserves the appearance of novel viewing angles by transferring the appearance information from input images to novel viewing angles. For appearance information, we use histograms of image intensities and steerable coefficients. We formulate the volume modeling as an energy minimization problem with statistical hard constraints, which is solved using an expectation maximization (EM)-like iterative algorithm. Our algorithm begins with a rough estimate of the initial volume modeled from the input images, followed by an iterative process whereby we first render the images of the current volume with novel viewing angles. Then, we modify the rendered images by transferring the appearance information from the input images, and we thereafter model the improved volume based on the modified images. We iterate these operations until the volume converges. We demonstrate our method successfully provides natural-looking volume sequences of fluids (i.e., fire, smoke, explosions, and a water splash) from sparse multiview videos. To create production-ready fluid animations, we further propose a method of rendering and editing fluids using a commercially available fluid simulator.