Deep multispectral painting reproduction via multi-layer, custom-ink printing
Deep multispectral painting reproduction via multi-layer, custom-ink printing
复制标题
DOI：
10.1145/3272127.3275057
复制
发表时间：
2018-12
期刊：
影响因子：
--
通讯作者：
Liang Shi;Vahid Babaei;Changil Kim;Michael Foshey;Yuanming Hu;Pitchaya Sitthi-amorn;S. Rusinkiewicz;W. Matusik
中科院分区：
文献类型：
--
作者：
Liang Shi;Vahid Babaei;Changil Kim;Michael Foshey;Yuanming Hu;Pitchaya Sitthi-amorn;S. Rusinkiewicz;W. Matusik
我们提出了一个工作流程的光谱再现的绘画，它捕捉绘画的光谱颜色，不变的照明，并再现它使用多材料3D打印。我们利用当前3D打印机将高度浓缩的墨水与大量图层相结合的能力，来扩展一组墨水的光谱范围。我们使用数据驱动的方法来预测印刷油墨堆叠的光谱，并优化与目标光谱最匹配的堆叠布局。这种双向映射使用一对神经网络进行建模，该神经网络通过特定于问题的多目标损失函数进行优化。我们的损失函数有助于找到最佳的油墨布局，从而在多种光源下实现光谱再现和色度精度之间的平衡。此外，本文还提出了一种新的基于色彩连续化和半色调化相结合的谱矢量误差扩散算法，该算法同时解决了布局离散化和色彩量化问题，准确高效。我们的工作流程在光谱预测和布局优化方面优于最先进的模型。我们展示了一些真实的绘画和历史上重要的颜料使用我们的原型实现，使用10个自定义油墨与不同的光谱和基于树脂的3D打印机的再现。
We propose a workflow for spectral reproduction of paintings, which captures a painting's spectral color, invariant to illumination, and reproduces it using multi-material 3D printing. We take advantage of the current 3D printers' capabilities of combining highly concentrated inks with a large number of layers, to expand the spectral gamut of a set of inks. We use a data-driven method to both predict the spectrum of a printed ink stack and optimize for the stack layout that best matches a target spectrum. This bidirectional mapping is modeled using a pair of neural networks, which are optimized through a problem-specific multi-objective loss function. Our loss function helps find the best possible ink layout resulting in the balance between spectral reproduction and colorimetric accuracy under a multitude of illuminants. In addition, we introduce a novel spectral vector error diffusion algorithm based on combining color contoning and halftoning, which simultaneously solves the layout discretization and color quantization problems, accurately and efficiently. Our workflow outperforms the state-of-the-art models for spectral prediction and layout optimization. We demonstrate reproduction of a number of real paintings and historically important pigments using our prototype implementation that uses 10 custom inks with varying spectra and a resin-based 3D printer.