3D-Kernel Foveated Rendering for Light Fields
3D-Kernel Foveated Rendering for Light Fields
复制标题
DOI：
10.1109/tvcg.2020.2975801
复制
发表时间：
2020-02
影响因子：
5.2
通讯作者：
Xiaoxu Meng;Ruofei Du;J. JáJá;Amitabh Varshney
中科院分区：
文献类型：
--
作者：
Xiaoxu Meng;Ruofei Du;J. JáJá;Amitabh Varshney
光场捕获空间和角度光线，从而实现自由视点渲染和自定义焦平面选择。科学家们可以使用虚拟现实耳机交互式地探索预先记录的器官、微生物和神经元的微观光场。然而，以交互帧率呈现高分辨率光场需要非常高的纹理采样率，这是具有挑战性的，因为光场和显示器的分辨率不断增加。在本文中，我们提出了一种利用3d核注视点渲染（3D-KFR）来可视化$4D$4D光场的有效算法。3D-KFR方案与眼动追踪相结合，有可能极大地加速4D深度光场的渲染。我们通过扩展KFR来渲染$3D$3D网格，为注视点光场开发了一个感知模型。在高分辨率显微光场数据集上，我们观察到光场渲染的速度提高了$3.47\times -7.28\times$3.47×-7.28×，并且细节感知损失最小。我们设想，3D-KFR将调和视觉保真度和渲染速度相互冲突的目标，以实现光场的交互式可视化。
Light fields capture both the spatial and angular rays, thus enabling free-viewpoint rendering and custom selection of the focal plane. Scientists can interactively explore pre-recorded microscopic light fields of organs, microbes, and neurons using virtual reality headsets. However, rendering high-resolution light fields at interactive frame rates requires a very high rate of texture sampling, which is challenging as the resolutions of light fields and displays continue to increase. In this article, we present an efficient algorithm to visualize $4D$4D light fields with 3D-kernel foveated rendering (3D-KFR). The 3D-KFR scheme coupled with eye-tracking has the potential to accelerate the rendering of $4D$4D depth-cued light fields dramatically. We have developed a perceptual model for foveated light fields by extending the KFR for the rendering of $3D$3D meshes. On datasets of high-resolution microscopic light fields, we observe $3.47\times -7.28\times$3.47×-7.28× speedup in light field rendering with minimal perceptual loss of detail. We envision that 3D-KFR will reconcile the mutually conflicting goals of visual fidelity and rendering speed for interactive visualization of light fields.