Fast gaze-contingent optimal decompositions for multifocal displays
Fast gaze-contingent optimal decompositions for multifocal displays
复制标题
多焦点显示的快速注视相关最优分解
DOI：
10.1145/3130800.3130846
复制
发表时间：
2017
期刊：
影响因子：
--
通讯作者：
Douglas Lanman
中科院分区：
文献类型：
--
作者：
O. Mercier;Y. Sulai;Kevin J. MacKenzie;Marina Zannoli;James M. Hillis;D. Nowrouzezahrai;Douglas Lanman
由于头戴式显示器（hmd）通常呈现单一的固定焦点显示平面，因此可能会在观看者的收敛响应和适应响应之间产生冲突。长期以来，人们一直在研究多焦头显作为一种潜在的解决方案，其中多个图像平面跨越了观看者的适应范围。这样的显示需要一个场景分解算法来将物体的描述分布在图像平面上，以前的工作已经表明，简单的分解可以实时实现。然而，最近的优化分解进一步提高了图像质量，特别是对于复杂的内容。这样的分解涉及更多的计算，并且可能需要更好地将图像平面与观看者的眼睛对齐，这是实际应用的潜在障碍。我们的目标是使交互式最优分解算法能够驱动融合和适应跟踪的多焦点测试平台。最终，在计算需求和硬件精度方面，这样的测试平台对于建立实际使用多焦点显示器的要求是必要的。为此，我们提出了一种有效的最优分解算法，并结合了视觉科学的见解。我们的方法适用于GPU实现，并且比以前的工作实现了三个数量级的加速。我们进一步表明，眼动追踪可以通过有效的基于图像的变形来进行适当的平面对齐，调整相对于显示器的眼睛旋转和头部运动。我们还建立了第一个集成眼动追踪和调节测量的双目多焦点测试平台，为这类有前途的显示器建立实用的眼动追踪和渲染要求铺平了道路。最后，我们报告了利用我们的试验台进行的试点用户研究的初步结果，调查了用户在最优分解下对动态刺激的适应反应。
As head-mounted displays (HMDs) commonly present a single, fixed-focus display plane, a conflict can be created between the vergence and accommodation responses of the viewer. Multifocal HMDs have long been investigated as a potential solution in which multiple image planes span the viewer's accommodation range. Such displays require a scene decomposition algorithm to distribute the depiction of objects across image planes, and previous work has shown that simple decompositions can be achieved in real-time. However, recent optimal decompositions further improve image quality, particularly with complex content. Such decompositions are more computationally involved and likely require better alignment of the image planes with the viewer's eyes, which are potential barriers to practical applications. Our goal is to enable interactive optimal decomposition algorithms capable of driving a vergence- and accommodation-tracked multifocal testbed. Ultimately, such a testbed is necessary to establish the requirements for the practical use of multifocal displays, in terms of computational demand and hardware accuracy. To this end, we present an efficient algorithm for optimal decompositions, incorporating insights from vision science. Our method is amenable to GPU implementations and achieves a three-orders-of-magnitude speedup over previous work. We further show that eye tracking can be used for adequate plane alignment with efficient image-based deformations, adjusting for both eye rotation and head movement relative to the display. We also build the first binocular multifocal testbed with integrated eye tracking and accommodation measurement, paving the way to establish practical eye tracking and rendering requirements for this promising class of display. Finally, we report preliminary results from a pilot user study utilizing our testbed, investigating the accommodation response of users to dynamic stimuli presented under optimal decomposition.
影响因子：
1.8
作者：
Shibata T;Kim J;Hoffman DM;Banks MS
通讯作者：
Banks MS