Fast and Precise Touch-Based Text Entry for Head-Mounted Augmented Reality with Variable Occlusion
Fast and Precise Touch-Based Text Entry for Head-Mounted Augmented Reality with Variable Occlusion
复制标题
DOI：
10.1145/3232163
复制
发表时间：
2018-12
期刊：
影响因子：
--
通讯作者：
John J. Dudley;K. Vertanen;P. Kristensson
中科院分区：
文献类型：
--
作者：
John J. Dudley;K. Vertanen;P. Kristensson
我们介绍VISAR键盘：一种增强现实（AR）头戴式显示器（HMD）系统，支持通过虚拟输入表面进行文本输入。用户通过模仿在物理触摸屏显示器上单手打字的过程来选择虚拟键盘上的键。我们的系统使用统计解码器来推断用户的预期文本，并提供容错预测。还有一个高精度的回退机制，以支持用户指示哪些键应该由自动校正过程修改。利用完善的触摸输入范例的一个独特优势是，我们的系统使文本输入具有最小的视觉混乱的透视显示器，从而保留用户的视野。我们迭代地设计和评估了我们的系统，并表明系统的最终迭代支持平均输入率为17.75wpm，平均字符错误率小于1%。相对于最先进的基线调查，这一性能提高了19.6%：一种源自Microsoft HoloLens系统键盘的凝视然后手势文本输入技术。最后，我们验证了该系统是有效的，在一个完全移动的使用场景中可能会遇到的AR头戴式显示器的工业应用中支持文本输入。
We present the VISAR keyboard: An augmented reality (AR) head-mounted display (HMD) system that supports text entry via a virtualised input surface. Users select keys on the virtual keyboard by imitating the process of single-hand typing on a physical touchscreen display. Our system uses a statistical decoder to infer users’ intended text and to provide error-tolerant predictions. There is also a high-precision fall-back mechanism to support users in indicating which keys should be unmodified by the auto-correction process. A unique advantage of leveraging the well-established touch input paradigm is that our system enables text entry with minimal visual clutter on the see-through display, thus preserving the user’s field-of-view. We iteratively designed and evaluated our system and show that the final iteration of the system supports a mean entry rate of 17.75wpm with a mean character error rate less than 1%. This performance represents a 19.6% improvement relative to the state-of-the-art baseline investigated: A gaze-then-gesture text entry technique derived from the system keyboard on the Microsoft HoloLens. Finally, we validate that the system is effective in supporting text entry in a fully mobile usage scenario likely to be encountered in industrial applications of AR HMDs.