Effective Gesture-Based User Interfaces on Mobile Mixed Reality
Effective Gesture-Based User Interfaces on Mobile Mixed Reality
复制标题
移动混合现实上有效的基于手势的用户界面
DOI：
10.1145/3565970.3568189
复制
发表时间：
2022
期刊：
影响因子：
--
通讯作者：
Tang, Hao
中科院分区：
文献类型：
--
作者：
Xia, Zhenchao;Oyekoya, Oyewole;Tang, Hao
为了帮助盲人或低视力（BLV）的人独立旅行，虚拟现实（VR）和混合现实（MR）被用来训练BLV用户获得旅行规划的空间知识。VR应用程序利用听觉和触觉反馈来帮助BLV人与虚拟环境进行交互，以构建心理地图。在这个项目中，我们通过设计和集成激光指针工具和基于手势的菜单来改进MR手杖iPhone应用程序，以帮助BLV用户更有效地学习虚拟环境的空间布局。激光指示器允许BLV用户快速探索虚拟环境。基于手势的菜单帮助BLV用户轻松操作MR手杖应用程序的用户界面。
To help people who are blind or have low vision (BLV) travel independently, virtual reality (VR) and mixed reality (MR) are used to train the BLV users to acquire spatial knowledge for trip planning. The VR apps utilizes auditory and haptic feedback to help BLV people interact with virtual environments to build mental maps. In this project, we improve a MR cane iPhone app by designing and integrating a laser pointer tool and a gesture-based menu to assist BLV users in learning spatial layout of a virtual environment more efficiently. A laser pointer allows BLV users to quickly explore a virtual environment. A gesture-based menu helps BLV users easily manipulate the user interface of the MR cane app.