Interaction Modalities for Notification Signals in Augmented Reality

Interaction Modalities for Notification Signals in Augmented Reality
复制标题

增强现实中通知信号的交互方式

DOI:
10.1145/3462244.3479898
复制
发表时间:
2021
期刊:
Proceedings of the 2021 International Conference on Multimodal Interaction
影响因子:
--
通讯作者:
M. Yun
M. Yun
中科院分区:
--
文献类型:
--
作者:
May Jorella S. Lazaro;Sung Ho Kim;Jae Yong Lee;Jaemin Chun;M. Yun

文献摘要

被引文献

相似文献

普适计算的兴起导致了增强现实(AR)等智能系统的快速发展。AR被用于各种用途,包括网页浏览、导航和控制其他物联网(IoT)设备等常见任务。在这些类型的系统使用中,类似于手机,通知的呈现是不可避免的。然而,关于AR环境中通知信号的有效传递的研究仍然缺乏。因此,本研究旨在研究不同输出模式(视觉、听觉和多模式)在AR系统中简单搜索和选择任务期间呈现通知的影响。20个人参加了一项用户研究,他们被要求在使用AR设备时执行一个简单的搜索和选择任务。参与者被要求确认在每次试验中随机出现的通知。用户研究结果表明,多模态通知信号(视觉和听觉)产生了更高的通知识别率,并被评为最合适的模态,在测试条件中最受欢迎。此外,无论输出类型如何,语音输入方式在响应通知时使用得更频繁。从研究结果中得出了几个设计含义。
The rise of ubiquitous computing has led to the rapid development of intelligent systems such as augmented reality (AR). AR is being employed for various usage including common tasks such as web browsing, navigating and controlling other internet of things (IoT) devices. In these types of system usage, similar to mobile phones, the presentation of notifications is inevitable. However, studies with regards to the effective delivery of notification signals within the AR environment is still lacking. Thus, the present study aims to investigate the effects of different output modalities (visual, auditory and multimodal) for presenting notifications during simple search and selection tasks within the AR system. Twenty individuals participated in a user study where they were asked to perform a simple search and selection task while using the AR device. Participants were asked to confirm the notifications that were presented at random in each trial. Results of the user study showed that multimodal notification signals (both visual and auditory) yielded a higher notification recognition rate and were rated as the most appropriate modality and most preferred among the conditions tested. Also, it was found that speech input modality was used more frequently in response to notifications, regardless of the output type. Several design implications were derived from the findings of the study.