A Virtual Assistant for Cybersickness Care
A Virtual Assistant for Cybersickness Care
复制标题
晕车护理虚拟助手
DOI：
10.1109/cbms49503.2020.00079
复制
发表时间：
2020
期刊：
影响因子：
--
通讯作者：
J. Hovdebo
中科院分区：
文献类型：
--
作者：
R. Harmouche;A. Lochbihler;Francis Thibault;G. D. Luca;Catherine Proulx;J. Hovdebo
我们提出了一个化身和面向任务的对话代理，用于监控用户在虚拟现实（VR）认知练习期间的不适感，并提供个性化的信息和缓解建议。这种方法的目标是为用户提供即时帮助，以获得更舒适的 VR 体验，从而使他们能够将更多时间花在认知任务上。我们在 VR 环境中开发了一个虚拟形象，用户可以与之进行口头交流，并在基于机器学习的对话人工智能平台中开发了一个对话代理。我们通过使用训练测试分割比较 2 个模型（BERT 和 StarSpace），对自然语言理解 (NLU) 组件进行了技术评估，显示了 BERT 对于较小数据集的显着优势。我们使用训练测试分割和随机生成的对话来验证回合预测。两次验证都显示出可接受的对话级别准确性。我们在两个地点进行了可用性研究，结果显示两个地点均有效，并且其中一个地点的可接受性良好。概述的框架可用于开发其他用于认知自我护理的虚拟代理。建议的改进包括使用集成 BERT 验证化身并减少对数据增强的依赖、离线语音交互模块、改进的 UX 设计、临床验证对话代理对用户不适和认知表现的影响，以及提高虚拟化身在 VR 认知护理环境中的普遍性。
We present an avatar and task-oriented dialog agent for monitoring user discomfort during a virtual reality (VR) cognitive exercise and providing personalized information and advice on its relief. The goal of this approach is to provide instantaneous assistance to users for a more comfortable VR experience, thereby enabling them to spend more time on cognitive tasks. We developed an avatar in a VR environment with which users may communicate verbally, and a dialog agent in a machine-learning based conversational AI platform. We performed a technical evaluation of the natural language understanding (NLU) component by comparing 2 models (BERT and StarSpace) using a train-test split, showing a significant benefit of BERT with smaller data sets. We validated the turn prediction using a train-test split and using randomly generated conversations. Both validations showed acceptable conversation-level accuracy. We undertook a usability study at two sites, showing effectiveness at both and good acceptability at one of the two. The framework outlined can be used to develop other virtual agents for cognitive self-care. Suggested improvements include validating the avatar with integrated BERT and reducing reliance on data augmentation, offline voice interaction modules, improved UX design, clinically validating the effect of the dialog agent on user discomfort and on cognitive performance, and increasing the ubiquity of the avatar within the VR cognitive care environment.