Designing a novel interactive virtual-reality platform: multimodal natural user interface targeting emotion

移情是社交中最重要的技能之一。缺乏社交技能和同理心将 干扰日常生活的功能。移情不是一夜之间发生的；随着孩子长大，他们会养成 这项技能是通过体验不同的社会背景来实现的。儿童对虚拟世界有很强的亲和力 环境将这些工具定位为促进社会情感技能的适当选择。 先进的人机交互使用户能够基于实时音频和 深度数据。随着基于家庭的虚拟现实技术的快速发展，一种 现实中的游戏开发商面临的挑战是如何设计和开发一种 多模式平台，使用自然的用户界面，目标是人类对情感的感知。 我们建议开发一种新的高性价比的交互式虚拟现实平台，目标是情感，通过 面向儿童的多模式自然用户界面。然后我们将评估系统，试验游戏的可用性， 完善系统的实施，并根据需要修改其规划。这样的计划具有 有可能监测和筛选社会情绪功能，因此可以作为一种辅助工具 沟通障碍方面的技术，如自闭症谱系障碍，或作为促进过渡到 在加拿大儿童中上学，加拿大经济的成本明显低于目前 程序。

Empathy is one of the most important skills in social interaction. The lack of social skills and empathy will interfere with functions of everyday life. Empathy does not occur overnight; as children get older, they nurture this skill through experiencing different social contexts. The strong affinity that children have for the virtual environments has positioned these tools as appropriate alternatives to facilitate socio-emotional skills. Advancing human-computer interactions enable users to interact naturally based on the real-time audio and depth data. With the rapid increase in the development of virtual reality home-based technologies, one challenge that game developers in Reality Controls Inc. (the company) face is how to design and develop a multi-modal platform using a natural user interface that targets humans' perception of emotion. We propose to develop a novel cost-effective interactive virtual reality platform, targeting emotion, via multimodal natural user interface for children. We will then evaluate the system, pilot the usability of the game, refine the implementation of the system, and revise its programming as required. Such a program has the potential to monitor and screen for socio-emotional functions and consequently serves as an assistive technology in communication disorders, such as autism spectrum disorder, or as a tool to facilitate transition to school among Canadian children with significantly lower costs to the Canadian economy than current programs.