Designing a novel interactive virtual-reality platform: multimodal natural user interface targeting emotion

点击翻译按钮获取中文摘要

Empathy is one of the most important skills in social interaction. The lack of social skills and empathy will interfere with functions of everyday life. Empathy does not occur overnight; as children get older, they nurture this skill through experiencing different social contexts. The strong affinity that children have for the virtual environments has positioned these tools as appropriate alternatives to facilitate socio-emotional skills. Advancing human-computer interactions enable users to interact naturally based on the real-time audio and depth data. With the rapid increase in the development of virtual reality home-based technologies, one challenge that game developers in Reality Controls Inc. (the company) face is how to design and develop a multi-modal platform using a natural user interface that targets humans' perception of emotion. We propose to develop a novel cost-effective interactive virtual reality platform, targeting emotion, via multimodal natural user interface for children. We will then evaluate the system, pilot the usability of the game, refine the implementation of the system, and revise its programming as required. Such a program has the potential to monitor and screen for socio-emotional functions and consequently serves as an assistive technology in communication disorders, such as autism spectrum disorder, or as a tool to facilitate transition to school among Canadian children with significantly lower costs to the Canadian economy than current programs.