Combining ML/AI with Voice and Gesture Control on a VR Platform

点击翻译按钮获取中文摘要

Titan 1 Studios (T1S) is a media-based company that specializes in short movies and graphic novels. They are now expanding their services into the gaming market, as there is significant overlap between their current skillset and that required for video game development. The studio has set out an ambitious plan to incorporate multiple aspects of artificial intelligence into a virtual reality (VR) platform that will push the envelope of current technologies available in VR gameplay. This includes voice recognition, gesture-based commands, advanced machine learning/artificial intelligence for non-player characters, and dynamic difficulty adjustment based on assessment of the player's skill. Although aspects of these components have been demonstrated in the research literature on an individual basis, there has been little research on how to incorporate them together on a single platform, i.e., a current, low cost, off-the-shelf VR system. Saskatchewan Polytechnic will collaborate with T1S in developing the software platform necessary to achieve this goal.