Combining ML/AI with Voice and Gesture Control on a VR Platform

在 VR 平台上将 ML/AI 与语音和手势控制相结合

• 批准号: 571172-2021
• 负责人: Blum, SusanSC
• 金额: $ 5.46万
• 依托单位: Saskatchewan Polytechnic
• 依托单位国家: 加拿大
• 项目类别: Applied Research and Development Grants - Level 2
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=755279
• 关键词: Combining; ML; AI; Voice; Gesture

Titan 1 Studios (T1S) is a media-based company that specializes in short movies and graphic novels. They are now expanding their services into the gaming market, as there is significant overlap between their current skillset and that required for video game development. The studio has set out an ambitious plan to incorporate multiple aspects of artificial intelligence into a virtual reality (VR) platform that will push the envelope of current technologies available in VR gameplay. This includes voice recognition, gesture-based commands, advanced machine learning/artificial intelligence for non-player characters, and dynamic difficulty adjustment based on assessment of the player's skill. Although aspects of these components have been demonstrated in the research literature on an individual basis, there has been little research on how to incorporate them together on a single platform, i.e., a current, low cost, off-the-shelf VR system. Saskatchewan Polytechnic will collaborate with T1S in developing the software platform necessary to achieve this goal.

Titan 1 Studios（T1 S）是一家以媒体为基础的公司，专门从事短片和漫画小说。他们现在正在将他们的服务扩展到游戏市场，因为他们目前的技能与视频游戏开发所需的技能之间存在重大重叠。该工作室制定了一项雄心勃勃的计划，将人工智能的多个方面融入虚拟现实（VR）平台，这将推动VR游戏中现有技术的发展。这包括语音识别、基于手势的命令、针对非玩家角色的高级机器学习/人工智能，以及基于玩家技能评估的动态难度调整。虽然这些组件的各个方面已经在研究文献中以个体为基础进行了论证，但很少有关于如何将它们合并到单个平台上的研究，即，一个低成本的虚拟现实系统萨斯喀彻温省理工学院将与T1 S合作开发实现这一目标所需的软件平台。