Procedural Animation of Conversational Gestures for Virtual Humans

虚拟人对话手势的程序动画

• 批准号: CCB21-2021-00146
• 负责人: Mowat, Vicki
• 金额: $ 72.85万
• 依托单位: Sheridan Institute of Technology and Advanced Learning
• 依托单位国家: 加拿大
• 项目类别: Applied Research and Technology Partnership Grants
• 财政年份: 2021
• 资助国家: 加拿大
• 起止时间: 2021-01-01 至 2022-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=729263
• 关键词: Procedural; Animation; Conversational; Gestures; Virtual

Two Ontario colleges and two Quebec cégeps are collaborating on co-creation of a prototype, open-source systems solution for the procedural animation of conversation gestures in Virtual Humans (VHs). Led by Sheridan College's Screen Industries Research and Training Centre (SIRT), Durham College's Hub for Applied Research in Artificial Intelligence for Business Solutions (AI Hub) and Mixed Reality Capture Studio (MRC), Cégep de Matane's Centre de développement et de recherche en intelligence numérique (CDRIN) and the Cégep de Rivière-du-Loup's Le Living Lab en innovation ouverte (LLio), the research team will conduct dual-language, cross-sectoral research and development focused on procedural animation workflows that incorporate advanced, data-driven analysis and leverage Artificial Intelligence (AI) and Machine Learning (ML) to allow for automation and procedural generation of complex VH movements, including hand, limb, body movement. A diverse group of researchers and students from Canadian institutions will conduct research and development using a human-centered design approach in collaboration with leading companies, including SpinVFX, Ubisoft, Transitional Forms, ReImagine AI, AMD Canada, etc. Canadian companies currently employ, or are in the process of developing, their own Virtual Humans pipelines, primarily for film & television productions, and realtime productions for interactive games and entertainment. As consumers expect increasingly realistic, believable, and interactive VHs within entertainment, and VHs are used more frequently within systems for training, simulation, healthcare, etc., applied research and development is needed to target the challenges of procedural generation to improve the intelligence of VH actions while reducing the amount of time needed to convincingly animate VHs. Research will provide companies with a significant competitive advantage by refining existing VH solutions to better capture customers needs, expanding VH solutions into new market segments, and by creating disruptive innovation with new products and services. An open-source gesture database will offer an effective resource to raise the state-of-the art for animation in Canada. Companies will be able to improve existing systems, processes, and products by integrating the open-source system and further develop and/or develop proprietary applications of the projects outcomes.

安大略省的两所学院和两个魁北克大学正在合作，共同创建了原型，开源系统解决方案，用于虚拟人类（VHS）的对话手势的程序动画。由谢里丹学院的屏幕界研究与培训中心（SIRT），达勒姆学院的枢纽用于人工智能的应用研究中心（AI HUB）（AI HUB）和混合现实捕获工作室（MRC），Cégep研究团队将进行双语言，跨部门的研究和开发，以允许进行跨性别的研究和开发，以允许使用高级的动画智能（人工智能）（人工智能）（人为分析）（人为分析）（效率分析）（人工分析（效率））用于自动化和程序生成复杂的VH运动，包括手，肢体，身体运动。来自加拿大机构的研究人员和学生将使用以人为中心的设计方法与领先的公司合作进行研发，包括SpinVFX，Ubisoft，过渡形式，Reimagine AI，AMD Canada等。由于消费者期望在娱乐中越来越现实，可信和交互式VHS，并且在系统中更频繁地使用VHS进行培训，模拟，医疗保健等，因此需要进行应用研发，以针对程序生成的挑战，以改善VH动作的智能，同时减少令人信服的动画动画VHS所需的时间量。研究将通过完善现有的VH解决方案来更好地捕获客户需求，将VH解决方案扩展到新的市场细分市场，并通过新产品和服务创造颠覆性创新，从而为公司提供巨大的竞争优势。开源手势数据库将提供有效的资源来提高加拿大动画的最新技术。公司将能够通过集成开源系统并进一步开发和/或开发项目成果的专有应用来改善现有系统，流程和产品。