Enabling the virtual actor - streamlining the creation of realistic 3D characters in XR

启用虚拟演员 - 简化 XR 中逼真 3D 角色的创建

• 批准号: 105173
• 金额: $ 16.62万
• 依托单位: FILMTIKI LIMITED
• 依托单位国家: 英国
• 项目类别: Collaborative R&D
• 财政年份: 2019
• 资助国家: 英国
• 起止时间: 2019 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=105173
• 关键词: Enabling; virtual; actor; streamlining; creation

"A truly innovative approach is needed to increase the production value of animated characters on low to medium-budget Extended Reality (XR) experiences. Independent content creators don't have access to the resources needed to convincingly depict actors in this virtual space. They need to resort to stock 3D animations and have real issues with producing compelling facial movements, which brings down the overall production value of their projects. With this project we want to solve this prevailing issue by developing a combined facial and motion capture workflow using a mobile MOCAP set-up with a new facial capture system using the iPhoneX.Through working on and finishing an episode of The Illuminatus! VR, we want to create new and cost-effective ways to create human characters in XR. With this project we want to integrate the new technology of marker-less motion capture and magnetic motion capture, with our bespoke depth camera facial capture rig set-up to develop a combined and portable MOTION/FACIAL/VOICE CAPTURE & SYNC application and workflow into the real-time compositing software UNITY to improve the quality and decrease the use of time and financial resources to use high-quality 3D human models in XR app productions.To optimise actors' performance capture, we hence aim to have a mobile service using an XSens full body magnetic based capture set-up and our depth- cam facial / voice sync and capture set-up that we bring to storytellers and filmmakers, who may not have the technical capacity or expertise to do this.Our goal with this innovation is to optimise the hardware (XSens MOCAP suit, helmet rig and iPhoneX), create the software (capturing app) and compositing workflow to produce high-end characters through enabling actors to effectively be captured for virtual spaces. These production techniques will enable actors to work in a virtual space, and increase the production value of animated characters in XR for a very affordable and competitive price to our clients. We will furthermore be able to hire this service out to our competitors to enrich their services, and are actively pursuing the possibility of licensing the software we will develop to production companies. The partnerships we establish through our for hire service will enable us to reach more clients while at the same time invigorating the XR production ecosystem in the UK."

需要一种真正创新的方法来增加中低预算扩展现实(XR)体验的动画角色的制作价值。独立的内容创作者无法获得在这个虚拟空间中令人信服地描绘演员所需的资源。他们需要求助于库存的3D动画，并且在制作引人注目的面部动作方面存在真正的问题，这降低了他们项目的整体生产价值。通过这个项目，我们希望通过使用移动MOCAP设置和使用iPhoneX的新面部捕获系统来开发一个组合的面部和运动捕获工作流来解决这个普遍存在的问题。通过工作和完成一集的照明！VR，我们希望创造新的、具有成本效益的方式来创建XR中的人类角色。通过这个项目，我们希望将无标记运动捕获和磁性运动捕获的新技术与我们定制的深度相机面部捕获设备设置集成在一起，开发一个组合的便携式运动/面部/语音捕获和同步应用程序和工作流到实时合成软件unity中，以提高质量并减少在XR应用程序制作中使用高质量3D人体模型所需的时间和财力的使用。为了优化演员的表演捕获，因此我们的目标是提供一项移动服务，使用Xsens基于全身磁场的捕获设置和我们的深度摄像头面部/语音同步和捕获设置，我们将带给讲故事的人和电影制作人。我们这项创新的目标是优化硬件(Xsens MOCAP套装、头盔装备和iPhoneX)，创建软件(捕捉APP)和合成工作流程，通过使演员能够有效地捕捉虚拟空间来产生高端角色。这些制作技术将使演员能够在虚拟空间中工作，并以非常实惠和具有竞争力的价格增加XR中动画角色的制作价值。此外，我们还可以将这项服务出租给我们的竞争对手，以丰富他们的服务，并正在积极寻求将我们将开发的软件授权给制作公司的可能性。我们通过出租服务建立的合作伙伴关系将使我们能够接触到更多的客户，同时振兴英国的XR生产生态系统。“