Enabling the virtual actor - streamlining the creation of realistic 3D characters in XR

“需要一种真正创新的方法来增加低到中等预算的延展实境（XR）体验的动画角色的生产价值。独立内容创作者无法获得在这个虚拟空间中令人信服地描绘演员所需的资源。他们需要求助于库存3D动画，并且在制作引人注目的面部动作方面存在真实的问题，这降低了他们项目的整体生产价值。在这个项目中，我们希望通过使用移动的MOCAP设置和使用iPhoneX的新面部捕捉系统开发一个组合的面部和动作捕捉工作流程来解决这个普遍存在的问题。VR，我们希望创造新的和具有成本效益的方式来创建XR中的人类角色。在这个项目中，我们希望整合无标记动作捕捉和磁性动作捕捉的新技术，与我们定制的深度相机面部捕捉钻机设置开发一个组合和便携式运动/面部/语音捕捉和同步应用程序和工作流程到实时合成软件UNITY，以提高质量和减少使用的时间和财政资源，以使用高-在XR应用程序制作中提供高质量的3D人体模型。为了优化演员的表演捕捉，我们的目标是提供一项移动的服务，该服务使用基于XSens全身磁性的捕捉设置以及我们的深度摄像头面部/语音同步和捕捉设置，我们将这些设置带给讲故事的人和电影制作人，他们可能没有技术能力或专业知识来做这件事。我们这项创新的目标是优化硬件（XSens MOCAP套装、头盔和iPhoneX），创建软件（捕捉应用程序）和合成工作流程，以通过使演员能够有效地被捕捉到虚拟空间来产生高端角色。这些制作技术将使演员能够在虚拟空间中工作，并以非常实惠和有竞争力的价格为我们的客户增加XR动画角色的制作价值。此外，我们将能够将这项服务出租给我们的竞争对手，以丰富他们的服务，并正在积极寻求将我们将开发的软件授权给生产公司的可能性。我们通过出租服务建立的合作伙伴关系将使我们能够接触到更多的客户，同时振兴英国的XR生产生态系统。"

"A truly innovative approach is needed to increase the production value of animated characters on low to medium-budget Extended Reality (XR) experiences. Independent content creators don't have access to the resources needed to convincingly depict actors in this virtual space. They need to resort to stock 3D animations and have real issues with producing compelling facial movements, which brings down the overall production value of their projects. With this project we want to solve this prevailing issue by developing a combined facial and motion capture workflow using a mobile MOCAP set-up with a new facial capture system using the iPhoneX.Through working on and finishing an episode of The Illuminatus! VR, we want to create new and cost-effective ways to create human characters in XR. With this project we want to integrate the new technology of marker-less motion capture and magnetic motion capture, with our bespoke depth camera facial capture rig set-up to develop a combined and portable MOTION/FACIAL/VOICE CAPTURE & SYNC application and workflow into the real-time compositing software UNITY to improve the quality and decrease the use of time and financial resources to use high-quality 3D human models in XR app productions.To optimise actors' performance capture, we hence aim to have a mobile service using an XSens full body magnetic based capture set-up and our depth- cam facial / voice sync and capture set-up that we bring to storytellers and filmmakers, who may not have the technical capacity or expertise to do this.Our goal with this innovation is to optimise the hardware (XSens MOCAP suit, helmet rig and iPhoneX), create the software (capturing app) and compositing workflow to produce high-end characters through enabling actors to effectively be captured for virtual spaces. These production techniques will enable actors to work in a virtual space, and increase the production value of animated characters in XR for a very affordable and competitive price to our clients. We will furthermore be able to hire this service out to our competitors to enrich their services, and are actively pursuing the possibility of licensing the software we will develop to production companies. The partnerships we establish through our for hire service will enable us to reach more clients while at the same time invigorating the XR production ecosystem in the UK."