Enabling the virtual actor - streamlining the creation of realistic 3D characters in XR

点击翻译按钮获取中文摘要

"A truly innovative approach is needed to increase the production value of animated characters on low to medium-budget Extended Reality (XR) experiences. Independent content creators don't have access to the resources needed to convincingly depict actors in this virtual space. They need to resort to stock 3D animations and have real issues with producing compelling facial movements, which brings down the overall production value of their projects. With this project we want to solve this prevailing issue by developing a combined facial and motion capture workflow using a mobile MOCAP set-up with a new facial capture system using the iPhoneX.Through working on and finishing an episode of The Illuminatus! VR, we want to create new and cost-effective ways to create human characters in XR. With this project we want to integrate the new technology of marker-less motion capture and magnetic motion capture, with our bespoke depth camera facial capture rig set-up to develop a combined and portable MOTION/FACIAL/VOICE CAPTURE & SYNC application and workflow into the real-time compositing software UNITY to improve the quality and decrease the use of time and financial resources to use high-quality 3D human models in XR app productions.To optimise actors' performance capture, we hence aim to have a mobile service using an XSens full body magnetic based capture set-up and our depth- cam facial / voice sync and capture set-up that we bring to storytellers and filmmakers, who may not have the technical capacity or expertise to do this.Our goal with this innovation is to optimise the hardware (XSens MOCAP suit, helmet rig and iPhoneX), create the software (capturing app) and compositing workflow to produce high-end characters through enabling actors to effectively be captured for virtual spaces. These production techniques will enable actors to work in a virtual space, and increase the production value of animated characters in XR for a very affordable and competitive price to our clients. We will furthermore be able to hire this service out to our competitors to enrich their services, and are actively pursuing the possibility of licensing the software we will develop to production companies. The partnerships we establish through our for hire service will enable us to reach more clients while at the same time invigorating the XR production ecosystem in the UK."