A garment acquisition pipeline for game asset retargetting

自计算机游戏诞生以来，布料动画在视频游戏中无处不在，并且是游戏体验的典型组成部分。逼真的布料动画可以使用复杂的布料模拟引擎来实现，但在实时游戏中，布料模拟的计算预算根本不允许进行详细的布料模拟。因此，实际的解决方案通常围绕增强简化的模拟技术：通过关键帧或其他动画技术增强基础上的简单模拟，以增强动画师的控制。这种方法存在许多缺点，从缺乏动画师控制到模拟稳定性和性能。 在这项工作中，我们提出了一种根本不同的方法，我们使用离线布料采集来驱动布料合成过程，其方式与运动捕捉驱动角色运动合成过程的方式类似。我们使用布料的性能捕捉作为资产，根据以前从未见过的角色和动作实时重新定位。我们通过利用人工智能和神经网络的最新进展来实现这一目标。我们将特定服装的动画定义为身体形状、身体动力学和服装属性的四维回归函数，并将问题构建为优化函数，其中输入是身体静止形状、身体运动、服装静止形状和输出。 我们正在与 UBISOFT 密切合作开展这个项目，UBISOFT 是一家领先的电脑游戏公司，在蒙特利尔设有大型研发工作室。使用这项技术将实现计算机动画领域的重大范式转变，有可能彻底改变计算机游戏领域，从而使公司、计算机动画社区以及整个加拿大游戏行业受益。

Cloth animation is ubiquitous in video games and a quintessential part of game playing experience since the dawn of computer gaming. Realistic cloth animation can be achieved using sophisticated cloth simulation engines, but in a real-time game the computing budget for cloth simulation simply does not allow for a detailed cloth simulation. Therefore, practical solutions generally revolve around augmenting simplified simulation techniques: a simple simulation at the base augmented by keyframing or other animation techniques for increased animator control. This approach has a number of shortcomings from lack of animator control, to simulation stability as well as performance. In this work we propose a fundamentally different approach where we use off-line cloth acquisition to drive the cloth synthesis process in a homologue way to how motion capture can drive the character motion synthesis process. We use performance captures of cloth as assets to be retargeted in real-time based on a never seen before character and motion. We achieve this by using the recent advances in artificial intelligence and neural networks. We define the animation of a specific garment as a four-dimensional regression function of body shape, body dynamics and garment properties and we frame the problem as an optimization function where the input is body rest shape, body motion, garment rest-shape and the output. We are collaborating closely on this project with UBISOFT, a leading company in computer games that has a large R&D studio in Montreal. Using this technique will achieve a significant paradigm shift in computer animation that has the potential of revolutionizing the computer gaming field thus benefiting the company, the computer animation community as well as the Canadian gaming industry as a whole.