Research on Reproducing Behaviors of Non-rigid Objects Present in Real Space in Virtual 3D Space

作为研究真实空间中存在的非刚性物体在虚拟三维空间中的再现行为的非刚性物体，(1)人体图像和(2)弹性物体的研究如下所述。(1)人类ImagesTo提高复制的质量的面部表情和动作的人,观察到相机是谁的脸,在真实感三维人脸模型放置在虚拟空间中,这种方法提取面部纹理从视频序列的每一帧被上述收购相机,仿射变换适用于提取的纹理根据检测到的面部位置和姿势,然后将转换后的纹理映射到模型,提出和研究。结果表明，皱纹、眼睛、嘴巴等难以通过面部模型的变形实现逼真动画的元素，可以高质量地再现出来。另一种逼真地表现人脸的方法包括漫画肖像……更多。到目前为止，漫画肖像都是由漫画作家绘制的，但如果计算机可以自动生成漫画肖像，则有望实现逼真的面部再现。研究了最优变形量与面部轮廓、眼睛和嘴巴形状测量结果的关系。针对整个人体，研究了计算机视觉在真实空间中识别人体运动的方法。更具体地说，研究了识别数据库中未包含的未知对象的运动识别方法，以及识别与周围环境相互作用的人类行为的方法。(2)弹性对象为了实时稳定地表示三维虚拟弹性对象的大尺度变形，提出了一种通过关节面连接多个弹性对象基元的铰接弹性对象模型。一种基于边界元法的方法可以实时稳定地表示形状复杂的弹性物体的大尺度变形。少

As the non-rigid objects in the research on reproducing behaviors of non-rigid objects present in real space in virtual 3D space, (1) human images, and (2) elastic objects are studied as described in the following.(1) Human ImagesTo improve the quality of reproducing the facial expressions and face movements of the person, whose face is observed by a camera, in the 3D face model placed in the virtual space, a method that extracts the facial texture from each frame in the video sequence acquired by the above-mentioned camera, applies Affine transform to the extracted texture based on the detected facial position and pose, and then maps the transformed texture onto the face model is proposed and studied. As a result, it turns out that the elements such as wrinkles, eyes and mouth, which are difficult to be animated realistically simply by deforming the face model, can be reproduced with high quality.Another methods that represent human faces realistically include the caricatured portrait … More . Till now, caricatured portraits have been drawn by caricature portrait writers, but if computers can generate caricatured portraits automatically, realistic reproductions of faces can be expected to be achieved. Relationship between optimal deformations and the results of the shape measurement of facial contour, eyes and mouth was studied.Concerning the entire human body, methods for recognizing human motions in real space by computer vision methods were studied. More specifically, a method for recognizing the motions of an unknown person, who is not included in the database for the recognition process, and a method for recognizing human actions interacting with the surroundings were researched.(2) Elastic objectsIn order to represent large-scale deformations of 3D virtual elastic objects in a stable manner in real-time, an articulated elastic object model that connects multiple elastic object primitives through joint surfaces is proposed. A method based on Boundary Element Method can represent large-scale deformations of elastic objects with complicated shapes in a stable manner in real-time. Less