Research on Reproducing Behaviors of Non-rigid Objects Present in Real Space in Virtual 3D Space

现实空间中非刚性物体在虚拟3D空间中的再现行为研究

基本信息

批准号：
17500122
负责人：
OHYA Jun
金额：
$ 2.24万
依托单位：
Waseda University
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (C)
财政年份：
2005
资助国家：
日本
起止时间：
2005 至 2006
项目状态：
已结题

来源：
https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-17500122/
关键词：
graphics virtual reality image information processing computer vision digital human model animation real world information processing コンピュータビジョン

项目摘要

As the non-rigid objects in the research on reproducing behaviors of non-rigid objects present in real space in virtual 3D space, (1) human images, and (2) elastic objects are studied as described in the following.(1) Human ImagesTo improve the quality of reproducing the facial expressions and face movements of the person, whose face is observed by a camera, in the 3D face model placed in the virtual space, a method that extracts the facial texture from each frame in the video sequence acquired by the above-mentioned camera, applies Affine transform to the extracted texture based on the detected facial position and pose, and then maps the transformed texture onto the face model is proposed and studied. As a result, it turns out that the elements such as wrinkles, eyes and mouth, which are difficult to be animated realistically simply by deforming the face model, can be reproduced with high quality.Another methods that represent human faces realistically include the caricatured portrait … More . Till now, caricatured portraits have been drawn by caricature portrait writers, but if computers can generate caricatured portraits automatically, realistic reproductions of faces can be expected to be achieved. Relationship between optimal deformations and the results of the shape measurement of facial contour, eyes and mouth was studied.Concerning the entire human body, methods for recognizing human motions in real space by computer vision methods were studied. More specifically, a method for recognizing the motions of an unknown person, who is not included in the database for the recognition process, and a method for recognizing human actions interacting with the surroundings were researched.(2) Elastic objectsIn order to represent large-scale deformations of 3D virtual elastic objects in a stable manner in real-time, an articulated elastic object model that connects multiple elastic object primitives through joint surfaces is proposed. A method based on Boundary Element Method can represent large-scale deformations of elastic objects with complicated shapes in a stable manner in real-time. Less

正如研究在虚拟3D空间中真实空间中存在的非辅导物体行为的研究中的非韧性对象一样从上述相机获取的视频序列中的每个帧的面部纹理，将仿射转换应用于基于检测到的面部位置和姿势的提取的纹理，然后将转换后的纹理映射到面部模型上。结果，事实证明，诸如包裹，眼睛和嘴巴之类的元素可以通过高质量复制而来，这些元素很难被简单地通过变形而被真实地进行动画。到目前为止，漫画肖像是由讽刺刻画作家绘制的，但是如果计算机可以自动产生讽刺画的肖像，则可以预计面部的现实复制品可以实现。最佳变形与面部轮廓，眼睛和口腔的形状测量结果之间的关系是研究整个人体的，通过计算机视觉方法识别实际空间中人类运动的方法是研究的。更具体地，研究了一种识别未知人的动作的方法，该方法未包含在识别过程的数据库中，并且研究了一种识别与周围环境相互作用的人类行为的方法。（2）通过实时弹出的弹性对象，可以稳定的弹性对象，以稳定的弹性模型将弹性弹性的弹性物体固定在弹性的弹性模型中，从而代表3D虚拟对象的弹性对象，以弹性的弹性对象进行了弹性的弹性对象。基于边界元素方法的方法可以实时以稳定的方式表示具有复杂形状的弹性对象的大规模变形。较少的