3D Sensing for Moving Objects Based on Integration of the Time-sequential Range Data

本研究的目标是开发新的三维传感技术及其应用。新的3D传感技术能够实时获取高速移动/变形物体的形状。重点介绍了高分辨率形状重建方法及其在人机界面中的应用。我提出了一种高分辨率形状重建方法。该方法通过对多个时间序列范围图像进行积分，实现高分辨率形状的重建。本文还提出了非刚性变形的估计方法。该方法基于涉及可展面物理特征的数学模型，实现了精确的曲面估计和平面展开。此外，基于高速3D传感技术，我开发了一个交互式显示系统。所提出的系统是多点触摸显示技术的一种变体，该技术引入了一种利用可变形的有形屏幕来操纵三维数据的原始方法。作为另一个应用，我开发了一种新的图书数字化技术，可以在用户执行连续翻页动作的同时扫描大量纸张。研究表明，该技术可以识别纸张的三维变形，并重建原始平面图像。

The goal of this study involves the development of the new 3D sensing technology and its applications. The new 3D sensing technology is capable of real-time shape acquisition of a high-speed moving/deforming object. Particularly, I focused on the method for the high-resolution shape reconstruction and applications for man-machine interface.I have proposed a method for High-resolution shape reconstruction. This method enables the reconstruction of high-resolution shape by integrating multiple time-sequential range images. Also the estimation method for non-rigid deformation has been developed in this study. This method achieves accurate surface estimation and planar development based on a mathematical model involving the physical features of the developable surface. In addition, based on the high-speed 3D sensing technology, I have developed an interactive display system. The proposed system is a variant of the multi-touch display technology that introduces an original way of manipulating three dimensional data by utilizing the deformable tangible screen. As another application, I have developed a new book digitalization technology of scanning large stacks of paper while the user performs a continuous page flipping action. The developed technology shows that it is possible to recognize the 3D deformation of the flipped papers and reconstruct the original flat image.