3D Sensing for Moving Objects Based on Integration of the Time-sequential Range Data

本研究的目的是开发新的三维传感技术及其应用。新的3D传感技术能够实时获取高速移动/变形物体的形状。重点研究了高分辨率形状重建方法及其在人机界面中的应用，提出了一种高分辨率形状重建方法。该方法能够通过整合多个时间序列的距离图像来重建高分辨率的形状。此外，非刚性变形的估计方法已在本研究中开发。该方法基于可展曲面的物理特征建立数学模型，实现了精确的曲面估计和平面展开。另外，基于高速三维传感技术，开发了一个交互式显示系统。所提出的系统是多点触摸显示技术的变体，其引入了通过利用可变形的有形屏幕来操纵三维数据的原始方式。作为另一个应用，我开发了一种新的图书数字化技术，在用户执行连续翻页动作的同时扫描大量纸张。所开发的技术表明，可以识别翻转纸张的3D变形并重建原始平面图像。

The goal of this study involves the development of the new 3D sensing technology and its applications. The new 3D sensing technology is capable of real-time shape acquisition of a high-speed moving/deforming object. Particularly, I focused on the method for the high-resolution shape reconstruction and applications for man-machine interface.I have proposed a method for High-resolution shape reconstruction. This method enables the reconstruction of high-resolution shape by integrating multiple time-sequential range images. Also the estimation method for non-rigid deformation has been developed in this study. This method achieves accurate surface estimation and planar development based on a mathematical model involving the physical features of the developable surface. In addition, based on the high-speed 3D sensing technology, I have developed an interactive display system. The proposed system is a variant of the multi-touch display technology that introduces an original way of manipulating three dimensional data by utilizing the deformable tangible screen. As another application, I have developed a new book digitalization technology of scanning large stacks of paper while the user performs a continuous page flipping action. The developed technology shows that it is possible to recognize the 3D deformation of the flipped papers and reconstruct the original flat image.