Real-Tune 3D Shape Reconstruction, Visualization, Editing, and Coding for 3D Video
实时调整 3D 形状重建、可视化、编辑和 3D 视频编码
基本信息
- 批准号:13308017
- 负责人:
- 金额:$ 31.7万
- 依托单位:
- 依托单位国家:日本
- 项目类别:Grant-in-Aid for Scientific Research (A)
- 财政年份:2001
- 资助国家:日本
- 起止时间:2001 至 2003
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
We have obtained the following technical attainments to realize 3D video generation, visualization, editing, and coding.1. PC cluster system (PC : 30, active camera : 25) to capture synchronized multi-view video of human action2. Precise calibration method for quasi fixed-viewpoint pan-tilt-zoom camera3. 3 base plane visual cone intersection algorithm and its parallel pipeline processing method for real-time dynamic 3D shape reconstruction using PC cluster ; with this system, we can reconstruct over 10 volumes per second of human action at 2cm X 2cm X 2cm spatial resolution.4. cooperative camera work planning for zoom-up active video capturing of human body parts ; with this method, we will be able to increase the accuracy of 3D shape and surface texture significantly.5. 3D deformable mesh model for reconstructing accurate 3D human shape and motion ; with this method, we can reconstruct even concave portions of 3D human body.6. Viewpoint dependent high fidelity texture mapping algorithm for 3D video visualization ; with,this method, we can visualize 3D video of almost standard video quality.7. Lighting environment sensing (i.e. estimation of multiple light sources) using multiple Lambertian spheres8. Lighting environment sensing using skeleton cube9. Interactive 3D video editing system using 3D video and omni-directional panoramic video10. Coding method of omni-directional video based on unfolded regular polyhedron11. Coding method of 3D video based on planar mapping of 3D surface shapeAs for two coding methods listed above, we proposed them to MPEG for international standardization.
在实现3D视频的生成、可视化、编辑、编码等方面取得了以下技术成果:1. PC集群系统(PC:30,活动摄像头:25)捕捉同步的多视角视频的人的行动2.准固定视点云台变焦相机的精确标定方法。基于PC集群的实时动态三维形状重建的基平面视锥求交算法及其并行流水线处理方法,该系统可以在2cm × 2cm × 2cm的空间分辨率下,每秒重建10个以上的人体动作体.协同摄像机工作规划用于人体部位的放大主动视频捕获,通过该方法,我们将能够显著提高3D形状和表面纹理的准确性.三维可变形网格模型,用于重建精确的三维人体形状和运动;使用该方法,我们可以重建甚至凹部的三维人体.视点相关的高保真纹理映射算法用于3D视频可视化;使用该方法,我们可以可视化几乎标准视频质量的3D视频.使用多个朗伯球的照明环境感测(即多个光源的估计)8。使用骨架立方体的照明环境感测9.使用3D视频和全方位全景视频的交互式3D视频编辑系统10.基于展开正多面体的全方位视频编码方法。基于3D表面形状平面映射的3D视频编码方法对于上述两种编码方法,我们已将其提交给MPEG进行国际标准化。
项目成果
期刊论文数量(33)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
X.Wu, T.Wada, S.Toukai, T.Matsuyama: "Parallel Volume Intersection Based on Plane-to-Plane Projection"IPSJ Transactions on CVIM. 42, No.SIG-6 (CVIM 2). 33-43 (2001)
X.Wu、T.Wada、S.Toukai、T.Matsuyama:“基于平面到平面投影的平行体积相交”CVIM 上的 IPSJ 交易。
- DOI:
- 发表时间:
- 期刊:
- 影响因子:0
- 作者:
- 通讯作者:
松山隆司, 高井勇志, ウ 小軍, 延原章平: "3次元ビデオ映像の撮影・編集・表示"日本バーチャルリアリティ学会論文誌. Vol.7,No.4. 521-532 (2002)
Takashi Matsuyama、Yuji Takai、Kogun U、Shohei Nobehara:“3D 视频图像的摄影、编辑和显示”日本虚拟现实学会杂志第 7 卷,第 521-532 期(2002 年)。
- DOI:
- 发表时间:
- 期刊:
- 影响因子:0
- 作者:
- 通讯作者:
S.Toukai, R.Yumiba, X.Wu, T.Matsuyama: "An Active Camera System for the Wide Area Scene Visualization"The IEICE Transactions (Japanese Edition). J84-D-II, No.8. 1910-1920 (2001)
S.Toukai、R.Yumiba、X.Wu、T.Matsuyama:“用于广域场景可视化的主动相机系统”IEICE Transactions(日文版)。
- DOI:
- 发表时间:
- 期刊:
- 影响因子:0
- 作者:
- 通讯作者:
T.Matsuyama, X.Wu, T.Takai, S.Nobuhara: "Real-Time 3D Shape Reconstruction, Dynamic 3D Mesh Deformation, and High Fidelity Visualization for 3D Video"International Journal on Compute Vision and Image Understanding. (in press).
T.Matsuyama、X.Wu、T.Takai、S.Nobuhara:“实时 3D 形状重建、动态 3D 网格变形和 3D 视频的高保真可视化”国际计算视觉和图像理解杂志。
- DOI:
- 发表时间:
- 期刊:
- 影响因子:0
- 作者:
- 通讯作者:
T.Takai, T.Matsuyama: "High Fidelity Visualization Algorithm and 3D Editing System for 3D Video"The journal of the institute of image information and television engineers. 58, No.4. 593-602 (2002)
T.Takai、T.Matsuyama:《3D视频的高保真可视化算法和3D编辑系统》图像信息和电视工程师学会期刊。
- DOI:
- 发表时间:
- 期刊:
- 影响因子:0
- 作者:
- 通讯作者:
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
MATSUYAMA Takashi其他文献
MATSUYAMA Takashi的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('MATSUYAMA Takashi', 18)}}的其他基金
Elucidation of the molecular mechanism for highly active terminator regions in Saccharomyces cerevisiae
阐明酿酒酵母高活性终止子区域的分子机制
- 批准号:
25660071 - 财政年份:2013
- 资助金额:
$ 31.7万 - 项目类别:
Grant-in-Aid for Challenging Exploratory Research
Establishment of Peri-implantitis treatment using a dual-purpose graft and cell transplantation.
建立使用双重目的移植物和细胞移植的种植体周围炎治疗方法。
- 批准号:
21592629 - 财政年份:2009
- 资助金额:
$ 31.7万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
The influence of bone formation by thrombomodulin in platelet rich plasma gel
富血小板血浆凝胶中血栓调节蛋白对骨形成的影响
- 批准号:
15592193 - 财政年份:2003
- 资助金额:
$ 31.7万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
Elucidation of new adhesion mechanism between neutrophils and gingival epithelial cells via thrombomodulin
通过血栓调节蛋白阐明中性粒细胞与牙龈上皮细胞之间的新粘附机制
- 批准号:
13672193 - 财政年份:2001
- 资助金额:
$ 31.7万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
Understanding human intention and activities for versatile real-time human-machine-interactions
了解人类意图和活动以实现多功能实时人机交互
- 批准号:
13224051 - 财政年份:2001
- 资助金额:
$ 31.7万 - 项目类别:
Grant-in-Aid for Scientific Research on Priority Areas
Cooperative Distributed Image Understanding Systems
协作分布式图像理解系统
- 批准号:
08408010 - 财政年份:1996
- 资助金额:
$ 31.7万 - 项目类别:
Grant-in-Aid for Scientific Research (A)
Developing High Precision Versatile Camera Systems by Multi-Image Integration
通过多图像集成开发高精度多功能相机系统
- 批准号:
07558047 - 财政年份:1995
- 资助金额:
$ 31.7万 - 项目类别:
Grant-in-Aid for Scientific Research (A)
Parallel Image Understanding System on Recursive Torus Architecture
递归环面架构的并行图像理解系统
- 批准号:
05452359 - 财政年份:1993
- 资助金额:
$ 31.7万 - 项目类别:
Grant-in-Aid for General Scientific Research (B)
Geometric Programming System
几何规划系统
- 批准号:
03452171 - 财政年份:1991
- 资助金额:
$ 31.7万 - 项目类别:
Grant-in-Aid for General Scientific Research (B)
Effects of Doxorubicin or OK-432 on Cancer cells during liver regeneration after two-thirds hepatectomy
阿霉素或 OK-432 对三分之二肝切除术后肝再生过程中癌细胞的影响
- 批准号:
03670630 - 财政年份:1991
- 资助金额:
$ 31.7万 - 项目类别:
Grant-in-Aid for General Scientific Research (C)
相似海外基金
Development and Evaluation of a Multi-Viewpoint Video Application for Nursing Technology Using Six Simultaneous Viewpoints
使用六个同时视点的护理技术多视点视频应用程序的开发和评估
- 批准号:
21K10616 - 财政年份:2021
- 资助金额:
$ 31.7万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
Development of interactive editing technique of real world video using multi-viewpoint video
使用多视点视频的现实世界视频交互式编辑技术的开发
- 批准号:
16K00225 - 财政年份:2016
- 资助金额:
$ 31.7万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
Research on recognition mechanisms of low-quality images for multi-viewpoint video surveillance
多视点视频监控低质量图像识别机制研究
- 批准号:
16300054 - 财政年份:2004
- 资助金额:
$ 31.7万 - 项目类别:
Grant-in-Aid for Scientific Research (B)