Surround 3D video content creation with moving cameras

使用移动摄像机创建环绕 3D 视频内容

基本信息

  • 批准号:
    501466-2016
  • 负责人:
  • 金额:
    $ 2.33万
  • 依托单位:
  • 依托单位国家:
    加拿大
  • 项目类别:
    Collaborative Research and Development Grants
  • 财政年份:
    2017
  • 资助国家:
    加拿大
  • 起止时间:
    2017-01-01 至 2018-12-31
  • 项目状态:
    已结题

项目摘要

The overall goal of the project is to develop image acquisition and processing technology that will enable relatively low-cost generation of 3D surround video content, integrating live action footage with computer graphic imagery. In particular we will investigate the utility of a novel imaging system that consists of a single high resolution stereo pair of cameras combined with a fixed ring of lower resolution cameras. The imaging system will be mobile and able to track objects of interest, thereby keeping the stereo pair fixated on aspects of the scene relevant to the cinematic content being generated. The tracking capability, in addition to permitting a single stereo camera pair to be used, also minimizes motion blur that would otherwise arise with non-tracking cameras as the camera system is translated. We will investigate approaches to scripting of the image acquisition (camera tracking motions) and graphics content generation that will allow the content producer to bias the viewer's attention towards scene features relevant to the content's narrative, while still providing a sense of surround immersion.The project will also address finding solutions to a number of technical problems in the generation of 3D surround content. The first is to minimize image stitching defects arising from the multiple perspectives of the cameras. These generate parallax, which is important to provide depth cues for the viewings, but problematic when stitching images to form panoramas. We propose to implement techniques that are half-occlusion aware (half-occlusions are places where one eye sees scene details that the other eye does not) to inform the stitching process. We will also investigate the coupled generation of the CGI panoramas and the live action (camera) panoramas to minimize artifacts created during the compositing step.
该项目的总体目标是开发图像采集和处理技术,以相对低成本生成3D环绕视频内容,将实景镜头与计算机图形图像相结合。特别是,我们将研究一种新型成像系统的效用,该系统由单个高分辨率立体相机对与固定环低分辨率相机组合而成。成像系统将是可移动的,能够跟踪感兴趣的物体,从而使立体视觉对固定在与正在生成的电影内容相关的场景方面。跟踪功能,除了允许使用单个立体摄像机对之外,还可以最大限度地减少运动模糊,否则在摄像机系统转换时,非跟踪摄像机会产生运动模糊。我们将研究图像采集(摄像机跟踪运动)和图形内容生成的脚本方法,这些方法将允许内容制作人将观众的注意力偏向于与内容叙述相关的场景特征,同时仍然提供环绕沉浸感。该项目还将致力于寻找3D环绕内容生成中一些技术问题的解决方案。首先是尽量减少由相机的多个角度引起的图像拼接缺陷。这些会产生视差,这对于为观看提供深度线索很重要,但在拼接图像以形成全景时就会出现问题。我们建议实现半遮挡感知技术(半遮挡是一只眼睛看到另一只眼睛看不到的场景细节的地方)来通知拼接过程。我们还将研究CGI全景图和实景(相机)全景图的耦合生成,以尽量减少合成步骤中创建的伪影。

项目成果

期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Clark, James其他文献

A population-scale temporal case-control evaluation of COVID-19 disease phenotype and related outcome rates in patients with cancer in England (UKCCP).
  • DOI:
    10.1038/s41598-023-36990-9
  • 发表时间:
    2023-07-25
  • 期刊:
  • 影响因子:
    4.6
  • 作者:
    Starkey, Thomas;Ionescu, Maria;Tilby, Michael;Little, Martin W.;Burke, Emma;Fittall, Matthew;Khan, Sam R.;Liu, Justin K. H.;Platt, James R.;Mew, Rosie;Tripathy, Arvind;Watts, Isabella;Williams, Sophie Therese;Appanna, Nathan;Al-Hajji, Youssra;Barnard, Matthew;Benny, Liza;Burnett, Alexander L.;Bytyci, Jola;Cattell, Emma J.;Cheng, Vinton;Clark, James;Eastlake, Leonie;Gerrand, Kate;Ghafoor, Qamar;Grumett, Simon;Harper-Wynne, Catherine;Kahn, Rachel;Lee, Alvin J. X.;Lomas, Oliver;Lydon, Anna;Mckenzie, Hayley;Kinloch, Emma;Lam, Emily;Murphy, Gillian;Rhodes, Malcolm;Robinson, Kate;Panneerselvam, Hari S.;Pascoe, Jennifer;Patel, Grisma;Patel, Vijay A.;Potter, Vanessa;Randle, Amelia S.;Rigg, Anne M.;Robinson, Tim;Roylance, Rebecca W.;Roques, Tom;Rozmanowski, Stefan;Roux, Rene L.;Shah, Ketan;Sheehan, Remarez;Sintler, Martin;Swarup, Sanskriti;Taylor, Harriet;Tillett, Tania;Tuthill, Mark;Williams, Sarah;Ying, Yuxin;Beggs, Andrew;Iveson, Tim;Lee, Siow Ming;Middleton, Gary;Middleton, Mark;Protheroe, Andrew;Fowler, Tom;Johnson, Peter;Lee, Lennard Y. W.;NCRI Consumer Forum
  • 通讯作者:
    NCRI Consumer Forum
Mechanism and consequence of the autoactivation of p38α mitogen-activated protein kinase promoted by TAB1.
  • DOI:
    10.1038/nsmb.2668
  • 发表时间:
    2013-10
  • 期刊:
  • 影响因子:
    16.8
  • 作者:
    De Nicola, Gian Felice;Martin, Eva Denise;Chaikuad, Apirat;Bassi, Rekha;Clark, James;Martino, Luigi;Verma, Sharwari;Sicard, Pierre;Tata, Renee;Atkinson, R. Andrew;Knapp, Stefan;Conte, Maria R.;Marber, Michael S.
  • 通讯作者:
    Marber, Michael S.
The Natural Orifice Simulated Surgical Environment (NOSsEâ„¢): Exploring the Challenges of NOTES Without the Animal Model
Lymphoid blast crisis after prolonged treatment-free remission in chronic myeloid leukaemia after tyrosine kinase inhibitor de-escalation during the COVID-19 pandemic.
  • DOI:
    10.1002/jha2.302
  • 发表时间:
    2022-03
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Avenoso, Daniele;Milojkovic, Dragana;Clark, James;Pocock, Christopher;Potter, Victoria;Yallop, Deborah;Hannah, Guy
  • 通讯作者:
    Hannah, Guy
Complete Genome Sequence of Vibrio natriegens Phage Phriendly
  • DOI:
    10.1128/mra.01096-19
  • 发表时间:
    2019-10-01
  • 期刊:
  • 影响因子:
    0.8
  • 作者:
    Clark, James;Awah, Adey;Ramsey, Jolene
  • 通讯作者:
    Ramsey, Jolene

Clark, James的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Clark, James', 18)}}的其他基金

Personalized Dynamic Attention Tracking
个性化动态注意力跟踪
  • 批准号:
    RGPIN-2020-04699
  • 财政年份:
    2022
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Discovery Grants Program - Individual
Task-, viewer- and degradation-specific image quality assessment
特定于任务、查看器和退化的图像质量评估
  • 批准号:
    561074-2020
  • 财政年份:
    2021
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Alliance Grants
Personalized Dynamic Attention Tracking
个性化动态注意力跟踪
  • 批准号:
    RGPIN-2020-04699
  • 财政年份:
    2021
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Discovery Grants Program - Individual
Personalized Dynamic Attention Tracking
个性化动态注意力跟踪
  • 批准号:
    RGPIN-2020-04699
  • 财政年份:
    2020
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Discovery Grants Program - Individual
Task-, viewer- and degradation-specific image quality assessment
特定于任务、查看器和退化的图像质量评估
  • 批准号:
    561074-2020
  • 财政年份:
    2020
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Alliance Grants
Attention Tracking using Shared Attention Modeling and Attentional Push
使用共享注意力建模和注意力推送进行注意力跟踪
  • 批准号:
    RGPIN-2015-06094
  • 财政年份:
    2019
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Discovery Grants Program - Individual
Surround 3D video content creation with moving cameras
使用移动摄像机创建环绕 3D 视频内容
  • 批准号:
    501466-2016
  • 财政年份:
    2019
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Collaborative Research and Development Grants
Attention Tracking using Shared Attention Modeling and Attentional Push
使用共享注意力建模和注意力推送进行注意力跟踪
  • 批准号:
    RGPIN-2015-06094
  • 财政年份:
    2018
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Discovery Grants Program - Individual
Surround 3D video content creation with moving cameras
使用移动摄像机创建环绕 3D 视频内容
  • 批准号:
    501466-2016
  • 财政年份:
    2018
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Collaborative Research and Development Grants
Attention Tracking using Shared Attention Modeling and Attentional Push
使用共享注意力建模和注意力推送进行注意力跟踪
  • 批准号:
    RGPIN-2015-06094
  • 财政年份:
    2017
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Discovery Grants Program - Individual

相似国自然基金

锰酸锂基复合气凝胶的3D打印构筑及其提锂机制研究
  • 批准号:
    JCZRLH202500778
  • 批准年份:
    2025
  • 资助金额:
    0.0 万元
  • 项目类别:
    省市级项目
3D打印楔形梯度多孔支架的优化构建及促进HTO术后骨再生修复的实验研究
  • 批准号:
  • 批准年份:
    2025
  • 资助金额:
    0.0 万元
  • 项目类别:
    省市级项目
基于3D Slicer的颅内动脉瘤破裂风险评估机器学习模型开发及临床推广应用
  • 批准号:
  • 批准年份:
    2025
  • 资助金额:
    0.0 万元
  • 项目类别:
    省市级项目
智能3D超微血管成像联合实时剪切波弹性评估胎盘功能对高血压孕妇子痫前期的预测效能分析
  • 批准号:
  • 批准年份:
    2025
  • 资助金额:
    0.0 万元
  • 项目类别:
    省市级项目
3D打印PH-GBS@CCP复合支架诱导骨肉瘤铜死亡及增效抗PD-1治疗的作用机制研究
  • 批准号:
  • 批准年份:
    2025
  • 资助金额:
    0.0 万元
  • 项目类别:
    省市级项目
双重固化3D打印连续纤维C/C复合材料成型与渗碳致密化机理研究
  • 批准号:
    2025JJ60269
  • 批准年份:
    2025
  • 资助金额:
    0.0 万元
  • 项目类别:
    省市级项目
载椎体骨髓干细胞外泌体3D打印n-HA/PA66生物支架的研制及促脊柱融合机制研究
  • 批准号:
    2025JJ80409
  • 批准年份:
    2025
  • 资助金额:
    0.0 万元
  • 项目类别:
    省市级项目
基于微流控技术的3D细胞培养体系构建及在乳腺癌耐药机制中应用研究
  • 批准号:
    2025JJ70487
  • 批准年份:
    2025
  • 资助金额:
    0.0 万元
  • 项目类别:
    省市级项目

相似海外基金

3D-Video for Post-Production Camera positioning.
用于后期制作摄像机定位的 3D 视频。
  • 批准号:
    10063895
  • 财政年份:
    2023
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Collaborative R&D
Learning 3D information and ego-motion from acoustic video in extreme underwater environment
在极端水下环境中从声学视频中学习 3D 信息和自我运动
  • 批准号:
    23K19993
  • 财政年份:
    2023
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Grant-in-Aid for Research Activity Start-up
Theatre stage capture using 3D video technologies
使用 3D 视频技术进行剧院舞台捕捉
  • 批准号:
    10069764
  • 财政年份:
    2023
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Collaborative R&D
Feasibility Study/Design for Build Back Better: Use of portable highest quality 3D facial scan product to scan faces for video games and provide immersive and connected experience with realistic avatars
更好地重建的可行性研究/设计:使用便携式最高质量 3D 面部扫描产品扫描视频游戏中的面部,并通过逼真的头像提供身临其境的互联体验
  • 批准号:
    10020552
  • 财政年份:
    2022
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Feasibility Studies
Advanced 3D Video Processing Technologies: Super-Resolution, Chroma-Keying, Depth-Map Generation, and Quality Evaluation
先进的 3D 视频处理技术:超分辨率、色度键控、深度图生成和质量评估
  • 批准号:
    RGPIN-2019-06163
  • 财政年份:
    2022
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Discovery Grants Program - Individual
Advanced 3D Video Processing Technologies: Super-Resolution, Chroma-Keying, Depth-Map Generation, and Quality Evaluation
先进的 3D 视频处理技术:超分辨率、色度键控、深度图生成和质量评估
  • 批准号:
    RGPIN-2019-06163
  • 财政年份:
    2021
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Discovery Grants Program - Individual
Advanced 3D Video Processing Technologies: Super-Resolution, Chroma-Keying, Depth-Map Generation, and Quality Evaluation
先进的 3D 视频处理技术:超分辨率、色度键控、深度图生成和质量评估
  • 批准号:
    RGPIN-2019-06163
  • 财政年份:
    2020
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Discovery Grants Program - Individual
Advanced 3D Video Processing Technologies: Super-Resolution, Chroma-Keying, Depth-Map Generation, and Quality Evaluation
先进的 3D 视频处理技术:超分辨率、色度键控、深度图生成和质量评估
  • 批准号:
    RGPIN-2019-06163
  • 财政年份:
    2019
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Discovery Grants Program - Individual
Documenting Arapaho Place Names with Virtual Reality Elicitation Using 3D 360 and Aerial Drone Video
使用 3D 360 度和空中无人机视频通过虚拟现实启发记录阿拉帕霍地名
  • 批准号:
    1911612
  • 财政年份:
    2019
  • 资助金额:
    $ 2.33万
  • 项目类别:
    Standard Grant
Characterization of 3D feeding kinematics and EMG of rats and laminar specific single cell encoding properties in the motor cortex
大鼠 3D 进食运动学和肌电图的表征以及运动皮层层状特定单细胞编码特性
  • 批准号:
    10006877
  • 财政年份:
    2019
  • 资助金额:
    $ 2.33万
  • 项目类别:
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了