Acquiring Complete and Editable Outdoor Models from Video and Images

从视频和图像中获取完整且可编辑的户外模型

• 批准号: EP/K02339X/1
• 负责人: Peter Hall
• 金额: $ 122.3万
• 依托单位: University of Bath
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2013
• 资助国家: 英国
• 起止时间: 2013 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FK02339X%2F1
• 关键词: Acquiring; Complete; Editable; Outdoor; Models

Imagine being able to take a camera out of doors and use it to capture 3D models of the world around you. The landscape at large, including valleys and hills replete with trees, rivers, waterfalls, fields of grass, clouds; seasides with waves rolling onto shore here and crashing onto rocks over there; urban environments complete with incidentals such as lamposts, balconies, and the detritus of modern life. Imagine models that look and move like the real thing. Models that you can use with to make up new scenes of your own, which you can control as you please, and render in how you like. You can zoom into to see details, and out to get a wide impression.This is an impressive vision, and one that is well beyond current know-how. Our plan is to take a major step towards meeting this vision. We will enable users to use video and images to capture large scale scenes of selected types and populate them with models trees, fountains, street furniture and such like, again carefully selecting the types of objects. We will provide software that recognises the sort of environment the camera is in, and objects in that environment, so that 3D moving models can be automatically created.This will prove very useful to our intended user group, which is the creative industries in the UK: films, games, broadcast. Modelling outdoor scenes is expensive and time consuming, and the industry recognises that video and images are excellent sources for making models they can use. To help them further we will develop software that makes use of their current practice of acquiring survey shots of scenes, so that all data is used at many levels of detail. Finally we will wrap all of our developments into a single system that shows the acquisition, editing and control of complete outdoor environments is one step closer.

想象一下，你可以把相机带到户外，用它来捕捉你周围世界的3D模型。整个景观，包括山谷和丘陵，到处都是树木、河流、瀑布、草地、云彩；海边，这里的海浪滚滚到岸上，那里的岩石上；城市环境，以及附带的灯柱、阳台和现代生活的碎屑。想象一下，模特的外表和动作都像真的一样。可以使用的模型来组成您自己的新场景，您可以随心所欲地控制这些场景，并以您喜欢的方式进行渲染。你可以放大以查看细节，也可以缩小以获得广泛的印象。这是一个令人印象深刻的愿景，远远超出了当前的技术诀窍。我们的计划是朝着实现这一愿景迈出重要的一步。我们将使用户能够使用视频和图像来捕捉选定类型的大规模场景，并在其中填充模型树、喷泉、街道家具等，再次仔细选择对象的类型。我们将提供识别摄像机所处环境类型的软件，以及该环境中的对象，以便自动创建3D运动模型。这将证明对我们的目标用户群体非常有用，这是英国的创意产业：电影、游戏、广播。为户外场景建模既昂贵又耗时，该行业认识到，视频和图像是制作他们可以使用的模型的极好来源。为了进一步帮助他们，我们将开发软件，利用他们目前获取现场勘测快照的做法，以便在许多细节级别使用所有数据。最后，我们将把我们的所有开发整合到一个单一的系统中，以显示对完整户外环境的获取、编辑和控制更近了一步。

项目成果

Seam-hiding for Looping Videos

循环视频的接缝隐藏

• DOI: 10.1145/3150165.3152766
• 发表时间: 2017
• 作者: Durrant J

Motion Estimation and Segmentation of Natural Phenomena

自然现象的运动估计和分割

• 发表时间: 2018
• 作者: Chen D.

My Text in Your Handwriting

• DOI: 10.1145/2886099
• 发表时间: 2016-05
• 期刊: ACM Transactions on Graphics (TOG)
• 作者: T. Haines;Oisin Mac Aodha;G. Brostow

Responsive Action-based Video Synthesis

基于动作的响应式视频合成

• DOI: 10.1145/3025453.3025880
• 发表时间: 2017
• 作者: Ilisescu C

RecurBot

递归机器人

• DOI: 10.1145/3170427.3188532
• 发表时间: 2018
• 作者: Intharah T