EAGER: A Local-Global Approach Towards Omnipresent Vision

EAGER：实现无所不在的愿景的本地-全球方法

• 批准号: 1353235
• 负责人: Ko Nishino
• 金额: $ 18.44万
• 依托单位: Drexel University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2013
• 资助国家: 美国
• 起止时间: 2013-09-15 至 2016-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1353235&HistoricalAwards=false
• 关键词: EAGER; Local; Global; Approach; Towards

This project constructs an Omnipresent Vision system - a computational system that allows us to navigate, share, enhance, and understand the visual data captured by a slew of fixed and moving cameras. The society is flooded with various cameras. Almost every cell phone has a video camera and wearable cameras are starting to permeate our lives. These local cameras capture visual experiences from personal perspectives. Static cameras at various outdoor and indoor locations are also constantly capturing videos. These fixed-view cameras offer global, persistent looks into our daily lives. The key idea of this project is to fully leverage the combination of these local and global cameras to enable new visual experiences and facilitate the understanding of the scene and the people within. This is achieved with novel algorithms and computational tools that bring together the local and global views into an integrated platform, model the dynamic scene by joining those two sets of perspectives, and recognize the actions and events in them. The research, at a personal level, enables the spatio-temporal and contextual expansion of the person's view, and at a scene level, it enables the interpretation of the scene at various scales of spatial and temporal resolutions. It also provides new means to understand people and scenes. For instance, it facilitates the understanding of people who cannot communicate their intentions. The research activities also furnish graduate and undergraduate students educational opportunities to take part in spawning this new area of research.

该项目构建了一个全方位视觉系统-一个计算系统，允许我们导航，共享，增强和理解由一系列固定和移动摄像机捕获的视觉数据。社会上充斥着各种各样的相机。几乎每部手机都有摄像头，可穿戴摄像头开始渗透到我们的生活中。这些本地相机从个人视角捕捉视觉体验。各种室外和室内位置的静态摄像机也在不断地捕捉视频。这些固定视角的摄像机为我们的日常生活提供了全球性的、持久的视角。该项目的核心理念是充分利用这些本地和全球相机的组合，以实现新的视觉体验，并促进对场景和人的理解。这是通过新颖的算法和计算工具来实现的，这些算法和计算工具将局部和全局视图整合到一个集成平台中，通过连接这两组视角来对动态场景进行建模，并识别其中的动作和事件。研究，在个人层面上，使人的观点的时空和上下文的扩展，并在现场水平，它使现场的解释在各种尺度的空间和时间分辨率。它还提供了了解人和场景的新手段。例如，它有助于理解那些无法表达自己意图的人。研究活动还为研究生和本科生提供教育机会，参与催生这一新的研究领域。