Lagrangian-Convolutional Networks for Video Classification

用于视频分类的拉格朗日卷积网络

• 批准号: 434160640
• 负责人: Professor Dr.-Ing. Thomas Sikora
• 金额: --
• 依托单位: Fachgebiet Nachrichtenübertragung
• 依托单位国家: 德国
• 项目类别: Research Grants
• 财政年份: 2019
• 资助国家: 德国
• 起止时间: 2018-12-31 至 2021-12-31
• 项目状态: 已结题
• 来源: https://gepris.dfg.de/gepris/projekt/434160640?language=en
• 关键词: Lagrangian; Convolutional; Networks; Video; Classification

The amount of video data has rapidly increased throughout the last decades. This development rises the demand for effective methods to analyse video data beyond a single frame image-based analysis. Specifically the detection quantification and classification of dynamic motion information is a crucial aspect for processing time-dependent video data which yet needs to be fully exploited. With this project we request funding to develop a novel system for analysis and classification of video data based on a Lagrangian methodology. With our preliminary work we highlighted the innovative potential for video processing using such methods in combination with recent machine learning approaches. With this project we like to evolve and substantiate this approach and aim to develop a novel concept for video-level description and classification: the Lagrangian- Convolutional Neural Network (LaCNN). This concept takes advantage of recent in-depth understanding of motion signatures in a video sequence and exploits the capabilities of the Lagrangian methodology and the encoded motion information more effectively. In summary this novel concept will lead to a competitive effective and more transparent video classification system in comparison to existing state of the art methods.

在过去的几十年里，视频数据的数量迅速增加。这一发展增加了对有效的视频数据分析方法的需求，而不仅仅是基于单帧图像的分析。具体来说，动态运动信息的检测、量化和分类是处理时变视频数据的一个重要方面，目前还有待充分开发。在这个项目中，我们请求资助开发一个基于拉格朗日方法的视频数据分析和分类的新系统。通过我们的初步工作，我们强调了使用这些方法结合最近的机器学习方法进行视频处理的创新潜力。在这个项目中，我们希望发展和证实这种方法，并旨在为视频级描述和分类开发一个新的概念：拉格朗日-卷积神经网络（LaCNN）。这个概念利用了最近对视频序列中运动特征的深入理解，并更有效地利用了拉格朗日方法和编码运动信息的能力。总之，与现有的最先进的方法相比，这一新颖的概念将导致一个具有竞争力的、有效的和更透明的视频分类系统。