CIF: Small: Collaborative Research: Sparse and Low Rank Methods for Imbalanced and Heterogeneous Data

近年来，稀疏和低秩建模技术已经成为以非传统方式有效处理视觉数据的强大工具。这些理论的一个特别有希望的领域是视觉识别，其中对象检测和图像分类方法需要能够处理现实世界对象的高度多样化的外观。然而，现有的视觉识别方法通常仅在存在足够量的与实际测试条件良好匹配的均匀且平衡的训练数据的情况下才能成功。在实践中，当数据是异构和不平衡的，现有的方法的性能可能会比预期的要差得多。该项目将基于新的稀疏和低秩建模技术开发一个用于真实世界视觉识别的综合框架，该框架将能够处理不平衡，异构和多模态数据。不平衡数据将使用凸优化技术来处理，该技术自动将数据集划分为常见和罕见模式，并为常见模式选择一小组代表，然后将其与罕见模式组合以形成平衡数据集。异构和多模态数据将使用非凸优化技术来处理，该技术从多个域或模态中学习潜在表示。分类和聚类算法可以应用于潜在的表示。这些方法的应用包括基于图像和视频的对象识别、活动识别、视频摘要和监控。

In recent years, sparse and low-rank modeling techniques have emerged as powerful tools for efficiently processing visual data in non-traditional ways. A particular area of promise for these theories is visual recognition, where object detection and image classification approaches need to be able to deal with the highly diverse appearance of real-world objects. However, existing visual recognition methods generally succeed only in the presence of sufficient amounts of homogeneous and balanced training data that are well matched to the actual test conditions. In practice, when the data are heterogeneous and imbalanced, the performance of existing methods can be much worse than expected. This project will develop a comprehensive framework for real-world visual recognition based on novel sparse and low-rank modeling techniques, which will be able to deal with imbalanced, heterogeneous and multi-modal data. Imbalanced data will be handled using convex optimization techniques that automatically divide a dataset into common and rare patterns, and select a small set of representatives for the common patterns that are then combined with the rare patterns to form a balanced dataset. Heterogeneous and multi-modal data will be handled using non-convex optimization techniques that learn a latent representation from multiple domains or modalities. Classification and clustering algorithms can be applied to the latent representation. Applications of these methods include image and video-based object recognition, activity recognition, video summarization, and surveillance.