Large-Scale Machine Learning: Sparse Representations for Signal/Image Processing and System Modeling

大规模机器学习：信号/图像处理和系统建模的稀疏表示

• 批准号: 8131-2012
• 负责人: Pawlak, Mirek
• 金额: $ 3.06万
• 依托单位: University of Manitoba
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2012
• 资助国家: 加拿大
• 起止时间: 2012-01-01 至 2013-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=513312
• 关键词: Large; Scale; Machine; Learning; Sparse

Rapid advances in computer based technologies such as energy grid networks, web services, bioinformatics, and sensor networks, create a great demand for new pattern recognition/machine learning algorithms able to cope with massive data sets, multiple hypothesis, and data of high dimensionality. This defines the field referred to as large-scale machine learning. In this proposal, I wish to extend my current research on nonparametric/semiparametric learning methods to large-scale machine learning problems. This challenge includes not only the development of new mathematical techniques, but also to verify them in the framework of signal/image processing and system modeling tasks. Testing of the proposed methods in concrete applications within the areas of power engineering, microscopic imaging and multiple change-point detection for biological and network signals is also planned. Our research proposal relies on the idea of blending the modern nonparametric/semiparametric learning methodology with the concept of sparse representations of a given process. The sparsity is roughly defined as a solution to the examined problem based on the representation using a small number of dominating terms. The key is to discover a sparse (low-dimensional) representation and its form in a given setting. Thus far, sparse learning algorithms have mostly focused on parametric (finite dimensional) linear models, where an observed data point is expressed as a linear combination of a small number of vectors of the representation matrix (dictionary). In this proposal we aim at developing a class of nonparametric and semiparametric learning algorithms that utilize the inherent sparsity of a given object. Hence, we wish to go beyond the thus far used linear and finite dimensional sparsity models and apply these findings to problems stemming from multidimensional systems, computational symmetry and multiple change-point detection problems. We believe that the proposed sparse object representation methodology can substantially enlarge a scope of machine learning applications and improve the existing algorithms within the context of proposed case studies.

基于计算机的技术的快速发展，例如能源网格网络、Web服务、生物信息学和传感器网络，产生了对能够科普海量数据集、多假设和高维数据的新模式识别/机器学习算法的巨大需求。这定义了被称为大规模机器学习的领域。在这个提案中，我希望将我目前对非参数/半参数学习方法的研究扩展到大规模机器学习问题。这一挑战不仅包括新的数学技术的发展，而且要在信号/图像处理和系统建模任务的框架中验证它们。还计划在电力工程、显微成像和生物和网络信号的多个变点检测领域内的具体应用中测试所提出的方法。我们的研究建议依赖于现代非参数/半参数学习方法与给定过程的稀疏表示概念相结合的想法。稀疏性被粗略地定义为基于使用少量主导项的表示的所研究问题的解决方案。关键是发现稀疏（低维）表示及其在给定设置中的形式。到目前为止，稀疏学习算法主要集中在参数（有限维）线性模型上，其中观察到的数据点表示为表示矩阵（字典）的少量向量的线性组合。在这个建议中，我们的目标是开发一类非参数和半参数的学习算法，利用一个给定的对象的固有稀疏性。因此，我们希望超越迄今为止使用的线性和有限维稀疏模型，并将这些发现应用于多维系统，计算对称性和多个变点检测问题。我们相信，所提出的稀疏对象表示方法可以大大扩大机器学习应用的范围，并在所提出的案例研究的背景下改进现有的算法。