CAREER: New Representations of Probability Distributions to Improve Machine Learning --- A Unified Kernel Embedding Framework for Distributions

职业：改进机器学习的概率分布的新表示——统一的分布内核嵌入框架

• 批准号: 1350983
• 负责人: Haesun Park
• 金额: $ 49.97万
• 依托单位: Georgia Tech Research Corporation
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2014
• 资助国家: 美国
• 起止时间: 2014-05-15 至 2021-04-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1350983&HistoricalAwards=false
• 关键词: CAREER; New; Representations; Probability; Distributions

Computational intelligence touches our lives daily. Web searches, weather prediction, detecting financial fraud, medicine and education benefit from this ubiquitous technology. Problems in computational intelligence such as image classification and predicting properties of new materials produce copious amounts of high-dimensional, complex data. Many algorithms in computational intelligence rely on probability distributions, and such data can carry unusual distributions that challenge traditional methods of modeling. (For example, they are typically not textbook distributions such as the Gaussian.) In some applications, the data input to the algorithms are themselves probability distributions. Existing techniques are cannot both capture unusual distributions and scale to millions of data points without stalling the computation. There is a pressing need for a flexible, efficient framework for representing, learning, and reasoning about datasets arising from these problems.This project will address these challenges by developing a novel and unified framework to represent and model, learn, and use probability distributions in computational intelligence. To evaluate the utility of the new techniques, the project will test them on difficult real-world problems in computer image analysis, materials science, and flow cytometry (a biotechnology technique used for cell counting, cell sorting, and protein engineering).The project, an NSF CAREER award, will integrate the research results with several education intiatives. New curricula will be designed for both undergraduate and graduate students, with empahsis on students from under-represented groups. A new online course will be created to make the results accessible to massive online masters students. Finally, advanced high school math teachers will be engaged to design problems related to the reserach for use in a math competition for advanced high school students.This project will (1) create a novel and unified nonparametric kernel framework for distributional data and distributions with fine-grained statistical properties, and (2) develop principled and scalable algorithms for nonparametric analysis of big data. The unified kernel embedding framework will advance large scale nonparametric data analysis significantly, and play an important synergistic role in bridging together traditionally separate research areas in data analysis, including kernel methods, graphical models, optimization, nonparametric Bayesian methods, functional analysis and tensor data analysis. In addition to advances in algorithmic methods, the applications to large-scale image classification, flow cytometry, and materials property prediction have the potential for transformative impact on society.

计算智能每天都在影响我们的生活。 网络搜索、天气预报、金融欺诈检测、医疗和教育都受益于这种无处不在的技术。 计算智能中的问题，如图像分类和预测新材料的特性，产生了大量的高维复杂数据。 计算智能中的许多算法都依赖于概率分布，而这些数据可能带有不寻常的分布，这对传统的建模方法构成了挑战。 (For例如，它们通常不是教科书分布，如高斯分布。 在某些应用中，输入到算法的数据本身就是概率分布。 现有技术无法在不停止计算的情况下捕获异常分布并扩展到数百万个数据点。 有一个迫切需要一个灵活的，高效的框架来表示，学习和推理的数据集所产生的这些问题。本项目将通过开发一个新颖的和统一的框架来表示和建模，学习和使用计算智能中的概率分布来解决这些挑战。 为了评估新技术的实用性，该项目将在计算机图像分析、材料科学和流式细胞术（一种用于细胞计数、细胞分选和蛋白质工程的生物技术）等现实世界中的难题上测试它们。该项目是NSF CAREER奖，将把研究成果与几项教育计划结合起来。 新课程将为本科生和研究生设计，重点关注代表性不足的群体的学生。 一个新的在线课程将被创建，使大量的在线硕士生访问的结果。 最后，高中数学教师将参与设计与研究相关的问题，用于高中学生的数学竞赛。该项目将（1）为分布数据和具有细粒度统计特性的分布创建一个新颖且统一的非参数内核框架，（2）开发大数据非参数分析的原则性和可扩展算法。统一的核嵌入框架将大大推进大规模非参数数据分析，并在将数据分析中传统独立的研究领域（包括核方法，图形模型，优化，非参数贝叶斯方法，函数分析和张量数据分析）连接起来方面发挥重要的协同作用。除了算法方法的进步之外，大规模图像分类、流式细胞术和材料属性预测的应用也有可能对社会产生变革性的影响。