CAREER: Scalable Machine Learning for Astrostatistics

职业：天文统计学的可扩展机器学习

• 批准号: 0845865
• 负责人: Alexander Gray
• 金额: $ 59万
• 依托单位: Georgia Tech Research Corporation
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-07-01 至 2014-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0845865&HistoricalAwards=false
• 关键词: CAREER; Scalable; Machine; Learning; Astrostatistics

This award is funded under the American Recovery and Reinvestment Act of 2009 (Public Law 111-5).This project is designing new data structures and efficient algorithms for scaling modern machine learning techniques to massive datasets, and their application to recent sky surveys to solve central problems in astronomy. The long term goal is to scale up all the best machine learning techniques, by focusing on key computational primitives, and by creating the educational initiatives to allow future generations to do the same.In the shorter term, the project is accelerating the singular value decomposition (SVD), the key computational bottleneck in a number of state-of-the-art methods in machine learning (and well beyond). In addition to the classic principal component analysis, we consider the application of our ideas to kernel ridge regression, graphical model inference, and maximum variance unfolding, each representing a larger class (kernelized, graphical, and convex models). Working with leading astrophysicist collaborators, we validate each of these in a fundamental astronomical data analysis problem: respectively, estimation of the distances to objects, cross-matching of objects in different catalogs, and discovery of new types of objects. The key insight is the use of a new data structure called a cosine tree, which partitions vectors based on their mutual orthogonality, using analogies of successful ideas for distance-based geometric problems to enable a new Monte Carlo sampling technique. Preliminary results demonstrate as much as 20,000 times speedup over exact SVD in moderate-sized problems with user-specifiable high approximation accuracy.The broader impact of the work is the transformative ability to utilize the advanced data analysis techniques to unlock the potential insights across science, engineering, and business lying within the tera- and peta-scale datasets of the present and future. Apropos these goals, the project educational goals are deep integration of real-world data analysis, and cross-disciplinary thinking into traditional computing programs.

该奖项是根据2009年美国复苏和再投资法案（公法111-5）资助的。该项目旨在设计新的数据结构和高效算法，将现代机器学习技术扩展到大规模数据集，并将其应用于最近的天空调查，以解决天文学中的核心问题。长期目标是通过专注于关键的计算原语，并通过创建教育计划让后代也能这样做，来扩展所有最好的机器学习技术。从短期来看，该项目正在加速奇异值分解（SVD），这是机器学习中许多最先进方法（以及其他领域）的关键计算瓶颈。除了经典的主成分分析，我们还考虑将我们的想法应用于核脊回归、图形模型推理和最大方差展开，每个都代表一个更大的类（核化、图形化和凸模型）。与顶尖的天体物理学家合作，我们在一个基本的天文数据分析问题中验证了这些：分别是物体距离的估计，不同目录中物体的交叉匹配，以及新类型物体的发现。关键的洞察力是使用了一种叫做余弦树的新数据结构，它根据向量的相互正交性来划分向量，使用类似于基于距离的几何问题的成功思想来实现新的蒙特卡罗采样技术。初步结果表明，在用户指定的高近似精度的中等规模的问题中，与精确SVD相比，加速高达20,000倍。这项工作的更广泛的影响是利用先进的数据分析技术，在现在和未来的万亿级和千万亿级数据集中，解锁科学、工程和商业领域的潜在见解的变革性能力。针对这些目标，该项目的教育目标是将现实世界的数据分析和跨学科的思考深度集成到传统的计算程序中。