CIF: CAREER: Robust, Interpretable, and Efficient Unsupervised Learning with K-set Clustering

现代机器学习技术旨在设计模型和算法，使计算机能够从大量以前未开发的数据中有效地学习。这些问题被称为“无监督”，因为没有人类提供的关于数据的信息来指导机器学习过程。可以说，两个最重要的无监督机器学习工具是降维和聚类。在降维方面，该算法寻求一种简单的低维结构，以捕获数据中有趣的行为。在聚类中，算法寻求将数据点分组到有意义的聚类中。随着越来越多的高维数据被收集到越来越复杂的物理、生物和社会现象中，旨在降维和聚类的算法通常是非常适用的。然而，文献中的联合公式通常是临时的，并且从根本上无法操作具有缺失元素，腐败和异质性的真实数据-现代数据问题的关键机器学习挑战。该研究项目有望在数据科学中具有广泛的适用性，并将在遗传学和计算机视觉两个应用中得到证明。本项目中使用的联合聚类和降维公式称为K集聚类，它寻求K个“中心集”，这些“中心集”被约束为具有一些低维表示，每个中心集代表数据中K个聚类中的一个。该公式是k -均值、k -子空间和主成分分析的推广，它自然会导致几个新的问题实例。给定一个已定义的几何集合，从两个角度来处理相应的问题实例：理解问题公式化实例的几何形状，以及从数据中学习这些几何模型。我们将研究问题表述的三个具体例子：子空间聚类、品种聚类和多面体集聚类。虽然每个例子都提出了内在和独特的挑战，但这些只是一个更大的范例的例子，该范例仅受限于定义适合于对数据中的几何结构建模的集合的能力。该公式支持可解释的数据分析，并使用可以轻松合并缺失数据和异构数据的框架。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Modern machine learning techniques aim to design models and algorithms that allow computers to learn efficiently from vast amounts of previously unexplored data. These problems are called 'unsupervised' because no human-provided information about the data is available to guide the machine learning process. Arguably the two most important unsupervised machine learning tools are dimensionality-reduction and clustering. In dimensionality-reduction, the algorithm seeks a simple low-dimensional structure that captures the interesting behavior in the data. In clustering, the algorithm seeks to group data points together into meaningful clusters. As increasingly higher-dimensional data are collected about progressively more elaborate physical, biological, and social phenomena, algorithms that aim at both dimensionality reduction and clustering are often highly applicable. However, joint formulations in the literature are often ad-hoc and fundamentally unable to operate on real data that have missing elements, corruptions, and heterogeneity --- critical machine learning challenges for modern data problems. This research project is expected to have broad applicability in data science, and will be demonstrated in two applications: genetics and computer vision. The joint clustering and dimensionality reduction formulation used in this project, called K-set clustering, seeks K "central sets" constrained to have some low-dimensional representation, each of which represents one of K clusters in the data. The formulation is a generalization of K-means, K-subspaces, and principal component analysis, and it naturally leads to several novel problem instances. Given a defined set geometry, the corresponding problem instance is approached from two perspectives: understanding the geometry of that instance of the problem formulation, and learning those geometric models from data. Three specific examples of the problem formulation will be studied: subspace clustering, variety clustering, and polyhedral set clustering. While each example presents intrinsic and unique challenges, these are just examples of a larger paradigm that is limited only by one's ability to define sets amenable to modeling the geometric structure in data. The formulation allows for interpretable data analysis, with a framework that can readily incorporate missing data and heterogeneous data.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.