Collective Machine Learning for Semantic Data Interpretation

这项研究将研究集合机器学习算法，这些算法结合来自不同来源的信息，自动诱导复杂数据的语义解释器。两个新出现的趋势推动了这项研究。首先，在大数据时代，与任何特定解释问题相关的免费可用的数据源越来越多。尽管这些数据源在大小和注解覆盖范围上各不相同，但可以利用它们的联合来降低在目标解释任务中实现能力所需的注解成本。其次，机器学习的日益成功增加了人们超越学习简单分类模型的雄心，以适应跨复杂输出类别的相关语义预测器。*跨复杂输出空间执行集体学习的主要挑战在于数据源的异质性，根据所记录的不同输入特征、所捕获的不同输出注释以及所考虑的不同预测任务。为了解决这一根本挑战，本研究将开发新的表示学习算法，以发现不同数据集和不同输出目标下的共享结构。*如果成功，该研究计划将克服传统机器学习和数据分析系统的界限，并为异类数据分析提供新的工具，以满足现代大数据背景下的重大需求。此外，这项研究还将极大地提高语义数据分析系统的自主性和健壮性，同时减少甚至在某些情况下消除它们对人类指导的依赖。*拟议的研究计划具有基础和应用两个方面，预计将在这两个方面做出贡献。特别是，这项研究不仅将有助于机器学习和数据分析研究方面的新的数学和算法发展，还将扩大自动数据分析系统的适用性，使其适用于更广泛的自然语言处理、计算机视觉、生物信息学、社会和商业数据分析问题。由此产生的方法将适用于政府、行业、组织或个人收集的各类不同类型的数据，并将大大减少在开发有用的数据解释系统时对领域专门知识的依赖。

This research will investigate collective machine learning algorithms that combine information from heterogeneous sources to automatically induce semantic interpreters of complex data. Two emerging trends motivate this research. First, in the era of big data there are an increasing number of freely available data sources that are relevant to any particular interpretation problem. Although such data sources vary in size and annotation coverage, their union can be leveraged to reduce the annotation cost required to achieve competence in a target interpretation task. Second, the growing success of machine learning has increased the ambition to move beyond learning simple classification models to adapting related semantic predictors across complex output categories.******The primary challenge of performing collective learning across complex output spaces lies in the heterogeneity of data sources, in terms of the different input features recorded, different output annotations captured, and different prediction tasks considered. To address this fundamental challenge, this research will develop novel representation learning algorithms that can uncover the shared structure underlying different data sets and different output targets.******If successful, this research program will overcome the boundaries of traditional machine learning and data analysis systems, and provide new tools for heterogeneous data analysis that address a significant need in the modern context of big data. Moreover, this research will also dramatically increase the autonomy and robustness of semantic data analysis systems while reducing, and in some cases eliminating, their dependence on human guidance.******The proposed research program has both fundamental and applied aspects and is expected to contribute progress in both respects. In particular, this research will not only contribute new mathematical and algorithmic developments in machine learning and data analysis research, it will also broaden the applicability of automated data analysis systems to a wider range of natural language processing, computer vision, bioinformatics, social and commercial data analysis problems. The resulting methods will be applicable to broad classes of heterogeneous data collected by governments, industry, organizations or individuals, and will significantly reduce the dependence on domain expertise in developing useful data interpretation systems.