CRII: III: Spatio-Temporal Data Mining to Learn From Unlabeled Climate Data

全球气候变化及其潜在的社会影响已成为我们这个时代最大的挑战之一。气候科学正在经历巨大的数据增长(到2020年达到100艾字节)，但我们从这些数据中学习的能力是有限的，因为大多数现有的数据科学方法不太适合气候科学中噪声、异质、不完整和时空数据。该项目将开发新的数据挖掘方法，以增强我们从具有科学和社会重要性的大型和复杂数据集中学习的能力。具体地说，该项目将专注于传统模式挖掘的基础性进展，通过整合来自多个不确定和不完整数据集中的信息来发现连续数据中具有统计意义的模式，并将其应用于海洋学。我们提出了“时空冗余”的概念，即在多个相关数据集中发现模式，以弥补数据中目标标签的缺失。这种方法将解决大数据分析中的两大挑战，以进行科学发现。首先，随着数据的大小和复杂性的增长，错误发现的可能性显著增加。第二，缺乏实地实况核查数据，使客观核实成为一项挑战。最后，我们依靠第一原则和领域理论来约束我们的数据挖掘方法，以产生易于处理和科学一致的结果。这些方法可以推广到各种领域，其中没有基本事实数据可用，但可以访问几个信息丰富但不确定的数据集。

Global climate change and its potential societal impacts have become one of our era's greatest challenges. Climate science is experiencing tremendous data growth (~100s of exabytes by 2020), yet our ability to learn from such data is limited because most of the existing data science methods are not well-suited for the noisy, heterogeneous, incomplete, and spatio-temporal data in climate science. This project will develop novel data mining methods to enhance our ability to learn from large and complex datasets with scientific and societal importance.Specifically, this project will focus on foundational advances to traditional pattern mining by incorporating information from multiple uncertain and incomplete datasets to discover statistically significant patterns in continuous data with an application to oceanography. We propose the notion of "spatio-temporal redundancy" where patterns are discovered in multiple related datasets to offset the lack of target labels in the data. This approach will address two major challenges in Big Data analysis for scientific discovery. First, as the size and complexity of the data grow, the likelihood of false discoveries increases significantly. Second the lack of ground truth verification data makes objective validation a challenge. Finally, we rely on First Principles and domain theory to constrain our data mining approaches to produce tractable and scientifically consistent results. These methods can generalize to various domains where no ground truth data are available but one has access to several information-rich, yet uncertain datasets.