III: Small: Persistent Data Summaries: Temporal Analytics on Big Data Histories

越来越多的应用程序需要存储和访问所有历史数据，以支持丰富的分析、学习和挖掘操作。该项目开发了一系列汇总数据的方法，以便不仅可以按照标准针对整个数据集进行查询，而且可以针对任何历史时间的数据集的状态进行查询。这些摘要与大型时态数据库集成，在离线批处理和在线流应用场景中都是如此。这些方法的有效性将在一个巨大的科学数据库上得到验证，该数据库收集了40,000多个气象站20年来的大气数据。我们将与行业合作伙伴合作，帮助部署我们的新算法，结果将整合到围绕数据科学倡议增长的教育和推广工作中。更具体地说，该项目扩展并结合了近似查询处理和时态大数据。特别是，该项目不使用(或在其上)使用多版本数据库，而是设计并实现了持久数据摘要(PDS)，该PDS提供交互式时态分析，并为其近似质量提供强有力的理论保证。除了将这些模型正式化外，该项目还为基于采样的摘要、数据草图和支持高级分析查询的核心集开发了实用的PDS实施。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

An increasing number of applications require the storage of and access to all historical data to support rich analytics, learning, and mining operations. This project develops a series of methods to summarize data so that it can be queried with respect to not just the full data set, as is standard, but with respect to the state of the data set at any historical time. These summaries integrate with large temporal databases, in both offline batched-processing and online streaming application scenarios. The effectiveness of these methods will be demonstrated on an enormous scientific database of atmospheric data collected for 20 years from over 40,000 weather stations. We will work with industry collaborators to help deploy our new algorithms, and the results will be integrated into education and outreach efforts surrounding the growth of data science initiatives. More specifically, this project extends and combines approximate query processing with temporal big data. In particular, instead of (or on top of) using a multi-version database, this project designs and implements persistent data summaries (PDSs) that offer interactive temporal analytics with strong theoretical guarantees on their approximation quality. In additional to formalizing these models, this project develops practical PDS implementations for sampling-based summaries, data sketches, and core sets that support advanced analytical queries.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.