CIF21 DIBBs: STORM: Spatio-Temporal Online Reasoning and Management of Large Data

许多研究项目面临的一个根本挑战是处理大量异构数据的能力。从不同来源和时间段收集的数据可能不一致，或以不同的格式和数据管理系统存储。因此，许多项目中的关键步骤是开发定制的查询和分析引擎来翻译输入。 但是对于每个新的数据集，或者对于现有数据集的每个新的查询类型或分析任务，必须开发新的查询接口或程序，这需要大量的时间和精力投入。 该项目将开发一个自动引擎，用于搜索天气和气象学的大型异构数据集，特别是来自美国西部的仪器，在一个名为MesoWest的区域网络中。本项目开发了一个针对大型异构时空数据的自动查询和分析引擎。此功能允许用户在具有空间和时间维度的大型异构数据上自动部署查询和分析引擎实例。 该系统支持一个简单的搜索框和类似地图的查询界面，允许许多强大的分析查询。 技术，使这些查询强大的，相关的，高度可扩展性将被开发。 该项目还使用户能够同时无缝地对多个数据源执行查询。这项工作的目标是极大地简化不同机构、团体和公司的大型时空数据的管理和分析。

A fundamental challenge for many research projects is the ability to handle large quantities of heterogeneous data. Data collected from different sources and time periods can be inconsistent, or stored in different formats and data management systems. Thus, a critical step in many projects is to develop a customized query and analytical engine to translate inputs. But for each new dataset, or for each new query type or analytic task for an existing dataset, a new query interface or program must be developed, requiring significant investments of time and effort. This project will develop an automatic engine for searching large, heterogeneous data collections for weather and meteorology, particularly from instruments in the western US, in a regional network called MesoWest. This project develops an automatic query and analytical engine for large, heterogeneous spatial and temporal data. This capability allows users to automatically deploy a query and analytical engine instance over their large, heterogeneous data with spatial and temporal dimensions. The system supports a simple search-box and map-like query interface that allows numerous powerful analytical queries. Techniques to make these queries robust, relevant, and highly scalable will be developed. The project also enables users to execute queries over multiple data sources simultaneously and seamlessly. The goal of the work is to dramatically simplify the management and analysis of large spatio-temporal data at different institutions, groups, and corporations.