EarthCube Building Blocks: Collaborative Proposal: Cloud-Hosted Real-time Data Services for the Geosciences (CHORDS)

实时科学数据的重要性与日俱增，特别是在任务关键情况下，必须迅速做出明智的决定。此外，实时数据分布的进步导致了许多新的时空瞬变现象被观测到。然而，目前在许多情况下，实时决策是不可行的，这些情况需要流动的科学数据与复杂的模型相结合。虽然EarthCube将为传播数据源提供一个前所未有的框架，但实时数据的使用带来了一系列必须考虑的额外复杂挑战。该项目是一个试点项目，旨在展示围绕实时数据收集和使用协调地球科学的重要性。这项工作将展示一种云托管的地球科学实时数据服务(CHIODS)CHICODS背后的愿景是提供一种实时数据管理基础设施，该基础设施将：a)提供一个通过互联网存档、导航和分发实时数据流的系统；b)易于部署和配置；c)在云基础设施上运行；d)使用基于RESTful协议的事务(即通过URL)；e)采用符合标准的数据和元数据格式，从而简化用户体验；F)免费和开源。例如，从观察平台数据中获得的科学是在部署之前多年规划的结果，部署本身花费了数百万美元，希望获得所需的数据集。许多地球科学实验往往受到资源的限制。在这种情况下，至关重要的是保证资源的最佳分配，以确保重要事件不会被忽视。在地球科学领域，在实地活动之后分析数据，只有在已经太晚的时候才发现传感器故障、校准偏差或异常行为，这种情况并不少见。实时数据将通过自动检测故障和异常来实现受限实验资源的最佳分配。CHODS将提供一个框架，以实现各种实时地球科学数据源的自适应采样、发现和融合，从而促进开展地球科学实验的一种新手段。用例将通过展示传统实验由于无法访问实时数据而错过感兴趣的事件来说明这一点。专注于定义需求、设计和规范的初始工作。开始将一小部分地球科学数据流吸收到云中构建的原型和弦结构中。参与一些活动，加强将通过和弦接收的实时数据集成到其他正在开发的EarthCube构建块系统中。它们将侧重于在水文传感器数据、雷达数据流、NCAR低层大气观测设施以及与地球和海洋社区的接触方面的一些初步测试案例。

The importance of real-time scientific data is ever increasing, particularly in mission critical scenarios, where informed decisions must be made rapidly. Furthermore, advances in the distribution of real-time data are leading many new transient phenomena in space-time to be observed. Presently however, realtime decision-making is infeasible in many cases that require streaming scientific data to be coupled with complex models. While EarthCube will provide an unprecedented framework for disseminating data sources, the use of real-time data raises an additional set of complex challenges that must be considered. This project is a pilot to demonstrate the importance of coodinating the geosciences around their real-time data gathering and use. The work will demonstrate a Cloud-Hosted Real-time Data Services for the Geosciences (CHORDS)The vision behind CHORDS is to provide a real-time data management infrastructure that will: a)Provide a system to archive, navigate and distribute real-time data streams via the Internet; b)Be easily deployed and configured; c)Run on cloud infrastructure; d)Use transactions built on RESTful protocols (i.e. via URLs); e)Employ data and metadata formats that adhere to standards, which simplify the user experience; f)Be free and open source.Science derived from observing platform data is the result of years of planning before a deployment, for example, and millions of dollars are spent on the deployment itself in hopes of obtaining the desired dataset. Many geo-scientific experiments are often resource constrained. In such cases it is vital to guarantee the optimal allocation of resources to ensure that important events do not go unobserved. In geo-scientific domains it is not uncommon to analyze data after a field campaigns, only to detect sensor faults, calibration offsets or anomalous behaviors when it is already too late. Real-time data will enable the optimal allocation of constrained experimental resources by automating the detection of faults and anomalies. CHORDS will provide a framework to enable adaptive sampling, discovery and fusion of various real-time geoscientific data sources, thus facilitating a new means by which geoscience experiments are carried out. The use cases will illustrate this by showing traditional experiments would have missed events of interest due to lack of access to real-time data. Focus on the initial work of defining requirements, design and specifications. Begin to ingest a small subset of geosciences data streams into a prototype CHORDS structure built in the cloud. Participate in activities that strengthen the integration of real-time data being ingested via CHORDS into other EarthCube Building Block systems that are under development. They will focus on some initial test cases, in hydrology sensor data, radar data streams, the NCAR Lower Atmosphere Observing Facilities, and outreach to earth and oceans communities.