SDCI: Data/NMI New/Improvement - Semantic Provenance Capture in Data Ingest Systems (SPCDIS)

SDCI：数据/NMI 新增/改进 - 数据摄取系统中的语义来源捕获 (SPCDIS)

• 批准号: 0968277
• 负责人: Peter Fox
• 金额: $ 56.56万
• 依托单位: Rensselaer Polytechnic Institute
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-04-21 至 2012-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0968277&HistoricalAwards=false
• 关键词: SDCI; Data; NMI; New; Improvement

Semantic Provenance Capture in Data Ingest Systems (SPCDIS)In analyzing the needs of instrument data providers, several challenges areclear:- Data is coming in faster, in greater volumes and outstripping our ability to perform adequate quality control.- Data is being used in new ways and we frequently do not have sufficient information on what happened to the data along the processing stages to determine if it is suitable for a use we did not envision.- We often fail to capture, represent and propagate manually generated information that need to go with the data flows.- Each time we develop a new instrument, we develop a new data ingest procedure and collect different metadata and organize it differently. It is then hard to use with previous projects.- The task of event determination and feature classification is onerous and we don't do it until after we get the data.These statements point to the lack of a comprehensive, re-useable data ingest framework that consists of a semantically rich set of annotations along the data ingest workflow and a smart storage, propagation and retrieval mechanism for the provenance and derivation information. For the purpose of this project, provenance is defined as: the origin or source from which something comes, its intention for use, who/what is was generated for, its manner, sense of place, and time of manufacture, production or discovery, history of subsequent owners, and documented in detail sufficient to allow reproducibility. Thus, the goal of this project is to provide an extensible representation for provenance for data ingest systems. Initially, we limit our focus to the set of solar coronal physics instruments operated at the Mauna Loa Solar Observatory in Hawaii by the High Altitude Observatory, National Center for Atmospheric Research. Over time, we will target the broader area of solar and solar-terrestrial physics, including the proposed Coronal Solar Magnetism Observatory. This project leverages innovative work with the Inference Web explanation framework which provides a set of tools for generating, validating, manipulating, summarizing, and presenting knowledge provenance. In addition we will utilize its Interlingua for provenance, justification, and trust representation - PML - the Proof Markup Language.Two important concepts to be captured are the data quality and nature of the processing stages that the data has passed through. Both qualitative and quantitative encodings of data quality are very important to a scientist determining if the data of interest are useful, applicable or accurate enough for the intended use.The provenance work will have broad applicibility since it will include domain-independent portions geared for any data ingest system as well as a domain-literate module aimed at solar and solar-terrestrial physics. This project is expected to generate a science-driven extension to PML that will provide representational primitives required for scientific provenance. The project will also contribute to community standards by adding meta data to ontologies developed in related projects with a wide degree of applicability to similar community and government programs.

在分析仪器数据提供商的需求时，有几个挑战是明确的：-数据进来的速度更快，数量更大，超出了我们执行适当质量控制的能力。数据正在以新的方式被使用，我们经常没有足够的信息来了解数据在处理阶段沿着发生了什么，以确定它是否适合我们没有想到的用途。我们经常无法捕获，表示和传播需要与数据流一起使用的手动生成的信息。每次我们开发一个新的仪器，我们都会开发一个新的数据摄取程序，收集不同的元数据，并以不同的方式组织它。因此，很难与以前的项目一起使用。事件确定和特征分类的任务是繁重的，并且我们直到获得数据之后才做。这些陈述指出缺乏全面的、可重用的数据摄取框架，该框架由沿着数据摄取工作流的语义丰富的注释集沿着以及用于起源和派生信息的智能存储、传播和检索机制组成。出于本项目的目的，出处被定义为：某物的起源或来源、其使用意图、为谁/什么而产生、其方式、地点感、制造、生产或发现的时间、历史后续所有者，并详细记录足以允许再现性。因此，这个项目的目标是提供一个可扩展的表示数据摄取系统的起源。 最初，我们将我们的重点限制在太阳日冕物理仪器在莫纳罗亚太阳天文台在夏威夷的高海拔天文台，国家大气研究中心。 随着时间的推移，我们将瞄准更广泛的太阳和日地物理学领域，包括拟议的日冕太阳磁力观测站。该项目利用推理Web解释框架的创新工作，该框架提供了一套用于生成，验证，操作，总结和呈现知识出处的工具。此外，我们将利用其中间语言的出处，理由，和信任表示- PML -证明标记语言。两个重要的概念是要捕捉的数据质量和数据已经通过的处理阶段的性质。数据质量的定性和定量编码对于科学家确定感兴趣的数据是否有用、适用或足够准确以用于预期用途非常重要。来源工作将具有广泛的适用性，因为它将包括面向任何数据摄取系统的独立于领域的部分，以及针对太阳和日地物理学的领域识字模块。该项目预计将产生一个科学驱动的扩展到PML，将提供科学出处所需的代表性原语。该项目还将通过将Meta数据添加到相关项目中开发的本体中来为社区标准做出贡献，这些本体具有广泛的适用性，可用于类似的社区和政府计划。