Transition of the CEDAR Database to Madrigal

CEDAR 数据库过渡到 Madrigal

• 批准号: 1025467
• 负责人: Philip Erickson
• 金额: $ 26.53万
• 依托单位: Massachusetts Institute of Technology
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2011
• 资助国家: 美国
• 起止时间: 2011-05-15 至 2015-04-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1025467&HistoricalAwards=false
• 关键词: Transition; CEDAR; Database; Madrigal

This is a 4-year project to modernize and upgrade the data infrastructure for the Coupling, Energetics and Dynamics of Atmospheric Regions (CEDAR) research program. CEDAR is a NSF supported research program that began in 1986. Initially focused on instrumentation, it soon broadened to include theory, modeling and coordinated observational campaigns. A database has been an important component of CEDAR since its inception. Since the beginning, the CEDAR Database format has been the standard for archiving and distributing data from the wide variety of instruments and models employed by the CEDAR community. Currently, the primary CEDAR data archive is housed at the National Center for Atmospheric Research, but from the start there have been two primary distribution mechanisms - that provided by NCAR and the Madrigal Database, a distributed system that is employed by all incoherent scatter radars used for CEDAR research. The result of this effort will be a merged system with Madrigal providing both data archiving and distribution. Madrigal will be extended to include the concept of one or more archiving nodes that will automatically download and archive new and modified data when it appears on any of the distributed nodes. The main new archiving node will be located at the Haystack Geospace Science Center, with off-site backup at the MIT Data Center. In addition to the archiving capability, a number of other new features will be added to Madrigal in response to user and administrator requests. The most important of these will be the replacement of the existing scaled integer data format with a modern floating point, self-describing format. This will greatly simplify adding new data types to Madrigal and will also allow Madrigal data sets to be directly accessed from a wide variety of existing standard analysis software.Community infrastructure building and service is at the heart of the proposed activity. There are numerous societal benefits to enhanced understanding of atmospheric effects and sustained, easy access to CEDAR data is vital to this research community. Madrigal is already used by the CEDAR community as an efficient and popular tool for training of undergraduates and graduate students. Madrigal is an open-source project, which means that software and developer documentation are on-line so anyone can contribute capabilities. The web services component of the system, coupled with the use of a standard scientific data format will enable anyone with internet access to participate in the analysis of CEDAR data.

这是一个为期 4 年的项目，旨在对大气区域耦合、能量和动力学 (CEDAR) 研究项目的数据基础设施进行现代化和升级。 CEDAR 是 NSF 支持的一项研究计划，始于 1986 年。最初专注于仪器仪表，但很快就扩展到包括理论、建模和协调观测活动。自 CEDAR 成立以来，数据库一直是其重要组成部分。从一开始，CEDAR 数据库格式就一直是归档和分发来自 CEDAR 社区所使用的各种仪器和模型的数据的标准。目前，主要的 CEDAR 数据档案存放在国家大气研究中心，但从一开始就有两种主要的分发机制 - 由 NCAR 和 Madrigal 数据库提供，后者是用于 CEDAR 研究的所有非相干散射雷达所采用的分布式系统。 这项工作的结果将是与 Madrigal 合并提供数据归档和分发的系统。 Madrigal 将扩展为包含一个或多个归档节点的概念，当新数据和修改后的数据出现在任何分布式节点上时，这些节点将自动下载和归档新数据和修改后的数据。主要的新归档节点将位于 Haystack 地球空间科学中心，并在麻省理工学院数据中心进行异地备份。 除了归档功能之外，为了响应用户和管理员的请求，Madrigal 中还将添加许多其他新功能。其中最重要的是用现代浮点自描述格式替换现有的缩放整数数据格式。这将大大简化向 Madrigal 添加新数据类型的过程，并且还允许从各种现有标准分析软件直接访问 Madrigal 数据集。社区基础设施建设和服务是拟议活动的核心。 加强对大气影响的了解可以带来许多社会效益，而持续、轻松地获取 CEDAR 数据对于这个研究界至关重要。 Madrigal 已被 CEDAR 社区用作培训本科生和研究生的高效且流行的工具。 Madrigal 是一个开源项目，这意味着软件和开发人员文档都是在线的，因此任何人都可以贡献功能。该系统的网络服务组件，再加上标准科学数据格式的使用，将使任何能够访问互联网的人都能够参与 CEDAR 数据的分析。