Transition of the CEDAR Database to Madrigal

这是一个为期4年的项目，以现代化和升级的数据基础设施的耦合，能量学和动力学的大气区域（CEDAR）研究计划。CEDAR是NSF支持的研究计划，始于1986年。最初专注于仪器，它很快扩大到包括理论，建模和协调的观测活动。数据库自成立以来一直是CEDAR的重要组成部分。从一开始，CEDAR数据库格式就一直是CEDAR社区使用的各种仪器和模型的存档和分发数据的标准。目前，CEDAR的主要数据存档存放在国家大气研究中心，但从一开始就有两个主要的分发机制-由NCAR和牧歌数据库提供，牧歌数据库是一个分布式系统，用于CEDAR研究的所有非相干散射雷达。 这一努力的结果将是一个与牧歌合并的系统，提供数据存档和分发。Madrigal将被扩展为包括一个或多个归档节点的概念，当新的和修改的数据出现在任何分布式节点上时，这些节点将自动下载和归档。新的主要存档节点将位于Haystack地球空间科学中心，并在麻省理工学院数据中心进行异地备份。 除了存档功能外，还将为Madrigal添加一些其他新功能，以响应用户和管理员的请求。其中最重要的将是用现代浮点自描述格式取代现有的缩放整数数据格式。这将大大简化向Madrigal添加新数据类型的工作，还将允许从各种现有的标准分析软件直接访问Madrigal数据集。社区基础设施建设和服务是拟议活动的核心。 加强对大气影响的理解有许多社会效益，持续、方便地获取CEDAR数据对这一研究界至关重要。牧歌已经被CEDAR社区用作本科生和研究生培训的有效和流行的工具。Madrigal是一个开源项目，这意味着软件和开发人员文档都是在线的，因此任何人都可以贡献功能。该系统的网络服务部分，加上标准科学数据格式的使用，将使任何人都能够通过互联网访问参与CEDAR数据的分析。

This is a 4-year project to modernize and upgrade the data infrastructure for the Coupling, Energetics and Dynamics of Atmospheric Regions (CEDAR) research program. CEDAR is a NSF supported research program that began in 1986. Initially focused on instrumentation, it soon broadened to include theory, modeling and coordinated observational campaigns. A database has been an important component of CEDAR since its inception. Since the beginning, the CEDAR Database format has been the standard for archiving and distributing data from the wide variety of instruments and models employed by the CEDAR community. Currently, the primary CEDAR data archive is housed at the National Center for Atmospheric Research, but from the start there have been two primary distribution mechanisms - that provided by NCAR and the Madrigal Database, a distributed system that is employed by all incoherent scatter radars used for CEDAR research. The result of this effort will be a merged system with Madrigal providing both data archiving and distribution. Madrigal will be extended to include the concept of one or more archiving nodes that will automatically download and archive new and modified data when it appears on any of the distributed nodes. The main new archiving node will be located at the Haystack Geospace Science Center, with off-site backup at the MIT Data Center. In addition to the archiving capability, a number of other new features will be added to Madrigal in response to user and administrator requests. The most important of these will be the replacement of the existing scaled integer data format with a modern floating point, self-describing format. This will greatly simplify adding new data types to Madrigal and will also allow Madrigal data sets to be directly accessed from a wide variety of existing standard analysis software.Community infrastructure building and service is at the heart of the proposed activity. There are numerous societal benefits to enhanced understanding of atmospheric effects and sustained, easy access to CEDAR data is vital to this research community. Madrigal is already used by the CEDAR community as an efficient and popular tool for training of undergraduates and graduate students. Madrigal is an open-source project, which means that software and developer documentation are on-line so anyone can contribute capabilities. The web services component of the system, coupled with the use of a standard scientific data format will enable anyone with internet access to participate in the analysis of CEDAR data.