Collaborative Research: The Dark Energy Survey Data Management System

AST-0813534/0812790/0813575 Mohr/Jarvis/PeoplesThe Dark Energy Survey（DES）是一项中期调查，在2011-2016年期间，将使用四种独立和互补的技术来解决暗能量的性质：（1）与NSF的南极望远镜Sunyaev-Zel'dovich效应测绘实验合作进行的星系团调查，（2）宇宙剪切测量，（3）在z=1.35的红移壳层内测量星系成团的角度，（4）测量大约2000颗1a型超新星（SNe Ia）的距离。 DES将产生大约170 Tb的原始数据，处理成科学准备的图像和目录，并共同添加到更深，更高质量的图像和目录中。 总的来说，DES数据集将接近2 Pb。 这一数据量和调查时间要求有一种新型的数据管理系统，具有高度自动化和稳健性，包括综合质量保证测试。 目前的合作项目将建立DES数据管理（DESDM）系统。 DESDM已设计和测试，使用模拟数据和真实的数据从Mosaic 2相机。 该项目小组已经为荒漠化和可持续土地利用数据库的许多要素创建了工作原型，现在将把这些原型转化为荒漠化和可持续土地利用数据库系统的生产版本。 它被组织为DESDM和其他两个主题。 这两个项目是将安装在Cerro Tololo泛美天文台（CTIO）4米布兰科望远镜上的暗能量相机（DECam），以及CTIO的设施改进和整合项目（CTIOFP）。 CTIOFP由国家科学基金会国家光学天文台的一个组成部分CTIO提供支持，DECam由能源部（DoE）以及国际和机构合作伙伴提供支持。 DESDM得到NSF和项目合作伙伴的支持。DESDM项目正在与其他大型成像项目合作开发通用解决方案，并将向社区提供所有制作的软件。 学生将发挥重要作用，发展科学数据管理，高性能计算和科学分析工具开发方面的专业知识。 DESDM系统将对DES数据进行存档，通过提供的科学分析接口（将使用由伊利诺伊大学运营的NSF国家超级计算应用中心（NCSA）的高性能计算资源），使公众能够访问和科学分析（一年专有期后）。 该奖项未涵盖的项目的一个单独部分是DECam减少门户，支持DECam的非DES用户减少他们自己的数据。

AST-0813534/0812790/0813575Mohr/Jarvis/PeoplesThe Dark Energy Survey (DES) is an intermediate term survey, in the years 2011-2016, that will address the nature of dark energy using four independent and complementary techniques: (1) a galaxy cluster survey in collaboration with NSF's South Pole Telescope Sunyaev-Zel'dovich Effect mapping experiment, (2) a cosmic shear measurement, (3) a galaxy angular clustering measurement within redshift shells to z=1.35, and (4) distance measurements to approximately 2000 type 1a supernovae (SNe Ia). The DES will produce about 170Tb of raw data, processed into science-ready images and catalogs and co-added into deeper, higher quality images and catalogs. In total, the DES dataset will approach 2Pb. This data volume and the survey duration require a new type of data management system with a high degree of automation and robustness, including integrated quality assurance testing. The present collaborative project will build the DES Data Management (DESDM) system. DESDM has been designed and tested, using both simulated data and real data from the Mosaic2 camera. The project team has created working prototypes of many elements of DESDM and will now transform those prototypes into the production version of the DESDM system.DES is a complex international, multi-agency project, with far-reaching foreign and domestic impacts. It is organized into DESDM and two other themes. These are the Dark Energy Camera (DECam), to be installed at the 4-meter Blanco telescope of the Cerro Tololo Interamerican Observatory (CTIO), and the facilities improvement and integration project at the CTIO (CTIOFP). The CTIOFP is supported by CTIO, a component of NSF's National Optical Astronomy Observatory, and DECam is supported by the Department of Energy (DoE) and by international and institutional partners. DESDM is supported by NSF and also by the project partners.The DESDM project is working collaboratively with other large scale imaging projects to develop common solutions, and will be making all produced software available to the community. Students will play important role, developing expertise in aspects of scientific data management, high performance computing, and the development of science analysis tools. The DESDM system will archive the DES data, enabling public access and science analyses (after a one year proprietary period) through a provided scientific analysis interface that will use high performance computing resources at the NSF's National Center for Supercomputing Applications (NCSA), operated by the University of Illinois. A separate part of the project not covered by this award is a DECam Reduction Portal, supporting non-DES users of the DECam to reduce their own data.