Collaborative Research: The Dark Energy Survey Data Management System

暗能量调查（DES）是一项中期调查，将在2011-2016年期间进行，它将使用四种独立和互补的技术来解决暗能量的本质：(1)与NSF南极望远镜Sunyaev-Zel'dovich效应映射实验合作的星系团测量，(2)宇宙剪切测量，(3)z=1.35的红移壳内星系角星系团测量，以及(4)大约2000颗1a型超新星（SNe Ia）的距离测量。DES将产生大约170Tb的原始数据，这些数据将被处理成可供科学研究的图像和目录，并共同添加到更深层次、更高质量的图像和目录中。总的来说，DES数据集将接近2Pb。这种数据量和调查持续时间需要一种自动化程度高、鲁棒性强的新型数据管理系统，包括综合质量保证测试。目前的合作项目将建立DES数据管理系统。利用Mosaic2相机的模拟数据和真实数据，对DESDM进行了设计和测试。项目团队已经创建了DESDM许多元素的工作原型，现在将把这些原型转化为DESDM系统的生产版本。DES是一个复杂的国际、多机构项目，具有深远的国内外影响。它被组织成DESDM和另外两个主题。这是将安装在塞罗·托洛洛美洲天文台（CTIO）的4米布兰科望远镜上的暗能量相机（DECam）和CTIO （CTIOFP）的设施改进和集成项目。CTIOFP由美国国家科学基金会国家光学天文台的一个组成部分CTIO支持，DECam由美国能源部（DoE）以及国际和机构合作伙伴支持。DESDM由NSF和项目合作伙伴共同支持。DESDM项目正在与其他大型成像项目合作开发通用解决方案，并将使所有生产的软件可供社区使用。学生将在科学数据管理、高性能计算和科学分析工具开发方面发挥重要作用。DESDM系统将对DES数据进行存档，通过提供的科学分析接口（将使用由伊利诺伊大学运营的NSF国家超级计算应用中心（NCSA）的高性能计算资源），使公众能够访问和科学分析（在一年的专有期限后）。该奖项不包括项目的另一部分是DECam减少门户，支持DECam的非des用户减少自己的数据。

AST-0813534/0812790/0813575Mohr/Jarvis/PeoplesThe Dark Energy Survey (DES) is an intermediate term survey, in the years 2011-2016, that will address the nature of dark energy using four independent and complementary techniques: (1) a galaxy cluster survey in collaboration with NSF's South Pole Telescope Sunyaev-Zel'dovich Effect mapping experiment, (2) a cosmic shear measurement, (3) a galaxy angular clustering measurement within redshift shells to z=1.35, and (4) distance measurements to approximately 2000 type 1a supernovae (SNe Ia). The DES will produce about 170Tb of raw data, processed into science-ready images and catalogs and co-added into deeper, higher quality images and catalogs. In total, the DES dataset will approach 2Pb. This data volume and the survey duration require a new type of data management system with a high degree of automation and robustness, including integrated quality assurance testing. The present collaborative project will build the DES Data Management (DESDM) system. DESDM has been designed and tested, using both simulated data and real data from the Mosaic2 camera. The project team has created working prototypes of many elements of DESDM and will now transform those prototypes into the production version of the DESDM system.DES is a complex international, multi-agency project, with far-reaching foreign and domestic impacts. It is organized into DESDM and two other themes. These are the Dark Energy Camera (DECam), to be installed at the 4-meter Blanco telescope of the Cerro Tololo Interamerican Observatory (CTIO), and the facilities improvement and integration project at the CTIO (CTIOFP). The CTIOFP is supported by CTIO, a component of NSF's National Optical Astronomy Observatory, and DECam is supported by the Department of Energy (DoE) and by international and institutional partners. DESDM is supported by NSF and also by the project partners.The DESDM project is working collaboratively with other large scale imaging projects to develop common solutions, and will be making all produced software available to the community. Students will play important role, developing expertise in aspects of scientific data management, high performance computing, and the development of science analysis tools. The DESDM system will archive the DES data, enabling public access and science analyses (after a one year proprietary period) through a provided scientific analysis interface that will use high performance computing resources at the NSF's National Center for Supercomputing Applications (NCSA), operated by the University of Illinois. A separate part of the project not covered by this award is a DECam Reduction Portal, supporting non-DES users of the DECam to reduce their own data.