Data commons for 'omic, microscopy and analysis core facilities

产品说明：我们提出了一个“数据共享空间”，为七个核心设施提供数据存储，这些设施为杜克大学的生物医学研究人员及其全球合作者生成或分析大型复杂数据集。由于数据存储需求已经达到数百TB，核心设施继续采用新技术，这将进一步增加数据流量，这对数据保留和分析构成了迫在眉睫的挑战。我们的提案旨在将这些过剩的数据从挑战转变为生命科学研究人员的力量。使用NIH SIG资助购买的设备将使用磁盘阵列（约450 TB可用）和磁带库（初始未压缩数据容量为1 PB）的混合，以创建可扩展的数据存储资源，并具有保护和保存数据以及有效管理数据的功能。磁盘阵列将被配置为向现有的计算服务器提供数据，供研究人员或杜克“组学分析核心设施”的工作人员进行分析，该设施创建于2012年，为不熟悉使用基因组数据集的研究人员提供支持。磁盘阵列和磁带库将在Quantum“Stornext”文件系统中以协调的方式运行，数据管理策略和系统使用数据收集将允许对系统性能和经济性进行细粒度优化。量子系统已被广泛部署在数据密集型行业和研究中，包括基因组科学。从一开始，核心设施就将使用这些设备来加强其整合。杜克快速数据存储库的数据来源和管理功能-自2006年以来由蛋白质组学和微阵列核心设施使用-将被附加到拟议的存储设备，以便服务可以扩展到包括序列数据，RNAi筛选数据，显微镜图像和分析核心的结果。因此，所提出的数据共享区将以允许在受保护的存储框架内进行高效的并且在许多情况下自动的数据移交的方式运行。这种集成消除了数据集成的后勤障碍，减少了意外（或恶意）数据损坏的机会，并提高了大型研究项目的自动化范围。存储将通过核心连接到数据生产设备和由组学分析核心运行的计算服务器，并连接到高性能分析集群上的存储。所有信息技术资产，包括拟议的设备，都由专业的信息技术人员管理，他们在基因组科学大规模研究所需的基础设施方面具有特别的优势。虽然数据管理效率的提高将是一个直接的好处，但该项目更重要的目标是使研究人员能够加快使用综合和复杂的数据来探索人类健康和疾病的复杂性。

DESCRIPTION: We propose a "data commons" to provide data storage for seven core facilities that produce or analyze large and complex datasets for biomedical researchers at Duke University and their collaborators worldwide. With data storage requirements already counting in hundreds of terabytes the core facilities continue to adopt new technologies that will further increase the flows of data by orders of magnitude, a looming challenge for data retention and analysis. Our proposal seeks to turn this excess of data from a challenge to strength for life sciences researchers. Equipment purchased with the NIH SIG grant will use a mixture of disc arrays (~450 usable terabytes) and tape library with initial uncompressed data capacity of 1 petabyte to create a scalable data storage resource with features that protect and preserve data and manage data efficiently. Disc arrays will be configured to serve up data to existing computational servers for analysis either by researchers or by staff in Duke's "Omics Analysis Core Facility," which was created in 2012 to provide support to researchers unfamiliar with using genomic data sets. The disc arrays and tape library will function in a coordinated fashion in a Quantum "Stornext" file system, and data management policies and system usage data collection will allow for fine-grained optimization of system performance and economy. The Quantum systems have been widely deployed in data-intensive industry and research, including in the genome sciences. From the outset, the core facilities will use the equipment to enhance their integration. Data provenance and management features of the Duke's Express Data Repository - used by the proteomics and microarray core facilities since 2006 - will be attached to the proposed storage equipment so that services can be expanded to include sequence data, RNAi screening data, microscopy images, and results from the analysis core. Thus, the proposed data commons will function in a manner allowing for efficient and, in many cases, automatic data hand-offs within a protected storage framework. This integration removes logistical impediments for data integration, reduces chances for accidental (or malicious) data corruption, and enhances the scope of automation for large-scale research projects. The storage will be connected via the cores to data-producing equipment and to computational servers run by the 'omics analysis core and to storage on a high-performance analysis cluster. All IT assets, including the proposed equipment, are administered by professional IT staff with particular strength in infrastructure required for large-scale research in the genome sciences. While increase in efficiency of data management will be an immediate benefit, the more important goal of the project is to enable researchers to speed their use of integrated and complex data to explore the complexity of human health and disease.