CIF21 DIBBS: The Data Exacell

CIF21 DIBBS：数据 Exacell

• 批准号: 1261721
• 负责人: Nicholas Nystrom
• 金额: $ 760万
• 依托单位: Carnegie-Mellon University
• 依托单位国家: 美国
• 项目类别: Cooperative Agreement
• 财政年份: 2013
• 资助国家: 美国
• 起止时间: 2013-10-01 至 2018-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1261721&HistoricalAwards=false
• 关键词: CIF21; DIBBS; Data; Exacell

The Pittsburgh Supercomputing Center (PSC) will carry out an accelerated, development pilot project to create, deploy and test software building blocks and hardware implementing functionalities specifically designed to support data-analytic capabilities for data intensive scientific research. Building on the successful Data Supercell (DSC) technology which replaced a conventional tape-based archive with a disk-based system to economically provide the much lower latency and higher bandwidth data success necessary for data-intensive activities, PSC will implement and bring to production quality additional functionalities important to such work. These include improved local performance, additional abilities for remote data access and storage, enhanced data integrity, data tagging and improved manageability. PSC will work with partners in diverse fields of science, initially chosen from biology, astronomy and computer science, who will provide scientific and technology drivers and system validation. The project will leverage current NSF/CI investments in data analytics systems at PSC. Those investments include DSC, Blacklight (an SGI UV1000 with 2×16TB of hardware-enabled cache-coherent shared memory), and Sherlock (a YarcData ?Urika? graph-analytic appliance which also supports a globally accessible shared memory), both very capable for data analytic applications. Their tight coupling to the pilot storage system will allow synergistic development of analytical capabilities with development of increasingly sophisticated mechanisms for data handling. Working with the new, multi-petabyte data store, they will constitute a system specifically optimized for data intensive work as contrasted with conventional HPC systems. Blacklight will be upgraded with more powerful technology, specifically architected to satisfy the more demanding needs of data analytics in years 3,4. When successful, PSC will engage the NSF to consider larger-scale deployment aiming at exascale capacity.

匹兹堡超级计算中心(PSC)将开展一项加速开发的试点项目，以创建、部署和测试软件构建块和硬件实施功能，这些功能专门设计用于支持数据密集型科学研究的数据分析能力。基于成功的Data Supercell(DSC)技术，该技术用基于磁盘的系统取代了传统的基于磁带的归档，以经济的方式提供数据密集型活动所需的低得多的延迟和更高的带宽数据成功，PSC将实施对此类工作至关重要的附加功能，并将其带入生产质量。其中包括提高本地性能、增加远程数据访问和存储能力、增强数据完整性、数据标记和改进的可管理性。PSC将与不同科学领域的合作伙伴合作，这些合作伙伴最初是从生物学、天文学和计算机科学中挑选出来的，他们将提供科学和技术驱动因素和系统验证。该项目将利用目前NSF/CI在PSC数据分析系统方面的投资。这些投资包括DSC、Blacklight(一款SGI UV1000，配备2×16TB的硬件缓存一致性共享内存)和Sherlock(YarcData？Urika？Graph-分析设备，也支持全局可访问的共享内存)，两者都非常适合数据分析应用。它们与试点存储系统的紧密结合将使分析能力的发展与日益复杂的数据处理机制的开发协同发展。与传统的HPC系统相比，它们将与新的、数PB的数据存储一起工作，构成一个专门针对数据密集型工作进行优化的系统。Blacklight将使用更强大的技术进行升级，该技术专为满足第3、4年中更苛刻的数据分析需求而设计。成功后，PSC将与NSF合作，考虑以亿级容量为目标的更大规模的部署。