CIF21 DIBBS: The Data Exacell

匹兹堡超级计算中心（PSC）将执行一项加速开发试点项目，以创建、部署和测试软件构建模块和硬件实现功能，这些功能专门设计用于支持数据密集型科学研究的数据分析能力。基于成功的Data Supercell （DSC）技术（用基于磁盘的系统取代传统的基于磁带的存档，经济地提供数据密集型活动所需的更低延迟和更高带宽的数据成功），PSC将执行并带来对此类工作重要的生产质量附加功能。这些改进包括改进的本地性能、远程数据访问和存储的额外功能、增强的数据完整性、数据标记和改进的可管理性。PSC将与不同科学领域的合作伙伴合作，最初从生物学、天文学和计算机科学中选择，他们将提供科学和技术驱动和系统验证。该项目将利用目前NSF/CI在PSC数据分析系统上的投资。这些投资包括DSC、Blacklight （SGI UV1000，拥有2×16TB硬件支持的缓存一致共享内存）和Sherlock (YarcData ？Urika吗?图形分析设备（也支持全局可访问的共享内存），两者都非常适合数据分析应用程序。它们与试点存储系统的紧密耦合将使分析能力的协同发展与日益复杂的数据处理机制的发展成为可能。与传统的HPC系统相比，与新的多pb数据存储一起工作，它们将构成一个专门针对数据密集型工作进行优化的系统。Blacklight将采用更强大的技术进行升级，专门用于满足第三、四年更苛刻的数据分析需求。一旦成功，PSC将与NSF合作，考虑针对百亿亿级容量的更大规模部署。

The Pittsburgh Supercomputing Center (PSC) will carry out an accelerated, development pilot project to create, deploy and test software building blocks and hardware implementing functionalities specifically designed to support data-analytic capabilities for data intensive scientific research. Building on the successful Data Supercell (DSC) technology which replaced a conventional tape-based archive with a disk-based system to economically provide the much lower latency and higher bandwidth data success necessary for data-intensive activities, PSC will implement and bring to production quality additional functionalities important to such work. These include improved local performance, additional abilities for remote data access and storage, enhanced data integrity, data tagging and improved manageability. PSC will work with partners in diverse fields of science, initially chosen from biology, astronomy and computer science, who will provide scientific and technology drivers and system validation. The project will leverage current NSF/CI investments in data analytics systems at PSC. Those investments include DSC, Blacklight (an SGI UV1000 with 2×16TB of hardware-enabled cache-coherent shared memory), and Sherlock (a YarcData ?Urika? graph-analytic appliance which also supports a globally accessible shared memory), both very capable for data analytic applications. Their tight coupling to the pilot storage system will allow synergistic development of analytical capabilities with development of increasingly sophisticated mechanisms for data handling. Working with the new, multi-petabyte data store, they will constitute a system specifically optimized for data intensive work as contrasted with conventional HPC systems. Blacklight will be upgraded with more powerful technology, specifically architected to satisfy the more demanding needs of data analytics in years 3,4. When successful, PSC will engage the NSF to consider larger-scale deployment aiming at exascale capacity.