Ceph High-Performance Storage Cluster

使用低温电子显微镜(CRYO-EM)、低温电子断层扫描(CRYO-ET)、用于高分辨率脑成像(连接学)的连续切片扫描电子显微镜、基因组和单细胞的DNA测序以及光片显微镜的尖端科学产生了越来越多的数据。这些数据使许多新发现成为可能，但它们的数量带来了重大的技术问题，因为这些数据需要进行存储、处理和分析才能变得有用。在LMB，我们每年产生数PB的高价值科学数据集，这些数据集通常需要存储、处理和分析几个月，然后才能发布和存档。这些数据集的大小在存储和处理它们方面产生了独特的技术问题。首先，存储系统需要有足够的容量来一次容纳多个数据集，因为存储系统为整个LMB提供服务。其次，大多数情况下，处理和分析使用LMB的并行计算集群，该集群要求存储系统能够快速且可同时访问数百到数千个计算节点，以实现它们的并行访问。出于这些目的，我们建议投资于一个大型Cave集群存储系统，该系统满足所有这些标准，同时最大限度地具有成本效益，并且不受供应商的限制。Cave是由公益性驱动的，并得到其他有大量数据需求的科学组织的使用和支持，例如瑞士日内瓦的欧洲核子研究中心。

Cutting edge science using cryogenic electron microscopy (cryo-EM), cryo electron tomography (cryo-ET), serial-section scanning electron microscopy as used in high-resolution brain imaging (connectomics), DNA sequencing of genomes and single cells and light sheet microscopy produces ever increasing amounts of data. These data are enabling many new discoveries, but their volume creates signficant technical problems since the data need to be stored, processed and analysed to become useful. At the LMB, we generate multiple petabytes of high-value scientific datasets each year and these datasets often need to be stored, processed and analysed for several months before they can be published and then archived. The very size of these datasets creates unique technical problems in storing and processing them. First, the storage system needs to have enough capacity to be able to hold many datasets at once, since the storage system serves the entire LMB. Second, processing and analysis most of the time use the LMB's parallel compute cluster that requires the storage system to be fast and acessible from hundreds to thousands of compute nodes at the same time, for their parallel access. For these purposes we propose to invest in a large Ceph cluster storage system that fulfils all of these criteria, while being maximally cost effective, and without vendor lock-in. Ceph is comminity driven and used and supported by other scientific organisations with large data requirements such as CERN in Geneva, Switzerland.