META-pipe cloud setup and execution
META-pipe cloud setup and execution
复制标题
META-pipe 云设置和执行
作者：
A. Agafonov;K. Mattila;Cuong Duong Tuan;Lars Tiede;I. Raknes;L. A. Bongo
META - pipe是一种用于海洋宏基因组数据分析的完整服务。它提供高通量序列数据的组装、预测基因的功能注释以及分类学分析。功能注释对计算要求很高，因此目前在挪威的一个高性能计算集群上运行。然而，需要额外的计算资源才能向所有ELIXIR用户开放该服务。我们描述了在其他学术和商业云上建立和执行META - pipe功能分析的方法。我们的目标是提供一种强大的、易于使用和维护的分析服务。因此，我们的设计采用分布式架构，将中央服务器与多个分布式后端相结合，由后端执行计算密集型任务。我们相信，我们开发和运营META - pipe的经验为那些计划在ELIXIR以及其他拥有地理分布式计算和存储资源的组织中提供基于门户的数据分析服务的人员提供了一个有用的模型。
META-pipe is a complete service for the analysis of marine metagenomic data. It provides assembly of high-throughput sequence data, functional annotation of predicted genes, and taxonomic profiling. The functional annotation is computationally demanding and is therefore currently run on a high-performance computing cluster in Norway. However, additional compute resources are necessary to open the service to all ELIXIR users. We describe our approach for setting up and executing the functional analysis of META-pipe on additional academic and commercial clouds. Our goal is to provide a powerful analysis service that is easy to use and to maintain. Our design therefore uses a distributed architecture where we combine central servers with multiple distributed backends that execute the computationally intensive jobs. We believe our experiences developing and operating META-pipe provides a useful model for others that plan to provide a portal based data analysis service in ELIXIR and other organizations with geographically distributed compute and storage resources.