A Framework for Scalable Genome Assembly on Clusters, Clouds, and Grids

A Framework for Scalable Genome Assembly on Clusters, Clouds, and Grids
复制标题

集群、云和网格上可扩展基因组组装的框架

DOI:
--
复制
发表时间:
2012
影响因子:
5.3
通讯作者:
D. Thain
D. Thain
中科院分区:
计算机科学2区
文献类型:
--
作者:
C. Moretti;A. Thrasher;Li Yu;Michael Olson;S. Emrich;D. Thain

文献摘要

参考文献

被引文献

相似文献

生物信息学研究人员需要有效的手段来处理大量的基因组序列数据。感兴趣的一个应用程序,基因组组装,具有很大的潜力,并行化,然而,大多数以前的尝试并行化需要不常见的高端硬件。本文介绍了可扩展的汇编在圣母院(SAND)框架,可以实现显着的加速使用大量的商品机器利用集群,云和网格。SAND与Celera开源汇编工具包接口,用可扩展的并行替代方案取代两个独立的顺序模块:候选选择器利用分布式内存容量,序列比对器利用分布式计算能力。对于大型问题,这些模块提供了强大的任务和数据管理,同时还实现了高效率的加速。我们展示了从73.8万到超过3.2亿的比对数据集的结果,这些数据集使用的资源范围从一个小集群到跨越三个机构的一千多个节点。
Bioinformatics researchers need efficient means to process large collections of genomic sequence data. One application of interest, genome assembly, has great potential for parallelization; however, most previous attempts at parallelization require uncommon high-end hardware. This paper introduces the Scalable Assembler at Notre Dame (SAND) framework that can achieve significant speedup using large numbers of commodity machines harnessed from clusters, clouds, and grids. SAND interfaces with the Celera open-source assembly toolkit, replacing two independent sequential modules with scalable parallel alternatives: the candidate selector exploits distributed memory capacity, and the sequence aligner exploits distributed computing capacity. For large problems, these modules provide robust task and data management while also achieving speedup with high efficiency. We show results for several data sets ranging from 738 thousand to over 320 million alignments using resources ranging from a small cluster to more than a thousand nodes spanning three institutions.
DOI: 10.1101/gr.9.9.868
发表时间: 1999-09-01
期刊: GENOME RESEARCH
影响因子: 7
作者:
Huang, XQ;Madan, A
通讯作者: Madan, A
DOI: 10.1056/nejmoa1012928
发表时间: 2011-01-06
期刊: The New England journal of medicine
影响因子: --
作者:
Chin CS;Sorenson J;Harris JB;Robins WP;Charles RC;Jean-Charles RR;Bullard J;Webster DR;Kasarskis A;Peluso P;Paxinos EE;Yamaichi Y;Calderwood SB;Mekalanos JJ;Schadt EE;Waldor MK
通讯作者: Waldor MK
DOI: 10.1101/gr.1390403
发表时间: 2003-09-01
期刊: GENOME RESEARCH
影响因子: 7
作者:
Huang, XQ;Wang, JM;Hillier, L
通讯作者: Hillier, L