Dynamically scalable accessible analysis for next generation sequence data

描述(由申请人提供)：项目摘要：“下一代”测序(NGS)仪器的广泛应用使任何研究人员都能够以适度的成本产生大量的DNA序列数据。然而，处理这些原始序列给个人研究人员、小型实验室或核心设施带来了重大问题。对于一个没有计算专业知识的实验小组来说，仅仅运行数据分析程序就是一个障碍，更不用说构建能够处理NGS数据的计算和数据存储基础设施了。幸运的是，最近出现了一种计算模型--“云计算”，非常适合大规模序列数据的分析。在该模型中，计算和存储作为虚拟资源存在，可以根据需要动态分配和释放。重要的是，对于某些用例，云资源可以以比专用资源低得多的成本提供存储和计算。然而，需要应对艰巨的挑战，以使这些资源可供个别调查人员使用。具体地说，虽然云计算提供了一种按需获取计算资源的方式，但提供的资源要么是互联网上的虚拟机，要么是特定的编程库，这对实验者来说是无法使用的。因此，可行的分析解决方案需要在没有信息学专业知识的情况下能够访问和部署；它必须高效和自动地使用可动态扩展的资源，同时考虑时间和成本；它必须包括适当的分析工具，并在新工具出现时轻松支持添加。我们之前已经开发了一个软件系统--银河(http://galaxyproject.org))，它为满足这些需求提供了一个强大的框架。在这里，我们建议大幅扩展该框架，以允许任何实验者利用云计算基础设施的能力执行大规模的NGS分析。特别是，我们将修改现有的Galaxy框架，使其完全在云中运行。我们将调整Galaxy调度和执行作业的方式，以有效利用云计算风格。我们将为个人用户提供一种机制，通过完全基于Web的界面在云上创建和部署自定义Galaxy实例。最后，我们将测试我们的方法，将开发的设施应用于现有的人类重新测序数据，以揭示导致人类遗传病的大规模突变的隐藏模式。 与公共卫生相关：项目叙述日益可用和廉价的高通量DNA测序为生物医学研究带来了巨大的希望，但信息学挑战阻碍了这项变革性技术潜力的充分实现。特别是，生物医学研究人员的信息学和工程专业知识，以及分析这些庞大数据集的足够计算基础设施的可用性，限制了进展。该项目将把银河系统与“云计算”结合起来解决这些问题，银河系统是一个使复杂的计算分析变得可访问和可重复使用的系统，而“云计算”是一种基础设施模式，根据需要按需购买计算资源，使没有信息学专业知识的调查人员能够利用云资源进行数据密集型分析。

DESCRIPTION (provided by applicant): Project Summary Wide availability of "next-generation" sequencing (NGS) instruments has enabled any investigator, for a modest cost, to produce enormous amounts of DNA sequence data. However, working with these raw sequences presents significant problems for individual investigators, small labs, or core facilities. For an experimental group with no computational expertise, simply running a data analysis program is a barrier, let alone building a compute and data storage infrastructure capable of dealing with NGS data. Fortunately, a computational model - "Cloud computing" - has recently emerged and is ideally suited to the analysis of large- scale sequence data. In this model, computation and storage exist as virtual resources, which can be dynamically allocated and released as needed. Importantly, cloud resources can provide storage and computation at far less cost than dedicated resources for certain use cases. However, formidable challenges need to be addressed to make these resources available to individual investigators. Specifically, although cloud computing provides a way to acquire computational resources on demand, the resources provided are either virtual machines on the Internet or specific programming libraries, which are unusable for experimentalists. Thus, a viable analysis solution needs to be accessible and deployable without informatics expertise; it must efficiently and automatically use dynamically scalable resources, while taking into account time and cost; it must include appropriate analysis tools and easily support addition of new tools as they emerge. We have previously developed a software system - Galaxy (http://galaxyproject.org) - that provides a robust framework for addressing these needs. Here we propose to significantly extend this framework to allow any experimentalist to perform large-scale NGS analyses utilizing the power of cloud computing infrastructure. In particular, we will modify the existing Galaxy framework to run entirely within the cloud. We will adapt the way Galaxy schedules and executes jobs to make effective use of cloud-style. We will provide a mechanism for individual users to create and deploy custom Galaxy instances on a cloud through an entirely web-based interface. Finally, we will test our approach by applying the developed facilities to the existing human re- sequencing data in order to uncover hidden patters of mutations causing human genetic disease on a very large scale. PUBLIC HEALTH RELEVANCE: Project Narrative Increasingly available and inexpensive high-throughput DNA sequencing holds great promise for biomedical research, but informatics challenge block the full realization of the potential of this transformative technology. In particular progress is limited by the informatics and engineering expertise of biomedical researchers, and the availability of sufficient computational infrastructure to analyze these enormous datasets. This project will address these problems by bringing together Galaxy, a system for making complex computational analysis accessible and reproducible, with "cloud computing", an infrastructure model where computing resources are purchased on demand as needed, making it possible for investigators with no informatics expertise to perform data-intensive analysis using cloud resources.