The Widening Gulf between Genomics Data Generation and Consumption: A Practical Guide to Big Data Transfer Technology
The Widening Gulf between Genomics Data Generation and Consumption: A Practical Guide to Big Data Transfer Technology
复制标题
基因组数据生成与消费之间日益扩大的鸿沟：大数据传输技术实用指南
DOI：
--
复制
发表时间：
2015
影响因子：
5.8
通讯作者：
Kuang
中科院分区：
文献类型：
--
作者：
F. A. Feltus;Joseph R. Breen;Juan Deng;Ryan Izard;Christopher A. Konger;W. Ligon;D. Preuss;Kuang
在过去的十年中，高通量 DNA 测序已成为一项颠覆性技术，并将生命科学推向序列数据生产者和消费者的分布式生态系统。鉴于基因组学的力量和不断下降的测序成本，生物学是一门新兴的“大数据”学科，当所有子学科结合在一起时，它将很快进入艾字节数据范围。这些数据集必须以创造性的方式跨商业和研究网络传输，因为不加思考地发送数据可能会对数据处理时间框架产生严重后果。因此，生物学家、生物信息学家和信息技术工程师必须重新校准数据处理范例以适应这一新兴现实。这篇综述试图提供跨网络大数据传输的概况，这一点经常被许多生物学家忽视。具体来说，我们讨论四个关键领域：1）数据传输网络、协议和应用程序； 2）数据传输安全包括加密、访问、防火墙和科学DMZ； 3）软件定义网络的数据流控制； 4) 数据存储、暂存、归档和访问。本文的主要目的是让生物学家了解数据传输过程的关键方面，以便向企业 IT 专业人员构建他们以基因组学为导向的需求。
In the last decade, high-throughput DNA sequencing has become a disruptive technology and pushed the life sciences into a distributed ecosystem of sequence data producers and consumers. Given the power of genomics and declining sequencing costs, biology is an emerging “Big Data” discipline that will soon enter the exabyte data range when all subdisciplines are combined. These datasets must be transferred across commercial and research networks in creative ways since sending data without thought can have serious consequences on data processing time frames. Thus, it is imperative that biologists, bioinformaticians, and information technology engineers recalibrate data processing paradigms to fit this emerging reality. This review attempts to provide a snapshot of Big Data transfer across networks, which is often overlooked by many biologists. Specifically, we discuss four key areas: 1) data transfer networks, protocols, and applications; 2) data transfer security including encryption, access, firewalls, and the Science DMZ; 3) data flow control with software-defined networking; and 4) data storage, staging, archiving and access. A primary intention of this article is to orient the biologist in key aspects of the data transfer process in order to frame their genomics-oriented needs to enterprise IT professionals.
影响因子：
4.7
作者：
Dabydeen, Sarah A.;Kang, Keunsoo;Furth, Priscilla A.
通讯作者：
Furth, Priscilla A.