The Modern Research Data Portal: a design pattern for networked, data-intensive science.

The Modern Research Data Portal: a design pattern for networked, data-intensive science.
复制标题

DOI:
10.7717/peerj-cs.144
复制
发表时间:
2018
期刊:
PeerJ. Computer science
影响因子:
--
通讯作者:
Williams J
Williams J
中科院分区:
其他
文献类型:
--
作者:
Chard K;Dart E;Foster I;Shifflett D;Tuecke S;Williams J

文献摘要

参考文献

被引文献

相似文献

我们将介绍通过研究数据门户提供对大数据的便捷、高速、安全访问的最佳实践。我们在一种新的设计模式--现代研究数据门户中捕捉到了这些最佳实践,该设计模式分解了传统的基于Web的单一数据门户,以实现数据传输性能的数量级提升,支持将控制逻辑与数据存储分离的新部署架构,并降低了开发和运营成本。我们将介绍设计模式;解释它如何利用高性能数据飞地和基于云的数据管理服务;回顾研究实验室和大学的代表性示例,包括实验设施和超级计算机站点;描述如何利用PythonAPI进行身份验证、授权、数据传输和数据共享;并使用编码示例演示如何使用这些API实现一系列研究数据门户功能。在一个配套网站上的示例代码中,https://docs.globus.org/mrdp,提供了应用程序框架,读者可以对其进行调整以实现自己的研究数据门户。
We describe best practices for providing convenient, high-speed, secure access to large data via research data portals. We capture these best practices in a new design pattern, the Modern Research Data Portal, that disaggregates the traditional monolithic web-based data portal to achieve orders-of-magnitude increases in data transfer performance, support new deployment architectures that decouple control logic from data storage, and reduce development and operations costs. We introduce the design pattern; explain how it leverages high-performance data enclaves and cloud-based data management services; review representative examples at research laboratories and universities, including both experimental facilities and supercomputer sites; describe how to leverage Python APIs for authentication, authorization, data transfer, and data sharing; and use coding examples to demonstrate how these APIs can be used to implement a range of research data portal capabilities. Sample code at a companion web site, https://docs.globus.org/mrdp, provides application skeletons that readers can adapt to realize their own research data portals.
DOI: 10.3389/fpls.2011.00034
发表时间: 2011
影响因子: 5.6
作者:
Goff SA;Vaughn M;McKay S;Lyons E;Stapleton AE;Gessler D;Matasci N;Wang L;Hanlon M;Lenards A;Muir A;Merchant N;Lowry S;Mock S;Helmke M;Kubach A;Narro M;Hopkins N;Micklos D;Hilgert U;Gonzales M;Jordan C;Skidmore E;Dooley R;Cazes J;McLay R;Lu Z;Pasternak S;Koesterke L;Piel WH;Grene R;Noutsos C;Gendler K;Feng X;Tang C;Lent M;Kim SJ;Kvilekval K;Manjunath BS;Tannen V;Stamatakis A;Sanderson M;Welch SM;Cranston KA;Soltis P;Soltis D;O'Meara B;Ane C;Brutnell T;Kleibenstein DJ;White JW;Leebens-Mack J;Donoghue MJ;Spalding EP;Vision TJ;Myers CR;Lowenthal D;Enquist BJ;Boyle B;Akoglu A;Andrews G;Ram S;Ware D;Stein L;Stanzione D
通讯作者: Stanzione D
DOI: 10.1109/mcc.2014.52
发表时间: 2014-09-01
影响因子: --
作者:
Chard, Kyle;Tuecke, Steven;Foster, Ian
通讯作者: Foster, Ian
DOI: 10.1016/j.future.2015.09.006
发表时间: 2016-03-01
影响因子: 7.5
作者:
Chard, Kyle;Lidman, Mattias;Foster, Ian
通讯作者: Foster, Ian
DOI: 10.1109/mnet.2005.1383434
发表时间: 2005-01-01
期刊: IEEE NETWORK
影响因子: 9.3
作者:
Jin, C;Wei, D;Feng, WC
通讯作者: Feng, WC
DOI: 10.1145/956981.956989
发表时间: 2003-04-01
影响因子: 2.8
作者:
Kelly, T
通讯作者: Kelly, T