First steps into the cloud: Using Amazon data storage and computing with Python notebooks.

First steps into the cloud: Using Amazon data storage and computing with Python notebooks.
复制标题

DOI:
10.1371/journal.pone.0278316
复制
发表时间:
2023
期刊:
影响因子:
3.7
通讯作者:
--
中科院分区:
综合性期刊3区
文献类型:
--
作者:

文献摘要

参考文献

相似文献

随着大数据时代的到来,生物学家正在遇到更多基于云计算的用例,以简化数据处理和存储。不幸的是,云平台很难学习,生物学家也很少有资源来揭开它们的神秘面纱。我们已经为实验生物学家开发了一个指南,用于在Amazon Web Services上设置云处理,以廉价的方式外包数据处理和存储。在这里,我们提供了在云中设置计算环境的指南,并展示了使用Python和Julia编程语言的示例。我们目前的例子钙成像数据在斑马鱼的大脑和相应的分析,使用suite2p软件。预算和用户管理工具将在所附议定书中进一步讨论。使用本指南,编码经验有限的研究人员可以开始使用基于云的计算或将现有的编码基础设施迁移到云环境中。
With the oncoming age of big data, biologists are encountering more use cases for cloud-based computing to streamline data processing and storage. Unfortunately, cloud platforms are difficult to learn, and there are few resources for biologists to demystify them. We have developed a guide for experimental biologists to set up cloud processing on Amazon Web Services to cheaply outsource data processing and storage. Here we provide a guide for setting up a computing environment in the cloud and showcase examples of using Python and Julia programming languages. We present example calcium imaging data in the zebrafish brain and corresponding analysis using suite2p software. Tools for budget and user management are further discussed in the attached protocol. Using this guide, researchers with limited coding experience can get started with cloud-based computing or move existing coding infrastructure into the cloud environment.
DOI: 10.1038/s41586-020-2649-2
发表时间: 2020-09
期刊: Nature
影响因子: 64.8
作者:
Harris CR;Millman KJ;van der Walt SJ;Gommers R;Virtanen P;Cournapeau D;Wieser E;Taylor J;Berg S;Smith NJ;Kern R;Picus M;Hoyer S;van Kerkwijk MH;Brett M;Haldane A;Del Río JF;Wiebe M;Peterson P;Gérard-Marchant P;Sheppard K;Reddy T;Weckesser W;Abbasi H;Gohlke C;Oliphant TE
通讯作者: Oliphant TE
DOI: 10.1063/1.5144487
发表时间: 2020-05-01
影响因子: 1.6
作者:
Keomanee-Dizon, Kevin;Fraser, Scott E.;Truong, Thai V.
通讯作者: Truong, Thai V.