Microbench: automated metadata management for systems biology benchmarking and reproducibility in Python.

Microbench: automated metadata management for systems biology benchmarking and reproducibility in Python.
复制标题

DOI:
10.1093/bioinformatics/btac580
复制
发表时间:
2022-10-14
期刊:
Bioinformatics (Oxford, England)
影响因子:
--
通讯作者:
--
中科院分区:
其他
文献类型:
--
作者:

文献摘要

参考文献

相似文献

计算系统生物学分析通常利用多个软件及其依赖项,这些软件通常跨不同的计算环境运行。这可能会导致性能和重复性上的差异。捕获元数据(如包版本、GPU模型)目前需要重复的代码,很难集中存储以供分析。即使在使用虚拟环境和容器的情况下,随着时间的推移进行更新,也意味着仍应在分析管道中捕获版本化元数据,以保证可重现性。MicroBENCH是一个简单且可扩展的Python包,用于自动将元数据捕获到文件或Redis数据库。捕获的元数据可以包括执行时间、软件包版本、环境变量、硬件信息、Python版本等,以及插件。我们提供了三个案例研究,演示了如何使用微工作台对代码执行进行基准测试,并检查环境元数据以实现可重现性。使用PIP INSTALL MICROBASE从Python包索引进行安装。源代码可从https://github.com/alubbock/microbench.获得补充数据可在生物信息学在线上获得。
Computational systems biology analyses typically make use of multiple software and their dependencies, which are often run across heterogeneous compute environments. This can introduce differences in performance and reproducibility. Capturing metadata (e.g. package versions, GPU model) currently requires repetitious code and is difficult to store centrally for analysis. Even where virtual environments and containers are used, updates over time mean that versioning metadata should still be captured within analysis pipelines to guarantee reproducibility. Microbench is a simple and extensible Python package to automate metadata capture to a file or Redis database. Captured metadata can include execution time, software package versions, environment variables, hardware information, Python version and more, with plugins. We present three case studies demonstrating Microbench usage to benchmark code execution and examine environment metadata for reproducibility purposes. Install from the Python Package Index using pip install microbench. Source code is available from https://github.com/alubbock/microbench. Supplementary data are available at Bioinformatics online.
使用PYSB在Python中编程生物模型。
DOI: 10.1038/msb.2013.1
发表时间: 2013
影响因子: 9.9
作者:
通讯作者: --
DOI: 10.1016/j.patter.2021.100322
发表时间: 2021-09-10
期刊: Patterns (New York, N.Y.)
影响因子: --
作者:
Leipzig J;Nüst D;Hoyt CT;Ram K;Greenberg J
通讯作者: Greenberg J
DOI: 10.1109/ms.2014.58
发表时间: 2014-05-01
期刊: IEEE SOFTWARE
影响因子: 3.3
作者:
Meyer, Mathias
通讯作者: Meyer, Mathias