DataLad: distributed system for joint management of code, data, and their relationship.
DataLad: distributed system for joint management of code, data, and their relationship.
复制标题
DOI：
10.21105/joss.03262
复制
发表时间：
2021-01-01
影响因子：
--
通讯作者：
Hanke, Michael
中科院分区：
文献类型：
--
作者：
Halchenko, Yaroslav O;Meyer, Kyle;Hanke, Michael
DataLad是一个基于Python的工具，用于联合管理代码、数据和它们之间的关系，它建立在一个通用的数据物流系统(Git附件)和最流行的分布式版本控制系统(Git)之上。它采用开源软件开发和分发的原则，以解决数字对象生命周期中的数据管理、数据共享和数字来源收集方面的技术挑战。DataLad的目标是让数据管理像管理代码一样简单。对于任何大小或类型的数据，它简化了使用、发布和更新数据的过程，并将它们链接为精确版本化的轻量级依赖项。DataLad有助于使科学更具重复性和公平性(Wilkinson等人，2016)。它可以捕获数据转换的完整和可操作的流程来源，以实现自动重新计算。DataLad项目(datalad.org)为灵活分散的研究数据管理(RDM)提供了一个完全开放的开创性平台(Hanke，Pstilli等人，2021年)。它的特点是具有一个Python和一个命令行界面、一个可扩展的体系结构，并且不依赖于任何集中式服务，但促进了与多个现有工具和服务的互操作性。为了最大限度地提高其效用和目标受众，DataLad可用于所有主要操作系统，并且可以以最小的摩擦集成到现有的工作流程和环境中。
DataLad is a Python-based tool for the joint management of code, data, and their relationship, built on top of a versatile system for data logistics (git-annex) and the most popular distributed version control system (Git). It adapts principles of open-source software development and distribution to address the technical challenges of data management, data sharing, and digital provenance collection across the life cycle of digital objects. DataLad aims to make data management as easy as managing code. It streamlines procedures to consume, publish, and update data, for data of any size or type, and to link them as precisely versioned, lightweight dependencies. DataLad helps to make science more reproducible and FAIR (Wilkinson et al., 2016). It can capture complete and actionable process provenance of data transformations to enable automatic re-computation. The DataLad project (datalad.org) delivers a completely open, pioneering platform for flexible decentralized research data management (RDM) (Hanke, Pestilli, et al., 2021). It features a Python and a command-line interface, an extensible architecture, and does not depend on any centralized services but facilitates interoperability with a plurality of existing tools and services. In order to maximize its utility and target audience, DataLad is available for all major operating systems, and can be integrated into established workflows and environments with minimal friction.