Assessing data availability and research reproducibility in hydrology and water resources
Assessing data availability and research reproducibility in hydrology and water resources
复制标题
DOI：
10.1038/sdata.2019.30
复制
发表时间：
2019-02-26
期刊：
影响因子：
9.8
通讯作者：
James, Ryan
中科院分区：
文献类型：
--
作者：
Stagge, James H.;Rosenberg, David E.;James, Ryan
人们对提高已发表研究的可重复性有着广泛的兴趣。我们开发了一个调查工具来评估与同行评审期刊文章（例如数据，模型，代码，使用说明）一起发表的数字研究工件的可用性和文章结果的可重复性。我们使用该工具评估了2017年6种水文和水资源期刊发表的1，989篇文章中的360篇。与其他领域的研究一样，我们仅使用其可用工件复制了一小部分文章（1.6%的测试文章）的结果。我们估计，在95%的置信度下，所有1，989篇文章中只有0.6%至6.8%的结果可能被复制。与之前的研究不同，调查工具确定了使工作更具可重复性的关键瓶颈。瓶颈包括：只有一些数字伪影可用（44%的文章），没有方向（89%），或所有伪影可用，但结果不可重现（5%）。该工具（或扩展）可以帮助作者，期刊，资助者和机构自我评估手稿，提供反馈以提高可复制性，并识别和奖励可复制的文章作为他人的榜样。
There is broad interest to improve the reproducibility of published research. We developed a survey tool to assess the availability of digital research artifacts published alongside peer-reviewed journal articles (e.g. data, models, code, directions for use) and reproducibility of article results. We used the tool to assess 360 of the 1,989 articles published by six hydrology and water resources journals in 2017. Like studies from other fields, we reproduced results for only a small fraction of articles (1.6% of tested articles) using their available artifacts. We estimated, with 95% confidence, that results might be reproduced for only 0.6% to 6.8% of all 1,989 articles. Unlike prior studies, the survey tool identified key bottlenecks to making work more reproducible. Bottlenecks include: only some digital artifacts available (44% of articles), no directions (89%), or all artifacts available but results not reproducible (5%). The tool (or extensions) can help authors, journals, funders, and institutions to self-assess manuscripts, provide feedback to improve reproducibility, and recognize and reward reproducible articles as examples for others.