The Rigor and Transparency Index Quality Metric for Assessing Biological and Medical Science Methods.
The Rigor and Transparency Index Quality Metric for Assessing Biological and Medical Science Methods.
复制标题
DOI：
10.1016/j.isci.2020.101698
复制
发表时间：
2020-11-20
期刊：
影响因子：
5.8
通讯作者：
Bandrowski A
中科院分区：
文献类型：
--
作者：
Menke J;Roelandse M;Ozyurt B;Martone M;Bandrowski A
再现性危机是一个多方面的问题，涉及科学界根深蒂固的做法。幸运的是，一些原因是通过作者对严格性和可重复性标准的坚持来解决的，这些标准通过各种期刊的检查表来实施。我们开发了一个自动化工具（SciScore），以前所未有的规模评估研究文章是否符合关键的严格标准，包括NIH标准和RRID。我们发现，尽管稳步改善，不到一半的评分标准，如盲法或功效分析，是由作者经常解决的;深入挖掘，我们检查了具体的检查表对平均分数的影响。期刊在特定年份的平均得分被命名为严谨性和透明度指数（RTI），这是一种新的期刊质量指标。我们将RTI与期刊影响因子进行了比较，发现两者之间没有相关性。RTI可以潜在地作为方法学质量的代表。使用SciScore（一种自动化工具）评估了1，578，964篇文章的严谨性标准开发了期刊质量指标并研究了严谨性标准报告趋势严谨性和透明度指数与影响因子之间无相关性严谨性和透明度指数可作为方法学质量的代表生物科学;生物信息学;生物科学研究方法学;生物科学方法学
The reproducibility crisis is a multifaceted problem involving ingrained practices within the scientific community. Fortunately, some causes are addressed by the author's adherence to rigor and reproducibility criteria, implemented via checklists at various journals. We developed an automated tool (SciScore) that evaluates research articles based on their adherence to key rigor criteria, including NIH criteria and RRIDs, at an unprecedented scale. We show that despite steady improvements, less than half of the scoring criteria, such as blinding or power analysis, are routinely addressed by authors; digging deeper, we examined the influence of specific checklists on average scores. The average score for a journal in a given year was named the Rigor and Transparency Index (RTI), a new journal quality metric. We compared the RTI with the Journal Impact Factor and found there was no correlation. The RTI can potentially serve as a proxy for methodological quality. Evaluated 1,578,964 articles for rigor criteria using SciScore, an automated tool Developed a journal quality metric and studied rigor criteria reporting trends No correlation between the Rigor and Transparency Index and the Impact Factor The Rigor and Transparency Index may serve as a proxy for methodological quality Biological Sciences; Bioinformatics; Biological Sciences Research Methodologies; Methodology in Biological Sciences
登录
查看更多内容
DOI：
10.1093/jamia/ocv044
发表时间：
2016-01-01
影响因子：
6.4
作者：
Marshall, Iain J.;Kuiper, Joel;Wallace, Byron C.
通讯作者：
Wallace, Byron C.
影响因子：
9.8
作者：
Moher, David;Bouter, Lex;Dirnagl, Ulrich
通讯作者：
Dirnagl, Ulrich
影响因子：
15.8
作者：
Ioannidis, JPA
通讯作者：
Ioannidis, JPA
影响因子：
64.8
作者：
Landis, Story C.;Amara, Susan G.;Asadullah, Khusru;Austin, Chris P.;Blumenstein, Robi;Bradley, Eileen W.;Crystal, Ronald G.;Darnell, Robert B.;Ferrante, Robert J.;Fillit, Howard;Finkelstein, Robert;Fisher, Marc;Gendelman, Howard E.;Golub, Robert M.;Goudreau, John L.;Gross, Robert A.;Gubitz, Amelie K.;Hesterlee, Sharon E.;Howells, David W.;Huguenard, John;Kelner, Katrina;Koroshetz, Walter;Krainc, Dimitri;Lazic, Stanley E.;Levine, Michael S.;Macleod, Malcolm R.;McCall, John M.;Moxley, Richard T., III;Narasimhan, Kalyani;Noble, Linda J.;Perrin, Steve;Porter, John D.;Steward, Oswald;Unger, Ellis;Utz, Ursula;Silberberg, Shai D.
通讯作者：
Silberberg, Shai D.
影响因子：
105.7
作者：
Rice, Danielle B.;Raffoul, Hana;Moher, David
通讯作者：
Moher, David