EAGER: Accelerating the Pace of Discovery by Changing the Peer Review Algorithm

EAGER：通过改变同行评审算法加快发现步伐

• 批准号: 1042164
• 负责人: Stefano Allesina
• 金额: $ 24.01万
• 依托单位: University of Chicago
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2010
• 资助国家: 美国
• 起止时间: 2010-08-01 至 2014-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1042164&HistoricalAwards=false
• 关键词: EAGER; Accelerating; Pace; Discovery; Changing

Peer review is the main tool for scrutinizing scholarly publications, grant proposals and career advancements in science. However, the current peer review system is under severe strain, with consequences for the quality of science and the rapidity of dissemination of scientific results. Several studies have found that the current way of performing peer review can be inefficient, slow, and even biased. Almost every scientist has ideas on how to improve the system, but it is very difficult, if not impossible, to perform experiments to determine which measures are most effective. The project implements a simulation framework in which many ideas of how to improve the review process can be quantitatively tested.Intellectual Merit The framework is built using agent-based modeling. Scientists, manuscripts and journals are digital agents and a peer review system emerges from their interaction. Multiple experiments can be run: for example, one proof-of-concept application shows how changing the way peer review is performed can dramatically alter the pace at which science is disseminated.The research develops a full-fledged and open-source simulation software that allows to study alternatives to the current system.Broader Impacts The proposed work is potentially transformative of the way science is carried out. This framework can be used to identify better and more efficient models for peer review, leading to profound changes on scientific publishing and funding. Also, if this exploratory research is successful, a new computational branch of sociology of science could emerge. Changing the way peer review is performed to favor faster and more efficient solutions could potentially have broad effects on the daily work of scientists, including more time for academic training and research, and less time spent revising and reformatting manuscripts and grant proposals. Favoring unbiased practices could enlarge the representation of minorities in science.

同行评议是审查学术出版物、赠款申请和科学职业发展的主要工具。然而，目前的同行审查制度受到严重的压力，影响了科学的质量和科学成果的传播速度。一些研究发现，目前的同行评议方式效率低下，速度缓慢，甚至存在偏见。几乎每个科学家都有关于如何改进该系统的想法，但如果不是不可能的话，也很难进行实验来确定哪些措施最有效。该项目实现了一个模拟框架，其中许多想法，如何改善审查过程可以定量测试。智力优点该框架是使用基于代理的建模。科学家、手稿和期刊都是数字媒介，同行评议系统从它们的互动中产生。可以进行多个实验：例如，一个概念验证应用程序展示了如何改变同行评议的方式可以极大地改变科学传播的速度。该研究开发了一个成熟的开源模拟软件，可以研究当前系统的替代方案。更广泛的影响拟议的工作可能会改变科学的开展方式。该框架可用于确定更好、更有效的同行评审模式，从而导致科学出版和资助方面的深刻变化。此外，如果这种探索性的研究是成功的，一个新的计算科学社会学的分支可能会出现。改变同行评议的方式，以支持更快、更有效的解决方案，可能会对科学家的日常工作产生广泛的影响，包括有更多的时间进行学术培训和研究，减少花在修改和重新格式化手稿和拨款申请上的时间。支持无偏见的做法可以扩大少数群体在科学领域的代表性。