Designing a System for Improved Null Results Tracking: Berkeley, CA - December 2019

该奖项提供了一个关于“设计一个系统，以改善跟踪结果”的研讨会的支持，将在2019年12月与伯克利倡议在社会科学年会的透明度一起举行。讲习班将侧重于设计一个可持续、综合和多方利益攸关方的系统，以改进对所有受资助研究成果的监测和获取。得出无效结果的研究项目不太可能发表，但仍然可以作为公众和研究界的宝贵资源。虽然已开始出现若干机制来解决这一问题，但这些办法往往缺乏协调，许多机构缺乏采用这些办法的能力。该讲习班将召集一个跨学科的研究利益攸关方小组，讨论改进受资助研究成果跟踪的现有方法和新方法，特别考虑产生无效结果的项目。学术界、政策制定者和广大公众将受益于更全面地获得研究成果。为更广泛的社区提供的产品包括现场直播演示文稿的录音，演示幻灯片，以及综合研讨会程序和结论的报告。该研讨会将探讨解决出版偏见，可疑的研究实践，文件抽屉的问题（未发表的无效或意外结果仍然锁在研究人员的文件柜中）。这些问题可能导致知识体系不完整和有偏见。重点将放在力求简单、降低采用现有和新方法的障碍、避免研究人员和资助者的高交易成本，以及确保与科学诚信和公共利益的价值观相一致。活动开始将讨论研究供资机构和其他机构目前如何组织科学的设计失误，以便在小组内就需要解决的优先问题达成共识。随后的演讲和讨论将集中在研究注册的有效性，结果存储库的实施，如何增加报告无效结果的好处或降低成本，以及研究社区监测注册研究未报告结果的策略等主题上。参与者还将讨论如何可行地实施和测试这样一个系统。该奖项反映了NSF的法定使命，并已被认为是值得通过使用基金会的智力价值和更广泛的影响审查标准进行评估的支持。

This award provides support for a workshop on "Designing a System for Improved Null Results Tracking," to be held in December 2019 in conjunction with the Berkeley Initiative for Transparency in the Social Sciences Annual Meeting. The workshop will focus on the design of a sustainable, integrated, and multi-stakeholder system for improving the monitoring of and access to outputs from all funded research. Research projects that yield null findings are less likely to be published, yet still may serve as a valuable resource to both the public and the research community. While several mechanisms have begun to emerge to address this problem, these approaches tend not to be coordinated, and many institutions lack the capacity to adopt them. This workshop will convene an interdisciplinary group of research stakeholders to discuss existing and new approaches for improving the tracking of funded research outputs, with special consideration for projects that yield null results. The academic community, policymakers, and the public at large would benefit from more complete access to research results. Products for the broader community include recordings of live-streamed presentations, presentation slides, and a report synthesizing the workshop's proceedings and conclusions.This workshop will explore integrated approaches for addressing the inter-related problems of publication bias, questionable research practices, and the file drawer problem (where unpublished null or unexpected results remain locked away in researchers' file cabinets) in the social and health sciences. These problems can lead to incomplete and biased bodies of knowledge. Emphasis will be placed on striving for simplicity, lowering barriers to uptake of existing and new approaches, and avoiding high transaction costs for researchers and funders, as well as on ensuring compatibility with the values of scientific integrity and public interest. The event will begin with a discussion of design failures in how science is currently organized in research funding agencies and other institutions in order to build consensus within the group on priority issues to be addressed. Subsequent presentations and discussions will center on topics such as the effectiveness of study registries, the implementation of results repositories, how the benefits of reporting null results could be increased or the costs reduced, and strategies for research community monitoring of unreported results from registered studies. Participants also will deliberate about how such a system could feasibly be implemented and tested.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.