CI-ADDO-NEW: OCCAM: Open Curation for Computer Architecture Modeling

计算机体系结构研究社区已经创建了丰富多样的模拟器、仿真器和基准测试集合。每个研究小组都有自己喜欢的工具，这些工具可能是建立在现有或自定义的基础设施之上的。在实验中使用这些工件来评估设计权衡，并分析对性能、能量、可靠性和其他指标的影响。不幸的是，这些工具用于评估的方式往往阻碍了科学方法的应用。使用各种工件的进入障碍（即，仿真工具和基准测试）通常很高，当这些工件可用时。 实验很少是开放的，也不容易被其他研究人员重复，导致不准确的比较。 此外，这是很难为一个单一的组，以探索所有的变化，由于状态空间explosion.To证明，这些问题可以解决，以提高计算机体系结构的评估，这个试点项目采取的第一步，开发一个开放访问的存储库，允许共享文物和实验结果之间的利益相关者在计算机体系结构的广泛群体。 该项目构建并吸引活跃的用户社区，建立治理和访问策略，并确定存储库软件服务的需求。这个初始原型为社区提供了一个机会，提供反馈和建议，以发展原型和完善其政策。该项目表明，通过共享模拟器和实验，作为科学方法的一部分，可以节省大量的集体努力。它避免了重新实施和重新创建工具，实验，数据集，基准测试等的负担，这种节省的努力和更健全和完整的评估，然后可以针对创新的新架构技术，更好的计算机系统。

The computer architecture research community has created a rich and diverse collection of simulators, emulators, and benchmarks. Each individual research group has its own preferred tools, perhaps built on top of an existing or custom infrastructure. These artifacts are used in experiments to evaluate design trade-offs and to analyze implications to performance, energy, reliability, and other metrics. Unfortunately, the ways in which these tools are used for evaluation often hinder the application of the scientific method. The barrier to entry for using various artifacts (i.e., simulation tools and benchmarks) is usually high, when these artifacts are made available. Experiments are rarely open, nor easily repeatable by other researchers, leading to inaccurate comparisons. Moreover, it is difficult for a single group to explore all variations due to state-space explosion.To demonstrate that these problems can be addressed to improve computer architecture evaluation, this pilot project takes the first steps to develop an open-access repository that permits sharing artifacts and experimental results among a broad group of stakeholders in computer architecture. The project builds and engages an active community of users, establishes governance and access policies, and determines the requirements for software services of the repository. This initial prototype provides the community an opportunity to supply feedback and suggestions to evolve the prototype and refine its policies.The project shows that significant collective effort can be saved by sharing simulators and experiments for accountable and repeatable experimentation as part of the scientific method. It avoids the burden of re-implementing and re-creating tools, experiments, data sets, benchmarks, etc. This savings in effort and more sound and complete evaluation can then be directed on innovating new architectural techniques for better computer systems.