Realistic Uncheatable Benchmarks

设计真实的不可欺骗基准的项目致力于实现基于计算复杂性理论的更复杂的计算机性能基准设计方法。其目标是将随机化和密码学的想法与日常使用的现实现有基准相结合。近年来，理论计算机科学取得了巨大的进步，特别是在随机化和交互作用的力量方面。这些想法非常适合设计不可欺骗的基准。基准测试的目的是评估硬件和软件系统的性能和可靠性。大体上，现有的基准设计侧重于系统的“典型”程序和数据集。让基准抗篡改的问题基本上被忽视了。该项目正在进行的研究已经证明了将计算复杂性和密码学的思想应用于各种现有基准测试的可行性，并使它们更准确、更耐篡改，从而更值得信任。*

The project on the design of realistic uncheatable benchmarks strives to achieve a more sophisticated design methodology of computer performance benchmarks, based on the theory of computational complexity. The goal is to integrate ideas from randomization and cryptography with realistic existing benchmark in everyday use. There has been tremendous progress in theoretical computer science in recent years, especially with regard to the power of randomization and interaction. These ideas are well suited to the design of uncheatable benchmarks. The purpose of benchmark testing is to estimate the performance and reliability of hardware and software systems. By and large existing benchmark design has focused on "typical" programs and data sets for the system. The problem of making benchmarks resistant to tampering has been mostly ignored. The on-going research in this project has demonstrated the feasibility of applying ideas from computational complexity and cryptography to a wide variety of existing benchmarks, and making them more accurate, resistant to tampering and thus more trustworthy.***