Top500 versus sustained performance - the top problems with the TOP500 list - and what to do about them
Top500 versus sustained performance - the top problems with the TOP500 list - and what to do about them
复制标题
Top500 与持续绩效 - TOP500 列表的首要问题 - 以及如何解决这些问题
DOI：
10.1145/2370816.2370850
复制
发表时间：
2012
期刊：
影响因子：
--
通讯作者：
W. Kramer
中科院分区：
文献类型：
--
作者：
W. Kramer
一位颇受欢迎的美国脱口秀主持人每天晚上都会用十大脱口秀节目名单来批评事件和文化。我们的HPC行业被另一个榜单-TOP500榜单迷住了，它是一种基于LOPS/S由单一的、长期存在的基准-LINPACK评估的跟踪HPC系统性能的方法。TOP500榜单的影响力越来越大，因为它作为一种营销工具具有价值。它简单但不现实地描述了高性能计算系统的性能。支持者在不同的时间以不同的理由倡导TOP500榜单。本文批评了TOP500排行榜的十大问题，并就如何纠正这些不足提出了建议。它讨论了为什么TOP500榜单限制了高性能计算系统对实际问题的影响，以及可能更有意义和更有用地代表高性能计算系统的真正有效性和价值的其他指标。
A popular U.S. talk show host uses “top 10” lists to critique events and culture every night. Our HPC industry is captivated by another list, the TOP500 list, as a way to track HPC systems' performance based on FLOPS/S assessed by a single, long-lived benchmark—Linpack. The TOP500 list has grown in influence because of its value as a marketing tool. It simplistically, but unrealistically, describes performance of HPC systems. The proponents have advocated for the TOP500 list for different reasons at different times. This paper critiques the Top 10 problems with the TOP500 list and provides suggestions on how to correct those shortcomings. It discusses why the TOP500 list is limiting the impact of HPC systems on real problems and other metrics that may be more meaningful and useful to represent the real effectiveness and value of HPC systems.