CSR---AES: Dynamic Adaptive Multithreading: Continuous Compilation and Runtime Scheduling for High End Computing

软件和工具的重大进步对于有效应用未来的高端计算(HEC)系统至关重要，HEC系统将在一个综合结构中展示数万(甚至数百万)个执行站点/线程。传统实践在很大程度上局限于分布式内存环境中基于SPMD的消息传递编程模型，它们提供有限程度的系统范围的应用程序控制，但通常被证明效率低下，并且难以针对大型复杂问题进行编程、调试和性能调优。这些挑战只会随着时钟速度、内存密度、系统规模、内存层次结构和问题复杂性在2010年前显著增加到Peta-flops规模而增加。该研究项目解决了性能降级的根本原因(例如延迟、开销和饥饿)和程序员工作效率的困难(例如显式局部性管理和调度、性能调优、碎片内存和同步全局障碍)，以显著增强高端计算的并行处理的广泛有效性。该项目将开发包括动态、多线程执行模型和编程模型的层次化线程虚拟机(HTVM)，为HEC系统软件和工具开发提供体系结构抽象。该项目将进行持续编译和运行时间软件技术的研究和开发，这些技术对于实现港灯系统的动态适应性至关重要。该研究项目解决了性能降低的潜在来源(例如延迟、开销和饥饿)和程序员生产力的困难(例如显式局部性管理和调度、性能可伸缩性、负载平衡和高效同步等)，并将在一个新的系统软件和工具框架中实施这些方法，以显著增强用于高端计算的并行处理的广泛有效性。

A substantial advance in software and tools is essential for effective application of future High-End Computing (HEC) systems exhibiting tens of thousands (or even millions) of execution sites/threads in an integrated structure. Conventional practices, largely restricted to SPMD-based messagepassing programming models in the context of distributed memory, provide limited degree of system-wide application control but often prove inefficient and are difficult to program, debug, and tune performance for large complex problems. These challenges will only increase as clock speeds, memory densities, system scale, memory hierarchy, and problem complexity increase significantly throughout this decade to peta-flops scale before 2010.This research project addresses the underlying sources of performance degradation (e.g. latency, overhead, and starvation) and the difficulties of programmer productivity (e.g. explicit locality management and scheduling, performance tuning, fragmented memory, and synchronous global barriers) to dramatically enhance the broad effectiveness of parallel processing for high end computing. The project will develop a hierarchical threaded virtual machine (HTVM) that includes a dynamic, multithreaded execution model and programming model, providing an architecture abstraction for HEC system software and tools development. The project will conduct research and development of a continuous compilation and runtime software technology that are critical to enable the dynamic adaptivity of the HEC system. The research project addresses the underlying sources of performance degradation (e.g. latency, overhead, and starvation) and the difficulties of programmer productivity (e.g. explicit locality management and scheduling, performance scalability, load balancing efficient synchronization, etc.), and and will implement these methods in a novel framework of system software and tools to dramatically enhance the broad effectiveness of parallel processing for high end computing.