CSR---AES: Dynamic Adaptive Multithreading: Continuous Compilation and Runtime Scheduling for High End Computing

软件和工具的重大进步对于未来的高端计算（HEC）系统的有效应用至关重要，这些系统在集成结构中展示了数万（甚至数百万）个执行站点/线程。传统的实践主要局限于分布式内存环境中基于spmd的消息传递编程模型，提供了有限程度的系统范围应用程序控制，但往往被证明效率低下，难以对大型复杂问题进行编程、调试和性能调优。这些挑战只会随着时钟速度、内存密度、系统规模、内存层次结构和问题复杂性的显著增加而增加，直到2010年之前达到千兆级。该研究项目解决了性能下降的潜在根源（例如延迟，开销和饥饿）和程序员生产力的困难（例如明确的局部性管理和调度，性能调优，碎片内存和同步全局屏障），以显着提高高端计算并行处理的广泛有效性。该项目将开发一个分层线程虚拟机（HTVM），其中包括一个动态的多线程执行模型和编程模型，为HEC系统软件和工具开发提供一个架构抽象。该项目将进行持续编译和运行时软件技术的研究和开发，这对于实现HEC系统的动态适应性至关重要。该研究项目解决了性能下降的潜在根源（例如延迟，开销和饥饿）和程序员生产力的困难（例如明确的局部性管理和调度，性能可扩展性，负载平衡高效同步等），并将在系统软件和工具的新框架中实现这些方法，以显着提高高端计算并行处理的广泛有效性。

A substantial advance in software and tools is essential for effective application of future High-End Computing (HEC) systems exhibiting tens of thousands (or even millions) of execution sites/threads in an integrated structure. Conventional practices, largely restricted to SPMD-based messagepassing programming models in the context of distributed memory, provide limited degree of system-wide application control but often prove inefficient and are difficult to program, debug, and tune performance for large complex problems. These challenges will only increase as clock speeds, memory densities, system scale, memory hierarchy, and problem complexity increase significantly throughout this decade to peta-flops scale before 2010.This research project addresses the underlying sources of performance degradation (e.g. latency, overhead, and starvation) and the difficulties of programmer productivity (e.g. explicit locality management and scheduling, performance tuning, fragmented memory, and synchronous global barriers) to dramatically enhance the broad effectiveness of parallel processing for high end computing. The project will develop a hierarchical threaded virtual machine (HTVM) that includes a dynamic, multithreaded execution model and programming model, providing an architecture abstraction for HEC system software and tools development. The project will conduct research and development of a continuous compilation and runtime software technology that are critical to enable the dynamic adaptivity of the HEC system. The research project addresses the underlying sources of performance degradation (e.g. latency, overhead, and starvation) and the difficulties of programmer productivity (e.g. explicit locality management and scheduling, performance scalability, load balancing efficient synchronization, etc.), and and will implement these methods in a novel framework of system software and tools to dramatically enhance the broad effectiveness of parallel processing for high end computing.