SHF: Small: Latency Tolerance Aware Runtime Optimization for General-Purpose GPU Architectures

SHF：小型：通用 GPU 架构的延迟容忍感知运行时优化

• 批准号: 1618039
• 负责人: Carole-Jean Wu
• 金额: $ 33万
• 依托单位: Arizona State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-08-01 至 2021-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1618039&HistoricalAwards=false
• 关键词: SHF; Small; Latency; Tolerance; Aware

Computing touches almost all aspects of our modern day lives -- from gene sequencing to physics simulations to powering the Internet, from real-time image and voice recognition to predicting stock market trends. The programmability advancement of high-performance accelerators, such as graphics processors, has enabled a large, diverse set of general-purpose algorithms to enjoy performance acceleration on GPUs. However, because the unique latency tolerance GPU design feature is often not taken into account, the state-of-the-art solutions lead to sub-optimal performance improvement. The proposed Latency Tolerance Aware runtime optimization framework (LATTE) can help the computing industry realize its high performance and high energy efficiency vision. Performance acceleration of important general-purpose algorithms with large and diverse input data sets has a profound impact on the advancement of all research domains and on society. The research agenda is complemented by an education agenda focusing on heterogeneous computing.The LATTE framework proposed in this project aims to explore and propose architectural solutions and to create system supports to accelerate the execution of important general-purpose applications on GPUs. The proposed LATTE runtime optimization framework revolves around identifying and designing optimization techniques that are fully latency tolerance aware in order to maximize performance improvement for GPGPUs. The pitfalls for directly adapting CPU-centric optimization to GPU architectures are analyzed and used to motivate the need to proactively manage the highly time-multiplexed computation and memory resources considering the critical latency tolerance characteristic of GPUs. The findings can serve as foundations for future performance optimization research to avoid blind replication, leading to important scientific research contributions for GPGPU acceleration.

计算几乎触及我们现代生活的方方面面--从基因测序到物理模拟，再到为互联网供电，从实时图像和语音识别到预测股市趋势。高性能加速器（如图形处理器）的可编程性进步使大量不同的通用算法能够在GPU上享受性能加速。然而，由于独特的延迟容限GPU设计特征通常没有被考虑在内，因此最先进的解决方案导致次优的性能改进。提出的延迟容忍感知运行时优化框架（LATTE）可以帮助计算行业实现其高性能和高能效的愿景。具有大型和多样化输入数据集的重要通用算法的性能加速对所有研究领域和社会的进步产生了深远的影响。该项目提出的LATTE框架旨在探索和提出架构解决方案，并创建系统支持，以加速在GPU上执行重要的通用应用程序。所提出的LATTE运行时优化框架围绕识别和设计完全延迟容限感知的优化技术，以最大限度地提高GPGPU的性能。直接适应以CPU为中心的优化GPU架构的陷阱进行了分析，并用于激励需要主动管理高度时间复用的计算和内存资源，考虑到关键的延迟容忍特性的GPU。这些发现可以作为未来性能优化研究的基础，以避免盲目复制，从而为GPGPU加速做出重要的科学研究贡献。