Collaborative Research: SHF: Medium: A hardware-software co-design approach for high-performance in-memory analytic data processing

协作研究：SHF：中：用于高性能内存分析数据处理的硬件软件协同设计方法

• 批准号: 2312741
• 负责人: Jose Martinez
• 金额: $ 40万
• 依托单位: Cornell University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-10-01 至 2026-09-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2312741&HistoricalAwards=false
• 关键词: Collaborative; Research; SHF; Medium; hardware

Database analytics is crucial for decision-making across various industries and fields of inquiry. However, there is a challenge: analyzing large amounts of data using traditional methods takes more time and money as the volume of data grows. Resolving this issue is vital for enterprises to stay competitive through fast and accurate data-driven decision-making and to keep up with rapid growth in data volumes. In the past, hardware and software for analytics could be developed separately, benefiting from Moore's Law (doubling of transistor density with each transistor generation) and Dennard scaling (which allowed Moore's Law to proceed without increasing power density). This scaling allowed the industry to steadily improve the performance of general-purpose hardware. However, we have now reached the physical limits of these trends and need new hardware approaches to enhance analytics speed and efficiency. Furthermore, processing units are now much faster than memory, so applications with large volumes of data are increasingly bottlenecked by memory accesses. This research, therefore, focuses on memory devices, in particular designing ``intelligent'' memory capable of computing results near the stored data, and proposes a solution by redesigning both hardware and software components of an analytics pipeline to work synergistically, addressing the data analytics performance issue from the ground up. This innovative approach has the potential to significantly improve the efficiency of data analytics. The project is a collaboration between one database and software researcher at the University of Wisconsin-Madison (UW) and two computer architecture and systems researchers at Cornell University and the University of Virginia (UVA). The project is organized into four thrusts. Thrust 1 aims to develop mechanisms for in-place data analytics query processing on the dynamic random access memory (DRAM) side and explore the synergies between intelligent DRAM and other processing units. Thrust 2 focuses on processing in memory (PIM) designs for static random-access memory (SRAM)-based caches, exploring associative processing (AP) and its applicability to data analytics workloads. Thrust 3 takes a holistic approach to accelerate analytics queries across both SRAM and DRAM-based PIM designs. It proposes a Domain-Specific Language (DSL)-based approach using an operational algebra, decomposing queries into a dataflow graph and optimizing their execution across different PIMs and the Central Processing Unit (CPU). Finally, Thrust 4 addresses the need for evaluation frameworks in the database-hardware co-design approach by developing a simulation infrastructure and benchmarks that can be used by the broader architecture and database research communities. Besides training students involved in this project across the hardware-software boundaries, the project will also support outreach efforts in entrepreneurship education at UW. Additionally, there are outreach plans to Native American high school students through an effort at Cornell, and at UVA, the project will contribute to ongoing efforts to build long-term collaborations with Historically Black Colleges and Universities (HBCUs) and Minority-Serving Institutions (MSIs) in the Virginia area.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

数据库分析对于不同行业和查询领域的决策至关重要。然而，存在一个挑战：随着数据量的增长，使用传统方法分析大量数据需要更多的时间和金钱。解决这一问题对于企业通过快速、准确的数据驱动决策保持竞争力以及跟上数据量的快速增长至关重要。在过去，分析的硬件和软件可以单独开发，得益于摩尔定律(每产生一次晶体管，晶体管密度翻一番)和Dennard比例(这允许摩尔定律在不增加功率密度的情况下继续进行)。这种扩展使该行业能够稳步提高通用硬件的性能。然而，我们现在已经达到了这些趋势的物理极限，需要新的硬件方法来提高分析速度和效率。此外，处理单元现在比内存快得多，因此拥有大量数据的应用程序越来越多地受到内存访问的瓶颈。因此，这项研究侧重于存储设备，特别是设计能够计算存储数据附近结果的“智能”存储器，并提出了一种解决方案，通过重新设计分析管道的硬件和软件组件以协同工作，从根本上解决数据分析性能问题。这种创新的方法有可能显著提高数据分析的效率。该项目是威斯康星大学麦迪逊分校(UW)的一个数据库和软件研究人员，以及康奈尔大学和弗吉尼亚大学(UVA)的两名计算机架构和系统研究人员合作完成的。这个项目被组织成四个项目。推力1旨在开发动态随机存取存储器(DRAM)端的就地数据分析查询处理机制，并探索智能DRAM与其他处理单元之间的协同效应。推力2专注于基于静态随机存取存储器(SRAM)的高速缓存的内存中处理(PIM)设计，探索关联处理(AP)及其对数据分析工作负载的适用性。推力3采用整体方法来加速跨SRAM和基于DRAM的PIM设计的分析查询。它提出了一种基于领域特定语言(DSL)的方法，使用操作代数，将查询分解到数据流图中，并在不同的PIM和中央处理单元(CPU)上优化它们的执行。最后，推力4通过开发可供更广泛的体系结构和数据库研究界使用的模拟基础设施和基准，解决了数据库-硬件联合设计方法中对评价框架的需求。除了培训参与该项目的学生跨越硬件和软件的界限外，该项目还将支持威斯康星大学创业教育的外展工作。此外，在康奈尔大学和弗吉尼亚大学，该项目还通过努力向美国原住民高中生推广计划，该项目将有助于与弗吉尼亚州地区历史上的黑人学院和少数族裔服务机构(MSI)建立长期合作关系。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。