Improving Data Organization in Managed Runtimes for Improved Performance

改进托管运行时中的数据组织以提高性能

• 批准号: RGPIN-2019-04415
• 负责人: Kent, Kenneth
• 金额: $ 2.48万
• 依托单位: University of New Brunswick
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2019
• 资助国家: 加拿大
• 起止时间: 2019-01-01 至 2020-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=685272
• 关键词: Improving; Data; Organization; Managed; Runtimes

Many software applications today are specified in interpreted languages. Interpretation allows applications to more easily execute and migrate on various platforms through the use of managed runtime technologies. This abstraction from the physical host as led to automation of resource acquisition and management such as processor scaling and memory management (garbage collection). As heap sizes increase, so does the cost incurred by garbage collection (GC) in managed runtimes. While scaling of dynamic memory in the host continues, so too does the demand by applications for more memory to satisfy the ever-increasing data to be processed. This discovery grant application is focused on the organization of data stored in dynamic memory within managed runtimes to achieve two goals. First, to segregate data objects/structures into different classes reflecting their access frequency to permit better mapping to different memory levels within the managed runtime. Second, to organize data within the dynamic memory so as to reduce pause times for garbage collection.***Java programmers expect the Java Virtual Machine (JVM) to deal with all aspects of resource management, including the object heap, in a transparent way; the definition of the language, which has a create construct but no corresponding delete for objects, is emblematic of this. However, this illusion of infinite free space is destroyed on large GC pauses. Because of this, different approaches to GC need to be explored in order to achieve low, consistent pause times while keeping applications running smoothly and with high performance. To achieve this, I propose to explore new escape analysis techniques, and to investigate a segregated heap system for locally v. globally allocated objects.***Cache and Translation Lookaside Buffer (TLB) misses cause large performance issues in most large Java applications. One way to mitigate these issues is by improving object locality. Improving object locality has proven to reduce cache and TLB misses in Java applications using the openJ9 JVM via Hierarchical Copying GC in the generational collector. When an object reference is followed from a parent object to a child the memory for the child object will need to be loaded into cache memory. If these objects were located within the same cache line or on the same memory page we could possibly save the cache and TLB misses. There several interesting areas of research that could improve object locality. *****

当今许多软件应用程序都是用解释语言指定的。解释允许应用程序通过使用托管运行时技术更轻松地在各种平台上执行和迁移。这种对物理主机的抽象导致了资源获取和管理的自动化，例如处理器扩展和内存管理（垃圾收集）。随着堆大小的增加，托管运行时中垃圾收集 (GC) 产生的成本也会增加。虽然主机中的动态内存不断扩展，但应用程序对更多内存的需求也在不断增加，以满足不断增加的要处理的数据。该发现资助申请的重点是在托管运行时内组织存储在动态内存中的数据，以实现两个目标。首先，将数据对象/结构分成反映其访问频率的不同类，以允许更好地映射到托管运行时内的不同内存级别。其次，在动态内存中组织数据，以减少垃圾收集的暂停时间。***Java程序员期望Java虚拟机（JVM）能够以透明的方式处理资源管理的各个方面，包括对象堆；该语言的定义具有创建结构，但没有相应的对象删除功能，这就是这一点的象征。然而，这种无限可用空间的幻觉在大量 GC 暂停时就会被破坏。因此，需要探索不同的 GC 方法，以实现较短且一致的暂停时间，同时保持应用程序平稳且高性能地运行。为了实现这一目标，我建议探索新的逃逸分析技术，并研究本地和全局分配对象的隔离堆系统。***缓存和转换后备缓冲区 (TLB) 未命中会在大多数大型 Java 应用程序中导致严重的性能问题。缓解这些问题的一种方法是改善对象局部性。事实证明，通过分代收集器中的分层复制 GC，使用 openJ9 JVM 改进对象局部性可以减少 Java 应用程序中的缓存和 TLB 缺失。当对象引用从父对象到子对象时，子对象的内存将需要加载到高速缓存中。如果这些对象位于同一缓存线或同一内存页上，我们可能会避免缓存和 TLB 未命中。有几个有趣的研究领域可以改善对象局部性。 *****