Next-Generation Data Management Systems and Software Tools

下一代数据管理系统和软件工具

• 批准号: RGPIN-2019-04620
• 负责人: Wang, Tianzheng
• 金额: $ 2.4万
• 依托单位: Simon Fraser University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2020
• 资助国家: 加拿大
• 起止时间: 2020-01-01 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=715072
• 关键词: Next; Generation; Data; Management; Systems

Modern data-intensive applications, such as machine learning and data mining, fundamentally depend on database systems to meet their performance, functionality and reliability requirements. This puts pressing needs on database systems to best utilize the hardware infrastructure. The recent commoditization of persistent memory (PM) and programmable networks is transforming both on-premise and cloud infrastructure. They bring many opportunities to optimize database systems, but also invalidate many prior designs and assumptions. Existing designs are not ready and will lead to sub-optimal results. This research program explores key principles for building next-generation database systems in the context of PM and programmable networks through the following three modules. 1. Persistent Memory Database System: PM fills the gap between main memory and storage, thus has the potential of enabling an "ideal" database system that commits transactions fast, recovers instantly, and performs as fast as today's main-memory databases but at a lower cost. Existing work often has to trade off some of these features for performance. This research leverages the diversity of PM (e.g., NVDIMMs, Intel Optane) to realize the aforementioned desirable functionality without tradeoffs. 2. Database-Network-PM Co-design: Future servers will be equipped with large amounts of PM and interconnected by programmable networks. This combination opens up opportunities for applications to offload operations to the network with immediate persistence by PM, freeing up precious CPU cores for more useful work. It requires a coordinated effort to co-design components in the network, use of PM and database system components to reap the full benefits of such hardware, which is the objective of this research. 3. Efficient and Reliable Tools for Programming PM and Fast Networks: The making of database systems relies on tools suitable for persistent memory and future programmable networks. But existing tools fall short on data integrity, reliability and programmability. These problems must be solved before PM and programmable networks can be widely adopted. This research focuses on such issues, with a final goal of creating and maintaining a framework and tools that evolve with future PM and programmable network technologies. Impact: With the recent commoditization, PM and programmable networks will likely become part of the standard infrastructure for data-intensive applications. This research program is necessary for database systems and tools to continue to evolve with hardware advances. It will enhance Canada's strengths in related areas and benefit applications that rely on database systems, e.g., data mining, machine learning and visualization, with high-performance yet low-cost solutions. It will contribute to Canadian economy by training highly qualified personnel (including female students and under-represented groups) whose expertise are in high demand in academia and industry.

现代数据密集型应用程序，例如机器学习和数据挖掘，从根本上依赖数据库系统来满足其性能、功能和可靠性要求。这迫切需要数据库系统充分利用硬件基础设施。最近持久内存 (PM) 和可编程网络的商品化正在改变本地和云基础设施。它们带来了许多优化数据库系统的机会，但也使许多先前的设计和假设失效。现有设计尚未准备好，将导致次优结果。该研究计划通过以下三个模块探索在 PM 和可编程网络背景下构建下一代数据库系统的关键原则。 1.持久内存数据库系统：PM填补了主内存和存储之间的空白，因此有可能实现“理想”的数据库系统，该系统可以快速提交事务，立即恢复，并且与当今的主内存数据库一样快地执行，但成本更低。现有的工作通常必须牺牲其中一些功能来换取性能。这项研究利用 PM（例如 NVDIMM、Intel Optane）的多样性来实现上述所需的功能，而无需权衡。 2.数据库-网络-PM协同设计：未来的服务器将配备大量的PM并通过可编程网络互连。这种组合为应用程序提供了通过 PM 立即持久性将操作卸载到网络的机会，从而释放宝贵的 CPU 核心来执行更有用的工作。需要协调一致地共同设计网络中的组件、使用 PM 和数据库系统组件才能充分发挥此类硬件的优势，这也是本研究的目标。 3. 用于编程PM和快速网络的高效可靠的工具：数据库系统的制作依赖于适合持久存储器和未来可编程网络的工具。但现有工具在数据完整性、可靠性和可编程性方面存在缺陷。在PM和可编程网络得到广泛采用之前，必须解决这些问题。本研究重点关注此类问题，最终目标是创建和维护随未来 PM 和可编程网络技术一起发展的框架和工具。 影响：随着最近的商品化，PM 和可编程网络可能会成为数据密集型应用程序标准基础设施的一部分。该研究计划对于数据库系统和工具随着硬件的进步而继续发展是必要的。它将增强加拿大在相关领域的优势，并使依赖数据库系统的应用程序受益，例如数据挖掘、机器学习和可视化，以及高性能且低成本的解决方案。它将通过培训学术界和工业界急需的高素质人才（包括女学生和代表性不足的群体）来为加拿大经济做出贡献。