Serverless Data Management Primitives for Software-defined Composable Systems

软件定义可组合系统的无服务器数据管理原语

• 批准号: 450276976
• 负责人: Professor Dr.-Ing. Wolfgang Lehner
• 金额: --
• 依托单位: Professur für Datenbanken
• 依托单位国家: 德国
• 项目类别: Reinhart Koselleck Projects
• 资助国家: 德国
• 项目状态: 未结题
• 来源: https://gepris.dfg.de/gepris/projekt/450276976?language=en
• 关键词: Serverless; Data; Management; Primitives; Software

The scientific as well as the commercial domain of data management has experienced a significant push within the last two decades. "Data as the new oil" has sparked research and innovation in all areas of data management systems, from theory via system-related work to data-intensive applications. In addition to novel data management architectures, the research community also explored the efficient use of modern hardware like GPU, FPGA, RDMA, etc.Within this project however, we plan to take the next step and target an upcoming hardware technology currently discussed in the context of Composable Systems. Composable Systems are software-defined computers directly "soft-wiring" a collection of real hardware components and thus completely blurring the boundaries of traditional Scale-Out or Scale-Up architectures. Since such a "Logical" system may be dynamically re-composed, each algorithm may define the "optimal" composition by instantly adding/removing computing units, changing memory and storage assignments, and modifying the topology of the memory and data backplane. While software is traditionally striving to optimally exploit the use of existing (hard-wired) hardware, the goal is now to identify the optimal combination of a software and (soft-wired) hardware configuration. The characteristics of such software-defined infrastructures require a fundamental re-thinking of many existing algorithms and data structures. Being able to re-compose many aspects of an underlying "Computer" during runtime (!) of an application opens up a large field of widely unexplored research opportunities. Reflecting the nature of a Reinhart Koselleck proposal, we aim at investigating the impact of such "next-next"-generation hardware environments of Composable Systems on the design and architecture of data management primitives to efficiently run large-scale but also transactionally correct query workloads. As of now, we are not aware of any dedicated data management research project with this particular focus on Composable Systems. We strive to produce internationally visible results and expect publications and presentations at international conferences like ACM SIGMOD, VLDB (PVLDB), IEEE ICDE as well as within journals like ACM TODS, VLDB Journal, and IEEE Data Engineering Bulletin.

数据管理的科学和商业领域在过去二十年中经历了重大的推动。“数据作为新的石油”引发了数据管理系统各个领域的研究和创新，从理论到系统相关工作，再到数据密集型应用。除了新颖的数据管理架构，研究界还探索了GPU，FPGA，RDMA等现代硬件的有效使用，但是在这个项目中，我们计划采取下一步，并针对目前在可组合系统的背景下讨论的即将到来的硬件技术。可组合系统是软件定义的计算机，直接“软连接”一组真实的硬件组件，从而完全模糊了传统横向扩展或纵向扩展架构的界限。由于这样的“逻辑”系统可以被动态地重新组成，因此每个算法可以通过立即添加/移除计算单元、改变存储器和存储分配以及修改存储器和数据底板的拓扑来定义“最优”组成。虽然软件传统上努力最佳地利用现有（硬连线）硬件的使用，但现在的目标是确定软件和（软连线）硬件配置的最佳组合。此类软件定义基础设施的特征需要对许多现有算法和数据结构进行根本性的重新思考。能够在运行时重新组合底层“计算机”的许多方面（！）一个应用程序打开了一个广泛的未开发的研究机会的大领域。反映了莱因哈特Koselleck建议的性质，我们的目标是调查这种“下一个下一代”的组合系统的硬件环境的设计和架构的数据管理原语，有效地运行大规模的，但也transactionally正确的查询工作负载的影响。到目前为止，我们还不知道有任何专门的数据管理研究项目特别关注组合系统。我们努力产生国际可见的结果，并期望在ACM SIGMOD，VLDB（PVLDB），IEEE ICDE等国际会议上以及ACM TODS，VLDB Journal和IEEE Data Engineering Bulletin等期刊上发表文章和演讲。