Scheduling and Adaptive Execution of Data Analysis Workflows across Heterogeneous Infra-structures (B01)

点击翻译按钮获取中文摘要

The scalable implementation of complex DAWs requires profound knowledge of a deep technology stack consisting of an abstract DAW description, compilation of logical plans, mapping onto the cur-rently available infrastructure, and appropriate configuration of execution engines. Components de-veloped for one system are often unsuitable for another, leading to an undesirable platform lock-in. The goal of B1 is to enhance portability and adaptation of DAWs by mapping their requirements to a declarative description of the available infrastructure combined with novel scheduling algorithms that exploit these descriptions. B1 is an important partner for several other FONDA subprojects, as the declarative hardware descriptions it develops are one of the key requirements for achieving portability. B1 will be led by Prof. Kao, an expert in the management and programming of large distributed sys-tems, and Prof. Meyerhenke, an expert in efficient scheduling algorithms and load balancing with ample prior experience in scientific applications.