CAREER: Timeliness as a Controllable Dimension via Knowledge-driven System Management

现代生活方式渗透并在很大程度上由与计算系统的共生交互定义。这些被期望在正确的时间（及时性）采取有意义的行动（逻辑正确性）。在无人驾驶汽车和飞机、制造业和发电厂以及重症监护和生命支持设备等安全关键型自主系统中，时间至关重要。类似地，企业和云系统中的服务质量主要包括应用程序工作负载的时间特性。不幸的是，过去十年对智能系统的强烈推动导致了软件和硬件层复杂性的爆炸式增长。反过来，系统复杂性的急剧上升大大削弱了我们推理、预测和控制应用程序工作负载的及时性的能力。该教师早期职业发展（CAREER）项目旨在通过综合研究和教育计划，协调对及时性的关键需求与现代智能系统日益增长的复杂性。该研究的重点是将及时性转变为一个可以在高性能平台中直接和明确管理的维度。它通过认识到收集有关软件和硬件组件之间低层次相互作用的精确知识并根据这些知识采取行动的重要性来做到这一点。系统的范式来收集，保留和利用这些知识进行了研究，具体侧重于实用的技术，可以立即在商业平台上使用。作为补充，PI设计了教育活动，将及时性作为计算机科学课程中的基本设计时维度，并为大学预科学生设计了一些外展活动，以探索时间敏感系统中的挑战。通过协调计划重新思考硬件和平台软件组件的作用，PI将为知识驱动的系统管理制定蓝图，并将对及时性的明确控制作为目标。包括传统处理元件和可重编程逻辑的新兴商业现成平台提供了实际实例化所述蓝图的独特机会。三个正交的研究推力包括这项研究工作的支柱。第一个重点是设计和开发一套使能机制，以最小的开销来观察和控制性能关键的硬件资源。特别是，观察机制被设计为收集对微尺度应用平台交互的见解。相反，控制机制被设计为在微架构级别执行细粒度的资源供应决策。第二个推力解决了从细粒度数据中提取知识的挑战。这需要将获取的数据流置于上下文中，以构建及时应用程序进度的概念。利用及时的进度信息来检测过去的不足/过度配置，并相应地执行分配/回收。同时，策略，以准确地预测未来的应用程序进展的资源供应政策的影响进行了探讨。最后，第三个推力涉及多个应用程序工作负载的关键性感知组合，具有指定的及时性要求，对硬件资源的概要需求，以及响应于资源配置变化的已知时间行为。这个项目的意义有三个方面。首先，通过知识驱动的系统管理直接控制复杂应用程序的及时性，为数据驱动的实时决策提供了必要的原则基础。其次，作为这项工作的一部分开发的方法和技术将作为未来硬件平台的参考，以实现控制的及时性设计。第三，针对波士顿大学预科生、本科生和研究生的跨学科活动旨在将时间行为分析和时间性纳入计算机科学教育的前景。该奖项反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

The modern lifestyle is permeated and largely defined by a symbiotic interaction with computing systems. These are expected to take meaningful actions (logical correctness) at the right time (timeliness). Timeliness is crucial in safety-critical autonomous systems such as driverless vehicles and aircraft, manufacturing and power plants, and devices for intensive care and life support. Similarly, quality-of-service in enterprise and cloud systems primarily encompasses the temporal characteristics of application workloads. Unfortunately, the intense push for intelligent systems over the last decade has caused an explosion in the complexity of software and hardware layers. In turn, the sharp rise in system complexity has significantly weakened our ability to reason about, predict, and control the timeliness of application workloads. This Faculty Early Career Development (CAREER) project aims to reconcile the critical need for timeliness with the growing complexity of modern intelligent systems with an integrative research and education plan. The research focuses on turning timeliness into a dimension that can be directly and explicitly managed in high-performance platforms. It does so by recognizing the importance of gathering and acting upon precise knowledge about the low-level interplay between software and hardware components. Systemic paradigms to collect, retain, and leverage such knowledge are studied, with a specific focus on practical technology that can be immediately employed on commercial platforms. In a complementary way, the PI has devised educational activities to introduce timeliness as a fundamental design-time dimension in computer science curricula, with a number of outreach activities designed for pre-college students to explore challenges in time-sensitive systems.Through a coordinated plan to rethink the role of hardware and platform-software components, the PI will lay down the blueprints for knowledge-driven system management with explicit control over timeliness as a goal. Emerging commercial-off-the-shelf platforms that include traditional processing elements and reprogrammable logic provide a unique opportunity to practically instantiate said blueprints. Three orthogonal research thrusts comprise the pillars of this research effort. The first thrust focuses on designing and developing a set of enabling mechanisms to observe and control performance-critical hardware resources with minimal overhead. In particular, observation mechanisms are designed to collect insights into micro-scale application-platform interactions. Conversely, control mechanisms are devised to enforce fine-grained resource provisioning decisions at a micro-architectural level. The second thrust tackles the challenge of extracting knowledge from fine-grained data. This entails contextualizing the acquired data streams to construct a notion of timely application progress. Timely progress information is leveraged to detect past under-/over-provisioning and perform allocation/reclaiming accordingly. Simultaneously, strategies to accurately predict the impact of resource provisioning policies over future application progress are explored. Finally, the third thrust concerns the criticality-aware composition of multiple application workloads with specified timeliness requirements, profiled demand for hardware resources, and known temporal behavior in response to changes in resource provisioning. The significance of this project is threefold. First, direct control over the timeliness of complex applications via knowledge-driven system management provides the necessary principled foundations for data-driven real-time decision-making. Second, the methodologies and techniques developed as part of this effort will serve as a reference for future hardware platforms to achieve control over timeliness by design. Third, cross-cutting activities targeting pre-college, undergraduate, and graduate students at Boston University aim to bring temporal behavior analysis and timeliness into the foreground of computer science education.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.