Towards Systematic and Cost-Effective Monitoring of Large-Scale Software Systems

大型软件系统的故障会对我们的生命和安全以及我们社会的经济和安全产生重大影响。例如，加拿大税务局（CRA）网站在2017年3月和2019年3月的故障使许多加拿大人无法提交税款。为了快速检测和解决此类故障并减少其对用户的影响，了解这些系统的内部状态和运行时行为至关重要。软件可观测性（即，系统的内部状态可以被推断的程度）允许软件工程师获得这样的理解，以验证系统是否如预期的那样运行，以及检测和诊断运行时故障。软件监控（例如，日志和跟踪）是保证大型软件系统可观测性的关键。尽管软件监控的重要性，一些挑战复杂的大型软件系统的监控。首先，大型软件系统通常由许多组件组成（例如，微服务），可能由不同的组织使用不同的编程语言开发。此外，这些组成部分往往是不断演变的。这些系统的异构性和不断变化的性质使得确保对这些系统进行一致和最新的监测变得具有挑战性。其次，随着软件的规模和复杂性的增加，对产生和管理监视数据所需的计算资源的要求也增加，这可能引入显著的开销（例如，性能和存储开销）到大规模软件系统的操作。第三，大规模软件系统通常从多个源（例如，来自不同的网络服务和应用程序），这对这些数据的分析和利用提出了挑战。 我的长期研究目标是发现，设计和开发一个全面和系统的解决方案，以改善软件监控和提高大型软件系统的可观测性。为了实现这一长期目标，拟议的研究计划将从三个相互补充的角度来解决软件监测的挑战：软件开发，软件执行和监测数据的分析。首先，我们的目标是通过系统地考虑整个软件开发生命周期中的监控方面来提高软件监控的质量。其次，我们的目标是通过动态优化软件执行过程中的监控强度来提高软件监控的成本效益。第三，我们将开发通用方法来简化分析监测数据的通用工作流程。拟议的研究计划将是一个开创性的尝试，系统地提高大型软件系统的监测和可观测性，这将有利于在加拿大生产高质量的软件的研究和实践。

Failures of large-scale software systems can have significant impacts on our lives and safety, as well as on the economy and security of our society. For example, failures of the Canada Revenue Agency (CRA) website in March 2017 and March 2019 blocked many Canadians from filing their taxes for days. To detect and address such failures quickly and reduce their impact on users, it is crucial to gain an understanding of the internal state and runtime behavior of these systems. Software observability (i.e., the extent to which the internal state of a system can be inferred) allows software engineers to gain such an understanding, to verify if a system behaves as expected, and to detect and diagnose runtime failures. Software monitoring (e.g., logging and tracing) is the key to ensure the observability of large-scale software systems. Despite the importance of software monitoring, several challenges complicate the monitoring of large-scale software systems. First, large-scale software systems are usually composed of many components (e.g., microservices) that may be developed by different organizations using different programming languages. Furthermore, these components are often evolving. The heterogeneous and evolving nature makes it challenging to ensure consistent and up-to-date monitoring of these systems. Second, as the scale and complexity of software increases, so do the requirements on the computing resources needed to produce and manage the monitoring data, which could introduce significant overhead (e.g., performance and storage overhead) to the operations of large-scale software systems. Third, large-scale software systems usually generate a very large amount of monitoring data from multiple sources (e.g., from different web services and applications), which poses challenges for the analysis and utilization of these data. My long-term research goal is to discover, design, and develop a comprehensive and systematic solution to improve software monitoring and increase the observability of large-scale software systems. To achieve this long-term goal, the proposed research program will tackle the challenges of software monitoring from three mutually complementary perspectives: software development, software execution, and analysis of monitoring data. First, we aim to improve the quality of software monitoring by systematically considering the monitoring aspect across the entire software development lifecycle. Second, we aim to increase the cost-effectiveness of software monitoring by dynamically optimizing the monitoring intensity during software execution. Third, we will develop generic approaches to simplify common workflows of analyzing monitoring data. The proposed research program will be a pioneering attempt to systematically improve the monitoring and observability of large-scale software systems, which will benefit the research and practices in Canada in producing high-quality software.