Intelligent Log Analytics for Predicting Future Run-Time Issues

大型机平台在支持由数百万用户使用的关键任务服务（如工资单服务、支付服务和客户订购处理服务）方面发挥着核心作用。在软件执行期间，通过跟踪一组关键性能指标并将指标的结果记录到执行日志中，对大型机平台上的应用程序进行持续监控，以检查应用程序的性能和可靠性。在实践的当前状态下，对执行日志的分析仅限于了解已经发生的事件（例如，崩溃和性能瓶颈）。在这个提议的项目中，我们计划应用机器学习技术，通过分析历史执行日志来预测未来的崩溃和性能问题。此外，我们将把运行时问题与开发联系起来，以预测开发阶段中可能出现的运行时故障（例如，性能瓶颈）。我们将在开发阶段设计和开发技术以提高软件性能（例如，CPU使用情况，内存使用情况）。我们的技术将为开发人员提供性能下降的早期警告，并在产品交付之前修复可能的缺陷。该项目的结果旨在为开发人员提供可操作的信息，以作出明智的决定，提高他们的生产力，并提高大型软件系统的质量和性能。该项目将培训8名HQPs（即2个phd， 3个msc， 2个bsc和1个ra），学习将机器学习和人工智能应用于软件开发操作的重要而关键的主题。

Mainframe platforms play a central role in supporting mission-critical services that are used by millions of users, such as payroll services, payment services and customer ordering processing services. During the software execution, applications on mainframe platforms are continuously monitored to check the performance and reliability of the applications by tracing a set of key performance metrics and recording the results of the metrics into execution logs. In the current state of practices, the analysis of the execution logs is limited to understanding the already happened events (e.g., crashes and performance bottlenecks). In this proposed project, we plan to apply machine learning techniques to predict future crashes and performance issues by analyzing the historical execution logs. Moreover, we will link the run-time problems with the development to predict the possible run-time failures (e.g., performance bottlenecks) during the development phrase. We will design and develop techniques to improve software performance (e.g., CPU usage, memory usage) in the development stage. Our techniques will give developers early warnings for performance degradation and fix the possible defects before product delivery. The results of the project aim to provide actionable information for the developers to make informed decisions, improve their productivity and enhance the quality and performance of mainframe software systems. The project will train 8 HQPs (i.e., 2PhD, 3MSc, 2BSc and 1RA) in an important and critical topic for applying machine learning and artificial intelligence to the software development operations.