Collaborative Research: EAGER: Automating CI Configuration Troubleshooting with Bayesian Group Testing

大型网络基础设施(CI)软件系统中的配置故障排除是一项复杂且昂贵的任务，因为有许多可配置的参数。现有的日志挖掘和机器学习分析等方法在这样的环境中面临挑战。为了解决这一问题，我们提出了BGT4AutoCI(使用贝叶斯组测试自动排除CI配置故障)，这是一个突破性的解决方案，利用贝叶斯组测试，即使在最少的先验知识和测试错误的情况下也能确保准确的结果。有经验的CI操作员可以利用近似的先验知识加快这一过程。这项研究旨在革新CI配置故障排除，引入一种高精度和高效的方法，以优化当前和未来大型CI系统的利用率。本研究的主要重点是解决大规模CI系统中自动配置故障排除的关键挑战。所提出的三重方法包括：(1)制定用于CI配置故障排除的贝叶斯组测试，该方法使用格模型来准确识别单个配置参数级别的风险，并考虑故障排除过程中的不确定性。(2)贝叶斯群测试的多项式范式，引入多项式响应来同时观察CI系统的多个方面，使得高效的测试选择算法能够联合测试影响CI各个方面的配置参数。(3)自动化配置故障排除，它涉及几个关键组件的设计，以建立BGT4AutoCI作为自动化配置故障排除框架，最大限度地减少对人工干预的需要。该项目的成果有可能显著提高CI配置故障排除的效率和准确性，使当前和未来的大规模CI系统受益。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Configuration troubleshooting in large-scale cyberinfrastructure (CI) software systems is a complex and costly task due to numerous configurable parameters. Existing methods like log mining and machine learning analysis face challenges in such environments. To address this, we present BGT4AutoCI (Automating CI Configuration Troubleshooting with Bayesian Group Testing), a groundbreaking solution that leverages Bayesian Group Testing, ensuring accurate results even with minimal prior knowledge and testing errors. Experienced CI operators can expedite the process with approximated prior knowledge. This research aims to revolutionize CI configuration troubleshooting, introducing a highly precise and efficient approach that will optimize the utilization of current and future large-scale CI systems.The primary focus of this research is to address critical challenges in automated configuration troubleshooting within large-scale CI systems. The proposed three-fold approach encompasses: (1) Formulating Bayesian Group Testing for CI configuration troubleshooting, which employs lattice models to accurately identify risks at the individual configuration parameter level, taking uncertainty into account during troubleshooting. (2) A multinomial paradigm for Bayesian Group Testing, which introduces multinomial responses to simultaneously observe multiple aspects of CI systems, enabling efficient test selection algorithms for jointly testing configuration parameters that impact various aspects of CIs. (3) Automated configuration troubleshooting, which involves the designs of several key components to establish BGT4AutoCI as an automated configuration troubleshooting framework that minimizes the need for human intervention. The outcomes of this project hold the potential to significantly enhance the efficiency and accuracy of CI configuration troubleshooting, benefiting current and future large-scale CI systems.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.