Collaborative Research: SaTC: CORE: Small: Self-Driving Continuous Fuzzing

连续模糊是一种新兴的软件测试范例，近年来获得了巨大的吸引力。在该范例中，当软件被开发/更新时，模糊器被全天候地应用于该软件，希望模糊器能够尽快发现软件错误。它已经被证明在大型和复杂的软件中找到错误是有效的，例如，在过去几年中发现了数千个错误和漏洞。尽管这个项目被认为是成功的，但它发现了当今持续模糊的一个重要限制：在查找错误方面存在严重延迟。这从根本上是因为缺乏进行调整/改进的内置功能，并总体上意识到随着时间的推移其性能。我们把这种能力称为“自动驾驶”。我们认为这是一种关键能力，因为连续模糊化(1)需要支持快速变化的模糊化目标(正在开发中)，(2)投入大量资源，并应有效地使用它们。该项目进一步发现，(1)这种延迟的第一部分是因为连续模糊器最初无法发现一些错误，以及(2)这种延迟的第二部分是因为连续模糊器未能有效地利用其资源来发现它已经能够发现的错误。该项目的成功完成将使持续模糊能够更快地发现错误和漏洞。因此，该项目将有助于提高使用持续模糊化测试的软件系统的质量，最终使社会和整个经济受益。这个项目调查了两个研究推动力，以解决上述限制。第一次推力的目标是提高连续推进器发现以前找不到的错误的能力。更具体地说，它开发了持续生成和细化软件接口描述的能力。它研究了结合各种分析技术的新方法，以克服分析大规模软件的挑战，提供自我纠正的能力以及更好的精度和可扩展性。第二次推力的目标是使连续模糊器能够更快地找到它能够找到的错误。这一推力研究了连续引信的调度器。调度器的目标是优化连续模糊器的现有资源的使用，以充分模糊给定软件的所有接口。它还探索了连续模糊器的资源规划策略，以动态和自动地调整可用的资源量，以在错误发现延迟方面实现可接受的性能。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Continuous fuzzing is an emerging software testing paradigm that has gained significant traction in recent years. In this paradigm, a fuzzer is applied 24/7 to a piece of software as it is being developed/updated, hoping that the fuzzer can find the software bugs as soon as possible. It has been shown to be effective in finding bugs in large and complex pieces of software such as the Linux kernel, e.g., finding thousands of bugs and vulnerabilities in the past few years. Despite its perceived success, this project identifies an important limitation in today’s continuous fuzzing: a significant delay in finding a bug. This is fundamentally due to the lack of built-in features to make adjustments/improvements and be aware of its performance over time in general. We refer to this ability as “self-drive”. We argue that this is a critical ability because continuous fuzzing (1) by design needs to support the rapidly changing fuzzing target (under development) and (2) invests a large amount of resources and should use them effectively. The project further finds that (1) the first part of this delay is because the continuous fuzzer is initially incapable of finding some bugs, and (2) the second part of this delay is because the continuous fuzzer fails to use its resources effectively to find the bugs that it is already capable of finding. The successful completion of the project will enable continuous fuzzing to find bugs and vulnerabilities faster. Consequently, the project will help improve the quality of software systems tested with continuous fuzzing, which ultimately benefits society and the economy at large. This project investigates two research thrusts to address the aforementioned limitation. The goal of the first thrust is to improve the capability of the continuous fuzzer to find bugs that it could not find before. More specifically, it develops the capability of continuous generation and refinement of software interface descriptions. It investigates novel methods that combine various analysis techniques to overcome the challenge of analyzing a large-scale piece of software, providing the ability of self-correction and better precision and scalability. The goal of the second thrust is to enable the continuous fuzzer to find the bugs that it is capable of finding faster. This thrust investigates a scheduler for the continuous fuzzer. The goal of the scheduler is to optimize the use of existing resources of a continuous fuzzer to adequately fuzz all the interfaces of a given piece of software. It also explores a resource planning strategy for the continuous fuzzer to dynamically and automatically adjust the amount of resources available to it to achieve acceptable performance in terms of bug-finding delay.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.