An empirical study of the robustness of Windows NT applications using random testing
An empirical study of the robustness of Windows NT applications using random testing
复制标题
DOI：
--
复制
发表时间：
2000-08
期刊：
影响因子：
--
通讯作者：
J. Forrester;B. Miller
中科院分区：
文献类型：
--
作者：
J. Forrester;B. Miller
我们报告的第三个在一系列的研究应用程序的可靠性，面对随机输入。在1990年和1995年，我们研究了UNIX应用程序的可靠性，包括命令行和基于X-Window（GUI）的应用程序。在这项研究中，我们将我们的测试技术应用于Windows NT操作系统上运行的应用程序。我们的测试是简单的黑盒随机输入测试;无论如何，这都是一种粗糙的技术，但它在定位真实的程序中的错误时似乎是有效的。我们测试了30多个基于GUI的应用程序，让它们接受两种随机输入：（1）有效的键盘和鼠标事件流和（2）随机的Win32消息流。我们已经建立了一个工具，帮助自动化测试的Windows NT应用程序。通过几个简单的参数，任何应用程序都可以测试。使用我们的随机测试技术，我们以前基于UNIX的研究表明，我们可以在几个UNIX平台上崩溃各种命令行和基于X窗口的应用程序。测试结果与基于NT的应用程序相似。当受到可以通过使用鼠标和键盘产生的随机有效输入时，我们崩溃了21%的测试应用程序，并挂起了另外24%的应用程序。当受到原始随机Win32消息时，我们崩溃或挂起了我们测试的所有应用程序。我们报告哪些应用程序在哪些测试下失败，并提供一些失败的分析。
We report on the third in a series of studies on the reliability of application programs in the face of random input. In 1990 and 1995, we studied the reliability of UNIX application programs, both command line and X-Window based (GUI). In this study, we apply our testing techniques to applications running on the Windows NT operating system. Our testing is simple black-box random input testing; by any measure, it is a crude technique, but it seems to be effective at locating bugs in real programs. We tested over 30 GUI-based applications by subjecting them to two kinds of random input: (1) streams of valid keyboard and mouse events and (2) streams of random Win32 messages. We have built a tool that helps automate the testing of Windows NT applications. With a few simple parameters, any application can be tested. Using our random testing techniques, our previous UNIX-based studies showed that we could crash a wide variety of command-line and X-window based applications on several UNIX platforms. The test results are similar for NT-based applications. When subjected to random valid input that could be produced by using the mouse and keyboard, we crashed 21% of applications that we tested and hung an additional 24% of applications. When subjected to raw random Win32 messages, we crashed or hung all the applications that we tested. We report which applications failed under which tests, and provide some analysis of the failures.