Test Effectiveness, Localization, Prioritization, and Risk in Ericssons's Complex Test Environment

爱立信为全球移动网络开发和提供设备、软件和服务。渥太华的爱立信公司开发的蜂窝基站是手机和物理骨干网之间的接口。这种高可靠性环境需要在昂贵的硬件上进行测试，这些硬件可以模拟手机与基站的交互。有些测试要运行几天，成本很高，而有些测试只需要几秒钟。当测试失败时，软件集成过程停止，工程师必须进行干预。我们的目标是将测试优先级、测试日志分析和经验软件工程结合起来，以挖掘历史工件，包括过去的代码更改、错误、同行评审和测试运行，从而创建统计模型(1)确定有效的环境有效的测试优先级，(2)区分环境和产品测试失败，(3)通过清除测试日志中的噪音来定位故障，(4)量化变更风险并识别需要新测试的软件单元。(5)将这些可操作的结果集成到我们提出的工具TestGuru中。

Ericsson develops and supplies equipment, software, and services for global mobile networks. Ericsson in Ottawa develops cellular base stations that are the interface between cell phones and the physical backbone networks. This high reliability environment requires testing on expensive hardware that can simulate cell phones interacting with base stations. Some tests are expensive running for days, while others take seconds. When a test fails, the software integration process stops and an engineer must intervene. Our goal is combine test prioritization, test log analysis, and empirical software engineering to mine the historical artifacts including past code changes, bugs, peer reviews, and test runs to create statistical models (1) to determine effective environmentally valid test prioritizations, (2) to differentiate between environment and product test failures, (3) to locate faults by cleaning the noise out of test logs, (4) to quantify change risk and identify software units that need new tests, and (5) to integrate these actionable results into our proposed tool called TestGuru.