Test Effectiveness, Localization, Prioritization, and Risk in Ericssons's Complex Test Environment

点击翻译按钮获取中文摘要

Ericsson develops and supplies equipment, software, and services for global mobile networks. Ericsson in Ottawa develops cellular base stations that are the interface between cell phones and the physical backbone networks. This high reliability environment requires testing on expensive hardware that can simulate cell phones interacting with base stations. Some tests are expensive running for days, while others take seconds. When a test fails, the software integration process stops and an engineer must intervene. Our goal is combine test prioritization, test log analysis, and empirical software engineering to mine the historical artifacts including past code changes, bugs, peer reviews, and test runs to create statistical models (1) to determine effective environmentally valid test prioritizations, (2) to differentiate between environment and product test failures, (3) to locate faults by cleaning the noise out of test logs, (4) to quantify change risk and identify software units that need new tests, and (5) to integrate these actionable results into our proposed tool called TestGuru.