Cost-Efficient Sampling for Performance Prediction of Configurable Systems (T)
Cost-Efficient Sampling for Performance Prediction of Configurable Systems (T)
复制标题
DOI：
10.1109/ase.2015.45
复制
发表时间：
2015-11
期刊：
影响因子：
--
通讯作者：
Atrisha Sarkar;Jianmei Guo;Norbert Siegmund;S. Apel;K. Czarnecki
中科院分区：
文献类型：
--
作者：
Atrisha Sarkar;Jianmei Guo;Norbert Siegmund;S. Apel;K. Czarnecki
可配置系统的开发和维护的一个关键挑战是根据所选择的功能来预测单个系统变体的性能。由于特征组合学的原因，测量所有可能的变体的性能通常是不可行的。以前的方法基于测量变量的小样本预测性能，但是如何动态地确定平衡预测精度和测量工作的理想样本仍然是开放的。在本文中，我们适应两个广泛使用的抽样策略的性能预测领域的可配置系统，并评估他们的抽样成本，这同时兼顾预测精度和测量工作。为了生成一个初始样本，我们引入了一个新的启发式特征频率的基础上，并比较它与传统的方法basedon t-路特征覆盖。我们在六个现实世界的系统上进行实验，并为利益相关者提供指导方针，以预测抽样性能。
A key challenge of the development and maintenanceof configurable systems is to predict the performance ofindividual system variants based on the features selected. It isusually infeasible to measure the performance of all possible variants, due to feature combinatorics. Previous approaches predictperformance based on small samples of measured variants, butit is still open how to dynamically determine an ideal samplethat balances prediction accuracy and measurement effort. Inthis paper, we adapt two widely-used sampling strategies forperformance prediction to the domain of configurable systemsand evaluate them in terms of sampling cost, which considersprediction accuracy and measurement effort simultaneously. Togenerate an initial sample, we introduce a new heuristic based onfeature frequencies and compare it to a traditional method basedon t-way feature coverage. We conduct experiments on six realworldsystems and provide guidelines for stakeholders to predictperformance by sampling.