Continuous Experimentation and A/B Testing: A Mapping Study
Continuous Experimentation and A/B Testing: A Mapping Study
复制标题
连续实验和 A/B 测试：映射研究
DOI：
10.1145/3194760.3194766
复制
发表时间：
2018
期刊：
影响因子：
--
通讯作者：
P. Runeson
中科院分区：
文献类型：
--
作者：
R. Ros;P. Runeson
背景连续实验（CE）最近已成为一个既定的行业惯例，并作为一个研究课题。我们的目标是研究CE和A/B测试在各种工业环境中的应用。Objective.我们想通过学术研究中的报告来调查CE是否在不同的行业中使用。我们还希望探讨研究的主要主题，以概述该主题并讨论未来的研究方向。法我们对已发表的文献进行了系统的映射研究，包括62篇论文，使用数据库搜索和滚雪球的组合。结果大多数报告的软件实验都是在线完成的，并将软件作为服务提供，尽管存在各种例外情况，例如，金融软件和游戏。最常研究的主题是进行实验的挑战和软件实验的统计方法。结论.并行工程的软件工程研究还处于起步阶段。在技术课题的评价研究和伦理实验的调查方面有未来的研究机会。我们的结论是，包括的研究表明，A/B测试是适用于各种各样的软件和组织。
Background. Continuous experimentation (CE) has recently emerged as an established industry practice and as a research subject. Our aim is to study the application of CE and A/B testing in various industrial contexts. Objective. We wanted to investigate whether CE is used in different sectors of industry, by how it is reported in academic studies. We also wanted to explore the main topics researched to give an overview of the subject and discuss future research directions. Method. We performed a systematic mapping study of the published literature and included 62 papers, using a combination of database search and snowballing. Results. Most reported software experiments are done online and with software delivered as a service, although varied exemptions exist for e.g., financial software and games. The most frequently researched topics are challenges to conduct experiments and statistical methods for software experiments. Conclusions. The software engineering research on CE is still in its infancy. There are future research opportunities in evaluation research of technical topics and investigations of ethical experimentation. We conclude that the included studies show that A/B testing is applicable to a diversity of software and organisations.
影响因子：
3.9
作者：
Kitchenham, Barbara A.;Budgen, David;Brereton, O. Pearl
通讯作者：
Brereton, O. Pearl