An Evaluation of Quality Checklist Proposals - A participant-observer case study
An Evaluation of Quality Checklist Proposals - A participant-observer case study
复制标题
质量检查表提案的评估 - 参与者-观察者案例研究
DOI：
10.14236/ewic/ease2009.7
复制
发表时间：
2009
期刊：
影响因子：
--
通讯作者：
Zhi Li
中科院分区：
文献类型：
--
作者：
B. Kitchenham;P. Brereton;D. Budgen;Zhi Li
背景：最近一组软件工程系统文献回顾（slr）的指导方针包括从文献中获得的质量标准列表。该指南建议，该清单可用于构建一套量身定制的问题，以评估初步研究的质量。目的：本文旨在评价质量标准清单是否有助于研究者构建个性化的质量检查清单。方法：我们采用参与者-观察者案例研究来调查质量标准列表。本研究中的“案例”是关于单元测试的系统文献回顾的计划阶段。结果：我们的单反指南中的检查清单不能为新手或有经验的研究人员提供足够的帮助来构建特定单反的质量检查清单。然而，检查表是相当完整的，并导致使用一个共同的术语为质量问题选择了一个特定的系统文献综述。结论：指南文件应修订，包括一个更短的通用清单。研究人员可能会发现，采用基于团队的过程来构建质量检查表是有用的，并为回答质量检查表中的问题提供建议。
Background: A recent set of guidelines for software engineering systematic literature reviews (SLRs) includes a list of quality criteria obtained from the literature. The guidelines suggest that the list can be used to construct a tailored set of questions to evaluate the quality of primary studies. Aim: This paper aims to evaluate whether the list of quality criteria help researchers construct tailored quality checklists. Method: We undertook a participant-observer case study to investigate the list of quality criteria. The "case" in this study was the planning stage of a systematic literature review on unit testing. Results: The checklists in our SLR guidelines do not provide sufficient help with the construction of a quality checklist for a specific SLR either for novices or for experienced researchers. However, the checklists are reasonably complete and lead to the use of a common terminology for quality questions selected for a specific systematic literature review. Conclusions: The guidelines document should be amended to include a much shorter generic checklist. Researchers might find it useful to adopt a team-based process for quality checklist construction and provide suggestions for answering quality checklist questions.