Evaluating Recommender Systems for Technology Enhanced Learning: A Quantitative Survey
Evaluating Recommender Systems for Technology Enhanced Learning: A Quantitative Survey
复制标题
DOI：
10.1109/tlt.2015.2438867
复制
发表时间：
2015-10-01
影响因子：
3.7
通讯作者：
Rensing, Christoph
中科院分区：
文献类型：
--
作者：
Erdt, Mojisola;Fernandez, Alejandro;Rensing, Christoph
有关技术增强学习 (TEL) 推荐系统的出版物数量不断增加，表明人们对其开发和部署的兴趣日益浓厚。为了支持学习，TEL 的推荐系统需要考虑特定的要求，这与电子商务等其他领域的推荐系统的要求不同。因此，这些特殊要求促使将特定目标和方法纳入 TEL 推荐系统的评估过程中。在本文中，研究了用于评估 TEL 推荐系统的各种评估方法。从2000年至2014年间发表过相关工作的主要会议、研讨会、期刊和书籍中总共选取了235篇文章。这些文章根据以下标准进行定量分析和分类：评估方法的类型、评估的主题和评估所衡量的效果。调查结果表明，研究界越来越意识到进行更详细评估的必要性。与此同时，仍然存在进一步改进的巨大潜力。这项调查强调了迄今为止 TEL 推荐系统评估的趋势并讨论了其优点和缺点，从而旨在激励研究人员思考新的评估方法。
The increasing number of publications on recommender systems for Technology Enhanced Learning (TEL) evidence a growing interest in their development and deployment. In order to support learning, recommender systems for TEL need to consider specific requirements, which differ from the requirements for recommender systems in other domains like e-commerce. Consequently, these particular requirements motivate the incorporation of specific goals and methods in the evaluation process for TEL recommender systems. In this article, the diverse evaluation methods that have been applied to evaluate TEL recommender systems are investigated. A total of 235 articles are selected from major conferences, workshops, journals, and books where relevant work have been published between 2000 and 2014. These articles are quantitatively analysed and classified according to the following criteria: type of evaluation methodology, subject of evaluation, and effects measured by the evaluation. Results from the survey suggest that there is a growing awareness in the research community of the necessity for more elaborate evaluations. At the same time, there is still substantial potential for further improvements. This survey highlights trends and discusses strengths and shortcomings of the evaluation of TEL recommender systems thus far, thereby aiming to stimulate researchers to contemplate novel evaluation approaches.