An auto-scoring mechanism for evaluating problem-solving ability in a web-based learning environment
An auto-scoring mechanism for evaluating problem-solving ability in a web-based learning environment
复制标题
一种评估网络学习环境中解决问题能力的自动评分机制
DOI：
10.1016/j.compedu.2009.02.006
复制
发表时间：
2009
期刊：
影响因子：
--
通讯作者：
Judy C. R. Tseng
中科院分区：
文献类型：
--
作者：
Chuang;Gwo;Judy C. R. Tseng
计算机和网络技术的快速发展吸引了研究人员研究在学习活动中应用信息技术的策略和效果；同时，学习环境被开发来记录学生寻找网络信息以解决问题的学习档案。虽然以前的研究已经证明了将信息技术应用于学习活动的好处，但这样做的困难也被揭示了。其中一大困难是缺乏一种机制来帮助教师评估学生的解决问题的能力，以便向学生提供建设性的建议，并相应地改进辅导策略。针对这一问题，本文开发了一种自动评分机制来分析学生个体的各种信息搜索能力。信息搜索能力指标(ISA)是基于著名的Big6模型提出的，并被采用在我们的自动评分机制中。此外，还进行了两个实验来证明这种创新方法的有效性。实验结果表明，自动评分机制的评分与人工评分具有较高的相关性。此外，来自158名教师的反馈也表明，这种创新的方法得到了教师的高度认可。
The rapid development of computer and network technologies has attracted researchers to investigate strategies for and the effects of applying information technologies in learning activities; simultaneously, learning environments have been developed to record the learning portfolios of students seeking web information for problem-solving. Although previous research has demonstrated the benefits of applying information technologies to learning activities, the difficulties in doing so have also been revealed. One of the major difficulties is the lack of a mechanism to assist teachers in evaluating the problem-solving ability of the students, such that constructive suggestions can be given to the students, and tutoring strategies can be improved accordingly. To cope with this problem, in this paper, an auto-scoring mechanism is developed to analyze the various information searching abilities of individual students. Indicators of information searching ability (ISA) are proposed based on the famous Big6 model and are adopted in our auto-scoring mechanism. Moreover, two experiments have been conducted to demonstrate the effectiveness of this innovative approach. The experimental results show high correlation between the scores of the auto-scoring mechanism and the manual scoring. Moreover, the feedbacks from 158 teachers also show that the innovative approach is highly accepted by the teachers.