A rating scheme for assessing the quality of computer-supported collaboration processes
A rating scheme for assessing the quality of computer-supported collaboration processes
复制标题
DOI：
10.1007/s11412-006-9005-x
复制
发表时间：
2007-03-01
影响因子：
4.3
通讯作者：
Rummel, Nikol
中科院分区：
文献类型：
--
作者：
Meier, Anne;Spada, Hans;Rummel, Nikol
对协作过程的分析是当前CSCL研究的一个中心课题。然而，定义相关的协作质量和开发工具，能够评估这些特性的过程特性是不平凡的任务。在本文提出的评估方法中，九个定性定义的合作维度进行定量评级：维持相互理解，对话管理，信息汇集，达成共识，任务分工，时间管理，技术协调，互惠互动，个人任务导向。这些维度发展的数据基础来自一项研究，在这项研究中，心理学和医学的学生通过桌面视频会议系统合作处理一个复杂的病人病例。一个定性的内容分析进行转录的合作对话的样本。从这个分析的见解，然后整合的沟通，联合信息处理，协调，人际关系和动机在协作过程中的作用的理论考虑。由此产生的评级计划被应用到处理数据从一个新的样本的40个合作的二元。基于此评价的评分者间信度、一致性和效度的积极发现，我们认为新方法可以推荐用于CSCL的不同领域。
The analysis of the process of collaboration is a central topic in current CSCL research. However, defining process characteristics relevant for collaboration quality and developing instruments capable of assessing these characteristics are no trivial tasks. In the assessment method presented in this paper, nine qualitatively defined dimensions of collaboration are rated quantitatively: sustaining mutual understanding, dialogue management, information pooling, reaching consensus, task division, time management, technical coordination, reciprocal interaction, and individual task orientation. The data basis for the development of these dimensions was taken from a study in which students of psychology and medicine collaborated on a complex patient case via a desktop-videoconferencing system. A qualitative content analysis was performed on a sample of transcribed collaboration dialogue. The insights from this analysis were then integrated with theoretical considerations about the roles of communication, joint information processing, coordination, interpersonal relationship, and motivation in the collaboration process. The resulting rating scheme was applied to process data from a new sample of 40 collaborating dyads. Based on positive findings on inter-rater reliability, consistency, and validity from this evaluation, we argue that the new method can be recommended for use in different areas of CSCL.