Examination of the Effectiveness of a Criteria-based Team Formation Tool
Examination of the Effectiveness of a Criteria-based Team Formation Tool
复制标题
检查基于标准的团队组建工具的有效性
DOI：
--
复制
发表时间：
2018
期刊：
影响因子：
--
通讯作者：
B. Bailey
中科院分区：
文献类型：
--
作者：
Albatool A. Alamri;B. Bailey
在这篇正在进行的研究工作论文中，我们研究了 CATME 的有效性，CATME 是一种实施基于标准的团队组建方法的工具。该工具有助于根据人口统计、技能和工作方式等标准组建团队。该信息是通过在线调查从学生那里收集的。此类工具的有效性取决于教师配置标准的实用性、学生对调查反应的准确性以及算法的健全性。在这篇正在进行的论文中，我们研究了影响这些因素的潜在问题。我们的研究是通过对先前研究中收集的数据进行新的分析来进行的，该研究比较了使用 CATME 或在用户界面设计课程中随机组建的团队的表现。两种情况下团队的表现没有统计学差异。在检查学生对团队组建调查的反应时，我们发现了与自我评估相关的问题，例如学生对其技能的评分与对其最强技能的报告之间不一致。同样，我们发现在某些情况下，该工具在计算团队技能的同质性时会产生意想不到的结果。讨论了对教师缓解这些问题的影响。
In this Research Work in Progress Paper, we examine the effectiveness of CATME, a tool that implements a criteria-based team formation approach. The tool facilitates forming teams based on criteria like demographics, skills, and work styles. This information is collected from the students via an online survey. The effectiveness of this genre of tool depends on the practicality of the instructor’s configuration of the criteria, the veracity of students’ responses to the survey, and the soundness of the algorithm. In this work-in-progress paper, we investigate potential issues affecting these factors. Our study was conducted by performing new analysis of data collected from a prior study comparing the performance of teams formed using CATME or randomly in a user interface design course. The performance of teams was not statistically different between the two conditions. In examining the students’ responses to the team formation survey, we found issues related to Self-Assessment such as inconsistencies between students’ ratings of their skills and reporting of their strongest skills. Likewise, we found some cases where the tool produced unexpected results when calculating the homogeneity of the skills of a team. Implications for instructors to mitigate these problems are discussed.