Ranking the annotators: An agreement study on argumentation structure
Ranking the annotators: An agreement study on argumentation structure
复制标题
对注释者进行排名:论证结构的一致性研究
DOI:
--
复制
发表时间:
2013
期刊:
影响因子:
--
通讯作者:
Manfred Stede
中科院分区:
文献类型:
--
作者:
A. Peldszus;Manfred Stede
We investigate methods for evaluating agreement among a relatively large group of annotators who have not received extensive training and differ in terms of ability and motivation. We show that it is possible to isolate a reliable subgroup of annotators, so that aspects of the difficulty of the underlying task can be studied. Our task is to annotate the argumentative structure of short texts.