Stating with Certainty or Stating with Doubt: Intercoder Reliability Results for Manual Annotation of Epistemically Modalized Statements
Stating with Certainty or Stating with Doubt: Intercoder Reliability Results for Manual Annotation of Epistemically Modalized Statements
复制标题
确定性陈述或怀疑性陈述：认知模态语句手动注释的内部编码器可靠性结果
DOI：
--
复制
发表时间：
2007
期刊：
影响因子：
--
通讯作者：
Victoria L. Rubin
中科院分区：
文献类型：
--
作者：
Victoria L. Rubin
文本表现出微妙但可识别的模态，关于作者对每个陈述的真实程度的估计（例如，绝对真实或有点真实）。本研究分析了书面新闻语篇中认知模态化陈述中的明确确定标记和疑问标记。本研究系统地阐述了作者在视角、焦点和时间三种新闻语用语境中的五个确定性水平（绝对、高度、中等、低度确定性和不确定性）。该研究的结论是，独立的编码器的认知模态化语句的确定性的阴影之间的边界是高度主观的，目前的困难手动注释和随之而来的自动化的意见提取和情感分析。虽然更严格的注释指令和更长的编码器训练可以改善编码器间一致性结果，但不完全清楚确定性的五级区分是否优于确定性陈述和可疑陈述之间的简单区分。
Texts exhibit subtle yet identifiable modality about writers' estimation of how true each statement is (e.g., definitely true or somewhat true). This study is an analysis of such explicit certainty and doubt markers in epistemically modalized statements for a written news discourse. The study systematically accounts for five levels of writer's certainty (ABSOLUTE, HIGH, MODERATE, LOW CERTAINTY and UNCERTAINTY) in three news pragmatic contexts: perspective, focus, and time. The study concludes that independent coders' perceptions of the boundaries between shades of certainty in epistemically modalized statements are highly subjective and present difficulties for manual annotation and consequent automation for opinion extraction and sentiment analysis. While stricter annotation instructions and longer coder training can improve inter-coder agreement results, it is not entirely clear that a five-level distinction of certainty is preferable to a simplistic distinction between statements with certainty and statements with doubt.