Resolving Gendered Ambiguous Pronouns with BERT

Resolving Gendered Ambiguous Pronouns with BERT
复制标题

使用 BERT 解决性别歧义代词

DOI:
--
复制
发表时间:
2019
期刊:
Proceedings of the First Workshop on Gender Bias in Natural Language Processing
影响因子:
--
通讯作者:
Jason Baldridge
Jason Baldridge
中科院分区:
--
文献类型:
--
作者:
Kellie Webster;Marta Recasens;Vera Axelrod;Jason Baldridge

文献摘要

被引文献

相似文献

代词解析是共指解析的一部分,是将一个表达式与其所指实体配对的任务。这是自然语言理解的一项重要任务,也是机器翻译系统、聊天机器人和助手的必要组成部分。神经机器学习系统在这项任务中的表现远非理想,在现代基准数据集上,F1得分低至73%。此外,对于男性代词,它们往往比对女性代词表现得更好。因此,这一问题对自然语言处理的研究者和实践者来说既具有挑战性又很重要。在这个项目中,我们描述了我们基于BERT的方法来解决性别平衡的代词解析问题。在谷歌人工智能语言团队共享的基准数据集上,我们能够达到92%的F1得分和更低的性别偏见。
Pronoun resolution is part of coreference resolution, the task of pairing an expression to its referring entity. This is an important task for natural language understanding and a necessary component of machine translation systems, chat bots and assistants. Neural machine learning systems perform far from ideally in this task, reaching as low as 73% F1 scores on modern benchmark datasets. Moreover, they tend to perform better for masculine pronouns than for feminine ones. Thus, the problem is both challenging and important for NLP researchers and practitioners. In this project, we describe our BERT-based approach to solving the problem of gender-balanced pronoun resolution. We are able to reach 92% F1 score and a much lower gender bias on the benchmark dataset shared by Google AI Language team.