RI: EAGER: Collaborative Research: Adaptive Heads-up Displays for Simultaneous Interpretation

RI：EAGER：协作研究：用于同声传译的自适应平视显示器

• 批准号: 1748642
• 负责人: Graham Neubig
• 金额: $ 15万
• 依托单位: Carnegie-Mellon University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-09-01 至 2019-10-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1748642&HistoricalAwards=false
• 关键词: RI; EAGER; Collaborative; Research; Adaptive

Interpretation, the task of translating speech from one language to another, is an important tool in facilitating communication in multi-lingual settings such as international meetings, travel, or diplomacy. However, simultaneous interpretation, during which the results must be produced as the speaker is speaking, is an extremely difficult task requiring a high level of experience and training. In particular, simultaneous interpreters often find certain content such as technical terms, names of people and organizations, and numbers particularly hard to translate correctly. This Early Grant for Exploratory Research project aims to create automatic interpretation assistants that will help interpreters with this difficult-to-translate content by recognizing this content in the original language, and displaying translations on a heads-up display (similar to teleprompter) for interpreters to use if they wish. This will make simultaneous interpretation more effective and accessible, making conversations across languages and cultures more natural, more common, and more effective and joining communities and cultures across the world in trade, cooperation, and friendship.Creating these systems is a technically challenging problem and has not previously been attempted. One challenge is that simultaneous interpretation is already a cognitively taxing task, and any interface must not unduly increase the cognitive load on the interpreter by being too intrusive. Reducing this cognitive load requires an interface that can decide when to provide translation suggestions and when to refrain from doing so. To achieve this goal, this project will develop methods that are robust to speech recognition errors, and learn what to display by observing the interpreters' interpretation results. The utility of the proposed framework will be evaluated with respect to how much it improves the ability of interpreters to produce fluent, accurate interpretation results, as well as the cognitive load the additional interface imposes on them.

口译是将言语从一种语言翻译成另一种语言的任务，是在国际会议、旅行或外交等多种语言环境中促进交流的重要工具。然而，同声传译是一项极其困难的任务，需要高度的经验和培训，在此过程中，结果必须在发言者发言时产生。特别是，同声传译员经常发现某些内容，如技术术语、人名和组织名称，以及数字，特别难以正确翻译。这个早期的探索性研究项目旨在创建自动口译助手，通过识别原始语言中的这些内容，并在平视显示器(类似于提词机)上显示翻译，以帮助口译员处理这些难以翻译的内容，供口译员使用。这将使同声传译更有效、更容易获得，使跨语言和文化的对话更自然、更常见、更有效，并将世界各地的社区和文化结合在一起，进行贸易、合作和友谊。创建这些系统是一个具有技术挑战性的问题，以前从未尝试过。一个挑战是，同声传译已经是一项认知上的繁重任务，任何接口都不能因为太过干扰而不适当地增加口译员的认知负荷。减少这种认知负担需要一个界面，它可以决定何时提供翻译建议，何时不提供建议。为了实现这一目标，该项目将开发对语音识别错误具有健壮性的方法，并通过观察口译员的口译结果来了解要显示什么。对拟议框架的效用将从它在多大程度上提高口译员产生流畅、准确的口译结果的能力，以及额外的接口对他们施加的认知负荷来评估。

项目成果

Mitigating Noisy Inputs for Question Answering

• DOI: 10.21437/interspeech.2019-3154
• 发表时间: 2019-08
• 期刊: ArXiv
• 作者: Denis Peskov;Joe Barrow;Pedro Rodriguez;Graham Neubig;Jordan L. Boyd-Graber

Improving Robustness of Machine Translation with Synthetic Noise

利用合成噪声提高机器翻译的鲁棒性

• 发表时间: 2019
• 期刊: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
• 作者: Vaibhav, Vaibhav;Singh, Sumeet;Stewart, Craig;Neubig, Graham
• 通讯作者: Neubig, Graham

Lost in Interpretation: Predicting Untranslated Terminology in Simultaneous Interpretation

• DOI: 10.18653/v1/n19-1010
• 发表时间: 2019-04
• 作者: Nikolai Vogler;Craig Alan Stewart;Graham Neubig

Automatic Estimation of Simultaneous Interpreter Performance

• DOI: 10.18653/v1/p18-2105
• 发表时间: 2018-05
• 期刊: ArXiv
• 作者: Craig Alan Stewart;Nikolai Vogler;Junjie Hu;Jordan L. Boyd-Graber;Graham Neubig