HNDS-I: A Collaborative Annotation System for Language Research

HNDS-I：语言研究协作注释系统

• 批准号: 2117578
• 负责人: Brian MacWhinney
• 金额: $ 79.28万
• 依托单位: Carnegie-Mellon University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-09-01 至 2024-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2117578&HistoricalAwards=false
• 关键词: HNDS; Collaborative; Annotation; System; Language

Human communication happens both when we speak to each other and when we write things down. Researchers studying how people communicate can easily obtain many examples of written material. Written material is also easy to analyze because it is easy to scan it for computer use or to download it from the Internet. It is far more difficult to do research on spoken language because it is much harder to record speech and convert those recordings into a format a computer can use, especially speech that occurs in natural situations such as a family conversation around a dinner table or an argument between children in a classroom. This project will build a new system that will let researchers and students examine recorded conversations and provide additional data about details of those conversations, such as the talkers’ emotions, that cannot otherwise be measured.The new system to be built will be part of the TalkBank system at Carnegie Mellon University, the largest publicly accessible databank for the study of spoken language in the world. TalkBank includes audio and video recordings from children, classrooms, bilinguals, second language learners, and persons with language disorders in 34 different languages, together with written transcripts of those recordings. The new system will allow scientists and researchers to study human communication by looking at patterns of speech in individual conversations, which is a level of detailed analysis that is not currently possible. Studying communication at the conversation level is important because fine details in speech patterns can help answer important questions such as how people resolve confusion and misunderstandings as a conversation unfolds. The new system will be based on a concept called Collaborative Commentary, which allows research groups and students to add comments about important conversation details, such as talkers’ motivations, directly into the database by adding links to the conversation transcript. This same system will also permit users to provide comments on media that has not yet been transcribed and create new transcripts through a web browser interface. This project will engage the public with the data through Citizen Science and provide a resource for teaching about language and communication through guided commentary. Completion of this work will open up a remarkable new window to the study of spoken language and communication.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

人类的交流既发生在我们彼此交谈的时候，也发生在我们写下事情的时候。研究人们如何交流的研究人员可以很容易地获得许多书面材料的例子。书面材料也很容易分析，因为它很容易扫描以供计算机使用或从互联网上下载。对口语进行研究要困难得多，因为记录语音并将这些录音转换为计算机可以使用的格式要困难得多，特别是在自然情况下发生的语音，如家庭聚餐时的谈话或教室里孩子之间的争吵。这个项目将建立一个新的系统，让研究人员和学生检查记录的对话，并提供有关谈话细节的额外数据，例如说话者的情绪，否则无法测量。将建立的新系统将是卡内基梅隆大学TalkBank系统的一部分，该数据库是世界上最大的可公开访问的口语研究数据库。TalkBank包括来自儿童、教室、双语者、第二语言学习者和语言障碍患者的34种不同语言的音频和视频记录，以及这些记录的书面记录。新系统将允许科学家和研究人员通过观察个人对话中的言语模式来研究人类交流，这是目前还不可能进行的详细分析。研究会话层面的交流很重要，因为言语模式中的细微细节可以帮助回答一些重要的问题，比如人们如何在对话中解决困惑和误解。新系统将基于一种名为协作评论的概念，研究小组和学生可以通过在对话记录中添加链接，直接将关于重要对话细节的评论添加到数据库中，例如说话者的动机。这一系统还将允许用户对尚未转录的媒体提供评论，并通过网络浏览器界面创建新的抄本。该项目将通过公民科学让公众接触数据，并通过引导性评论为语言和交流教学提供资源。这项工作的完成将为口语和交流的研究开辟一个非凡的新窗口。这一奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

AphasiaBank English Protocol PWA ACWT Corpus

AphasiaBank 英语协议 PWA ACWT 语料库

• DOI: 10.21415/x4rc-r061
• 发表时间: 2013
• 期刊: TalkBank
• 作者: Bynek, Katy