Talkbank: Building an Open Unified Multimodal Database of Communicative Interaction
Talkbank: Building an Open Unified Multimodal Database of Communicative Interaction
复制标题
Talkbank：构建开放统一的多模态沟通交互数据库
DOI：
10.1109/lwmoocs53067.2022.9927934
复制
发表时间：
2004
期刊：
影响因子：
--
通讯作者：
C. Martell
中科院分区：
文献类型：
--
作者：
B. MacWhinney;Steven Bird;C. Cieri;C. Martell
TalkBank项目（http：//www.example.com）的目标是支持数据共享，并在社区范围内直接获取人类和动物交流的自然记录和文字记录。talkbank.org为此，我们已经建立了一个网络访问数据库的成绩单链接到音频和视频媒体领域，如会话分析，课堂话语，动物交流，手势，会议，第二语言习得，第一语言习得，双语，辅导，和法律的口头辩论。我们讨论了我们如何从几十个单独的项目，并将它们合并到一个结构良好的统一的数据库中，成绩单可以通过浏览器在线打开，允许直接多媒体播放的差异数据库。为了实现跨语料库的翻译，我们定义了一个通用的XML模式。该模式的有效性是通过在备选输入格式与XML之间进行双向转换来检查的。然后将生成的抄本链接到提示媒体，并将SMIL用于格式化可通过SMIL播放的网络可读、可浏览的多媒体抄本。一个平行的途径是用来支持合作评论和出版的PDF链接到媒体通过在相关领域的期刊特刊。
The goal of the TalkBank project (http://talkbank.org) is to support data-sharing and direct, community-wide access to naturalistic recordings and transcripts of human and animal communication. Toward this end, we have constructed a web accessible database of transcripts linked to audio and video media within fields such as conversation analysis, classroom discourse, animal communication, gesture, meetings, second language acquisition, first language acquisition, bilingualism, tutoring, and legal oral argumentation. We discuss how we have taken discrepant databases from dozens of individual projects and merged them together into a well-structured uniform database in which transcripts can be opened online through browsers, allowing direct multimedia playback. To achieve translation across corpora, we have defined a general XML schema. The validity of this schema is checked by bidirectional conversion from alternative input formats to XML and back. The resultant transcripts are then linked to hinted media and XSLT is used to format web readable browsable multimedia transcripts playable through SMIL. A parallel pathway is used to support collaborative commentary and publication of PDF linked to media through special issues of journals in the relevant fields.