CI-P: The "Poor Quality" Meetings Corpus

去参加任何与年轻一代研究人员、商界人士或政府人员的会议或讲座，每个座位上都有一台笔记本电脑或智能手机。每个笔记本电脑和智能手机不仅能够记录和传输视频和音频在真实的时间，而且还对数据进行高级分析（例如语音识别，说话人识别，人脸检测等）。然而，由于缺乏用于机器学习算法的良好训练数据，这一丰富的资源在很大程度上未被利用。利用这一资源的第一步是使用参与者自己的笔记本电脑和手机收集“自然”会议的音频、视频和注释语料库，以便分析会议和训练机器学习算法。这个为期一年的计划项目涉及语料库的设计，包括收集协议，信号，格式和注释，小型试点语料库的收集，以及通过邮件列表，论坛，wiki和在加州伯克利的ICSI举办的研讨会与社区进行持续的互动。注释包括所说的话、笑声、电话铃声等事件，或者新参与者进入房间、谁在说话、谁出现在哪个摄像机上、头部和手势、参与者的注意力焦点，使用参与者自己的笔记本电脑和手机，成功地规划从各种环境中收集大量自然会议，为会议生成分析工具，包括浏览、搜索、协作工具和远程辅助工具。

Go to any meeting or lecture with the younger generation of researchers, business people, or government, and there is a laptop or smartphone at every seat. Each laptop and smartphone is capable not only of recording and transmitting video and audio in real time, but also of advanced analytics on the data (e.g. speech recognition, speaker identification, face detection, etc.). Yet this rich resource goes largely unexploited mostly due to lack of good training data for machine learning algorithms.The first step in exploiting this resource is to collect a corpus of audio, video, and annotations of "natural" meetings using the participants' own laptops and cellphones, allowing both analysis of the meetings and training of machine learning algorithms. This one year planning project involves design of the corpus, including collection protocols, signals, formats, and annotations, collection of a small pilot corpus, and ongoing interaction with the community through mailing lists, forums, wikis, and a workshop hosted at ICSI in Berkeley, California. The annotations include the words spoken, events such as laughter, a telephone ringing, or a new participant entering the room, who is speaking, who appears on which camera, head and hand gestures, the participants' focus of attention, and summaries and topics.Successful planning for the collection of a significant number natural meetings from a variety of settings using the participants' own laptops and cellphones allows for a new generation of analytic tools for meetings including browsing, search, collaboration tools, and teleremote aids.