Collaborative Research: A Digital Video Collaboratory to Integrate IT Innovations in Video Analysis, Sharing and Collaboration into Scientific Research Communities

拟议的工作将以参与机构先前在音频和视频采集、分析和协作方面的工作为基础，使每个机构能够利用彼此各自的优势、能力和先前的工作，更快地取得进展。该项目汇集了NSF资助的涉及人文科学多媒体数据的工作：位于斯坦福大学的DIVER项目，位于CMU和宾夕法尼亚大学的TalkBank项目，以及NSF中间件和网格项目。 拟议项目将采用双轨研究方法设计和实施合作实验室。第一个项目轨道是开发一个虚拟视频存储库和视频分析社区门户。第二个轨道将产生一个开放的社区工具包，大大扩展了视频分析，视频输入和输出的通用性和功能。除了这些从本地用户到分布式用户的目标之外，工具和数据还将在用户测试、试点和软件打包的持续过程中发展，让社区参与进来，并根据他们的经验改进工具。每个中期里程碑的项目成果将广泛传播，以提高科学和技术认识，特别是向会议和期刊传播，并辅之以一个开放网站，以分享正在进行的研究、技术发展、技术报告和供用户下载的软件版本。将向参与机构提供视频协作工具包，并努力促进采用，这将促进多个社区使用围绕视频的协作评论。我们项目的最初重点是人文科学，目的是利用视频记录来加强学习科学，教育，教学和培训。我们还希望视频应用和基础设施的工作可以提供重要的支持，物理科学，因为视频是一个重要的数据类型的科学可视化和主要的经验数据，和一些网格计划使用视频数据库集成。我们期望开发出可用于当前网格和中间件平台计划的开源视频软件。这可能会产生一个新的主要软件层，一套视频分析和协作中间件的标准，以及这项工作产生的更广泛影响的潜力。

The proposed effort will build upon prior work by participating institutions in audio and video capture, analysis and collaboration, allowing each institution to make progress more quickly by leveraging each other's respective strengths, capabilities and prior work. The project brings together NSF-funded efforts involving multimedia data in the human sciences: the DIVER project housed at Stanford University, and the TalkBank Project, housed at CMU and the University of Pennsylvania, as well as NSF Middleware and Grid projects. The proposed project will adopt a two-track research approach to designing and implementing the Collaboratory. The first project track is to develop a virtual video repository and video analysis community portal. The second track will produce an open community toolkit that greatly expands generality and capabilities for video analysis, video input and output. In addition to these goals of moving from local to distributed users, tools and data will evolve in an ongoing process of user testing, piloting, and software packaging, involving the community and refining the tools based on their experiences. Project results at each interim milestone will be disseminated broadly for enhancing scientific and technological understanding, especially to conferences and journals and complemented by an open website for sharing ongoing research, technical developments, technical reports and software releases to be downloaded to user communities. Video Collaboratory toolkits will be made available to participating institutions with efforts made to spur adoption that will facilitate multiple communities using collaborative commentary around video. The initial focus of our project is the human sciences, with the aim of leveraging video records to enhance the learning sciences, education, teaching and training. We also expect that video application and infrastructure work can provide significant support to the physical sciences, since video is an important data type for scientific visualization and primary empirical data, and several Grid initiatives use video databases integrally. We anticipate producing open-source video software that can be utilized in the current Grid and Middleware platform initiatives. This could enable a new primary software layer, a set of standards for video analysis and collaboration middleware, and the potential for a substantial broader impact as an outcome of this work.