Collaborative Research: ITR: A Digital Video Collaboratory to Integrate IT Innovations in Video Analysis, Sharing and Collaboration into Scientific Research Communities

拟议的工作将以参与机构在音频和视频捕获、分析和协作方面的先前工作为基础，使每个机构能够通过利用各自的优势、能力和先前的工作，更快地取得进展。该项目汇集了NSF资助的涉及人文科学多媒体数据的努力：斯坦福大学的DIVER项目，CMU和宾夕法尼亚大学的TalkBank项目，以及NSF中间件和网格项目。建议项目将采用双轨研究方法来设计和实施合作实验室。第一个项目轨道是开发一个虚拟视频库和视频分析社区门户。第二个轨道将产生一个开放的社区工具包，极大地扩展了视频分析、视频输入和输出的通用性和能力。除了这些从本地用户转移到分布式用户的目标之外，工具和数据将在用户测试、试验和软件打包的持续过程中发展，涉及社区并根据他们的经验改进工具。每个中期里程碑的项目成果将广泛传播，以增进对科学和技术的了解，特别是向会议和期刊传播，并辅以一个开放的网站，供用户社区下载，分享正在进行的研究、技术发展、技术报告和软件版本。视频协作实验室工具包将提供给参与的机构，并努力推动采用，这将促进多个社区使用围绕视频的协作评论。我们的计划最初的重点是人文科学，目的是利用录像来加强学习科学、教育、教学和培训。我们还期望视频应用和基础设施工作能够为物理科学提供重要的支持，因为视频是科学可视化和主要经验数据的重要数据类型，并且一些网格计划集成地使用视频数据库。我们期望生产出可以用于当前网格和中间件平台计划的开源视频软件。这可以实现一个新的主要软件层，一套视频分析和协作中间件的标准，并且作为这项工作的结果，有可能产生更广泛的影响。

The proposed effort will build upon prior work by participating institutions in audio and video capture, analysis and collaboration, allowing each institution to make progress more quickly by leveraging each other's respective strengths, capabilities and prior work. The project brings together NSF-funded efforts involving multimedia data in the human sciences: the DIVER project housed at Stanford University, and the TalkBank Project, housed at CMU and the University of Pennsylvania, as well as NSF Middleware and Grid projects. The proposed project will adopt a two-track research approach to designing and implementing the Collaboratory. The first project track is to develop a virtual video repository and video analysis community portal. The second track will produce an open community toolkit that greatly expands generality and capabilities for video analysis, video input and output. In addition to these goals of moving from local to distributed users, tools and data will evolve in an ongoing process of user testing, piloting, and software packaging, involving the community and refining the tools based on their experiences. Project results at each interim milestone will be disseminated broadly for enhancing scientific and technological understanding, especially to conferences and journals and complemented by an open website for sharing ongoing research, technical developments, technical reports and software releases to be downloaded to user communities. Video Collaboratory toolkits will be made available to participating institutions with efforts made to spur adoption that will facilitate multiple communities using collaborative commentary around video. The initial focus of our project is the human sciences, with the aim of leveraging video records to enhance the learning sciences, education, teaching and training. We also expect that video application and infrastructure work can provide significant support to the physical sciences, since video is an important data type for scientific visualization and primary empirical data, and several Grid initiatives use video databases integrally. We anticipate producing open-source video software that can be utilized in the current Grid and Middleware platform initiatives. This could enable a new primary software layer, a set of standards for video analysis and collaboration middleware, and the potential for a substantial broader impact as an outcome of this work.