Development of a High-Performance Digital Video Collaboratory (DVC) for Learning Sciences Research

在NSF重大研究仪器(MRI)奖的支持下，Roy Pea博士将开发一种新的高分辨率数字全景音频视频记录、分析和通信仪器。数字视频合作实验室(DVC)将提供一套集成的硬件技术，斯坦福大学的潜水器软件系统(数字互动视频探索和反思)将允许研究人员和教育工作者就同一丰富记录的课堂事件生成和分享不同的视角(POV)和分析视角。全景图像采集是通过使用多摄像机数字视频系统与反射镜相耦合来捕获360度水平圆弧上的图像而实现的。然后，这些摄像机图像通过软件拼接在一起，这样捕获的场景就可以在计算机显示器上显示为一个长方形，描绘了360度的视野。为了开发DVC，团队将在实验空间中集成最先进的数字全景视频捕获系统和房间大小的麦克风阵列，以及相关的软件和硬件工具，用于同步、存储和管理多媒体数据流。驱动软件系统将被用来创作和注释POV路径，通过这些“Free-D”全景数字视频记录。潜水员用户使用个人计算机，在全景场景上平移和缩放“虚拟相机”窗口，以聚焦于感兴趣的事件。然后，用户可以标记兴趣点并记录它们的POV路径和相关联的文本注释(用于研究或教育目的)。带注释的潜水员文件可以通过计算机网络共享，这样其他人就可以重新体验并回应用户对所记录活动的解释性“游览”。因此，Diver的用户在完成全景视频捕获后，能够成为一名“虚拟摄像师”。这个项目非常重要，因为学习科学中的研究人员越来越依赖多媒体技术来捕捉学习环境的复杂性，并反复查看记录，以深化互操作和分析。与其他数据类型集成在一起的数字视频和音频，承诺比旧方法更完整地记录学习活动，并使多名研究人员能够像在其他学科中那样调查共同的数据集。然而，目前的多媒体记录方法往往是临时的，会产生部分数据，并阻碍更强大的理论和实践的发展。数字视频协作实验室和DIVER软件系统不仅在学习科学研究和培训以及教师教育中具有广泛的应用潜力，而且在许多领域也有潜力，全景音频视频记录和注释可以为这些领域提供有用的功能。该项目的一个组成部分是斯坦福大学和其他地方的许多教职员工将DVC用于他们的研究、学习和认知科学方面的研究生和本科生教育，以及教师教育。

With support from a NSF Major Research Instrumentation (MRI) award, Dr. Roy Pea will develop a new develop a new instrument for high-resolution digital panoramic audio-video recording, analysis and communication. The Digital Video Collaboratory (DVC) will provide an integrated suite of hardware technologies and Stanford's DIVER software system (Digital Interactive Video Exploration and Reflection) will allow researchers and educators to generate and share different points-of-view (POV) and analytic perspectives on the same richly recorded classroom events. Panoramic image acquisition is make possible by using a multi-camera digital video system coupled with mirrors to capture images over 360 degrees of horizontal arc. These camera images are then stitched together by software so that the captured scene may be displayed on a computer monitor as a rectangle that depicts the "unwrapped" 360-degree field of view.To develop the DVC the team will integrate a state-of-the-art digital panoramic video capture system and a room-size microphone array in an experimental space with associated software and hardware tools for synchronizing, storing and managing the multimedia data streams. The DRIVER software system will be used to author and annotate POV-paths through these "Free-D" panoramic digital video records. Using a personal computer, the DIVER user pans and zooms a "virtual camera" window over a panoramic scene to focus on events of interest. The user may then mark interest points and record their POV-paths and associated textual annotations (for research or educational purposes). An annotated DIVER file can be shared through a computer network so others may re-experience and respond to the user's interpretive "tour" of the recorded activities. The user of DIVER is thus able to be a "virtual videographer", after the fact of panoramic video capture.This project is important because researchers in the learning sciences increasingly rely on multimedia technologies to capture the complexities of learning environments and to repeatedly view recordings to deepen interoperation and analyses. Digital video and audio, integrated with other data types, promise far more complete records of learning activities than older methods, and enable multiple researchers to investigate common datasets, as in other disciplines. However, current approaches to multimedia recording are often ad hoc, yielding partial data and hindering the development of more powerful theory and practice. The Digital Video Collaboratory and the DIVER software system have potential for widespread use not only in learning sciences research and training and teacher education, but also in many fields for which panoramic audio-video recording and annotation can provide a useful function. An integral part of the project is the use of the DVC by many faculty at Stanford and elsewhere for their research, for graduate and undergraduate education in learning and cognitive sciences, and for teacher education.