Development of a High-Performance Digital Video Collaboratory (DVC) for Learning Sciences Research

在美国国家科学基金会主要研究仪器（MRI）奖的支持下，Roy Pea博士将开发一种用于高分辨率数字全景音视频记录、分析和通信的新仪器。数字视频合作实验室（DVC）将提供一套集成的硬件技术，斯坦福大学的DIVER软件系统（数字互动视频探索和反思）将允许研究人员和教育工作者生成和分享不同的观点（POV）和分析观点，对同样丰富的课堂事件进行记录。全景图像采集是通过使用多摄像头数字视频系统与镜子相结合，以捕获图像超过360度的水平弧度。然后，这些相机图像通过软件拼接在一起，这样拍摄的场景就可以在电脑显示器上显示为一个矩形，描绘出“未包裹”的360度视野。为了开发DVC，该团队将在实验空间集成最先进的数字全景视频捕获系统和房间大小的麦克风阵列，以及用于同步、存储和管理多媒体数据流的相关软件和硬件工具。DRIVER软件系统将用于通过这些“Free-D”全景数字视频记录来编写和注释pov路径。使用个人电脑，DIVER用户可以在全景场景上平移和缩放“虚拟相机”窗口，以聚焦感兴趣的事件。然后，用户可以标记兴趣点并记录其pov路径和相关的文本注释（用于研究或教育目的）。注释的DIVER文件可以通过计算机网络共享，以便其他人可以重新体验并响应用户对记录活动的解释性“游览”。因此，潜水员的用户能够成为一个“虚拟摄像师”之后，全景视频捕捉的事实。这个项目很重要，因为学习科学的研究人员越来越依赖多媒体技术来捕捉学习环境的复杂性，并反复查看记录以深化互操作和分析。与其他数据类型相结合的数字视频和音频有望比旧方法更完整地记录学习活动，并使多个研究人员能够像在其他学科中一样调查通用数据集。然而，目前的多媒体记录方法往往是临时的，产生部分数据，阻碍了更强大的理论和实践的发展。数字视频协作实验室和DIVER软件系统不仅在学习科学研究、培训和教师教育方面具有广泛的应用潜力，而且在全景音视频记录和注释可以提供有用功能的许多领域也具有广泛的应用前景。该项目的一个组成部分是斯坦福大学和其他地方的许多教师在他们的研究、学习和认知科学的研究生和本科生教育以及教师教育中使用DVC。

With support from a NSF Major Research Instrumentation (MRI) award, Dr. Roy Pea will develop a new develop a new instrument for high-resolution digital panoramic audio-video recording, analysis and communication. The Digital Video Collaboratory (DVC) will provide an integrated suite of hardware technologies and Stanford's DIVER software system (Digital Interactive Video Exploration and Reflection) will allow researchers and educators to generate and share different points-of-view (POV) and analytic perspectives on the same richly recorded classroom events. Panoramic image acquisition is make possible by using a multi-camera digital video system coupled with mirrors to capture images over 360 degrees of horizontal arc. These camera images are then stitched together by software so that the captured scene may be displayed on a computer monitor as a rectangle that depicts the "unwrapped" 360-degree field of view.To develop the DVC the team will integrate a state-of-the-art digital panoramic video capture system and a room-size microphone array in an experimental space with associated software and hardware tools for synchronizing, storing and managing the multimedia data streams. The DRIVER software system will be used to author and annotate POV-paths through these "Free-D" panoramic digital video records. Using a personal computer, the DIVER user pans and zooms a "virtual camera" window over a panoramic scene to focus on events of interest. The user may then mark interest points and record their POV-paths and associated textual annotations (for research or educational purposes). An annotated DIVER file can be shared through a computer network so others may re-experience and respond to the user's interpretive "tour" of the recorded activities. The user of DIVER is thus able to be a "virtual videographer", after the fact of panoramic video capture.This project is important because researchers in the learning sciences increasingly rely on multimedia technologies to capture the complexities of learning environments and to repeatedly view recordings to deepen interoperation and analyses. Digital video and audio, integrated with other data types, promise far more complete records of learning activities than older methods, and enable multiple researchers to investigate common datasets, as in other disciplines. However, current approaches to multimedia recording are often ad hoc, yielding partial data and hindering the development of more powerful theory and practice. The Digital Video Collaboratory and the DIVER software system have potential for widespread use not only in learning sciences research and training and teacher education, but also in many fields for which panoramic audio-video recording and annotation can provide a useful function. An integral part of the project is the use of the DVC by many faculty at Stanford and elsewhere for their research, for graduate and undergraduate education in learning and cognitive sciences, and for teacher education.