Mobile multimedia recording system

所要求的设备包括两个相同的录象机-电脑包和两个录象编辑所需的项目。该设备增强了私家侦探现有的研究设施，并使私家侦探和他在UBC的合作者对交际行为的产生和感知进行多学科检查成为可能。相机包是最先进的专业数字视频录制；然而，价格低廉，可移动，并且非常适合用于以下研究：1)口语的多模态产生和多感官感知，因为它是自然和自发发生的，并通过机器界面进行调解；2)幼儿和婴儿与环境互动时的行为；3)口语和音乐表演中的交流互动。这个提议来得正是时候。经过10多年的发展，我们现在有了从视频图像序列中获取生物运动精确测量的软件工具。这些工具取代了物理上受限的基于标记的动作捕捉系统，使其成为可能，例如，测量小孩的运动。使用多个摄像头与非侵入性测力板相结合，现在可以同时测量交流互动中多个参与者的面部、头部和身体的运动。最近NSERC授予PI和feles的奖项（PI作为共同申请人）明确要求这样的记录。这两个相机包分别包括：1)一个高清相机（松下AG-HPX500）、镜头（佳能KJ16ex7.7 KRSD）和配件；2)一个硬件视频编码器（AJA IOHD），它可以实时压缩高清视频，而不会产生干扰或损失图像质量；3)一个苹果MacBookPro，它可以通过与AJA相连的苹果火线800将压缩后的视频直接写入磁盘。该系统的空间和时间分辨率是标准视频的两倍以上，可以精确测量手和脸的运动。最后，对于视频编辑，我们需要一个苹果显示器（Cinema HD）和软件（Final Cut Studio），将安装在现有的工作站上。所需资金总额为91,041美元。

The requested equipment consists of two identical camera-to-computer packages for video recording and two items needed for video editing. This equipment augments the PI's existing research facility and makes possible the multidisciplinary examination of the production and perception of communicative behavior undertaken by the P.I. and his collaborators at UBC. The camera package is state of the art for professional digital video recording; yet inexpensive, mobile, and well-suited for examining 1) the multimodal production and multisensory perception of spoken language as it occurs both naturally and spontaneously and as mediated through machine interfaces, 2) the behavior of young children and infants as they interact with their environment and 3) communicative interaction in spoken and musical performance.   The proposal is well-timed. After more than 10 years of development, we now have software tools for acquiring accurate measures of biological motion from video image sequences. These tools replace physically restrictive marker-based motion capture systems, making it possible, for example, to measure the motion of small children. Using multiple cameras in conjunction with  non-invasive force plates, the motions of the face, head, and body can now be simultaneously measured for multiple participants in a communicative interaction. Recent NSERC awards to the PI and Fels (with the PI as co-applicant) explicitly require such recordings.   The two camera packages each consist of 1) a high definition camera (Panasonic AG-HPX500), lens (Canon KJ16ex7.7 KRSD) and accessories, 2) a hardware video encoder (AJA IOHD) that compresses high definition video in real time without introducing artifacts or loss of image quality and 3) an Apple MacBookPro that writes the compressed video directly to disk via Apple's Firewire 800 linked to the AJA. This system has more than twice the spatial and temporal resolution of standard video, making possible the accurate measurement of hand and face motion. Finally, for video editing, we request an Apple monitor (Cinema HD) and software (Final Cut Studio) that will be installed on an existing workstation. Total funds needed are $91,041.