See Hear! Multimodal Recording and Analysis Facility

高分辨率的记录和分析将充分利用动作捕捉的潜力，逐步实现手势的自动识别，并最终实现实时系统。自动跟踪和识别系统的需求很高，现在可以通过计算实现来自多种模式的数据的交织。SeeHear！将使用多模态融合技术进行编码-通过定位和识别面部特征，以及用于从力和生理反应模式中分类手势的学习算法，将增强身体跟踪。未来，通过将视觉和听觉数据与表演艺术、康复和安全方面的应用程序相连接，将实现全面的交互性。

High resolution recording and analysis will exploit the full potential of motion capture with progress towards automatic recognition of gesture and, eventually, real-time systems. Automatic tracking and recognition systems are in high demand and the interlacing of data from multiple modes is now computationally achievable. SeeHear! will be coded using techniques in multimodal fusion - tracking of bodies will be enhanced by locating and recognizing facial features, and a learning algorithm used to classify gesture from patterns of force and physiological response. In the future, full interactivity will be achieved by interconnecting visual and auditory data with a flow on to applications in the performing arts, rehabilitation and security.