CSR-DMSS, SM: View Control Management in Geographically Distributed Tele-Immersive Environments

修订预算/报表我们项目的摘要(约250字)新兴的3D地理分布式远程沉浸式环境(3DTI)正在成为互联网上可行的协作环境，允许进行联合体育活动，如太极训练和许多其他用途。这些环境融合了来自多个地点的多个3D摄像机和其他传感器的多维数据流，在每个地点呈现一个共享的多视角视觉网络空间，让所有参与者沉浸其中。在网络空间中，每个参与者操纵自己(例如，位置、大小)，并与远程参与者或图形对象进行虚拟交互。这些环境中的一个基本挑战是需要在地理上分布的多站点3DTI环境之间进行有效的实时交互，PI观察到，保持一致的、信息丰富的共享视觉环境是有效实时交互的关键。如果不同参与者的观点变得不同步，他们的合作就会严重中断。在这个项目中，PI提出了一种新的视图控制管理，称为VIEWCALL。VIEWCALL提出了(1)一种整体的视点传播方法，其中PI研究了森林构建和负载平衡，用于在各个3DTI环境中以视点为中心的流传播；(2)一种新的基于视点或资源需求的动态的视觉情境/反馈分布的方法；(3)用于捕获、更新、协调和同步基于视点的视觉上下文元数据的新的分布式算法。VIEWCALL系统对3DTI环境产生了影响，在3DTI环境中，研究社区调查新形式的舞蹈编排、学生学习太极、居家照顾老龄化人口、电脑游戏和轮椅篮球教练训练行动不便的球员。VIEWCALL经常出现在一年一度的加州大学S工程开放日以及芝加哥理工大学全女生夏令营上。

Revised Budget/StatementAbstract for our project (about 250 words) Emerging 3D Geographically Distributed Tele-immersive Environments (3DTI) are becoming viable collaborative environments over the Internet to allow for joint physical activities such as tai-chi training and many other usages. These environments fuse multi-dimensional streams from multiple 3D cameras and other sensors across multiple sites to render a shared multi-view visual cyberspace at each site that immerses all participants. In the cyberspace, each participant manipulates herself (e.g., positions, size), and interacts with remote participants or graphical objects ?virtually?. A fundamental challenge in these environments is the need for effective real-time interaction among multi-site geographically distributed 3DTI environments and the PI observes that maintaining a consistent, information-rich shared visual context is the key to effective real-time interaction. If the views of different participants become out of sync, their collaboration is severely disrupted. In this project, the PI presents a novel view control management, called VIEWCALL. VIEWCALL presents (1) a holistic approach to view dissemination where the PI investigates forest construction and load balancing for view-centric stream dissemination among individual 3DTI environments; (2) a novel approach to visual context/feedback distribution due to dynamics in view or resource demands, and (3) new distributed algorithms for capturing, updating, coordinating and synchronizing view-based visual context metadata. The VIEWCALL system has an impact on the 3DTI environments where research community investigates new forms of dance choreography, students learning tai-chi, in-home care of ageing population, computer gaming, and wheelchair-basketball coaches training players with movement disabilities. VIEWCALL is regularly shown at the annual UIUC?s Engineering Open House as well as to ChicTech all-schoolgirl summer camp.