"Improved Shared Reality for Multi-Party, Multimodal Simulation and Interaction"

共享现实的目标是在支持最苛刻应用的存在级别上实现高保真的分布式交互，包括真实数据和虚拟数据，并且这样做不受传感器和带宽的限制。为此，我们正在提高模拟环境的质量，为用户提供丰富的音频、视频和触觉体验。我们正在努力实现下一代远程呈现技术，使远程参与者的视听呈现方式比目前的视频会议系统更令人信服。最后，我们正在探索补偿网络延迟影响的策略，网络延迟通常会阻碍有效的任务性能，特别是对于高度同步的活动。这项研究的应用包括虚拟现实模拟器、高保真训练环境、沉浸式游戏和娱乐系统、远程机器人操作、康复和分布式音乐表演。

The goal of Shared Reality is to achieve high-fidelity distributed interaction, with both real and virtual data, at levels of presence that support the most demanding applications, and to do so in spite of sensor and bandwidth limitations. To that end, we are advancing the quality of simulation environments, which provide users with rich experience of audio, video, and haptic modalities. We are working towards the next generation of telepresence technologies that render audiovisual representations of remote participants in a far more convincing manner than present-day videoconferencing systems. And last, we are exploring strategies to compensate for the effects of network latency, which often impede effective task performance, in particular for highly synchronized activities. Applications of this research include virtual reality simulators, high-fidelity training environments, immersive gaming and entertainment systems, telerobotic manipulation, rehabilitation, and distributed musical performance.