Collaborative Research: CNS Core: Medium: Rethinking Multi-User VR - Jointly Optimized Representation, Caching and Transport

合作研究：CNS 核心：媒介：重新思考多用户 VR - 联合优化表示、缓存和传输

• 批准号: 2212200
• 负责人: Sonia Fahmy
• 金额: $ 60万
• 依托单位: Purdue University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-10-01 至 2026-03-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2212200&HistoricalAwards=false
• 关键词: Collaborative; Research; CNS; Core; Medium

Interactive Virtual Reality (VR) on wirelessly-connected and resource-constrained devices has important applications in education and healthcare. Supporting such VR applications is challenging due to the high data volume and stringent latency requirements. This project takes a novel holistic approach towards robust and manageable multi-user VR application support. The project jointly develops data representations, algorithms, protocols, and a prototype system that enhance the user quality of experience in collaborative, wireless VR applications, while reducing the requirements for network bandwidth, and for device storage and computation. Central to the approach is exploiting "edge cloud" resources that are near a user or group of users. The edge cloud works in concert with user devices and the more remote cloud to optimize user experience, with robustness to network variability and temporary outages. The processing tasks among the edge, remote cloud, and user devices are orchestrated to best exploit the lower latency between the users and the edge.The project makes high-quality VR accessible to more users, with fewer hardware and network requirements, enabling interactive visualization in domains such as education and healthcare at scales not previously possible. The proposed research will contribute to the general area of increasing user quality of experience at a low cost for high-volume, latency-critical workloads. The work will contribute strategies for data representation, caching, and transport among wirelessly-connected thin clients, a nearby edge cloud, and a remote cloud. The project will disseminate well-documented software and educational material. The software prototypes will be used to recruit under-represented minorities in computer science and engineering at all levels, and to support joint research projects and summer internships for undergraduates.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

无线连接和资源受限设备上的交互式虚拟现实（VR）在教育和医疗保健中具有重要的应用。由于数据量高和严格的延迟要求，支持此类VR应用程序具有挑战性。该项目采取了一种新颖的整体方法，用于强大且易于管理的多用户VR应用程序支持。该项目共同开发数据表示，算法，协议和原型系统，该系统可以提高协作，无线VR应用程序中的体验质量，同时降低网络带宽的要求以及设备存储和计算。该方法的核心是利用靠近用户或一组用户的“边缘云”资源。 Edge Cloud与用户设备和更遥远的云共同起作用，以优化用户体验，并具有对网络可变性和临时中断的鲁棒性。边缘，远程云和用户设备之间的处理任务是精心策划的，以最好地利用用户和边缘之间的较低延迟。该项目使更多用户可以访问高质量的VR，具有较少的硬件和网络要求，可以在范围内进行较少的交互式可视化，例如以前是不可能的，例如教育和医疗保健。拟议的研究将为高批量，关键延迟工作负载的低成本以低成本而提高用户体验质量的一般领域。这项工作将为数据表示，缓存和运输的策略提供无线连接的薄客户，附近的边缘云和远程云的策略。该项目将传播有据可查的软件和教育材料。该软件原型将用于各个级别的计算机科学和工程领域中代表性不足的少数群体，并支持联合研究项目和本科生的暑期实习。该奖项反映了NSF的法定任务，并被认为是值得通过基金会的知识分子优点和更广泛的影响审查的评估来通过评估来支持的。

项目成果

Toward QoE-based Routing Path Selection

基于 QoE 的路由路径选择

• DOI: 10.1109/hpsr57248.2023.10147938
• 发表时间: 2023
• 期刊: 2023 IEEE 24th International Conference on High Performance Switching and Routing (HPSR
• 作者: Kulkarni, Umakant;Chen, Yufeng;Melampy, Patrick;Fahmy, Sonia
• 通讯作者: Fahmy, Sonia

Dynamic Redirection for VR Haptics with a Handheld Stick

使用手持棒实现 VR 触觉的动态重定向

• DOI: 10.1109/tvcg.2023.3247047
• 发表时间: 2023
• 期刊: IEEE Transactions on Visualization and Computer Graphics
• 影响因子: 5.2
• 作者: Zhou, Yuqi;Popescu, Voicu
• 通讯作者: Popescu, Voicu

AR Interfaces for Disocclusion—A Comparative Study

• DOI: 10.1109/vr55154.2023.00068
• 发表时间: 2023-03
• 期刊: 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)
• 作者: Shuqi Liao;Yuqi Zhou;V. Popescu

Towards Immersive Visualization for Large Lectures: Opportunities, Challenges, and Possible Solutions

大型讲座的沉浸式可视化：机遇、挑战和可能的解决方案

• 发表时间: 2023
• 期刊: EG2023
• 作者: Popescu, Voicu;Magana, Alejandra;Benes, Bedrich
• 通讯作者: Benes, Bedrich

Complex Virtual Environments on Thin VR Systems Through Continuous Near-Far Partitioning

• DOI: 10.1109/ismar55827.2022.00017
• 发表时间: 2022-10
• 期刊: 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
• 作者: V. Popescu;Seung Heon Lee;Andrew Shinyoung Choi;S. Fahmy