CAREER: Toward a Specialized Edge for Augmented Reality

职业：迈向增强现实的专业优势

• 批准号: 2236987
• 负责人: Tian Guo
• 金额: $ 65.78万
• 依托单位: Worcester Polytechnic Institute
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-06-01 至 2028-05-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2236987&HistoricalAwards=false
• 关键词: CAREER; Toward; Specialized; Edge; Augmented

Augmented Reality (AR) applications are a popular media that benefits millions of users. Domain experts and the public use AR applications for daily tasks, including safety training, tourism, and online shopping. However, existing edge-assisted AR systems often fall short in handling noisy sensor data, managing edge resources under dynamic workloads, and mitigating visual privacy risks. The proposed work will lay the scientific foundations for a specialized edge by designing a generic device-to-edge pipeline that AR developers can use to implement and deploy efficient and privacy-preserving AR tasks. The proposed techniques will complement and extend existing approaches for mobile AR frameworks and edge resource management. The proposed research thrusts include: (1) techniques for high-quality data capture, adaptive and scalable data sharing, and resource-efficient execution; (2) methods and datasets for AR researchers to gain new insights, and resource management techniques for developers to improve the performance of their AR applications; and (3) privacy-preserving approaches that help AR developers mitigate privacy risks associated with AR development and deployment. The proposed techniques will span development through deployment and improve AR applications' end-to-end performance. The PI regularly open-sources systems and datasets, promoting adoption and benefiting the research community. The research program will support the inclusion of undergraduate researchers by providing opportunities to students with diverse technical backgrounds to engage in mobile and edge computing research. The PI will create and pilot interactive course materials on mobile AR in the PI's existing courses and make them publicly available. Collaboration with AR technology leaders and domain experts will ease technology transfer and expose students to real-world AR products.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

增强现实（AR）应用程序是一种受益于数百万用户的流行媒体。域专家和公共使用AR应用程序用于日常任务，包括安全培训，旅游和在线购物。但是，现有的边缘辅助AR系统通常在处理嘈杂的传感器数据，在动态工作负载下管理边缘资源并减轻视觉隐私风险。拟议的工作将通过设计一条通用的设备到边缘管道，为AR开发人员可以用来实施和部署有效且保密保护的AR任务，为专业边缘奠定科学基础。提出的技术将补充和扩展移动AR框架和边缘资源管理的现有方法。拟议的研究推力包括：（1）高质量数据捕获，适应性和可扩展数据共享以及资源有效执行的技术； （2）AR研究人员获得新见解的方法和数据集，以及为开发人员提高其AR应用程序性能的资源管理技术； （3）保存隐私的方法，可帮助AR开发人员减轻与AR开发和部署相关的隐私风险。提出的技术将通过部署范围开发并改善AR应用程序的端到端性能。 PI定期开源系统和数据集，促进采用并受益于研究社区。该研究计划将通过为具有不同技术背景的学生提供机会从事移动和边缘计算研究的学生，以支持本科研究人员的包含。 PI将在PI现有课程中在移动AR上创建和试点交互式课程材料，并使它们公开可用。与AR技术领导者和领域专家的合作将简化技术转移，并使学生接触到现实世界中的AR产品。该奖项反映了NSF的法定任务，并且使用基金会的知识分子优点和更广泛的审查标准，认为值得通过评估来获得支持。

项目成果

Multi-Camera Lighting Estimation for Photorealistic Front-Facing Mobile Augmented Reality

• DOI: 10.1145/3572864.3580337
• 发表时间: 2023-01
• 期刊: Proceedings of the 24th International Workshop on Mobile Computing Systems and Applications
• 作者: Yiqin Zhao;S. Fanello;Tian Guo