Collaborative Research: SHF: Small: Software Hardware Architecture Co-Design for Enabling True Virtual Reality on Mobile Devices
合作研究:SHF:小型:软件硬件架构协同设计,在移动设备上实现真正的虚拟现实
基本信息
- 批准号:2215043
- 负责人:
- 金额:$ 30万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Standard Grant
- 财政年份:2022
- 资助国家:美国
- 起止时间:2022-07-01 至 2025-06-30
- 项目状态:未结题
- 来源:
- 关键词:
项目摘要
Virtual Reality (VR) provides users with immersive senses of physical presence in the virtual world. Emerging VR applications such as Metaverse aim to realize a virtual counterpart of the real human world, which is truly indistinguishable from the physical world and allows complete simulation of real human life. Providing such true VR experiences results in an unprecedented amount of computation demand, and creates tremendous challenges on resource-constrained mobile VR devices. Since the computation demand cannot be met by only redesigning either the mobile software or hardware systems, this project addresses these challenges via software-hardware architecture co-design. As VR is considered as one emerging technique that can fundamentally transform the way people interact with the environment and each other, this project has great potential to benefit society by facilitating large-scale adoption of VR systems into every aspect of people’s daily lives. This project is also contributing to society through developing new curricula, disseminating research for education and training, engaging under-represented students in research, and outreaching to high-school students.The primary goal of this project is to provide true VR experiences on mobile devices by fully understanding and utilizing the close correlation between different VR software systems and hardware components. The project consists of three research tasks: (1) developing new VR computing techniques and GPU hardware designs to minimize the amount of VR computation, by adaptively identifying the redundancy among the rendered VR frames of different users and reusing these frames whenever possible; (2) investigating VR frame tiling techniques based on different VR users’ commonality in Field of Views, to minimize the mobile device’s energy consumption on receiving and processing VR frames according to the mobile hardware characteristics; (3) exploring the potential of heterogeneous mobile hardware, especially AI accelerators, to enable AI-based image upscaling on mobile devices that compensates the possible VR quality degradation due to communication link variations.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
虚拟现实(VR)为用户提供了虚拟世界中物理存在的沉浸感。新兴的虚拟现实应用,如Metaverse,旨在实现真实的人类世界的虚拟对应物,这是真正无法区分的物理世界,并允许完全模拟真实的人类生活。 提供这种真实的VR体验会产生前所未有的计算需求,并对资源受限的移动的VR设备造成巨大挑战。由于计算需求不能满足仅仅重新设计的移动的软件或硬件系统,该项目通过软件-硬件架构协同设计来解决这些挑战。由于VR被认为是一种新兴技术,可以从根本上改变人们与环境和彼此之间的互动方式,因此该项目具有巨大的潜力,可以通过促进VR系统大规模应用于人们日常生活的各个方面来造福社会。此外,本项目还通过开发新课程、传播教育培训研究成果、让代表性不足的学生参与研究、面向高中生开展外展等方式,为社会做出贡献。本项目的主要目标是充分理解和利用VR软件系统和硬件之间的紧密关联,在移动的设备上提供真正的VR体验。该项目包括三个研究任务:(1)开发新的VR计算技术和GPU硬件设计,通过自适应地识别不同用户渲染的VR帧之间的冗余并尽可能重用这些帧,以最大限度地减少VR计算量;(2)研究了基于不同VR用户视野共性的VR框架拼接技术,根据所述移动的硬件特性,最小化所述移动终端在接收和处理VR帧时的能量消耗;(3)探索异构移动的硬件的潜力,尤其是AI加速器,使AI-基于移动的设备上的图像放大,以补偿由于通信链路变化而可能导致的VR质量下降。该奖项反映了NSF的法定使命,通过使用基金会的知识价值和更广泛的影响审查标准进行评估,被认为值得支持。
项目成果
期刊论文数量(3)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Macrotile: Toward QoE-Aware and Energy-Efficient 360-Degree Video Streaming
- DOI:10.1109/tmc.2022.3233022
- 发表时间:2024-02
- 期刊:
- 影响因子:7.9
- 作者:Xianda Chen;Tianxiang Tan;Guohong Cao
- 通讯作者:Xianda Chen;Tianxiang Tan;Guohong Cao
Deep Learning on Mobile Devices With Neural Processing Units
- DOI:10.1109/mc.2022.3215780
- 发表时间:2023-08
- 期刊:
- 影响因子:2.2
- 作者:Tianxiang Tan;Guohong Cao
- 通讯作者:Tianxiang Tan;Guohong Cao
Energy-Efficient 360-Degree Video Streaming on Multicore-Based Mobile Devices
- DOI:10.1109/infocom53939.2023.10228863
- 发表时间:2023-05
- 期刊:
- 影响因子:0
- 作者:Xianda Chen;Guohong Cao
- 通讯作者:Xianda Chen;Guohong Cao
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Guohong Cao其他文献
A Framework for Personalized Location Privacy (CCF-A)
个性化位置隐私框架 (CCF-A)
- DOI:
- 发表时间:
2021 - 期刊:
- 影响因子:7.9
- 作者:
Ben Niu;Qinghua Li;Hanyi Wang;Guohong Cao;Fenghua Li;Hui Li - 通讯作者:
Hui Li
Compromise-resilient anti-jamming communication in wireless sensor networks
- DOI:
10.1007/s11276-011-0361-8 - 发表时间:
2011-06-18 - 期刊:
- 影响因子:2.100
- 作者:
Xuan Jiang;Wenhui Hu;Sencun Zhu;Guohong Cao - 通讯作者:
Guohong Cao
One‐year status of hepatic venous pressure gradient measurement from 85 hospitals in China
国内85家医院一年肝静脉压力梯度测量现状
- DOI:
10.1002/poh2.68 - 发表时间:
2024 - 期刊:
- 影响因子:0
- 作者:
Jitao Wang;Ting Cui;Linpeng Zhang;Zhiping Yan;Lei Li;Jinjun Chen;Junhui Sun;Hua Xiang;He Zhu;Hao Wu;Jiancuo Gengzang;Feng Zhang;Wei Wu;Guohong Cao;Wuhua Guo;Haibin Shi;Hui Xue;Guangjun Huang;Qiang Yu;M. Niu;Huiling Xiang;Derun Kong;Wei Gou;Xuefeng Luo;Fuliang He;M. Yuan;Wei Liu;Yong Wang;Hongjie Hu;Xiaoliang Zhu;Tao Yu;Qinxue Sun;Wei Qu;Ting Lu;Deqiang Ma;Li Zhang;Jun Ma;Jun Yang;Ketao Mu;Xiaoliang Zhu;Kai Xiong;Huiguo Ding;Shengjuan Yao;Mingsheng Huang;Fang Wang;Zexin Wang;Yong Huang;Jianan Li;Hongfeng Yi;Birun Huang;Zhongwei Zhao;Duiping Feng;Yanming Lei;Changlong Hou;Wen;Shirong Liu;Gao;Kangshun Zhu;Fan Wu;Xiaogang Hu;Wenfeng Zhang;Shao;Zhouchao Hu;P. Pang;S. Zhuang;Weidong Wang;Q. Zhu;Kunpeng Zhang;Chengyu Liu;Dongliang Li;Chao Ma;Hong Jiang;Xingong Zhao;W. Ren;Zhiwei Wang;Lei Yu;Fuhuang Lin;Chaoguang Yan;Feng Wang;Lei Yu;Hui Huan;Wenyong Shen;Shaofei He;Chengda Zhang;Jin Bao;Jiangtao Liu;Jun Wu;Jianbo Zhao;Jian Zhang;Xiaolong Qi - 通讯作者:
Xiaolong Qi
YTHDC1 phase separation drives the nuclear export of m6A-modified lncNONMMUT062668.2 through the transport complex SRSF3–ALYREF–XPO5 to aggravate pulmonary fibrosis
YTHDC1 相分离通过转运复合物 SRSF3–ALYREF–XPO5 驱动 m6A 修饰的 lncNONMMUT062668.2 的核输出以加重肺纤维化
- DOI:
10.1038/s41419-025-07608-x - 发表时间:
2025-04-12 - 期刊:
- 影响因子:9.600
- 作者:
Shengjun Chen;Yujie Wang;Jinjin Zhang;Bo Liu;Weili Liu;Guohong Cao;Rongrong Li;Hongbo Li;Nailiang Zhai;Xiaodong Song;Songzi Zhang;Changjun Lv - 通讯作者:
Changjun Lv
On Improving the Performance of Cache Invalidation in Mobile Environments
- DOI:
10.1023/a:1015463328335 - 发表时间:
2002-08-01 - 期刊:
- 影响因子:2.000
- 作者:
Guohong Cao - 通讯作者:
Guohong Cao
Guohong Cao的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Guohong Cao', 18)}}的其他基金
SHF: Small: NPU-based Architecture for Accelerating Deep Learning on Mobile Devices
SHF:小型:基于 NPU 的架构,用于加速移动设备上的深度学习
- 批准号:
2125208 - 财政年份:2021
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
CSR: Small: Energy-Aware and QoE-Aware Video Streaming on Mobile Devices
CSR:小:移动设备上的能源感知和 QoE 感知视频流
- 批准号:
1815465 - 财政年份:2018
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
NeTS: Small: Collaborative Research: Network-Centric Mobile Cloud Computing
NeTS:小型:协作研究:以网络为中心的移动云计算
- 批准号:
1526425 - 财政年份:2015
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
NeTS: Small: Resource-Aware Crowdsourcing in Wireless Networks
NetS:小型:无线网络中的资源感知众包
- 批准号:
1421578 - 财政年份:2014
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
NeTS: Small: Resilient and Efficient Data Access in Cognitive Radio Networks
NeTS:小型:认知无线电网络中弹性且高效的数据访问
- 批准号:
1320278 - 财政年份:2013
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
NeTS: Small: Efficient Energy-Aware Web Browsing in Wireless Networks
NetS:小型:无线网络中的高效节能网页浏览
- 批准号:
1218597 - 财政年份:2012
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
NeTS:Small:Supporting Multi-Missions in Wireless Sensor Networks
NetS:小型:支持无线传感器网络中的多任务
- 批准号:
0916171 - 财政年份:2009
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
NeTS-WN: Collaborative Data Access in Wireless P2P Networks
NeTS-WN:无线 P2P 网络中的协作数据访问
- 批准号:
0721479 - 财政年份:2007
- 资助金额:
$ 30万 - 项目类别:
Continuing Grant
NeTS-NOSS: Controllable Node Mobility for Mission-Oriented Sensor Networks
NeTS-NOSS:面向任务的传感器网络的可控节点移动性
- 批准号:
0519460 - 财政年份:2005
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
ITR: Efficient Power-Aware Data Access in Pervasive Computing Environments
ITR:普适计算环境中的高效节能数据访问
- 批准号:
0219711 - 财政年份:2002
- 资助金额:
$ 30万 - 项目类别:
Continuing Grant
相似国自然基金
Research on Quantum Field Theory without a Lagrangian Description
- 批准号:24ZR1403900
- 批准年份:2024
- 资助金额:0.0 万元
- 项目类别:省市级项目
Cell Research
- 批准号:31224802
- 批准年份:2012
- 资助金额:24.0 万元
- 项目类别:专项基金项目
Cell Research
- 批准号:31024804
- 批准年份:2010
- 资助金额:24.0 万元
- 项目类别:专项基金项目
Cell Research (细胞研究)
- 批准号:30824808
- 批准年份:2008
- 资助金额:24.0 万元
- 项目类别:专项基金项目
Research on the Rapid Growth Mechanism of KDP Crystal
- 批准号:10774081
- 批准年份:2007
- 资助金额:45.0 万元
- 项目类别:面上项目
相似海外基金
Collaborative Research: SHF: Small: LEGAS: Learning Evolving Graphs At Scale
协作研究:SHF:小型:LEGAS:大规模学习演化图
- 批准号:
2331302 - 财政年份:2024
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
Collaborative Research: SHF: Small: LEGAS: Learning Evolving Graphs At Scale
协作研究:SHF:小型:LEGAS:大规模学习演化图
- 批准号:
2331301 - 财政年份:2024
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
Collaborative Research: SHF: Medium: Differentiable Hardware Synthesis
合作研究:SHF:媒介:可微分硬件合成
- 批准号:
2403134 - 财政年份:2024
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
Collaborative Research: SHF: Small: Efficient and Scalable Privacy-Preserving Neural Network Inference based on Ciphertext-Ciphertext Fully Homomorphic Encryption
合作研究:SHF:小型:基于密文-密文全同态加密的高效、可扩展的隐私保护神经网络推理
- 批准号:
2412357 - 财政年份:2024
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
Collaborative Research: SHF: Medium: Enabling Graphics Processing Unit Performance Simulation for Large-Scale Workloads with Lightweight Simulation Methods
合作研究:SHF:中:通过轻量级仿真方法实现大规模工作负载的图形处理单元性能仿真
- 批准号:
2402804 - 财政年份:2024
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
Collaborative Research: SHF: Medium: Tiny Chiplets for Big AI: A Reconfigurable-On-Package System
合作研究:SHF:中:用于大人工智能的微型芯片:可重新配置的封装系统
- 批准号:
2403408 - 财政年份:2024
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
Collaborative Research: SHF: Medium: Toward Understandability and Interpretability for Neural Language Models of Source Code
合作研究:SHF:媒介:实现源代码神经语言模型的可理解性和可解释性
- 批准号:
2423813 - 财政年份:2024
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
Collaborative Research: SHF: Medium: Enabling GPU Performance Simulation for Large-Scale Workloads with Lightweight Simulation Methods
合作研究:SHF:中:通过轻量级仿真方法实现大规模工作负载的 GPU 性能仿真
- 批准号:
2402806 - 财政年份:2024
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
Collaborative Research: SHF: Medium: Differentiable Hardware Synthesis
合作研究:SHF:媒介:可微分硬件合成
- 批准号:
2403135 - 财政年份:2024
- 资助金额:
$ 30万 - 项目类别:
Standard Grant
Collaborative Research: SHF: Medium: Tiny Chiplets for Big AI: A Reconfigurable-On-Package System
合作研究:SHF:中:用于大人工智能的微型芯片:可重新配置的封装系统
- 批准号:
2403409 - 财政年份:2024
- 资助金额:
$ 30万 - 项目类别:
Standard Grant