REU Site: Research Experience for Undergraduates in Immersive Media Computing

REU 网站：沉浸式媒体计算本科生研究经验

• 批准号: 1852516
• 负责人: Ying Zhu
• 金额: $ 31.68万
• 依托单位: Georgia State University Research Foundation, Inc.
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-02-01 至 2023-01-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1852516&HistoricalAwards=false
• 关键词: REU; Site; Research; Experience; Undergraduates

This project establishes a new Research Experiences for Undergraduates (REU) Site that is jointly hosted by the Department of Computer Science and the Creative Media Industries Institute at Georgia State University. Undergraduate students across the nation will work with a group of experienced faculty members and conduct cutting-edge research in immersive media computing during each summer. Immersive media computing is an emerging computing paradigm that aims to create the sensation of 3D immersion in a real or virtual environment. The recent development of immersive media computing has enabled a host of compelling technologies such as 360-degree videos, Augmented Reality, and Virtual Reality, potentially transforming a wide spectrum of sectors in healthcare, training, education, entertainment, tourism, etc. The REU site will train undergraduate students in this emerging computing paradigm and benefit their graduate application and job hunting. Through various activities such as seminars, demos, presentations, field trips, and other professional development opportunities, undergraduate students will also enhance their professional skills. This REU site aims to broaden the participation of underrepresented groups in research activities, especially in the neighboring regions with numerous Historically Black Colleges and Universities and Women Colleges. The emerging nature of immersive media computing leads to the strong intellectual merit of this project. Despite the rich history of research on regular images and videos, the computing of immersive content poses significant research challenges. New algorithms will be developed to address five research problems across the end-to-end immersive media computing system: (1) immersive content must be compressed to reduce the amount of data transported while maintaining the fidelity of the content; (2) the compressed immersive content needs to be streamed to the remote display in a bandwidth-efficient way; (3) the received immersive content should be quickly rendered based on the user head orientation using parallel computing in CPUs/GPUs; (4) the raw immersive content must be further analyzed to extract the events of interest; and (5) additional information needs to be overlaid over the immersive content to enhance the immersive visualization experience. In addition to algorithm and model designs, real-world systems will be built to demonstrate the effectiveness of the research.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目建立了一个新的本科生研究经验（REU）网站，由计算机科学系和创意媒体产业研究所在格鲁吉亚州立大学联合主办。全国各地的本科生将与一群经验丰富的教师一起工作，并在每年夏天进行沉浸式媒体计算的前沿研究。沉浸式媒体计算是一种新兴的计算范例，其目的是在真实的或虚拟环境中创建3D沉浸感。沉浸式媒体计算的最新发展已经启用了一系列引人注目的技术，如360度视频，增强现实和虚拟现实，可能会改变医疗保健，培训，教育，娱乐，旅游等领域的广泛领域。通过各种活动，如研讨会，演示，演示，实地考察和其他专业发展机会，本科生也将提高他们的专业技能。这个REU网站的目的是扩大在研究活动中代表性不足的群体的参与，特别是在邻近地区与众多的历史上黑人学院和大学和女子学院。沉浸式媒体计算的新兴性质导致了该项目的强大智力价值。尽管对常规图像和视频的研究历史丰富，但沉浸式内容的计算带来了重大的研究挑战。新的算法将被开发来解决端到端沉浸式媒体计算系统中的五个研究问题：（1）沉浸式内容必须被压缩以减少传输的数据量，同时保持内容的保真度;（2）压缩的沉浸式内容需要以带宽有效的方式流式传输到远程显示器;（3）接收到的沉浸式内容应当使用CPU/GPU中的并行计算基于用户头部取向来快速呈现;（4）原始沉浸式内容必须被进一步分析以提取感兴趣的事件;以及（5）需要在沉浸式内容上覆盖附加信息以增强沉浸式可视化体验。除了算法和模型设计之外，还将建立真实世界的系统来证明研究的有效性。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

OcuLock: Exploring Human Visual System for Authentication in Virtual Reality Head-mounted Display

• DOI: 10.14722/ndss.2020.24079
• 发表时间: 2020
• 期刊: Proceedings 2020 Network and Distributed System Security Symposium
• 作者: Shiqing Luo;Anh Nguyen;Chen Song;Feng Lin;Wenyao Xu;Zhisheng Yan

Computer-Assisted Heuristic Evaluation of Data Visualization

数据可视化的计算机辅助启发式评估

• DOI: 10.1007/978-3-030-90436-4_33
• 发表时间: 2021
• 期刊: Proceedings of the International Symposium on Visual Computing
• 作者: Zhu, Ying;Gumieniak, Julia A
• 通讯作者: Gumieniak, Julia A

Toward Injury-Aware Game Design

迈向伤害感知游戏设计

• 发表时间: 2022
• 期刊: Interactivity and Game Creation
• 作者: Tinnirello, Marinel;Zhu, Ying;Kane, Steven
• 通讯作者: Kane, Steven

Interactive Cartographic Storytelling with Complex Spatio-Temporal Structures and Social Connections

具有复杂时空结构和社会联系的交互式制图故事

• 发表时间: 2022
• 期刊: Lecture Notes in Computer Science
• 作者: Zhu, Ying;Turner, Aylish;Yonas, Naomi;Blackmon, Douglas
• 通讯作者: Blackmon, Douglas

A Computational Model of Suspense for Non-Narrative Gameplay

非叙事游戏悬念的计算模型

• DOI: 10.1109/iv51561.2020.00136
• 发表时间: 2020
• 期刊: Proceedings of the 24th International Conference Information Visualisation
• 作者: Bailey, Evelyn;Zhu, Ying
• 通讯作者: Zhu, Ying