REU Site: Computational Imaging and Mixed-Reality for Visual Media Creation and Visualization

本研究经验的本科生（REU）网站奖资金一个新的网站，专注于在艺术，媒体和工程学院在亚利桑那州州立大学的视觉计算系统的创建。REU网站每年夏天将招募8名学生，进行为期10周的计算成像和混合现实研究经验。从增强现实和虚拟现实到计算摄影和物联网，基于实时、高质量视觉传感的应用正在成为日常计算的核心。所有这些应用都表现出两个相互竞争的需求：一方面是复杂的特定于领域的传感能力，另一方面是系统考虑因素，如能源效率、数据带宽和延迟。这个REU网站的目的是让学生进行研究，为这些应用程序的新的视觉计算系统的设计，以解决这些挑战。此外，学生将接触到媒体艺术和科学的新兴领域，以了解他们建立的系统如何用于视觉媒体创作。学生将有机会在科学出版物和会议上展示他们的作品，并通过公开展览，与当地社区的联系以及与对视觉媒体感兴趣的更广泛受众的接触进行新颖的传播。本科生将从广泛的领域，包括计算机科学，电气工程，数字媒体艺术和科学招募。招聘工作将集中在州立大学，少数民族服务机构和社区学院的学生，特别是对视觉媒体技术感兴趣的服务不足的人群。这将使新的、多样化的受众能够接触到视觉计算研究及其在社会中的应用。这个REU网站的主要目标是培养计算成像和摄影，虚拟/增强/混合现实和可视化技术领域的本科研究人员。这些学生将致力于解决研究问题的项目，如：（a）如何将光和声传输的物理学有效地纳入/利用采集系统？(b)有效采样高维视觉数据的信号处理约束是什么？(c)我们如何描述用于感知、分发和回放高质量沉浸式空间数据的高效系统架构和算法的能量、性能和可扩展性？作为这些项目的一部分，将强调硬件和软件的协同设计，以实现节能的移动的和嵌入式系统，并扩展传感和处理的视觉能力。第二个目标是让学生通过展示他们的研究项目的应用程序与公众接触。这主要是通过媒体艺术和科学的工具来实现的，这些工具强调实时演示，公共展览，数字媒体内容创作以及关于这些系统背后的科学和工程的持续对话。这些综合目标将培养本科生研究人员建立令人兴奋的，新颖的视觉计算系统，具有广泛的应用相关的传感器，可视化，游戏和娱乐行业，利用这项技术。这个奖项反映了NSF的法定使命，并已被认为是值得通过评估使用基金会的智力价值和更广泛的影响审查标准的支持。

This Research Experiences for Undergraduates (REU) Site award funds a new site focused on the creation of visual computing systems at the School of Arts, Media and Engineering at Arizona State University. The REU Site will recruit eight students each summer for a ten-week long experience in computational imaging and mixed-reality research. From augmented and virtual reality to computational photography and the Internet of Things, applications built on real-time, high-quality visual sensing are becoming central to everyday computing. All of these applications exhibit two competing demands: complex, domain-specific sensing capabilities on one hand and systems considerations such as energy efficiency, data bandwidth, and latency on the other. This REU site aims to enable students to conduct research on the design of new visual computing systems for these applications to solve these challenges. Further, students will be exposed to the emerging area of media arts and sciences to understand how the systems they build can be utilized for visual media creation. Students will have the opportunity to present their work in both scientific publications and conferences as well as novel dissemination through public exhibition, outreach to the local community, and engagement with a wider audience interested in visual media. Undergraduate students will be recruited from a broad range of fields including computer science, electrical engineering, and digital media arts and sciences. Recruitment efforts will focus on students from state universities, minority-serving institutions, and community colleges, particularly from under-served populations who are interested in visual media technologies. This will enable new, diverse audiences to be exposed to visual computing research and its applications in society. The primary objective of this REU site is to train undergraduate researchers in the areas of computational imaging and photography, virtual/augmented/mixed reality, and visualization technologies. These students will work on projects that addresses research questions such as: (a) How can the physics of light and sound transport be incorporated/exploited into acquisition systems effectively? (b) What are the signal processing constraints for sampling high-dimensional visual data effectively? (c) How can we characterize the energy, performance, and scalability of efficient system architectures and algorithms for the sensing, distribution, and playback of high-quality immersive spatial data? As part of these projects, hardware and software co-design will be emphasized to realize mobile and embedded systems which are energy-efficient and extend the visual capabilities of sensing and processing. The second objective is to have students' engagement with the general public through applications demonstrating their research projects. This is primarily accomplished through tools from the media arts and sciences that emphasize real-time demonstrations, public exhibition, digital media content creation, and on-going dialogue about the science and engineering behind these systems. These combined objectives will train undergraduate researchers to build exciting, novel visual computing systems that have wide application to relevant sensor, visualization, gaming, and entertainment industries that utilize this technology.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.