MRI-R2: Development of an Immersive Giga-pixel Display

“这项奖励是根据2009年美国复苏和再投资法案（公法111-5）资助的。”提案号：9-59979 pi (s): Kaufman, Arie E., Mueller, Klaus, Qin, Hong, Samaras, Dimitrios, Varshney， amitabh机构：纽约州立大学Stony brook分校标题：MRI-R2：一种沉浸式千兆像素显示器的开发项目建议：该项目旨在开发下一代沉浸式显示仪器（称为“Reality Deck”），旨在探索和可视化来自多个领域的数据。为了满足该机构数据规模和环境爆炸式增长的需求，这项工作建立在沉浸式环境的现有经验之上（例如，“沉浸式小屋”，一种使用投影仪的新一代设备）。这个独特的项目创造了一个独一无二的探索剧场，使用308个高分辨率LCD显示器，通过提供一个视觉分辨率达到人眼灵敏度极限的环境。在这种环境下，调查人员可以与显示的数据/信息进行交互。该仪器服务于许多领域，包括视觉计算、虚拟和增强现实、人机界面、计算机视觉和图像处理、数据挖掘、物理、科学计算、化学、海洋和大气科学、气候和天气建模、材料科学等。合作科学家的应用将被移植到RealityDeck，包括纳米电子学、气候和天气建模、生物毒素模拟、微断层扫描、天文学、大气科学，用于情报收集的g像素相机，建筑设计和灾难模拟，智能能源网络等等。RealityDeck是显示器、GPU集群、传感器、通信/网络、计算机视觉和人机交互技术的独特组合，是一项具有用户研究的工程壮举，提供具有重要社会和研究价值的整体系统。它是一款独一无二的开创性的g像素显示器，接近视觉认知的极限，为不同的用户群提供功能。它的分辨率和视野总是超过人类用户（无论人类选择在哪里看），以非常直观的方式满足对数据的视觉查询。这种视觉交互与物理导航紧密结合。这个环绕式虚拟环境由惯性传感器和安装在RealityDeck房间顶部角落的六个摄像头组成，以便与显示器进行交互。该显示系统由大约80个高端计算机节点组成的集群驱动，每个节点配备两个高端gpu。一个小规模的视频墙已经被构建为RealityDeck的实验平台，该平台由9个高分辨率的30个LCD面板组成，配置为3×3。更广泛的影响：该仪器将用于该机构，马里兰大学和布鲁克海文国家实验室（BNL）的许多部门的研究，教育和推广。它促进了跨学科的合作，吸引了教师、研究人员和学生。RealityDeck显著地丰富了视觉思维和数据探索的质量。它极大地增强了研究和教育的基础设施，并有可能改变计算机图形学家、工程师和科学家工作和/或进行科学发现的方式。

"This award is funded under the American Recovery and Reinvestment Act of 2009 (Public Law 111-5)." Proposal #: 09-59979PI(s): Kaufman, Arie E., Mueller, Klaus, Qin, Hong, Samaras, Dimitrios, Varshney, AmitabhInstitution: SUNY at Stony BrookTitle: MRI-R2: Development of an Immersive Giga-pixel DisplayProject Proposed: This project, developing a next generation of immersive display instrument (called 'Reality Deck'), aims to explore and visualize data from many fields. To satisfy the need driven by the explosive growth of data size and environments already at the institution, the work builds on the existing experience with immersive environments (e.g., the 'Immersive Cabin' a current generation device using projectors). This unique project generates a one-of-a-kind exploration theater, using 308 high-resolution 30 LCD display monitors, by contributing an environment whose visual resolution is at the limit of the human eye's acuity. Within this environment investigators can interact with the data/information displayed. The instrument services many groups, including visual computing, virtual and augmented reality, human computer interfaces, computer vision and image processing, data mining, physics, scientific computing, chemistry, marine and atmospheric sciences, climate and weather modeling, material science, etc.Collaborating scientist's applications will be ported to the RealityDeck, including applications in nanoelectronics, climate and weather modeling, biotoxin simulations, microtomography, astronomy, atmospheric science, G-pixel camera for intelligence gathering, architectural design and disaster simulations, smart energy grid, and many others.A unique assembly of displays, GPU cluster, sensors, communication/networking, computer vision and human computer interaction technologies, RealityDeck is an engineering feat with user studies to deliver a holistic system with a significant societal and research value. It is a one-of-a-kind pioneering G-pixel display approaching the limits of visual cognition that provides functionalities to a diverse user base. Its resolution at the eye's visual acuity and its field of view will always exceed that of a human user (wherever a human chooses to look), satisfying visual queries into the data in a very intuitive way. This visual interaction is tightly coupled with physical navigation.This surround virtual environment consists of inertial sensors and six cameras mounted around the top corners of the RealityDeck room to allow interaction with the displays. The display system is driven by a cluster of about 80 high-end computer nodes, each equipped with two high end GPUs. A small-scale video-wall has already been constructed as an experimental platform for the RealityDeck consisting of 9 high-resolution 30 LCD panels in a 3×3 configuration. Broader Impacts: The instrument will be used for research, education, and outreach across many departments at the institution, the University of Maryland, and Brookhaven National Laboratory (BNL). It fosters collaborations across disciplines attracting faculty, researchers, and students. RealityDeck significantly enriches the quality of visual thinking and data exploration. It substantially enhances the infrastructure of research and education and has the potential to alter the way computer graphicists, engineers, and scientists work and/or conduct scientific discoveries.