MRI: Development of Experiential Supercomputing: Developing a Transdisciplinary Research and Innovation Holodeck

该项目开发一种分布式仪器，将物理与虚拟无缝集成，旨在创建一个独特的体验式超级计算机，一个沉浸式、协作式、虚拟/物理研究环境，拥有无与伦比的智力和创造性输出工具，在科学上超越《星际迷航》科幻小说的全息甲板。这项工作将推动下一代人类互动体验和虚拟与物理环境的深度融合，创造丰富的实现环境，以支持新范式的研究和发现。灵活的、模块化的、可重构的基础设施将连接整个大学、纽约大学全球网络大学（GNU）、外部研究人员、社区和全球行业合作伙伴的研究人员、研究和教育设施。该仪器将能够探索涉及虚拟环境、远程呈现、协作参与和远程交互的无数研究问题，并为扩展合作奠定坚实的基础。该项目整合了情感和动机的定性和定量评估，并结合了学习科学、运动科学、声学、建模和仿真、机器人和制造的基础，以提高研究的有效性和可扩展性，以应对现实世界的挑战。这项工作是通过集成3d打印来实现物理模拟形式，机器人允许虚拟模型影响物理世界并与之互动，触觉技术为人类合作者提供虚拟物体的触觉感受，以及生理状态监视器来尝试“进入”人类体验。这种“体验式超级计算”作为人类协作的范例，可以应用于计算机科学、工程学、音乐、心理学、护理学、放射学、应用数学、生物学和医学等所有学科。这项工作超越了可视化，从整体上接近人类合作，并有可能改变我们对合作、学习、创造、发现和创新的基本理解。纽约大学全息甲板将是一个集成良好的软件/硬件仪器，结合了视觉、音频和物理组件和新技术，以增强社会互动（人与人、人代理和人-机器人）。在它的快速原型和制造工具的结合，这种独特的仪器培养了创造性的能力，并紧密耦合互动的视觉，音频和物理体验。它的研究能力支持行为、生理、情感和认知数据的全面捕获，以及实时数据的可视化和分析。创建连接模拟、网络学习、科学可视化、人机交互和应用物理科学研究的创新环境；这一努力使来自不同学科的研究人员能够与理论模型、真实物体、机器人和代理进行互动的新型科学成为可能，从而产生2D、3D或其他现有表示方式无法实现的见解。

This project, developing a distributed instrument to physically integrate seamlessly the physical with the virtual, aims to create a unique experiential supercomputer, an immersive, collaborative, virtual/physical research environment with unparalleled tools for intellectual and creative output, a Holodeck that scientifically exceeds Star Trek science fiction. The work should advance the next-generation experiences in human interaction and deep integration of virtual and physical settings, creating rich actualizing environments to support research and discovery of new paradigms. The flexible, modular, reconfigurable infrastructure will connect researchers, research, and educational facilities across the university, the NYU Global Network University (GNU), and external researchers, communities, and industry partners worldwide. The instrument will enable exploration of a myriad of research questions involving virtual environments, telepresence, collaborative engagement, and remote interaction and create a strong foundation for extended collaborations. The project integrates qualitative and quantitative assessment of affect and motivation, with foundations of learning science, motion science, acoustics, modeling and simulation, robotics and fabrication to improve research effectiveness and scalability to address real world challenges.The work is accomplished by integrating 3-D printing to physically realize simulated forms, robots to allow virtual models to impact the physical world and interact with it, haptics to provide to human collaborators a sense of tactile feel of virtual objects, and physiological state monitors to try to get "inside" the human experience. This "experiential supercomputing" serves as a paradigm for human collaboration that translates to all disciplines spanning computer science, engineering, music, psychology, nursing, radiology, applied math, biology, and medicine. The effort transcends visualization to approach human collaboration in its totality and has the potential to transform our fundamental understanding of collaboration, learning, creativity, discovery, and innovation. The NYU Holodeck will be a well-integrated software/hardware instrument incorporating visual, audio, and physical components and novel technologies to enhance social interactions (human-human, human-agent, and human-robot). In its incorporation of rapid prototyping and fabrication tools, this unique instrument fosters creative capacity, and tight coupling of interactive visual, audio, and physical experience. Its research capabilities support comprehensive capture of behavioral, physiological, affective, and cognitive data, and visualization and analysis of the data in real time. Creating innovative environments that bridge simulation, cyber learning, scientific visualization, human-computer interaction, and applied physical science research; the effort enables new types of science where researchers from diverse disciplines can interact with theoretical models, real objects, robots, and agents, engendering insights not possible using 2D, 3D, or other currently available representations.