MRI: Development of Experiential Supercomputing: Developing a Transdisciplinary Research and Innovation Holodeck

这个项目开发了一种分布式仪器，将物理与虚拟无缝地结合在一起，旨在创建一台独特的体验式超级计算机，一个身临其境、协作的虚拟/物理研究环境，拥有无与伦比的智力和创意输出工具，一个科学上超过《星际迷航》科幻小说的全息甲板。这项工作应该推进人类互动的下一代体验以及虚拟和物理环境的深度融合，创造丰富的实施环境，以支持新范式的研究和发现。灵活、模块化、可重新配置的基础设施将连接整个大学、纽约大学全球网络大学(GNU)以及世界各地的外部研究人员、社区和行业合作伙伴的研究人员、研究和教育机构。该工具将允许探索涉及虚拟环境、网真、协作参与和远程交互的大量研究问题，并为扩展协作奠定坚实的基础。该项目集成了对情感和动机的定性和定量评估，以及学习科学、运动学、声学、建模和仿真、机器人和制造的基础，以提高研究的有效性和可扩展性，以应对现实世界的挑战。工作通过集成3-D打印来物理实现模拟形式，机器人来允许虚拟模型影响物理世界并与之互动，触觉来为人类合作者提供虚拟物体的触觉感觉，以及生理状态监测器来尝试进入人类体验来完成。这种“体验式超级计算”是人类协作的典范，涵盖了计算机科学、工程学、音乐、心理学、护理学、放射学、应用数学、生物学和医学等所有学科。这一努力超越了可视化，接近人类协作的整体，并有可能改变我们对协作、学习、创造力、发现和创新的基本理解。纽约大学全息仪将是一个完美集成的软件/硬件仪器，融合了视觉、音频和物理组件以及增强社会互动(人与人、人-代理人和人-机器人)的新技术。通过结合快速原型制作和制造工具，这一独特的仪器培养了创新能力，并将交互式视觉、音频和物理体验紧密结合在一起。它的研究能力支持全面捕获行为、生理、情感和认知数据，并实时可视化和分析数据。创建连接模拟、网络学习、科学可视化、人机交互和应用物理科学研究的创新环境；这一努力使来自不同学科的研究人员可以与理论模型、真实对象、机器人和代理进行交互，从而产生使用2D、3D或其他当前可用的表示法无法获得的见解。

This project, developing a distributed instrument to physically integrate seamlessly the physical with the virtual, aims to create a unique experiential supercomputer, an immersive, collaborative, virtual/physical research environment with unparalleled tools for intellectual and creative output, a Holodeck that scientifically exceeds Star Trek science fiction. The work should advance the next-generation experiences in human interaction and deep integration of virtual and physical settings, creating rich actualizing environments to support research and discovery of new paradigms. The flexible, modular, reconfigurable infrastructure will connect researchers, research, and educational facilities across the university, the NYU Global Network University (GNU), and external researchers, communities, and industry partners worldwide. The instrument will enable exploration of a myriad of research questions involving virtual environments, telepresence, collaborative engagement, and remote interaction and create a strong foundation for extended collaborations. The project integrates qualitative and quantitative assessment of affect and motivation, with foundations of learning science, motion science, acoustics, modeling and simulation, robotics and fabrication to improve research effectiveness and scalability to address real world challenges.The work is accomplished by integrating 3-D printing to physically realize simulated forms, robots to allow virtual models to impact the physical world and interact with it, haptics to provide to human collaborators a sense of tactile feel of virtual objects, and physiological state monitors to try to get "inside" the human experience. This "experiential supercomputing" serves as a paradigm for human collaboration that translates to all disciplines spanning computer science, engineering, music, psychology, nursing, radiology, applied math, biology, and medicine. The effort transcends visualization to approach human collaboration in its totality and has the potential to transform our fundamental understanding of collaboration, learning, creativity, discovery, and innovation. The NYU Holodeck will be a well-integrated software/hardware instrument incorporating visual, audio, and physical components and novel technologies to enhance social interactions (human-human, human-agent, and human-robot). In its incorporation of rapid prototyping and fabrication tools, this unique instrument fosters creative capacity, and tight coupling of interactive visual, audio, and physical experience. Its research capabilities support comprehensive capture of behavioral, physiological, affective, and cognitive data, and visualization and analysis of the data in real time. Creating innovative environments that bridge simulation, cyber learning, scientific visualization, human-computer interaction, and applied physical science research; the effort enables new types of science where researchers from diverse disciplines can interact with theoretical models, real objects, robots, and agents, engendering insights not possible using 2D, 3D, or other currently available representations.