Mobile Infospaces: Mapping Information to Neuropsychological Patterns of Human-Spatial Cognition to Support Wearable, Augmented-Reality Interface Design

该项目将开发一个系统的过程，将增强现实信息组织映射到人类大脑的巨大空间认知能力。人类思维和利用大脑资源的基础是空间认知：心理意象操作、数学推理、时间的空间心理模型、语言组织的某些方面和记忆组织的矩阵。AR界面设计的神经心理学人为因素路线可能为系统的理论、研究和移动AR界面设计指南提供坚实的基础。为了实现这一目标，研究将：(1)将人类空间认知的神经学和行为学研究扩展到系统地映射AR系统中以自我为中心（即以身体为中心）的空间感知和物体操纵；(2)为METLAB的ImageTclAR工具包添加新功能，以支持该项目和空间AR界面设计；(3)使用基于视觉跟踪和ShapeTape传感器的新型混合跟踪技术，开发具有身体和环境稳定组件的多用户移动AR原型。它还将系统地进行人机交互实验，以评估和确认新的移动信息空间接口技术对以下方面的影响：信息对象搜索和感知、工具和数据对象语义、对象操作的便利性和程序性能、数据工具和对象的位置和属性的记忆、组导航、态势感知和环境的认知地图。最后，该项目将组织和系统化的发现和界面设计经验，纳入移动信息空间AR设计指南。为AR系统设计开发的新模型和方法将在两个主要方面影响移动AR研究和开发。在研究方面，它将为增强现实设计提供经验验证的理论基础，使用信息显示中空间认知的神经心理学和行为有效的人为因素模型。在界面设计方面，它将提供信息显示指南和ImageTclAR界面开发工具，可以为移动、增强现实和沉浸式虚拟现实用户建立优化工具放置、菜单和数据组织以及程序聚类的参数。

This project will develop a systematic process of mapping Augmented Reality information organization to the human brain's prodigious capacity for spatial cognition. Fundamental to human thinking and utilizing much of the brain's resources is spatial cognition: a matrix for mental imagery manipulation, mathematical reasoning, spatial mental models of time, certain aspects of language organization, and memory organization. A neuropsychological human factors route to AR interface design may produce a solid basis for systematic theory, research, and guidelines for the design of mobile, AR interfaces. To accomplish this the research will: (1) extend neurological and behavioral research on human spatial cognition to systematically map egocentric (i.e., body centered) spatial perception and object manipulation in AR systems; (2) add new capabilities to the METLAB's ImageTclAR toolkit in support of this project and spatial AR interface design, and (3) develop multi-user mobile AR prototypes with both body and environmentally stabilized components using new hybrid tracking techniques based on visual tracking and ShapeTape sensors. It will also systematically conduct Human Computer Interaction experiments to evaluate and confirm the effect of new Mobile Infospaces interface techniques on: information object search and perception, tool and data object semantics, ease of object manipulation and procedural performance, memory for the location and properties of data tools and objects, group navigation, situational awareness, and cognitive maps of the environment. Finally, the project will organize and systematize findings and interface design experience into Mobile Infospaces AR Design Guidelines.The new models and methods developed for AR system design will impact mobile AR research and development in two main ways. For research, it will provide a empirically validated theoretical foundation for augmented reality design using a neuropsychological and behaviorally valid human factors model of spatial cognition in information displays. For interface design, it will provide information display guidelines and ImageTclAR interface development tools that can establish parameters for optimizing the placement of tools, organization of menus and data, and clustering of procedures for mobile, augmented-reality and immersive virtual reality users.