MRI: Acquisition of Equipment to Establish a Cognitive Sensorium and Visualization Facility at UC Merced

提案#：CNS07-23281PI(S)：Kallmann，Marcelo Matlock，Teenie；Newsam，ShawnInstitution：加州大学默塞德分校，CA 95343-5001标题：核磁共振/Acq.：加州大学默塞德分校的认知感官和可视化设施项目建议：该项目获取设备以建立认知感官和可视化设施，将实时眼球跟踪和运动捕捉设备与大型高分辨率显示器相结合。该基础设施旨在促进人类认知、感知和行动、图像处理、智能系统和人机交互方面的进步，使对视觉解析、分类、认知等新型计算模型的跨学科研究以及对运动规划和执行的研究成为可能。该项目旨在实现实现类人智能系统的新计算模型，支持在任务执行过程中理解人类视觉处理的研究。该仪器由三个模块组成：a.高分辨率沉浸式屏幕，其中可以模拟虚拟场景来感知人类行为；头戴式眼睛跟踪器系统，用于准确跟踪导航用户的视觉关注点，以及。一种全身无遮挡的惯性运动捕捉设备，用于捕捉用户在表演过程中的动作。理解类似人类的智能是开发无缝和完全集成的专注用户界面、情感协作工作以及未来所需的许多人机交互(HCI)应用程序的关键。该设备连接到一个专门用于运动控制和已在开发的类人虚拟代理的图形模拟的软件体系结构，支持跨学科研究活动，如：对图像中特征的视觉解析进行了分析。分析凝视和手势之间的相互作用，以描述特征和程序，以及。开发新的基于视觉的运动控制算法，用于在抓取任务时协调移动和伸展。布罗德影响：基础设施极大地受益于UC系统的最新园区。该机构为人数不足的人群提供服务，这些人群的学生通常是第一代大学生。该设施提供宝贵的编程和实验室技能，有助于在高科技工作和研究生院取得成功。它还改善了课程的教学和开发，并使许多应用领域的研究成为可能，包括培训、教学交付、人体工程学、娱乐、人机界面和教育。

Proposal #: CNS 07-23281PI(s): Kallmann, Marcelo Matlock, Teenie; Newsam, ShawnInstitution: University of California - Merced Merced, CA 95343-5001Title: MRI/Acq.: A Cognitive Sensorium and Visualization Facility at UC-MercedProject Proposed:This project, acquiring equipment to build a cognitive sensorium and visualization facility, integrates real-time eye tracking and motion capture devices with a large high-resolution display. Aiming to lead to advances in human cognition, perception and action, image processing, intelligent systems, and human-computer interaction, the infrastructure enables interdisciplinary research on novel computational models of visual parsing, categorization, cognition, and as well as research for motor planning and execution. Aiming to achieve novel computational models for implementing humanlike intelligent systems, the project supports research in understanding visual processing in humans during task execution. The instrumentation is composed of three modules: A. High-resolution immersive screen where virtual scenarios can be simulated for sensing human performances,. Head-mounted eye tracker system for accurately tracking the navigation of the user's visual attention point, and. Full-body occlusion-free inertial motion-capture equipment for capturing the motions of the user during performances.Understanding human-like intelligence is key for the development of seamless and fully integrated attentive user interfaces, affective collaborative work, and many human-computer interaction (HCI) applications needed in the future. Connected to a software architecture dedicated to the motion control and graphical simulation of human-like virtual agents already under development, the equipment supports interdisciplinary research activities such as:. Analyzing the visual parsing of features in images,. Analyzing the interactions between gaze and gestures for describing features and procedures, and. Developing new vision-based motor control algorithms for the coordination of locomotion and reaching during grasping tasks.Broader Impacts: The infrastructure greatly benefits the newest campus of the UC system. The institution services an underrepresented population where the students are usually first generation college students. The facility provides valuable programming and lab skills that contribute to success in high tech jobs and graduate schools. It also improves instruction and development of courses and enables research for many application domains, including training, delivery of instruction, ergonomics, entertainment, HCI, and education.