MRI: Acquisition of CAVE for Experiments in the Creation of Collaborative Learning Environments

本项目旨在通过有形界面协作学习环境（Tangible Interfaces Collaborative learning environments，简称tile）项目，为孩子们创造能够完全沉浸在学习材料中并参与其中的学习环境，以获得高端的可视化和动作捕捉。该项目以学习环境的发展为中心；在用户界面中处理多感官线索的技术，以及在智能代理的学习和适应中使用视觉技术。在研究人机交互和学习界面的同时，提出了基于cave的沉浸式环境的获取以及将与之集成的动作捕捉系统。探索虚拟现实，全运动跟踪和传感器输入设备等技术，工作涉及手势跟踪和识别/解释，确定如何将手势与对象操作联系起来。研究方向：协作学习环境的有形界面、交互范式、学习环境的追踪与表征、数据源间冲突的纠纠与解决、多参数界面与复杂的多媒体控制情境、日益增多的多参数实时多媒体控制情境、多参数实时多媒体控制情境的用户反馈策略、紧张与学习多参数实时多媒体控制智能主体的学习与适应人工智能主体的学习与适应人类主体的学习与适应作为编程隐喻的学习与适应几个子项目将先前的工作扩展到三维洞穴环境，需要在系统的复杂性上有一个显著的飞跃，包括计算机视觉、图形和系统；还有相当多的训练。在后一个项目中，运动跟踪系统监控机器人和CAVE，并向机器人提供反馈。在人机界面（HCI）领域，将开发用于跟踪和表示学习环境中正在发生的事情的策略，包括用于纠正和解决不同来源（如多对相机和传感器）之间冲突的算法。各种范例的实验决定了学生如何最好地与对象和信息互动。将探索以自然、富有表现力的方式与空间和数据交互的方式，影响多个参数。在人工智能领域，重点将是确定用户理解或意图。对自适应代理的调查将继续进行，使系统能够填补缺失的数据并随着时间的推移而学习。所有的课程都聚焦于HCI如何增强协作教育环境。更广泛的影响：支持少数族裔机构的研究，这项工作涉及本科生和研究生，包括那些来自代表性不足群体的学生。使更广泛的受众了解科学，在教育方面显示出更广泛影响的巨大潜力。此外，扩展到K-12已经在进行中。

This project, creating learning environments where children can be fully immersed in and engaged with their learning materials, aims at acquiring high-end visualization and motion capture in the form of the Tangible Interfaces Collaborative Learning Environments (TICLE) project. The project centers around the development of learning environments; techniques for handling multi-sensory cues in user interfaces, and the use of visual technology in learning and adaptation in intelligent agents. While studying interfaces amenable for human computer interaction and learning, proposed is the acquisition of a CAVE-based immersive environment as well as a motion capture system that will be integrated with it. Exploring techniques such as virtual reality, full motion tracking, and sensor input devices, the work involves working on gesture tracking and recognition/ interpretation, determining how to relate gestures to manipulation of objects. The proposal addresses the following research directions:Tangible Interfaces for Collaborative Learning EnvironmentsInteraction ParadigmsTracking and Representing the Learning EnvironmentRectifying and Resolving Conflicts among Data SourcesMulti-Parametric Interfaces and Complex Multi-Media Control SituationsIncreasingly Multi-Parametric Real-Time Multi-Media Control SituationsUser Feedback Strategies for Multi-Parametric Real-Time Multi-Media Control SituationsTraining and Learning Multi-Parametric Real-Time Multi-Media ControlLearning and Adaptation in Intelligent AgentsLearning and Adaptation by Artificial Intelligent AgentsLearning and Adapting Human AgentsLearning and Adapting as a Programming MetaphorSeveral subprojects extend previous work into a 3D cave environment, requiring a significant jump in complexity of the system including computer vision, graphics, and systems; as well as quite a bit of training. For the latter project, a motion tracking system monitors the robots and the CAVE to give feedback to the robots. In the area of human computer interfaces (HCI), strategies will be developed for tracking and representing what is going on in the learning environment, including algorithms for rectifying and resolving conflicts among disparate sources (such as multiple pairs of cameras and sensors). Experimentation with various paradigms determines how students may best interact with the objects and information. Ways of interacting with the space and the data in natural, expressive ways, affecting multiple parameters will be explored. In the area of artificial intelligence, the focus will be in determining what the users understand or intend. The investigation of adaptive agents will continue, allowing the system to fill in missing data and learn over time. All tracks focus on how the HCI can enhance collaborative educational environments. Broader Impact: Supporting research at a minority institution, the work involves undergraduate and graduate students, including those from underrepresented groups. Exposing a wider audience into science, the work on TICLE exhibits high potential for broader impact in education. Moreover, outreach to K-12 is already under way.