Intelligent Science Exhibits: Transforming Hands-on Exhibits into Mixed-Reality Learning Experiences

该项目将开发和研究一种新的系统，将物理世界和虚拟世界的优势联系起来，以合作的方式改善幼儿基于探究的科学学习和参与。该项目将使用为适应性辅导系统开发的创新技术和成功技术，并将这一核心研究带入以前从未应用过的非正式学习环境中，目标是在这些环境中增加参与、学习和基于深入探究的理解。博物馆和类似的非正式学习场所为儿童和家庭提供了以一种引人入胜的方式一起学习的机会。然而，如果没有人、标志或技术提供学习支持，人们往往会错过博物馆学习活动的要点。该项目将开发一种新的“智能”互动科学展品，它将成熟的智能教学系统方法与基于相机的视觉传感相结合，为实际操作的博物馆展品增加一个新的层次。当博物馆参观者在真实世界中试验物理对象时，这一智能层为他们提供个性化的交互反馈。该项目由卡内基梅隆大学人机交互研究所领导，与匹兹堡大学学习研究和发展中心、匹兹堡儿童博物馆和卡内基科学中心合作开展。该项目得到了推进非正式STEM学习(AISL)计划的支持，该计划为各种环境下使用的研究和创新资源提供资金，作为其加强非正式环境中学习的总体战略的一部分。该项目将研究在正规学校学习中有效的学习原则和适应性计算机技术是否以及如何在非正式博物馆体验中通过动手活动来提高儿童和家长的学习和参与能力。该系统将使用智能摄像头传感，跟踪并注意儿童在物理和虚拟空间中的互动，并通过吸引人的角色的帮助提供自适应的个性化反馈。它引导孩子和父母进行富有成效的对话，帮助形成更好的亲子互动。为了研究这一点，该项目将进一步开发创新的混合现实系统和智能适应系统，根据游客的行为向他们提供个性化反馈，引导他们像科学家一样了解周围的世界。该项目将收集非正式环境中混合现实体验中学习者行为的数据，以告知如何更好地设计智能科学展品，并得出支持关键结果的模式，包括学习、参与、协作和富有成效的对话。该项目还将研究这些设计模式在不同科学内容领域的应用。

The project will develop and research a new system that bridges the advantages of physical and virtual worlds to improve young children's inquiry-based science learning and engagement in a collaborative way. The project will use innovative technology and successful techniques developed for adaptive tutoring systems and bring this core research into informal learning settings where they haven't been applied before, with the goal of increasing engagement, learning and deep inquiry-based understanding in these environments. Museums and similar informal learning settings offer opportunities for children and families to learn together in an engaging way. However, without learning supports provided by people, signage, or technology, people often miss the point of the learning activity in museums. The project will develop a new genre of "intelligent" interactive science exhibits that combine proven intelligent tutoring system approaches with camera-based vision sensing to add a new layer to hands-on museum exhibits. This intelligent layer provides personalized interactive feedback to museum visitors while they experiment with physical objects in the real world. The project is a collaborative effort led by the Human Computer Interaction Institute at Carnegie Mellon University in partnership with the University of Pittsburgh Learning Research and Development Center, Children's Museum of Pittsburgh, and Carnegie Science Center. It is supported by the Advancing Informal STEM Learning (AISL) program funds research and innovative resources for use in a variety of settings, as a part of its overall strategy to enhance learning in informal environments.The project will research whether and how learning principles and adaptive, computer-based technologies that are effective in formal school learning be made effective in an informal museum experience with hands-on activities to enhance the learning and engagement of children and parents. The system will use intelligent camera sensing that tracks and notices children's interaction in physical and virtual spaces and provides adaptive personalized feedback via the help of an engaging character. It guides the children as well as the parents to engage in productive dialogue, helping shape a better parent-child interaction. To investigate this, the project will further develop an innovative mixed-reality system and smart adaptive system that gives personalized feedback to visitors based on their actions, guiding them to understand the world around them like a scientist. The project will gather data on learner behaviors in mixed-reality experiences in informal settings to inform how to better design intelligent science exhibits and derive patterns to support key outcomes, including learning, engagement, collaboration, and productive dialogue. The project will also research the application of these design patterns across different science content areas.