Smart Science Exhibits: Enhancing STEM Learning through Sustained Use of Mixed-Reality in Multiple Informal Learning Spaces

智能科学展品：通过在多个非正式学习空间中持续使用混合现实来增强 STEM 学习

• 批准号: 2005966
• 负责人: Nesra Yannier
• 金额: $ 235.62万
• 依托单位: Carnegie-Mellon University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-09-01 至 2024-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2005966&HistoricalAwards=false
• 关键词: Smart; Science; Exhibits; Enhancing; STEM

Museums and similar informal learning settings offer opportunities for children and families to learn together in an engaging way. Current exhibits rely mainly on parents, teachers, signage, and staff in science museums to provide support and guidance. Since it is not always feasible to have knowledgeable staff on hand and not all parents have the same knowledge and background, children receive varied support and people often miss the point of the learning experience or activity. This project will develop and research a new genre of Smart Science Exhibits that use artificial intelligence (AI) in an adaptive system to support children in learning science by doing science. The aim of the project is to incorporate AI adaptivity and personalization to maximize inquiry-based STEM learning and engagement in informal learning settings. This research builds on the project team’s first Smart Science Exhibit (EarthShake), which uses AI vision to give interactive feedback to visitors based on their actions and guides them through scientific inquiry. In the project’s preliminary work, the first smart exhibit demonstrated higher engagement and more learning gains than resulted from a traditional museum exhibit addressing the same scientific content. Smart exhibits can extend and enhance the limited support that staff and parents can provide. This project will develop and investigate adaptive approaches to mixing exploration and AI guidance, which will personalize feedback during constructive exploration. The project will build on learning science techniques and technology, proven in intelligent tutoring systems in formal settings, and apply this to different informal learning contexts. The goal is to provide just-in-time learning support, which will extend the time visitors spend with exhibits, thereby deepening inquiry-based science learning. The project is partnering with science museums and afterschool programs, which will enable thousands of children and families from a wide variety of backgrounds to use the project’s smart exhibits each year. Smart Science Exhibits is funded by the Advancing Informal STEM Learning (AISL) program which supports innovative research, approaches, and resources as part of its overall strategy to enhance learning in informal environments. Many informal learning settings are considering mixed-reality (MR) technologies to increase engagement and understanding of science. Using Smart Science Exhibits, the project will investigate how design choices in mixed-reality systems impact users’ engagement and learning of STEM concepts. (Mixed reality is the blending of the physical world and the digital world, enabling interaction between human and artificial intelligence.) Project research will extend current research, which is largely descriptive, by investigating empirical results on learner outcomes. Key research questions are: What types of adaptivity and personalization can improve Smart Science Exhibits and MR systems generally? What balance of exploration and AI guidance is best to maximize enjoyment, engagement and learning? Do findings about the effective features of Smart Science Exhibits generalize to different content areas and informal learning settings? The project will employ user-centered design research, formative evaluation, and controlled experimentation to discover how mixed-reality systems should be designed to best meet visitor and staff needs in informal learning settings including multiple museums and afterschool providers. Data on learner behaviors in mixed-reality experiences in a variety of informal settings will inform the design of Smart Science Exhibits. The project will investigate whether adaptive approaches generalize across content and context to achieve better STEM learning, engagement, collaboration, and productive dialogue. The project will incorporate the team’s prior technical research, which developed both vision techniques to track children’s physical interactions and interactive pedagogical techniques to provide scaffolds for and reactive feedback on children’s inquiry and construction behaviors. New technical research will develop AI techniques for adaptive task selection and personalized feedback that draws on a visitor’s history of interaction. Project research and design resources will be widely shared with the science museum educators and designers through presentations at annual conferences and with researchers, developers and others through peer-reviewed journal publications and professional publications.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

博物馆和类似的非正式学习场所为儿童和家庭提供了以参与的方式共同学习的机会。目前的展品主要依靠家长、老师、标牌和科学馆工作人员提供支持和指导。由于并不总是能够拥有知识渊博的工作人员，而且并非所有父母都有相同的知识和背景，儿童得到各种各样的支持，人们往往错过了学习经验或活动的重点。该项目将开发和研究一种新类型的智能科学展览，在自适应系统中使用人工智能（AI），以支持儿童通过做科学来学习科学。该项目的目的是将人工智能的适应性和个性化，以最大限度地提高基于探究的STEM学习和非正式学习环境中的参与度。这项研究建立在项目团队的第一个智能科学展览（EarthShake）的基础上，该展览使用人工智能视觉根据游客的行动向他们提供互动反馈，并指导他们进行科学探究。在项目的前期工作中，第一个智能展览展示了比传统博物馆展览更高的参与度和更多的学习收益，这些展览涉及相同的科学内容。智能展品可以扩展和加强工作人员和家长可以提供的有限支持。该项目将开发和研究混合探索和人工智能指导的自适应方法，这将在建设性探索期间个性化反馈。该项目将建立在学习科学技术和技术的基础上，在正式环境中的智能辅导系统中得到证明，并将其应用于不同的非正式学习环境。其目标是提供及时的学习支持，这将延长参观者在展品上花费的时间，从而加深基于探究的科学学习。该项目正在与科学博物馆和课外项目合作，这将使数千名来自各种背景的儿童和家庭每年都能使用该项目的智能展览。智能科学展览由推进非正式STEM学习（AISL）计划资助，该计划支持创新研究，方法和资源，作为其整体战略的一部分，以加强非正式环境中的学习。许多非正式的学习环境正在考虑混合现实（MR）技术，以增加参与和对科学的理解。该项目将利用Smart Science Exhibits研究混合现实系统中的设计选择如何影响用户对STEM概念的参与和学习。 （混合现实是物理世界和数字世界的融合，使人类和人工智能之间能够进行交互。项目研究将扩大目前的研究，这主要是描述性的，通过调查学习者的成果的实证结果。关键的研究问题是：什么类型的适应性和个性化可以改善智能科学展品和MR系统一般？探索和人工智能指导的平衡是最好的，以最大限度地享受，参与和学习？智能科学展品的有效功能的研究结果推广到不同的内容领域和非正式的学习环境？该项目将采用以用户为中心的设计研究，形成性评估和受控实验，以发现如何设计混合现实系统，以最好地满足非正式学习环境中的游客和工作人员的需求，包括多个博物馆和课后提供者。在各种非正式环境中的混合现实体验中，学习者行为的数据将为智能科学展览的设计提供信息。该项目将调查自适应方法是否适用于内容和背景，以实现更好的STEM学习，参与，协作和富有成效的对话。该项目将纳入该团队之前的技术研究，该研究开发了跟踪儿童身体互动的视觉技术和互动教学技术，为儿童的探究和建造行为提供支架和反应性反馈。新的技术研究将开发用于自适应任务选择和个性化反馈的人工智能技术，这些技术将利用访问者的互动历史。 项目研究和设计资源将通过在年度会议上的演讲与科学博物馆的教育工作者和设计师广泛分享，并通过同行评审的期刊出版物和专业出版物与研究人员、开发人员和其他人广泛分享。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Intelligent science exhibits: Transforming hands-on exhibits into mixed-reality learning experiences

智能科学展览：将动手展览转变为混合现实学习体验

• DOI: 10.1080/10508406.2022.2032071
• 发表时间: 2022
• 期刊: Journal of the Learning Sciences
• 影响因子: 3.8
• 作者: Yannier, Nesra;Crowley, Kevin;Do, Youngwook;Hudson, Scott E.;Koedinger, Kenneth R.
• 通讯作者: Koedinger, Kenneth R.