DIP: Collaborative Research: Interactive Science Through Technology Enhanced Play (iSTEP)

DIP：协作研究：通过技术增强游戏进行互动科学 (iSTEP)

• 批准号: 1628918
• 负责人: Joshua Danish
• 金额: $ 34.81万
• 依托单位: Indiana University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-09-01 至 2021-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1628918&HistoricalAwards=false
• 关键词: DIP; Collaborative; Research; Interactive; Science

The iSTEP project addresses a basic research question by exploring the role of the body and physical activity in learning through the design of a new genre of developmentally appropriate learning technologies for young children. There is increasing recognition that the body plays a role in cognition: human beings, especially young children, understand complex concepts in part by relating them to how we move our own bodies. In extending these ideas, the iSTEP project also aims to develop teaching techniques and technological tools that can be used in real classrooms in the near future. Instead of supporting the learning of individual students as many current technological advances attempt to do, the iSTEP project creates opportunities for entire classrooms of students to engage together to model scientific phenomena using their bodies. For instance, a classroom of students can use their own bodies to model how a state of matter such as liquid is made up of many moving particles and technologically enhance this activity to improve learning. The iSTEP project builds upon the already successful STEP mixed reality platform (IIS-1323767) by adding new forms of interaction - the use of gestures and physical props to control the STEP computer simulation. Adding these new forms of interaction allows us to examine their role in supporting learning.The existing open source STEP platform uses commercially available vision-based sensors to track the motion of up to 12 children in an 8m x 8m space. The children simply walk into the space, are assigned an avatar (i.e., they become a water particle), and that avatar follows them as they move around the room. The children's avatars are then immersed in a virtual simulation that is programed to mimic the scientific concept they are learning. In this case, the state of matter of water (e.g., solid, liquid, or gas) is determined by how fast the children move and the relative distance between them. This allows the students to discover the laws that govern state changes through their collaborative activity. Students can also use the PLAE interface (IIS-1522945) to annotate the simulation and create representations of their peers' activity, helping them all to reflect on the underlying principles inherent in the system. In iSTEP, students will now also be able to control the simulation by gesturing, posing with their whole body, and by manipulating physical objects in addition to the previous model of interacting with their entire body. In addition, by using smart watches, the project will explore alternative forms of feedback to the students as they can feel vibrations, hear sounds, and even see simple images that are targeted to help them explore the simulation. In the first round of experiments this project will contrast the gesture (and pose) interface with a new interface that uses physical props to see how each contributes to student learning. In the final year, these will be integrated to develop deeper insights into how they can best be used to support the design of learning environments that build on mixed reality systems.

ISTEP项目通过设计新的适合幼儿的发展适合发展的学习技术的新类型来探索身体和体育活动在学习中的作用来解决一个基础研究问题。人们越来越认识到身体在认知中发挥作用：人类，尤其是幼儿，部分理解复杂的概念，部分原因是将它们与我们如何移动自己的身体联系起来。在扩展这些想法时，ISTEP项目还旨在开发在不久的将来可以在真实教室中使用的教学技术和技术工具。 ISTEP项目并没有像许多当前的技术进步那样支持各个学生的学习，而是为学生的整个课堂提供了机会，可以使用自己的身体建模科学现象。 例如，一个学生可以使用自己的身体来模拟诸如液体之类的物质状态如何由许多移动的粒子组成，并且在技术上可以增强这项活动以改善学习。 ISTEP项目通过添加新形式的互动形式建立在已经成功的步骤混合现实平台（IIS -1323767）上 - 使用手势和物理道具来控制步骤计算机模拟。添加这些新形式的互动形式使我们能够检查它们在支持学习中的作用。现有的开源步骤平台使用市售基于视觉的传感器来跟踪8m x 8m空间中多达12个孩子的运动。孩子们只是走进空间，被分配为一个化身（即，他们成为水颗粒），当他们在房间里移动时，阿凡达（Avatar）跟随他们。然后，将儿童的化身沉浸在一个虚拟模拟中，该虚拟模拟被编程以模仿他们正在学习的科学概念。在这种情况下，水（例如，固体，液体或气体）的状态取决于孩子的移动速度和相对距离。这使学生能够通过其协作活动发现规范国家的法律变化。学生还可以使用PLAE界面（IIS-1522945）来注释模拟并创建同龄人活动的表示形式，从而帮助他们反思系统固有的基本原则。 在ISTEP中，学生现在还将能够通过手势，摆姿势整个身体以及操纵物理物体来控制模拟，除了先前与整个身体互动的模型外。此外，通过使用智能手表，该项目将探索对学生的替代形式的反馈形式，因为他们可以感受到振动，听到声音，甚至看到针对性的简单图像，这些图像旨在帮助他们探索模拟。在第一轮实验中，该项目将将手势（和姿势）接口与使用物理道具来查看每个界面如何贡献学生学习的新接口对比。在最后一年，这些将被整合在一起，以开发更深入的见解，以了解如何最好地用于支持基于混合现实系统的学习环境的设计。