Designing Mixed Reality Experiences to Support Participatory Complex Systems Learning

这个项目探索了一种新的技术辅助方法，使学习者参与复杂的系统内容。该项目将利用虚拟现实（VR）头戴式耳机上的直通增强现实（AR）技术，创建一个混合现实（MR）沉浸式参与式模拟，供课堂使用。这种参与式模拟将是一个共享的“系统的系统”，其中每个学生小组都与一个子系统协作工作，每个子系统都与其他子系统相互连接，这样一个子系统中的更改可以影响其他子系统的行为，或者影响整个系统。这种表示系统的方式非常适合于说明现实世界系统的复杂性，如流域和渔业，并通过承担土木工程师和渔业经理等人的角色来吸引学习者解决现实世界的问题。MR系统将在教室空间顶部覆盖一个模拟环境，并进一步允许学习者访问专门的信息显示，以支持他们基于角色的系统参与。该研究将使用：(1)混合技术（交互分析、定性编码和小案例研究）来理解学生的学习过程，以及它们如何与学习体验的设计元素相交；(2)评估学生参与和沉浸体验的调查；(3)通过前后访谈、测试和态度调查来衡量学生复杂系统推理和对STEM态度的变化；(4)对从学生和教师那里收集的观察笔记和反馈数据进行编码的扎根理论方法，以确定在沉浸式磁共振参与式模拟中需要哪种类型的社会、技术和教学支持来吸引学习者参与复杂系统推理。该项目的贡献在于它能够阐明一种使学习者参与复杂系统的新方法的价值，并且在技术进步方面，它将为开发一个平台做出贡献，该平台允许教室的学习者同时参与共享的空间混合现实模拟。研究结果将促进对将混合现实融入课堂环境的理解。开发的平台、两个参与式模拟、支持材料和设计Wiki将公开提供给其他人使用，或复制或构建类似的模拟体验。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

This project explores a new technologically assisted method of engaging learners with complex systems content. The project will make use of passthrough Augmented Reality (AR) on Virtual Reality (VR) headsets to create a Mixed Reality (MR) immersive participatory simulation for classroom use. This participatory simulation will be a shared “system of systems,” wherein small groups of students each work collaboratively with a subsystem, each of which is interconnected with other subsystems, such that changes in one subsystem can impact the behavior of other subsystems, or impact the system as a whole. This way of representing systems is well-suited to illustrate the complexity of real-world systems like watersheds and fisheries, and engaging learners with real-world problem solving by undertaking the roles of people like civil engineers and fishery managers. The MR system will overlay a simulated setting on top of the classroom space, and further allow learners to access specialized informational displays that support their role-based engagement with the system.The research will use: (1) a mix of techniques (interaction analysis, qualitative coding, and small case studies) to understand the learning processes undertaken by the students and how they intersect with designed elements of the learning experience; (2) surveys to gauge students’ engagement with and immersion in the experience; (3) pre-post interviews, tests, and attitude surveys to measure changes in students’ complex systems reasoning and attitudes towards STEM; and (4) a grounded theory approach to coding a mix of observational notes and feedback data gathered from students and teachers to identify what types of social, technological, and pedagogical supports are needed to engage learners in complex systems reasoning within an immersive MR participatory simulation. The contribution of the project lies in its ability to shed light on the value of a novel method of engaging learners with complex systems, and on the technological strides it will make contributions towards developing a platform that allows a classroom of learners to be simultaneously engaged in a shared, spatially- mixed reality simulation. The results will advance understanding of integrating mixed reality into classroom settings. The developed platform, two participatory simulations, support materials, and a design Wiki will be made publicly available for others to use, or to replicate or construct similar simulation experiences.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.