Measuring and Modeling Visual Attention in Online Multimedia Instruction

在线多媒体教学有望增长。然而，考虑到学生的注意力往往会走神，特别是在网络教学中，研究人员和教育工作者必须了解如何帮助学生专注于重要的信息，而忽略不重要的信息。此项目解决两个基本问题：在线科学、技术、工程和数学(STEM)讲师或教育材料开发人员如何知道学习者何时有效地关注学习材料？他们如何利用这些信息来改进STEM在线学习材料的设计？在一学期的大学物理入门课程中，将收集数百名学生使用多个在线模块时的注意力和学习结果。这些数据将被用来预测学生的注意力以及它与他们的学习结果之间的关系。这些信息将被用来帮助改进在线多媒体教学。这个项目解决了已知的注意力对学习的影响与试图以严格、可靠和有效可测量的方式将这些理论结构转化为教学实践之间的差距。这项研究首次将认知科学中注意力研究的理论和方法与大学网络课程为期一学期的教育实践联系起来。它指出了在理解学生时时刻刻的注意状态和他们长期STEM学习之间的联系方面取得快速、生态有效进展的方法。这些进展可能有助于推动围绕改善STEM学习的政策和实践。在第一阶段(基础研究)，首席调查人员(PI)建议对在线教学中的注意力和学习进行纵向、自然主义的研究。PI将研究数百名学生对在线学习材料的关注程度，以及他们在为期一学期的大型大学物理入门课程中的学习情况。在第二阶段(应用研究)，督导主任会利用上述资料，在学生注意力疏忽的关键时刻提醒学生，或提示他们注意相关资料，从而找出学生注意力状态改变的一般目标。对于教师和教学设计师来说，该项目将提供有意义的、高影响的数据，了解学生随着时间的推移而变化的注意力状态，并将准确地指出注意力不足的地方。这项拟议的研究将开发一个注意力工具包，它采取双管齐下的方法来利用学生的注意力状态，并改善他们的教育结果。第一个方面(“需求方”)通过测量学习者的注意力水平并提醒/提示他们的注意力来解决学习者的问题。第二个方面(“供应方”)面向讲师或在线材料开发人员。为了提高其研究的更广泛影响，私人投资促进机构将寻找不同的参与者，并采取一切必要措施，以提高公平性和减少偏见。此外，由于所提出的方法可能可以在许多教育领域推广，注意工具包可以在教育学科中广泛使用。除了出版物和演示文稿，注意工具包还将提供给教职员工。PIS还将为教授多媒体在线课程的教师提供如何使用注意工具包的研讨会。该项目由EHR核心研究(ECR)计划资助，该计划支持推进STEM学习和学习环境的基础研究、扩大对STEM的参与以及STEM劳动力发展的工作。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Online multimedia instruction is expected to grow. Yet, given the tendency for students’ minds to wander and to be distracted especially during online instruction, it is important for researchers and educators to understand how to help students to stay focused on the important information while ignoring the unimportant information. This project addresses two fundamental issues: How does the online Science, Technology, Engineering, and Mathematics (STEM) instructor or educational materials developer know when learners are effectively paying attention to the learning material? How can they use this information to improve the design of their online learning materials in STEM? Attention and learning outcomes will be collected for several hundred students as they use multiple online modules, over a semester-long of a university introductory physics course. These data will be used to predict students’ attention and how it relates to their learning outcomes. This information will then be used to help improve online multimedia instruction.This project addresses a gap between the known effects of attention on learning and attempts to translate those theoretical constructs into pedagogical practice in rigorously, reliably, and validly measurable ways. This study is the first to bridge the theory and methods of studying attention in cognitive science with educational practice during a semester-long university online course. It points the way to making rapid, ecologically valid progress in understanding the connections between students' moment-to-moment attentional states and their long-term STEM learning. Such progress could be useful in advancing policy and practice surrounding improving STEM learning. In Phase 1(Basic Research), the Principal Investigators (PIs) propose a longitudinal, naturalistic study of attention and learning from online instruction. The PIs will study several hundred students' attention to online learning materials, and their learning, over a semester-long of a large university introductory physics course. In Phase 2 (Applied Research), using the above information, the PIs will identify generalizable targets of change in students' attentional states by alerting students at critical moments of attentional lapses, or cueing their attention to relevant information. For instructors and instructional designers, the project will provide meaningful, high impact data on students' varying attentional states over time, and will pinpoint attentional deficiencies. The proposed research will develop an Attentional Toolkit that takes a two-pronged approach to leveraging students' attentional states and improving their educational outcomes. The first prong ("demand side") addresses the learner by measuring their level of attentiveness and alerting/cueing their attention. The second prong ("supply side") addresses the instructor or online materials developer. To improve the broader impact of their research, the PIs will seek out a diverse pool of participants and take all measures necessary to improve fairness and reduce bias. Further, because the proposed methods are likely generalizable across numerous educational domains, the Attentional Toolkit could be broadly used across educational disciplines. In addition to publications and presentations, the Attentional Toolkit will be made available to faculty. The PIs will also provide workshops to faculty who are teaching multimedia online courses on how to use the Attentional Toolkit. This project is funded by the EHR Core Research (ECR) program, which supports work that advances fundamental research on STEM learning and learning environments, broadening participation in STEM, and STEM workforce development.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.