Visualizing learner engagement, performance, and trajectories to evaluate and optimize online course design
Visualizing learner engagement, performance, and trajectories to evaluate and optimize online course design
复制标题
DOI：
10.1371/journal.pone.0215964
复制
发表时间：
2019-05-06
期刊：
影响因子：
3.7
通讯作者：
Borner, Katy
中科院分区：
文献类型：
--
作者：
Ginda, Michael;Richey, Michael C.;Borner, Katy
学习分析和可视化使其能够检查和交流在线课程中学员的参与度、表现和轨迹，以评估和优化学员的课程设计。这对于需要以最有效的方式获取新知识的员工的劳动力培训尤为重要。本文介绍了一套旨在捕获学习者参与度、绩效和课程轨迹的关键动态方面的度量和可视化。这些指标用于通过课程内容、活动和评估以及与课程内容、活动和评估的交互来识别典型行为和学习路径。该方法通过3000多万个独立的记录事件进行了示范和经验验证，这些事件记录了1,608名波音工程师在2016年秋季开设的MITxPro课程--“复杂系统的体系结构”--的活动。可视化结果显示了课程结构以及学习者与课程材料、活动和评估的交互模式。树形可视化用于表示课程的层次结构和内容模块的显式顺序。学习者轨迹网络通过课程模块表示单个学习者的路径和交互，揭示了学习者的参与度、内容获取策略和绩效的模式。研究结果为教师和课程设计者评估课程材料和干预策略的使用和有效性提供了依据。
Learning analytics and visualizations make it possible to examine and communicate learners' engagement, performance, and trajectories in online courses to evaluate and optimize course design for learners. This is particularly valuable for workforce training involving employees who need to acquire new knowledge in the most effective manner. This paper introduces a set of metrics and visualizations that aim to capture key dynamical aspects of learner engagement, performance, and course trajectories. The metrics are applied to identify prototypical behavior and learning pathways through and interactions with course content, activities, and assessments. The approach is exemplified and empirically validated using more than 30 million separate logged events that capture activities of 1,608 Boeing engineers taking the MITxPro Course, "Architecture of Complex Systems,"delivered in Fall 2016. Visualization results show course structure and patterns of learner interactions with course material, activities, and assessments. Tree visualizations are used to represent course hierarchical structures and explicit sequence of content modules. Learner trajectory networks represent pathways and interactions of individual learners through course modules, revealing patterns of learner engagement, content access strategies, and performance. Results provide evidence for instructors and course designers for evaluating the usage and effectiveness of course materials and intervention strategies.