VLAT: Development of a Visualization Literacy Assessment Test
VLAT: Development of a Visualization Literacy Assessment Test
复制标题
VLAT：可视化素养评估测试的开发
DOI：
10.1109/tvcg.2016.2598920
复制
发表时间：
2017-01-01
影响因子：
5.2
通讯作者：
Kwon, Bum Chul
中科院分区：
文献类型：
--
作者：
Lee, Sukwon;Kim, Sung-Hee;Kwon, Bum Chul
信息可视化社区已经开始关注可视化素养；然而，研究人员仍然缺乏测量用户可视化素养的工具。为了解决这一差距，我们系统地开发了可视化素养评估测试（VLAT），特别是针对非数据可视化专家用户，遵循心理与教育测量中既定的测试开发程序：(1)测试蓝图构建，(2)测试项目生成，(3)内容效度评估，(4)测试尝试和项目分析，(5)测试项目选择，(6)可靠性评估。VLAT由12个数据可视化和53个选择题组成，涵盖8个数据可视化任务。VLAT的测试项目由5位信息可视化和视觉分析领域的专家对其重要性进行评估（平均内容效度比-0.66）。VLAT也在191名考生中进行了测试，显示出较高的信度（信度系数ω -0.76）。此外，我们证明了用户的可视化素养与学习不熟悉的可视化能力之间的关系，并表明它们具有相当高的正相关关系（相关系数=0.64）。最后，我们讨论了VLAT有效性的证据以及与该仪器相关的潜在研究领域。
The Information Visualization community has begun to pay attention to visualization literacy; however, researchers still lack instruments for measuring the visualization literacy of users. In order to address this gap, we systematically developed a visualization literacy assessment test (VLAT), especially for non-expert users in data visualization, by following the established procedure of test development in Psychological and Educational Measurement: (1) Test Blueprint Construction, (2) Test Item Generation, (3) Content Validity Evaluation, (4) Test Tryout and Item Analysis, (5) Test Item Selection, and (6) Reliability Evaluation. The VLAT consists of 12 data visualizations and 53 multiple-choice test items that cover eight data visualization tasks. The test items in the VLAT were evaluated with respect to their essentialness by five domain experts in Information Visualization and Visual Analytics (average content validity ratio -0.66). The VLAT was also tried out on a sample of 191 test takers and showed high reliability (reliability coefficient omega -0.76). In addition, we demonstrated the relationship between users' visualization literacy and aptitude for learning an unfamiliar visualization and showed that they had a fairly high positive relationship (correlation coefficient =0.64). Finally, we discuss evidence for the validity of the VLAT and potential research areas that are related to the instrument.