What Do We Actually Learn from Evaluations in the “Heroic Era” of Visualization? : Position Paper

What Do We Actually Learn from Evaluations in the “Heroic Era” of Visualization? : Position Paper
复制标题

我们实际上从可视化“英雄时代”的评估中学到了什么:立场文件?

DOI:
10.1109/beliv51497.2020.00013
复制
发表时间:
2020
期刊:
2020 IEEE Workshop on Evaluation and Beyond - Methodological Approaches to Visualization (BELIV)
影响因子:
--
通讯作者:
M. Correll
M. Correll
中科院分区:
--
文献类型:
--
作者:
M. Correll

文献摘要

参考文献

被引文献

相似文献

我们经常指出,与该领域最早的日子相比,可视化系统评估的数量和复杂性相对增加,这证明我们作为一个领域正在走向成熟。我不是很信服。特别是,我觉得可视化的评价,因为它们通常是在实地进行的,或者是由审查者要求的,不能告诉我们关于可视化系统的许多有用的或可转移的东西,无论评价的统计严谨性或生态有效性。通过一系列的思维实验,我展示了我们目前对可视化评估的概念如何不完整、反复无常,或者对于进一步发展这一领域的目标来说是无用的,更符合医学科学的“英雄时代”,而不是我们可能渴望的严格的基于证据的领域。最后,我建议应该重新审视我们设计评价的模式,以及我们作为一个领域的优先事项。
We often point to the relative increase in the amount and sophistication of evaluations of visualization systems versus the earliest days of the field as evidence that we are maturing as a field. I am not so convinced. In particular, I feel that evaluations of visualizations, as they are ordinarily performed in the field or asked for by reviewers, fail to tell us very much that is useful or transferable about visualization systems, regardless of the statistical rigor or ecological validity of the evaluation. Through a series of thought experiments, I show how our current conceptions of visualization evaluations can be incomplete, capricious, or useless for the goal of furthering the field, more in line with the “heroic age” of medical science than the rigorous evidence-based field we might aspire to be. I conclude by suggesting that our models for designing evaluations, and our priorities as a field, should be revisited.
DOI: 10.1126/science.8178168
发表时间: 1994-05-20
期刊: SCIENCE
影响因子: 56.9
作者:
DAMASIO, H;GRABOWSKI, T;DAMASIO, AR
通讯作者: DAMASIO, AR