EAGER: Collaborative Research: Articulate: Augmenting Data Visualization With Natural Language Interaction

EAGER：协作研究：清晰表达：通过自然语言交互增强数据可视化

• 批准号: 1445751
• 负责人: Barbara DiEugenio
• 金额: $ 24.15万
• 依托单位: University of Illinois at Chicago
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2014
• 资助国家: 美国
• 起止时间: 2014-08-15 至 2017-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1445751&HistoricalAwards=false
• 关键词: EAGER; Collaborative; Research; Articulate; Augmenting

Nearly one third of the human brain is devoted to processing visual information. Vision is the dominant sense for the acquisition of information from our everyday world. It is therefore no surprise that visualization, even in its simplest forms, remains the most effective means for converting large volumes of raw data into insight, a process that can support scientific discovery. However a key challenge hindering scientific users from adopting the latest visualization tools and techniques is the steep learning curve that has to be overcome in order to make use of them. The tendency then is to resort to the simplest tools, such as bar charts and line graphs, even though they may lack the expressive power necessary to bring scientific data into focus.The notion that scientists would ideally like to simply speak with a computer to ask questions about their data, and have the computer automatically generate visualizations that answer their queries, has been well known since at least the NSF 2007 report "Enabling Science Discoveries through Visual Exploration." This is the motivation for the current project, which involves a collaboration among researchers at two institutions, given that scientists still are unable to do so. The PIs' ultimate goal is to implement a Virtual Visualization Expert to translate the language of science into the language of visualization. To demonstrate the concept is indeed viable, the PIs previously developed and evaluated a small prototype, which supported their argument that by relieving the user of the burden of having to learn how to use a complex interface one could enable them to focus on articulating better scientific questions.Given this initial success, the focus of this exploratory research is to establish the foundations of a more generalizable approach that can encompass techniques used in scientific visualization. To this end, the PIs will research the steps needed for mapping natural language requests, which may be accompanied by gestures, into meaningful visualizations and for enabling incremental creation and modifications of visualizations. They will develop innovative models to understand the intent of the user and the objects s/he is referring to, and they will explore how best to design user interfaces for creating and modifying visualizations using language and direct manipulation. The PIs' initial study showed that all these capabilities are crucial to enabling users to make the best use of a dialogic interface for data visualization. Although project outcomes will be geared in the short term to serving the scientific community, the techniques should be applicable more broadly to consumers of information, such as citizen scientists, public policy decision makers, and students.

人类大脑的近三分之一用于处理视觉信息。视觉是我们从日常世界中获取信息的主要感觉。 因此，毫不奇怪，可视化，即使是最简单的形式，仍然是将大量原始数据转化为洞察力的最有效手段，这是一个可以支持科学发现的过程。然而，阻碍科学用户采用最新可视化工具和技术的一个关键挑战是为了使用它们而必须克服的陡峭的学习曲线。因此，人们倾向于使用最简单的工具，如条形图和折线图，尽管它们可能缺乏将科学数据集中起来所必需的表达能力。科学家理想的想法是，简单地与计算机对话，就他们的数据提出问题，并让计算机自动生成可视化结果来回答他们的问题，至少从NSF 2007年的报告“通过视觉探索实现科学发现”开始，“这是目前项目的动机，该项目涉及两个机构的研究人员之间的合作，因为科学家仍然无法这样做。 PI的最终目标是实现一个虚拟可视化专家，将科学语言翻译成可视化语言。 为了证明这一概念确实可行，PI先前开发并评估了一个小型原型，该原型支持了他们的论点，即通过减轻用户必须学习如何使用复杂界面的负担，可以使他们能够专注于阐述更好的科学问题。这一探索性研究的重点是为一种更普遍的方法奠定基础，这种方法可以包括科学可视化中使用的技术。 为此，PI将研究将可能伴随手势的自然语言请求映射为有意义的可视化以及实现可视化的增量创建和修改所需的步骤。 他们将开发创新的模型来理解用户的意图和他/她所指的对象，他们将探索如何最好地设计用户界面，以便使用语言和直接操作来创建和修改可视化。 PI的初步研究表明，所有这些功能对于使用户能够充分利用数据可视化的对话界面至关重要。 虽然项目成果将在短期内为科学界服务，但这些技术应更广泛地适用于信息消费者，如公民科学家、公共政策决策者和学生。