Natural Language Interactions with Visual Analytics
Natural Language Interactions with Visual Analytics
批准号:
RGPIN-2019-06340
负责人:
Prince, MdEnamulHoque
金额:
$2.4万
依托单位:
依托单位国家:
加拿大
项目类别:
Discovery Grants Program - Individual
财政年份:
2020
资助国家:
加拿大
项目状态:
已结题
起止时间:
2020-01-01 至 2021-12-31
中文摘要
可视化分析已经成为人们探索和理解数据的一种流行方式。它结合了计算工具和信息可视化技术来促进分析推理过程。虽然交互是可视化数据分析的核心,但多年来人们与数据交互的方式在很大程度上保持不变。通常,人们通过鼠标和触摸交互来执行视觉数据分析,当界面需要许多步骤来完成复杂任务时,这种交互通常效率低下。一种更有效地支持用户的有希望的方法是引入自然语言作为视觉分析的补充输入方式,因为与其他方式相比,语言可以更具表现力和可访问性。本研究的长期目标是通过将自然语言作为一种交互方式,为视觉分析创建下一代多模式界面,使人们能够更快、更有效地执行复杂的数据分析任务。
英文摘要
Visual analytics has become a popular way for people to explore and understand data. It combines computational tools with information visualization techniques to facilitate the analytical reasoning process. While interaction is at the core of visual data analysis, the way people interact with data has largely remained the same over the years. Typically, people perform visual data analysis via mouse and touch interactions which are often inefficient when the interface requires many steps to complete a complex task. A promising way to support the user more effectively is to introduce natural language as a complementary input modality for visual analytics, as language can be more expressive and accessible compared to other modalities. The long-term goal of this research is to create the next generation of multimodal interfaces for visual analytics by incorporating natural language as an interaction modality which will enable people to perform complex data analysis tasks faster and more effectively.
Using such futuristic interfaces, people will be able to express their complex information needs through a novel combination of input modalities including natural language, touch, gesture, and gaze, enabling rich interaction cycles with visual analytics systems. In response, the system will automatically generate answers combining visual representations with natural language explanations for effective comprehension. To this end, this proposal will focus on the following objectives. First, drawing from latest advances in automatic question answering research, we will develop methods for analyzing the syntactic, semantic, and pragmatic aspects of the question to determine what results should be presented to the user. Second, we will leverage natural language generation techniques to automatically create a multimedia summary by combining visualizations and text that effectively answers the question. Here, the text would not only facilitate users to comprehend the results more effectively by explaining key points but also enhance the transparency of the algorithm by conveying how the results were computed. Finally, we will investigate how combining natural language with other modalities affect the user while interacting with visual analytics and communicating insights.
The research will open up new ways of analyzing large and complex datasets, improving the ability of Canadians to discover critical insights and make informed decisions in domains ranging from health informatics to business intelligence to customer analytics. The research program has great potential for supporting data democratization, enabling novice users and people who are visually impaired or who have cognitive difficulties to comprehend charts and perform analytical tasks through natural language. In addition to scientific impact, the program will provide specialized training for graduate and undergraduate students in data science and analytics for their future career.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
Natural Language Interactions with Visual Analytics
-
批准号:RGPIN-2019-06340
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$2.4万
-
财政年份:2022
-
负责人:Prince, MdEnamulHoque
-
依托单位:
Natural Language Interactions with Visual Analytics
-
批准号:RGPIN-2019-06340
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$2.4万
-
财政年份:2021
-
负责人:Prince, MdEnamulHoque
-
依托单位:
Natural Language Interactions with Visual Analytics
-
批准号:DGECR-2019-00365
-
项目类别:Discovery Launch Supplement
-
资助金额:$0.91万
-
财政年份:2019
-
负责人:Prince, MdEnamulHoque
-
依托单位:
Natural Language Interactions with Visual Analytics
-
批准号:RGPIN-2019-06340
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$2.4万
-
财政年份:2019
-
负责人:Prince, MdEnamulHoque
-
依托单位:
海外基金