权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

III: Small: Creating Natural Data Visualization and Analysis Environments

III：小：创建自然的数据可视化和分析环境

基本信息

批准号：
1717111
负责人：
John Stasko
金额：
$ 49.38万
依托单位：
Georgia Tech Research Corporation
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2017
资助国家：
美国
起止时间：
2017-11-15 至 2021-10-31
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=1717111&HistoricalAwards=false
关键词：
III Small Creating Natural Data

项目摘要

In the current data-rich era, data visualization and exploration capabilities are becoming more widely used in a variety of disciplines including business, health, education, and public policy, among others. Currently, people use visualization systems on desktop and laptop computers and typically interact via keyboard and mouse. Such interactions, while useful, pale in comparison to the natural, fluid interactions presented in futuristic feature films such as "Minority Report" and "Iron Man" where characters interact with large, projected wall displays through speech, gaze, and gesture. To move towards such futuristic interfaces, we must develop new forms of Natural User Interfaces (NUIs) employing multimodal interactions such as speech, pen, touch, gestures, gaze, and head and body movements. While no specific interaction modality may provide all desired capabilities, combinations of modalities (e.g., speech, gaze, and pen) could ideally provide a more natural, intuitive, and integrated interface experience. This project will explore, design, develop, and evaluate NUIs for data visualization and visual analytics. Developing techniques and systems that provide natural, expressive, multimodal input and interaction for multiple representations of data has the potential to broadly impact a virtually unlimited number of disciplines and areas of society. Additionally, the project will provide educational experience and research training for graduate and undergraduate students to help assist them in their careers. Drawing upon prior research on natural language and multi-touch interfaces for visualization, the research seeks to enable a next generation of powerful, expressive, and natural systems that facilitate fluid interaction with visual representations of data. While these interaction modalities harbor great potential, many research challenges exist and must be addressed. For instance, how should a system handle speech input that is ill-formed, incomplete, or ambiguous? What if an intention is misinterpreted or misunderstood? Regarding multi-touch gesture input, what are the "best" touch gestures to use in these interfaces? Do those gestures map well to different types of visualizations and to different display types and sizes and types? How do we make these gestures easier to discover and learn? Combining multiple input modalities may allow systems to counterbalance the weaknesses of one modality with the strengths of another (e.g., ambiguity in selection via speech can be balanced by the preciseness of touch), facilitating a naturalistic user experience. Project objectives include the design, implementation, and evaluation of multimodal interfaces to data visualization systems. In particular, the research will investigate how different interaction methods affect and enable data analysis and exploration. The project will create applications for particular data domains as well as open-source toolkits for other researchers to use in their own work. User studies will identify if and how different types of interaction (speech, touch, gesture, etc.) make analysis faster, easier to learn, and more powerful. The project website (http://www.cc.gatech.edu/gvu/ii/naturalvis) will include project information, links to resulting publications, videos, and open-source software that is produced.

在当前的数据丰富时代，数据可视化和探索能力正越来越广泛地应用于各种学科，包括商业、健康、教育和公共政策等。目前，人们在台式机和笔记本电脑上使用可视化系统，并且通常通过键盘和鼠标进行交互。这样的交互虽然有用，但与未来主义故事片中呈现的自然、流畅的交互相比就相形见绌了，比如《少数派报告》和《钢铁侠》，其中人物通过语音、凝视和手势与大型投影墙显示器进行交互。为了实现这种未来的界面，我们必须开发新形式的自然用户界面（NUI），采用多模式交互，如语音，笔，触摸，手势，凝视，头部和身体运动。虽然没有特定的交互模态可以提供所有期望的能力，但是模态的组合（例如，语音、凝视和笔）可以理想地提供更自然、直观和集成的界面体验。该项目将探索，设计，开发和评估NUI的数据可视化和可视化分析。开发技术和系统，为数据的多种表示提供自然的，富有表现力的，多模式的输入和交互，有可能广泛影响几乎无限数量的学科和社会领域。此外，该项目将为研究生和本科生提供教育经验和研究培训，以帮助他们在职业生涯中获得帮助。借鉴之前对自然语言和多点触摸界面进行可视化的研究，该研究旨在实现下一代强大的，富有表现力的自然系统，这些系统可以促进与数据的视觉表示的流畅交互。虽然这些交互方式具有巨大的潜力，但仍存在许多研究挑战，必须加以解决。例如，系统应该如何处理格式不正确、不完整或模糊的语音输入？如果一个意图被误解或误解了怎么办？关于多点触摸手势输入，在这些界面中使用的“最佳”触摸手势是什么？这些手势是否能很好地映射到不同类型的可视化以及不同的显示类型、大小和类型？我们如何使这些手势更容易发现和学习？组合多个输入模态可以允许系统用另一模态的优点来平衡一个模态的弱点（例如，通过语音选择的模糊性可以通过触摸的精确性来平衡），从而促进自然的用户体验。项目目标包括数据可视化系统的多模态接口的设计、实现和评估。特别是，研究将调查不同的交互方法如何影响和实现数据分析和探索。该项目将为特定的数据域创建应用程序，并为其他研究人员在自己的工作中使用开源工具包。用户研究将确定是否以及如何不同类型的交互（语音，触摸，手势等）使分析更快，更容易学习，更强大。项目网站（http：//www.cc.gatech.edu/gvu/ii/naturalvis）将包括项目信息、与所产生的出版物、视频和开放源码软件的链接。

项目成果

期刊论文数量（9）

专著数量（0）

科研奖励数量（0）

会议论文数量（0）

专利数量（0）

NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language Queries

DOI：
10.1109/tvcg.2020.3030378
发表时间：
2020-08
期刊：
IEEE Transactions on Visualization and Computer Graphics
影响因子：
5.2
作者：
Arpit Narechania;Arjun Srinivasan;J. Stasko
通讯作者：
Arpit Narechania;Arjun Srinivasan;J. Stasko

Tangraphe: interactive exploration of network visualizations using single hand, multi-touch gestures

Tangraphe：使用单手多点触控手势对网络可视化进行交互式探索

DOI：
10.1145/3206505.3206519
发表时间：
2018
期刊：
Proceedings of the 2018 International Conference on Advanced Visual Interfaces
影响因子：
0
作者：
Thompson, John;Srinivasan, Arjun;Stasko, John
通讯作者：
Stasko, John

Touch? Speech? or Touch and Speech? Investigating Multimodal Interaction for Visual Network Exploration and Analysis