CAREER: Developing Display Ecologies for Visual Analysis and Sensemaking

从小型可穿戴设备到大型墙壁显示器的各种类型的显示器和设备的持续增长为设计个人、专业和教育计算任务提供了新的可能性。特别是，使用多个显示器进行视觉分析和感知有可能改善单个显示屏和界面的功能，提高人们从数据中获得新见解的能力。然而，多显示器环境为跨显示器协调的视觉分析工具提出了一组新的设计和开发挑战：（a）将不同类型的显示器组合成整体视觉分析空间以满足给定任务的需求;（B）跨显示器分布数据、可视化视图和表示;以及（c）帮助人们在这些数据、视图和跨单独显示器的表示之间建立联系。该项目通过全面了解如何将多个显示器集成以增强视觉分析和感知，快速实现多显示器视图的工具以及评估其对最终用户的有效性的方法来解决这些挑战。该团队将与来自当地几所大学多个学科的学生密切合作，为评估系统创造机会，教育学生数据科学和人机交互，并让来自历史上在计算领域代表性不足的群体的学生参与进来。该项目旨在概念化并赋予显示生态的概念，由此，不同种类的显示器彼此交互并且协同工作以辅助交互、导航、分析和感知任务。有效的显示器生态将帮助用户灵活地建立和修改每个显示器的角色（例如，视图、视觉表示和用户界面），以及根据不同的视觉分析需要来帮助确定显示器之间的关系。这个项目将探讨四个相互关联的研究目标，涉及视觉数据分析和意义建构的显示生态的发展。第一个目标是通过分析学术文献中现有的多显示器应用程序，获得多显示器和设备如何创建一个有凝聚力的可视化系统以解决视觉分析任务的设计知识。第二个目标是，然后开发显示生态的各种视觉分析任务的基础上获得的设计知识。第三个目标是在基于增强现实的新型显示生态基础设施中纳入和支持多个显示器的空间性和物理性的基本方面。第四个目标是将这些目标的结果整合到一个基于显示生态的有凝聚力的视觉分析系统中;这一最终目标将需要对使用多个显示器对视觉分析和意义构建的不同影响进行定性和定量评估。这项研究的结果将指导设计和开发更有效的可视化和分析工具，用于多个显示器，支持各种应用领域的数据分析，该项目由以人为中心的计算（HCC）和刺激竞争研究的既定计划（EPSCoR）联合资助。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

The ongoing proliferation of various types of displays and devices, ranging from small wearable devices to large wall displays, provide new possibilities for designing personal, professional, and educational computing tasks. In particular, using multiple displays for visual analysis and sensemaking has the potential to improve upon the capabilities of a single display screen and interface, increasing people’s ability to gain new insights from data. However, multi-display environments present a new set of design and development challenges for visual analysis tools that coordinate across the displays: (a) combining different types of displays into a holistic visual analysis space to meet the demands of a given task; (b) distributing data, visualization views, and representations across displays; and (c) helping people make connections between these data, views, and representations across separate displays. This project addresses these challenges by building a comprehensive understanding of how multiple displays can be integrated for enhanced visual analysis and sensemaking, tools for rapidly implementing multi-display views, and methods for assessing their effectiveness for end-users. The team will work closely with students from a number of disciplines in several local universities, creating opportunities for evaluating the systems, educating students in data science and human-computer interaction, and involving students from groups historically underrepresented in computing.This project is designed to conceptualize and empower the concept of the display ecology, whereby heterogeneous displays interact with each other and function in concert to aid interaction, navigation, analysis, and sensemaking tasks. Effective display ecologies will aid the user in flexibly establishing and modifying the roles of each display (e.g., view, visual representations, and user interfaces), as well as assist in determining relationships among the displays according to different visual analysis needs. This project will explore four interrelated research goals pertaining to the development of display ecologies for visual data analysis and sensemaking. The first goal is to gain design knowledge of how multiple displays and devices can create a cohesive visualization system for tackling visual analysis tasks by analyzing existing multi-display applications from the academic literature. The second goal is to then develop display ecologies for a variety of visual analysis tasks based on the obtained design knowledge. The third goal is to incorporate and support essential aspects of the spatiality and physicality of multiple displays in a novel display ecology infrastructure based on augmented reality. The fourth goal is to integrate the results from these goals into a cohesive visual analysis system based on display ecologies; this final goal will require qualitative and quantitative evaluations of the diverse impacts of using multiple displays on visual analysis and sensemaking. Findings from this research will guide the design and development of more effective visualization and analysis tools for multiple displays, supporting data analysis in various application domains, which continue to emerge with the explosion of available data.This project is jointly funded by Human Centered Computing (HCC) and the Established Program to Stimulate Competitive Research (EPSCoR).This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.