EAGER: Embodying Visual Semantic Information Composition to Stimulate Sensemaking and Ideation

该项目综合了交互设计、创意认知、视觉设计、编程语言、信息检索和可视化等技术，帮助人们利用大数据激发创新。语义构建是理解信息资源集合的过程。构思意味着产生新想法的过程。在执行基于信息的构思任务时，人们使用信息来发展新的想法，例如计划一篇论文、论文或发明。这个项目将为可视化地呈现信息提供新的工具。“信息组合”是将每个信息集合表示为一个相互联系的整体的媒介。为了更好地支持创新和创造性的视觉思维，本研究将图表与收藏策展一起引入信息构成。笔、触摸和空气感应将把互动转化为身体的延伸，帮助人们表达、理解和记忆。具体的交互将基于界面生态实验室的零触摸，一种新颖的多指传感技术。智力优势：本建议的目标是开发“具身的InfoComposer”，这是一个使用笔、触摸和其他方式来创作视觉语义信息集合的工具集。主要假设是，体现交互、使表示可视化和连接丰富的元数据语义将刺激意义生成和构思，帮助人们收集、反思、创造和发明。这项研究将在以人为中心的计算的重要领域产生重大成果，包括：(1)对集成图表和信息组合如何促进创造性视觉思维的新理解；(2)新的流体具身交互技术；(3)测量反思、思维和意义的新方法；(4)具身创意支持环境设计的新启示。更广泛的影响：这项研究将改变人们处理信息的方式，在包括商业和教育在内的各个领域带来更大的创新。这项工作可能会产生广泛的社会影响，因为创新是创造就业机会和经济成功的关键因素。该项目还将通过培训研究生和使用Embodied InfoComposer在设计过程课程中培养来自不同专业的本科生的创造性视觉思维，从而产生教育影响。计算机科学本科学生在顶点设计高级将使用所得的技术作为创新项目的基石。将寻求在研究生和本科两级征聘女性和少数民族学生研究人员。

This project synthesizes techniques from interaction design, creative cognition, visual design, programming languages, and information retrieval and visualization to help people draw on big data to stimulate innovation. Sensemaking is the process of understanding a collection of information resources. Ideation means the process of generating new ideas. In performing information-based ideation tasks, people use information for developing new ideas, such as planning a paper, thesis, or invention. This project will provide new tools for presenting information visually. "Information composition" is a medium for representing each information collection as a connected whole. To better support innovation and creative visual thinking, this research brings diagramming, along with collection curation, to information composition. Pen, touch, and in-air sensing will transform interaction into an extension of the body, helping people express, understand, and remember. Embodied interaction will be based on the Interface Ecology Lab's ZeroTouch, a novel multi-finger sensing technology.Intellectual merit: The objective of this proposal is to develop "Embodied InfoComposer", a toolset that uses pen, touch, and other modalities for authoring visual semantic information collections. The principal hypothesis is that embodying interaction, making representations visual, and connecting rich metadata semantics will stimulate sensemaking and ideation, helping people collect, reflect, create, and invent. This research will result in significant outcomes in important areas of human centered computing, including: (1) new understanding of how integrated diagramming and information composition promotes creative visual thinking; (2) new fluid embodied interaction techniques; (3) new methods for measuring reflection, ideation, and sensemaking; and (4) new implications for design of embodied creativity support environments.Broader impacts: This research will transform how people work with information, leading to greater innovation in a variety of domains including business and education. The work is likely to have broad societal impact because innovation is a key factor leading to job creation and economic success. The project will also have educational impact through the training of graduate students and by the use of Embodied InfoComposer to foster creative visual thinking by undergraduate students from diverse majors in a design process course. Undergraduate computer science students in capstone senior design will use resulting technologies as building blocks in innovative projects. Recruitment of female and minority student researchers at the graduate and undergraduate levels will be sought.