CAREER: Understanding visual reasoning for visual communication

职业:理解视觉传达的视觉推理

基本信息

  • 批准号:
    1945303
  • 负责人:
  • 金额:
    $ 55.87万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
    Continuing Grant
  • 财政年份:
    2020
  • 资助国家:
    美国
  • 起止时间:
    2020-07-01 至 2025-06-30
  • 项目状态:
    未结题

项目摘要

This project aims to advance the understanding of visual reasoning for visual communication. Visual reasoning enables people to translate visual input to abstract concepts. For example, to interpret which counties will receive more snowfall using a weather map, it is necessary to figure out which colors on the weather map indicate which amounts of snowfall. People have expectations about how visual features should map to concepts in visualizations, and it is harder for them to interpret visualizations that violate those expectations, even if mappings are clearly labeled. However, the nature of those expectations and their role in visual reasoning is not well-understood, so the design of information visualizations is often unprincipled and ad-hoc. With a better understanding of how visual reasoning works, it will be possible to design visualizations that fit its strengths and optimize visual communication. The investigators will address this problem by studying how people infer meaning from color in visualizations. This research can be translated to producing online tools for designing visualizations, which will improve STEM education and increase public literacy and engagement with science and technology. The education plan will use visual communication to make science more accessible and engaging through virtual reality (VR) and accompanying hands-on experiences with color and visualization, for both college undergraduates and middle-school students. The investigators will also support broadening participation of females in STEM through mentoring among the PI, graduate student, undergraduate intern, and middle school girls. The proposed research will address fundamental questions about how visual reasoning enables visual communication. In Objective 1, the investigators will study how people learn to associate perceptual features with novel concepts through environmental statistics. They will also examine how learned associations extend beyond perceptual input due to categorical structure in cognitive representations. In Objective 2, the team will study how to automatically estimate color–concept associations from image statistics. They will construct and evaluate new models that incorporate predictors based on visual input and cognitive representations of color categories. In the process of constructing these models, the team will develop new methods for quantifying graded category membership in a continuous space. By modeling human judgments, there is potential to develop new insights into how those judgments are made. In Objective 3, the team will investigate how people use color–concept associations to interpret visualizations, in a process called assignment inference. Assignment inference enables people to infer optimal mappings between colors and concepts in visualizations, but little is known about how this process works. It is proposed that it can be understood using accumulator models typically used in decision making research, which will forge new connections between the fields of decision making and information visualization. The results will increase knowledge of how people integrate information from multiple, conflicting sources and provide new knowledge about how to optimally design semantically interpretable visualizations.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
本项目旨在促进对视觉传达的视觉推理的理解。视觉推理使人们能够将视觉输入转化为抽象概念。例如,要使用天气图解释哪些县将会有更多的降雪量,就必须弄清楚天气图上的哪些颜色表示降雪量。人们对视觉特征应该如何映射到可视化中的概念有期望,并且对他们来说很难解释违反这些期望的可视化,即使映射被清楚地标记。然而,这些期望的本质及其在视觉推理中的作用并没有得到很好的理解,因此信息可视化的设计通常是无原则的和临时的。更好地理解视觉推理是如何工作的,将有可能设计出适合其优势的可视化并优化视觉交流。研究人员将通过研究人们如何从视觉化的颜色中推断意义来解决这个问题。这项研究可以转化为制作用于设计可视化的在线工具,这将改善STEM教育,提高公众对科学技术的素养和参与度。该教育计划将利用视觉传达,通过虚拟现实(VR)以及伴随的色彩和可视化实践体验,让科学更容易理解和吸引人,面向大学本科生和中学生。研究人员还将通过在PI、研究生、本科生实习生和中学女生之间提供指导,支持扩大女性在STEM领域的参与。拟议的研究将解决关于视觉推理如何使视觉交流的基本问题。在目标1中,研究者将研究人们如何通过环境统计学习将感知特征与新概念联系起来。他们还将研究由于认知表征中的分类结构,习得的联想如何超越知觉输入。在目标2中,团队将研究如何从图像统计中自动估计颜色概念关联。他们将构建和评估新的模型,这些模型结合了基于视觉输入和颜色类别的认知表征的预测器。在构建这些模型的过程中,团队将开发新的方法来量化连续空间中的分级类别隶属度。通过模拟人类的判断,有可能对这些判断是如何做出的产生新的见解。在目标3中,团队将调查人们如何使用颜色概念关联来解释可视化,这一过程称为分配推理。分配推理使人们能够推断出可视化中颜色和概念之间的最佳映射,但很少有人知道这个过程是如何工作的。本文提出可以使用决策研究中常用的累加器模型来理解它,这将在决策和信息可视化领域之间建立新的联系。结果将增加人们如何整合来自多个冲突来源的信息的知识,并提供关于如何优化设计语义可解释的可视化的新知识。该奖项反映了美国国家科学基金会的法定使命,并通过使用基金会的知识价值和更广泛的影响审查标准进行评估,被认为值得支持。

项目成果

期刊论文数量(6)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
A Holey Perspective on Venn Diagrams
维恩图的漏洞视角
  • DOI:
    10.1111/cogs.13073
  • 发表时间:
    2021
  • 期刊:
  • 影响因子:
    2.5
  • 作者:
    Bartel, Anna N.;Lande, Kevin J.;Roos, Joris;Schloss, Karen B.
  • 通讯作者:
    Schloss, Karen B.
Context Matters: A Theory of Semantic Discriminability for Perceptual Encoding Systems
  • DOI:
    10.1109/tvcg.2021.3114780
  • 发表时间:
    2021-08
  • 期刊:
  • 影响因子:
    5.2
  • 作者:
    Kushin Mukherjee;Brian Yin;Brianne E. Sherman;Laurent Lessard;Karen B. Schloss
  • 通讯作者:
    Kushin Mukherjee;Brian Yin;Brianne E. Sherman;Laurent Lessard;Karen B. Schloss
Colour-concept association formation for novel concepts
  • DOI:
    10.1080/13506285.2022.2089418
  • 发表时间:
    2022-07-21
  • 期刊:
  • 影响因子:
    2
  • 作者:
    Schoenlein,Melissa A.;Schloss,Karen B.
  • 通讯作者:
    Schloss,Karen B.
{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Karen Schloss其他文献

Karen Schloss的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Karen Schloss', 18)}}的其他基金

Travel: Student Travel Support for the Doctoral Colloquium at IEEE Visualization (IEEE VIS) 2023
旅行:IEEE 可视化 (IEEE VIS) 2023 博士座谈会的学生旅行支持
  • 批准号:
    2325235
  • 财政年份:
    2023
  • 资助金额:
    $ 55.87万
  • 项目类别:
    Standard Grant
Females of Vision, et al. (FoVea): Increasing Success, Visibility, and Impact of Women in Vision Science
视觉女性等。
  • 批准号:
    2333229
  • 财政年份:
    2023
  • 资助金额:
    $ 55.87万
  • 项目类别:
    Standard Grant

相似国自然基金

Understanding structural evolution of galaxies with machine learning
  • 批准号:
    n/a
  • 批准年份:
    2022
  • 资助金额:
    10.0 万元
  • 项目类别:
    省市级项目
Understanding complicated gravitational physics by simple two-shell systems
  • 批准号:
    12005059
  • 批准年份:
    2020
  • 资助金额:
    24.0 万元
  • 项目类别:
    青年科学基金项目

相似海外基金

Understanding how predictions modulate visual perception
了解预测如何调节视觉感知
  • 批准号:
    DE240100327
  • 财政年份:
    2024
  • 资助金额:
    $ 55.87万
  • 项目类别:
    Discovery Early Career Researcher Award
Understanding the Impact of Vaping Prevention Ads on Adolescents and Young Adults
了解电子烟预防广告对青少年和年轻人的影响
  • 批准号:
    10665870
  • 财政年份:
    2023
  • 资助金额:
    $ 55.87万
  • 项目类别:
Multiphon imaging for understanding social brain function in tadpoles
多声子成像用于了解蝌蚪的社交脑功能
  • 批准号:
    10717610
  • 财政年份:
    2023
  • 资助金额:
    $ 55.87万
  • 项目类别:
Understanding the Role of Extracellular Vesicle/Exosome Transport in the Visual System
了解细胞外囊泡/外泌体运输在视觉系统中的作用
  • 批准号:
    2890845
  • 财政年份:
    2023
  • 资助金额:
    $ 55.87万
  • 项目类别:
    Studentship
Understanding the computational principle of visual objects
理解视觉对象的计算原理
  • 批准号:
    23H03698
  • 财政年份:
    2023
  • 资助金额:
    $ 55.87万
  • 项目类别:
    Grant-in-Aid for Scientific Research (B)
Understanding the neurodevelopmental effects of youth tackle football participation
了解青少年参与橄榄球运动对神经发育的影响
  • 批准号:
    10742262
  • 财政年份:
    2023
  • 资助金额:
    $ 55.87万
  • 项目类别:
Understanding the Numbers: Quantitative Literacy for Experimental Rigor
理解数字:实验严谨性的定量素养
  • 批准号:
    10722653
  • 财政年份:
    2023
  • 资助金额:
    $ 55.87万
  • 项目类别:
Understanding the Conceptual Priority Map Guiding Naturalistic Visual Attention for Autistic Individuals
了解指导自闭症患者自然视觉注意力的概念优先级图
  • 批准号:
    10829114
  • 财政年份:
    2023
  • 资助金额:
    $ 55.87万
  • 项目类别:
Understanding the neuronal substrates of flexible visual processing in everyday life
了解日常生活中灵活视觉处理的神经元基质
  • 批准号:
    2898985
  • 财政年份:
    2023
  • 资助金额:
    $ 55.87万
  • 项目类别:
    Studentship
A dynamic interactive account of human visual action understanding
人类视觉动作理解的动态交互描述
  • 批准号:
    ES/X005534/1
  • 财政年份:
    2023
  • 资助金额:
    $ 55.87万
  • 项目类别:
    Research Grant
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了