Excellence in Research: Predicting computations that lead to a stable perception of object lightness under spectral variabilities of the visual scene

卓越的研究：预测计算，在视觉场景的光谱变化下实现物体亮度的稳定感知

• 批准号: 2054900
• 负责人: Vijay Singh
• 金额: $ 37.36万
• 依托单位: North Carolina Agricultural & Technical State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-08-01 至 2025-07-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2054900&HistoricalAwards=false
• 关键词: Excellence; Research; Predicting; computations; lead

The human visual system allows people to see objects in a scene as unchanging, despite variation in the light reaching the eyes. For example, consider the task of estimating the lightness of an object (i.e., the fraction of light reflected by the object’s surface). Properties of the object (e.g., its color), will change the fraction of light it reflects and hence the amount of light available to the eyes. However, the light available to the eyes also depends on several other aspects of the scene, such as the intensity of the light source and how background objects also reflect the light. Despite all this variation, the human visual system allows people to stably perceive an object’s lightness. This project aims to identify the mental computations that lead to stable perception of object lightness. Lightness perception is just one example of a large variety of scene invariant perception problems that the human brain deals with and thus, an understanding of these mental computations could open the door to a better grasp of other brain functions as well. This interdisciplinary project will establish a color perception lab at an Historically Black College and University (HBCU), which will train students from under-represented communities in valuable job-oriented analytical, computational, and experimental skills that are in high demand in academia and industry.To identify these computations, the investigator proposes to combine computational methods – mathematical models that mimic the behavior of complex systems – with experiments involving human participants to study how changes in scene properties affect people’s perception of lightness. Human participants will view computer-generated pictures of natural looking scenes using specifically calibrated equipment and will be asked to discriminate between two objects based on their lightness. For instance, a participant may see back-to-back images of the same scene and be asked to indicate in which of the two scenes a target object (e.g., a spherical object) is lighter. The images will be generated using the investigator’s custom-built software pipeline; each image will be a two-dimensional rendering of a three-dimensional scene. The software employed here can be used to generate large databases of images with precise control over the properties of the objects in the scene, such as the position and color of the objects, and the intensity and color of the light sources. During the experiment, the investigator will vary the intensity of light sources and the color of the background objects and measure human participants’ ability to distinguish the lightness of the target objects. A computational model will then be created to compare with the performance of human observers. The computational learning methods will be designed to perform the same task as the human participants. If the model performs in a similar manner to the humans, it will suggest that the underlying mathematical computations of the model are similar to the mental computations of the human observers. Taken together, the experiments and model will provide a rich description of how human beings perceive the lightness of objects under varying conditions and will provide insights into the possible biological mechanisms involved in stable lightness perception.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

人类的视觉系统使人们可以在场景中看到对象，因为光线不变，目的地变化到达眼睛。例如，考虑估计对象的轻度的任务（即，对象表面反射的光的比例）。物体的属性（例如其颜色）将改变其反射的光的比例，因此可以改变眼睛的光量。但是，眼睛可用的光还取决于场景的其他几个方面，例如光源的强度以及背景对象也反映了光。尽管有所有这些变化，人类的视觉系统使人们能够稳定感知物体的轻度。该项目旨在确定导致对物体轻度稳定感知的心理计算。轻度感知只是人类大脑所处理的各种场景不变问题的一个例子，因此，对这些心理计算的理解也可以为更好地掌握其他大脑功能打开大门。这个跨学科的项目将在历史上一所历史悠久的黑人学院和大学（HBCU）建立一个色彩感知实验室，该实验室将培训来自代表性不足的社区的学生，以有价值的以工作为导向的工作，分析性的分析，计算和实验技能，在学术界和行业中需求较高。研究场景特性的变化如何影响人们对轻度的看法。人类参与者将使用专门校准的设备查看计算机生成的自然外观场景图片，并根据其轻度来区分两个物体。例如，参与者可能会看到同一场景的背对背图像，并被要求指出目标对象（例如，球形对象）中的两个场景中的哪一个更轻。这些图像将使用调查员的定制软件管道生成；每个图像将是三维场景的二维渲染。这里携带的软件可用于生成大型图像数据库，并精确控制场景中对象的属性，例如对象的位置和颜色，以及光源的强度和颜色。在实验过程中，研究者将改变光源的强度和背景对象的颜色，并测量人类参与者区分目标对象的轻度的能力。然后，将创建一个计算模型与人类观察者的表现进行比较。计算学习方法将被设计为执行与人类参与者相同的任务。如果该模型以与人类类似的方式执行，则表明该模型的基本数学计算与人类观察者的心理计算相似。综上所述，实验和模型将提供有关人类如何在不同条件下对物体轻松感知的亮度的丰富描述，并将提供有关稳定轻度感知所涉及的生物学机制的见解。这项奖项反映了NSF的法定任务，并通过使用基金会的知识优点和广泛的影响来评估NSF的法定任务，并被认为是宝贵的支持。

项目成果

Equivalent noise characterization of human lightness constancy.

• DOI: 10.1167/jov.22.5.2
• 发表时间: 2022-04-06
• 期刊: Journal of vision
• 影响因子: 1.8
• 作者: Singh V;Burge J;Brainard DH
• 通讯作者: Brainard DH