CAREER: Overcoming bias in computer vision: Building fairer systems and training diverse leaders

职业：克服计算机视觉中的偏见：建立更公平的系统并培训多元化的领导者

• 批准号: 2145198
• 负责人: Olga Russakovsky
• 金额: $ 60万
• 依托单位: Princeton University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-06-15 至 2027-05-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2145198&HistoricalAwards=false
• 关键词: CAREER; Overcoming; bias; computer; vision

Artificial Intelligence (AI) systems have become an integral part of daily life. These systems provide access to information about current events, guide shopping experiences, and allow communication across language boundaries. For example, computer vision systems (which make automated decisions based on visual information from photos or videos) are becoming increasingly deployed in high-stakes applications such as autonomous driving or medical diagnosis. However, automated AI systems have been known to capture, propagate and even amplify historical biases, stereotypes, and disparities: known issues in computer vision include racial bias in face recognition, geographic bias in object detection, and gender bias in activity understanding, to name a few. This project focuses on developing practical bias mitigation strategies for computer vision systems. The work is integral to ensuring the ethical and equitable deployment of computer vision in high-stakes applications. There is a rich and growing literature on mitigating social bias in AI systems generally. Much of it studies bias in models with tabular or text input, such as criminal justice records or resumes. Mitigating bias in computer vision requires unique approaches: since the input tokens (single pixels) are uninformative, revealing problematic patterns in data and models is particularly challenging. The project focused on bias in the form of inappropriate correlations between visual protected attributes and predictions of recognition models. It features a multi-pronged approach, which includes developing strategies for mitigating bias in the data (improving data collection processes and leveraging synthetic data), studying how bias propagates from data into downstream models (designing novel interpretability techniques that are well-suited for this goal), and developing strategies for directly mitigating bias in the models (leveraging novel benchmarks and metrics to inform model design). In addition, the project also tackles the problem of homogeneity among current AI researchers, which is one of the root causes of AI bias. Going beyond the technical innovations, the educational component focuses on training and providing leadership pathways for students from historically underrepresented groups starting as early as high school, in partnership with the national nonprofit AI4ALL.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

人工智能（AI）系统已成为日常生活中不可或缺的一部分。这些系统提供有关当前事件的信息，指导购物体验，并允许跨语言边界的通信。例如，计算机视觉系统（根据照片或视频中的视觉信息做出自动决策）越来越多地部署在自动驾驶或医疗诊断等高风险应用中。然而，众所周知，自动化人工智能系统会捕捉、传播甚至放大历史偏见、刻板印象和差异：计算机视觉中的已知问题包括人脸识别中的种族偏见、物体检测中的地理偏见和活动理解中的性别偏见等。该项目的重点是为计算机视觉系统开发实用的偏差缓解策略。这项工作对于确保计算机视觉在高风险应用中的道德和公平部署是不可或缺的。关于减轻人工智能系统中的社会偏见的文献越来越多。其中大部分研究的是表格或文本输入模型中的偏见，如刑事司法记录或简历。减轻计算机视觉中的偏差需要独特的方法：由于输入标记（单个像素）是无信息的，因此揭示数据和模型中的问题模式特别具有挑战性。该项目的重点是偏见的形式之间的视觉保护属性和识别模型的预测不适当的相关性。它采用多管齐下的方法，包括制定减轻数据偏差的策略（改进数据收集过程和利用合成数据），研究偏差如何从数据传播到下游模型（设计适合这一目标的新型可解释性技术），以及制定直接减轻模型偏差的策略（利用新的基准和指标为模型设计提供信息）。此外，该项目还解决了当前人工智能研究人员的同质性问题，这是人工智能偏见的根本原因之一。除了技术创新，教育部分的重点是培训和提供领导的途径，为学生从历史上代表性不足的群体，早在高中开始，与国家非营利组织AI4ALL合作。该奖项反映了NSF的法定使命，并已被认为是值得通过评估使用基金会的智力价值和更广泛的影响力审查标准的支持。