FAI: A novel paradigm for fairness-aware deep learning models on data streams

海量的信息以数据流的形式在不同的域之间不断传输。社交网络、博客、在线企业和传感器都会产生巨大的数据流。这样的数据流以随时间变化的模式被接收。虽然这些数据可以被分配到特定的类别、对象和事件，但它们的分布并不是恒定的。这些类别会受到分布变化的影响。这些分布变化往往是由于潜在的环境、地理、经济和文化背景的变化。例如，在新冠肺炎大流行期间，贷款申请的风险水平一直受到分布变化的影响。这是因为贷款风险是基于与申请者相关的因素，如就业状况和收入。这些因素通常是相对稳定的，但由于大流行的经济影响，变化很快。因此，现有的贷款推荐系统需要调整，以适应有限的例子。该项目将开发开放软件，以帮助用户评估在线公平算法，减轻潜在的偏见，并检查效用公平之间的权衡。它将实现两个真实世界的应用：根据视频数据进行在线犯罪事件识别和根据点击流数据进行在线购买行为预测。为了扩大该项目在研究和教育方面的影响，该项目将利用STEM项目，面向不同背景、性别和种族/民族的学生。该项目包括为学生举办的研讨会、研讨会、短期课程和研究项目等活动。这个项目旨在开发一种新的创新范式来设计、实施和评估在线公平感知深度学习(DL)模型。这样的模型将用于噪声和非平稳数据流中的分类任务。该项目将集中在五个方面。首先，该项目将探索如何确保在线和非固定环境下的数字图书馆模型中纳入各种公平原则。该项目还将研究如何确定反映因果结构并适应分布变化的神经网络体系结构。该项目还考察了DL模型将如何学习原始参数(与模型精度相关)和双重参数(与模型公平性相关)的全局初始化。最后，该项目着眼于如何使在线学习算法对模型估计公平性的不确定性具有健壮性，以及如何最终解释在线DL模型的公平性。通过将神经体系结构搜索、在线元学习和公平感知深度学习技术结合起来，该项目推进了人工智能中公平的最先进研究。该项目将提供以下创新：(1)通过因果表示学习将潜在的敏感和非敏感因果变量从原始特征中分离出来；(2)通过差分体系结构搜索为数据流识别自适应体系结构；(3)以在线中在线的方式学习原始和双重模型参数的有效初始化；(4)开发稳健版本的算法，以处理模型公平性和任务中的不确定性，以及(5)使用本地和全球解释来确定负责模型适应的训练范例和潜在因果变量。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Massive amounts of information are transferred constantly between different domains in the form of data streams. Social networks, blogs, online businesses, and sensors all generate immense data streams. Such data streams are received in patterns that change over time. While this data can be assigned to specific categories, objects and events, their distribution is not constant. These categories are subject to distribution shifts. These distribution shifts are often due to the changes in the underlying environmental, geographical, economic, and cultural contexts. For example, the risks levels in loan applications have been subject to distribution shifts during the COVID-19 pandemic. This is because loan risks are based on factors associated to the applicants, such as employment status and income. Such factors are usually relatively stable, but have changed rapidly due to the economic impact of the pandemic. As a result, existing loan recommendation systems need to be adapted to limited examples. This project will develop open software to help users evaluate online fairness-in algorithms, mitigate potential biases, and examine utility-fairness trade-offs. It will implement two real-world applications: online crime event recognition from video data and online purchase behavior prediction from click-stream data. To amplify the impact of this project in research and education, this project will leverage STEM programs for students with diverse backgrounds, gender and race/ethnicity. This project includes activities including seminars, workshops, short courses, and research projects for students. This project aims to develop a new and innovative paradigm for designing, implementing, and evaluating online fairness-aware Deep Learning (DL) models. Such models would be used for classification tasks in noisy and non-stationary data streams. This project will focus on five areas. First, the project will explore how to ensure a variety of fairness principles are incorporated in a DL model in online and non-stationary settings. The project will also look at how to identify a neural network architecture that will reflect the causal structure and be adaptive to distribution shifts. The project also looks at how the DL model will learn global initialization of primal parameters (associated with model accuracy) and dual parameters (associated with model fairness). Finally, the project looks at how to make online learning algorithms robust to uncertainties in model estimation of fairness and how to, ultimately, interpret the fairness of an online DL model. By bridging the areas of neural architecture search, online meta-learning, and fairness-aware deep learning techniques, this project advances state-of-the-art research in Fairness in AI. This project will offer the following innovations: (1) disentangle underlying sensitive and non-sensitive causal variables from raw features via causal representation learning; (2) identify adaptive architectures for data streams via differential architecture search; (3) learn effective initializations for both primal and dual model parameters in an online-within-online manner; (4) develop robust versions of the algorithms to deal with uncertainties in model fairness and tasks, and (5) identify the training examples and latent causal variables responsible for model adaption using local and global interpretations.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.