EAGER: Causal Bayesian Network-Based Discrimination Discovery and Prevention

围绕收集和使用客户数据来做出就业、信贷和保险等重要决策，已经建立了各种商业模式。越来越多的人担心歧视，因为数据分析技术可能被用来根据个人的人口统计信息，如性别，年龄，婚姻状况，种族，宗教或信仰，少数民族成员，残疾或疾病，不公平地对待个人。必须开发预测性决策模型，这样进入模型的数据以及在模型帮助下做出的决策就不会受到歧视。EAGER的研究设计了实用的技术，以准确地检测和消除用于建立决策模型的数据集中的歧视。这项研究的主要成果是一个统一的框架和原型系统的歧视发现和消除。该系统可以帮助弱势群体的个人确定他们是否受到公平对待，并帮助组织的决策者确保他们的预测决策模型是无歧视的。现有的判别发现方法主要基于相关或关联，不能准确地发现真实的判别。此外，每一项条例草案都只针对一、两类歧视。本研究根据歧视是否跨越整个系统，发生在一个子系统中，或发生在一个人身上，以及歧视对决策的直接影响或间接影响来对歧视进行分类。然后，本研究开发了一个统一的因果贝叶斯网络为基础的框架，考虑到歧视和一般的因果关系和模型之间的区别直接歧视和间接歧视作为因果关系的影响，通过不同的路径之间的保护属性和决定。它可以准确地捕捉和衡量系统，群体和个人层面的各种类型的歧视。然后，该研究开发了新的歧视发现和预防模型和算法。该研究还建立了一个测试框架，用于模拟不同类型的歧视和评估基于各种度量的方法，并将歧视发现和预防算法集成到开源数据挖掘和机器学习软件系统中。

Various business models have been built around the collection and use of customer data to make important decisions like employment, credit, and insurance. There are increasing worries of discrimination as data analytics technologies could be used to unfairly treat individuals based on their demographic information such as gender, age, marital status, race, religion or belief, membership in a national minority, disability, or illness. It is imperative to develop predictive decision models, such that the data that goes into them and the decisions made with their assistance are not subject to discrimination. This EAGER research designs practical techniques to accurately detect and remove discrimination from the datasets used to build decision models. A primary outcome of this research is a unifying framework and a prototype system for discrimination discovery and removal. This system can help individuals from disadvantaged groups determine whether they are fairly treated and help decision makers from organizations ensure their predictive decision models are discrimination free. Existing discrimination discovery approaches are mainly based on correlation or association and cannot accurately discover the true discrimination. In addition, each of them targets on one or two types of discrimination only. This research categorizes discrimination based on whether discrimination is across the whole system, occurs in one subsystem, or happens to one individual, and whether discrimination is a direct effect or an indirect effect on the decision. This research then develops a unifying causal Bayesian network based framework that takes into consideration the distinctions between discrimination and general causalities and models both direct discrimination and indirect discrimination as causal effects via different paths between protected attributes and the decision. It can accurately capture and measure various types of discrimination at system, group, and individual levels. The research then develops novel discrimination discovery and prevention models and algorithms. The research also builds a testing framework for simulating different types of discrimination and evaluating the approaches based on various metrics, and integrates the discrimination discovery and prevention algorithms into an open source data mining and machine learning software system.