CAREER: Towards Methodologies and Tools for Conducting Algorithm Audits

职业：研究进行算法审计的方法和工具

• 批准号: 1553088
• 负责人: Christopher Wilson
• 金额: $ 53.51万
• 依托单位: Northeastern University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-07-01 至 2022-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1553088&HistoricalAwards=false
• 关键词: CAREER; Towards; Methodologies; Tools; Conducting

This project will develop methodologies and tools for conducting algorithm audits. An algorithm audit uses controlled experiments to examine an algorithmic system, such as an online service or big data information archive, and ascertain (1) how it functions, and (2) whether it may cause harm. Examples of documented harms by algorithms include discrimination, racism, and unfair trade practices. Although there is rising awareness of the potential for algorithmic systems to cause harm, actually detecting this harm in practice remains a key challenge. Given that most algorithms of concern are proprietary and non-transparent, there is a clear need for methods to conduct black-box analyses of these systems. Numerous regulators and governments have expressed concerns about algorithms, as well as a desire to increase transparency and accountability in this area.This research will develop methodologies to audit algorithms in three domains that impact many people: online markets, hiring websites, and financial services. Auditing algorithms in these three domains will require solving fundamental methodological challenges, such as how to analyze systems with large, unknown feature sets, and how to estimate feature values without ground-truth data. To address these broad challenges, the research will draw on insights from prior experience auditing personalization algorithms. Additionally, each domain also brings unique challenges that will be addressed individually. For example, novel auditing tools will be constructed that leverage extensive online and offline histories. These new tools will allow examination of systems that were previously inaccessible to researchers, including financial services companies. Methodologies, open-source code, and datasets will be made available to other academic researchers and regulators. This project includes two integrated educational objectives: (1) to create a new computer science course on big data ethics, teaching how to identify and mitigate harmful side-effects of big data technologies, and (2) production of web-based versions of the auditing tools that are designed to be accessible and informative to the general public, that will increase transparency around specific, prominent algorithmic systems, as well as promote general education about the proliferation and impact of algorithmic systems.

该项目将开发进行算法审计的方法和工具。算法审计使用受控实验来检查算法系统，例如在线服务或大数据信息存档，并确定（1）它是如何工作的，以及（2）它是否可能造成伤害。有记录的算法危害的例子包括歧视、种族主义和不公平的贸易行为。尽管人们越来越意识到算法系统可能造成伤害，但在实践中实际检测这种伤害仍然是一个关键挑战。考虑到大多数算法都是专有的和不透明的，显然需要对这些系统进行黑箱分析的方法。许多监管机构和政府都对算法表示担忧，并希望提高这一领域的透明度和问责制。这项研究将开发方法来审计影响许多人的三个领域的算法：在线市场，招聘网站和金融服务。这三个领域的审计算法将需要解决基本的方法学挑战，例如如何分析具有大型未知特征集的系统，以及如何在没有真实数据的情况下估计特征值。为了应对这些广泛的挑战，研究将借鉴以往审计个性化算法的经验。此外，每个领域也带来了独特的挑战，将单独解决。例如，将构建新的审计工具，利用广泛的在线和离线历史。这些新工具将允许研究人员（包括金融服务公司）检查以前无法访问的系统。方法、开源代码和数据集将提供给其他学术研究人员和监管机构。 该项目包括两个综合教育目标：（1）创建一个关于大数据伦理的新的计算机科学课程，教授如何识别和减轻大数据技术的有害副作用，以及（2）制作基于网络的审计工具版本，这些工具旨在向公众提供信息，这将增加特定的，突出的算法系统的透明度，以及促进关于算法系统的扩散和影响的普通教育。