CAREER: Towards Methodologies and Tools for Conducting Algorithm Audits
CAREER: Towards Methodologies and Tools for Conducting Algorithm Audits
批准号:
1553088
负责人:
Christopher Wilson
金额:
$53.51万
依托单位:
依托单位国家:
美国
项目类别:
Continuing Grant
财政年份:
2016
资助国家:
美国
项目状态:
已结题
起止时间:
2016-07-01 至 2022-06-30
中文摘要
该项目将开发进行算法审计的方法和工具。算法审计使用受控实验来检查算法系统,例如在线服务或大数据信息存档,并确定(1)它是如何工作的,以及(2)它是否可能造成伤害。有记录的算法危害的例子包括歧视、种族主义和不公平的贸易行为。尽管人们越来越意识到算法系统可能造成伤害,但在实践中实际检测这种伤害仍然是一个关键挑战。考虑到大多数算法都是专有的和不透明的,显然需要对这些系统进行黑箱分析的方法。许多监管机构和政府都对算法表示担忧,并希望提高这一领域的透明度和问责制。这项研究将开发方法来审计影响许多人的三个领域的算法:在线市场,招聘网站和金融服务。这三个领域的审计算法将需要解决基本的方法学挑战,例如如何分析具有大型未知特征集的系统,以及如何在没有真实数据的情况下估计特征值。为了应对这些广泛的挑战,研究将借鉴以往审计个性化算法的经验。此外,每个领域也带来了独特的挑战,将单独解决。例如,将构建新的审计工具,利用广泛的在线和离线历史。这些新工具将允许研究人员(包括金融服务公司)检查以前无法访问的系统。方法、开源代码和数据集将提供给其他学术研究人员和监管机构。 该项目包括两个综合教育目标:(1)创建一个关于大数据伦理的新的计算机科学课程,教授如何识别和减轻大数据技术的有害副作用,以及(2)制作基于网络的审计工具版本,这些工具旨在向公众提供信息,这将增加特定的,突出的算法系统的透明度,以及促进关于算法系统的扩散和影响的普通教育。
英文摘要
This project will develop methodologies and tools for conducting algorithm audits. An algorithm audit uses controlled experiments to examine an algorithmic system, such as an online service or big data information archive, and ascertain (1) how it functions, and (2) whether it may cause harm. Examples of documented harms by algorithms include discrimination, racism, and unfair trade practices. Although there is rising awareness of the potential for algorithmic systems to cause harm, actually detecting this harm in practice remains a key challenge. Given that most algorithms of concern are proprietary and non-transparent, there is a clear need for methods to conduct black-box analyses of these systems. Numerous regulators and governments have expressed concerns about algorithms, as well as a desire to increase transparency and accountability in this area.This research will develop methodologies to audit algorithms in three domains that impact many people: online markets, hiring websites, and financial services. Auditing algorithms in these three domains will require solving fundamental methodological challenges, such as how to analyze systems with large, unknown feature sets, and how to estimate feature values without ground-truth data. To address these broad challenges, the research will draw on insights from prior experience auditing personalization algorithms. Additionally, each domain also brings unique challenges that will be addressed individually. For example, novel auditing tools will be constructed that leverage extensive online and offline histories. These new tools will allow examination of systems that were previously inaccessible to researchers, including financial services companies. Methodologies, open-source code, and datasets will be made available to other academic researchers and regulators. This project includes two integrated educational objectives: (1) to create a new computer science course on big data ethics, teaching how to identify and mitigate harmful side-effects of big data technologies, and (2) production of web-based versions of the auditing tools that are designed to be accessible and informative to the general public, that will increase transparency around specific, prominent algorithmic systems, as well as promote general education about the proliferation and impact of algorithmic systems.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
CHS: Small: Auditing Critical Dependencies Between Online Media Platforms
-
批准号:1910064
-
项目类别:Standard Grant
-
资助金额:$49.98万
-
财政年份:2019
-
负责人:Christopher Wilson
-
依托单位:
Collaborative Research: Extending and Investigating the Impact of the High School Model-Based Educational Resource
-
批准号:1813538
-
项目类别:Continuing Grant
-
资助金额:$158.91万
-
财政年份:2018
-
负责人:Christopher Wilson
-
依托单位:
Collaborative Research: ArguLex--Applying Automated Analysis to a Learning Progression for Argumentation
-
批准号:1561150
-
项目类别:Standard Grant
-
资助金额:$57.94万
-
财政年份:2016
-
负责人:Christopher Wilson
-
依托单位:
Science Teachers Learning from Lesson Analysis (STeLLA): High School Biology
-
批准号:1503280
-
项目类别:Continuing Grant
-
资助金额:$299.82万
-
财政年份:2015
-
负责人:Christopher Wilson
-
依托单位:
Collaborative Research: PCK*Lex: Applying Computerized Lexical Analysis to Develop a Cost-Effective Measure of Science Teacher Pedagogical Content Knowledge
-
批准号:1437173
-
项目类别:Standard Grant
-
资助金额:$53.26万
-
财政年份:2014
-
负责人:Christopher Wilson
-
依托单位:
CHS: Medium: Towards Transparency of Personalization on the Web
-
批准号:1408345
-
项目类别:Standard Grant
-
资助金额:$72.71万
-
财政年份:2014
-
负责人:Christopher Wilson
-
依托单位:
SBIR Phase I: Mapping Driver Behavior: Toward an Active Safety Knowledge Base
-
批准号:1401259
-
项目类别:Standard Grant
-
资助金额:$15.0万
-
财政年份:2013
-
负责人:Christopher Wilson
-
依托单位:
The Red Queen and the bdelloid rotifers: how to keep up with co-evolving parasites in the long-term absence of sexual reproduction
-
批准号:NE/J01933X/1
-
项目类别:Fellowship
-
资助金额:$35.76万
-
财政年份:2013
-
负责人:Christopher Wilson
-
依托单位:
SBIR Phase I: Mapping Driver Behavior: Toward an Active Safety Knowledge Base
-
批准号:1315892
-
项目类别:Standard Grant
-
资助金额:$15.0万
-
财政年份:2013
-
负责人:Christopher Wilson
-
依托单位:
Videocases for Science Teaching Analysis Plus (ViSTA Plus): Efficacy of a Videocase-based, Analysis-of-Practice Teacher Preparation Program
-
批准号:1220635
-
项目类别:Continuing Grant
-
资助金额:$268.74万
-
财政年份:2012
-
负责人:Christopher Wilson
-
依托单位:
Science Teachers Learning from Lesson Analysis (STeLLA) Professional Development Program: Scaling for Effectiveness
-
批准号:0918277
-
项目类别:Continuing Grant
-
资助金额:$499.72万
-
财政年份:2009
-
负责人:Christopher Wilson
-
依托单位:
Consumer Protection Policy and Competition
-
批准号:ES/E001661/1
-
项目类别:Fellowship
-
资助金额:$19.4万
-
财政年份:2006
-
负责人:Christopher Wilson
-
依托单位:
Structural Properties of Parallel Complexity Classes
-
批准号:8810051
-
项目类别:Standard Grant
-
资助金额:$4.09万
-
财政年份:1988
-
负责人:Christopher Wilson
-
依托单位:
海外基金