RI: Small: Towards a Formal Theory of Blameworthiness, Intention, and Moral Responsibility

RI：小：走向应受谴责、意图和道德责任的正式理论

• 批准号: 1718108
• 负责人: Joseph Halpern
• 金额: $ 42.7万
• 依托单位: Cornell University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-08-01 至 2021-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1718108&HistoricalAwards=false
• 关键词: RI; Small; Towards; Formal; Theory

As we move to an era of self-driving cars, autonomous drones, and robots helping people in work and everyday tasks, there is an increasing need to develop a theory of moral or ethical behavior. Policy-makers are already grappling with some of the issues. Jurisdictions around the world are beginning to formulate highway codes that take into consideration the presence of driverless cars. The goal of this project is to provide the foundations for a theory of blameworthiness, intention, and moral responsibility for such agents and applications. The study will evaluate this theory against the moral judgments that people make, and take the first steps to applying resulting policies in practice. A good theory will have to take into consideration tradeoffs among many competing and sometimes conflicting goals. This suggests that probability and utility will be involved. The theory will also have to deal with counterfactuals--that is, reasoning about what would have happened had circumstances or actions differed. Issues of causality will reveal whether an agent's action was responsible for an outcome, or if the action was coincidental to the outcome. Yet another relevant issue is determining intent: that is, determining whether an agent intended an outcome when performing an act. Pearl's structural-equations framework can model counterfactuals (interventions) and has been used as the basis of a definition of causality. In this project, the framework will be extended to capture degree of blameworthiness and intention. These definitions are given relative to an agent's epistemic state, which describes the agent's beliefs and preferences. Initially, the beliefs will be specified by a probability measure and the preferences by a utility function. The framework will then be extended to consider more qualitative representations of beliefs and preferences, to take into account issues of normality and typicality (e.g., to capture societal conventions), and to settings with multiple agents (e.g., multiple communicating driverless cars or robots), where game-theoretic concerns and issues of group responsibility vs. individual responsibility arise. The definitions developed under this framework will be tested to see if they capture people's intuitions about these issues, and will be applied to situations of practical interest. The theory will then be refined to take into account the outcomes of these experiments.

随着我们进入自动驾驶汽车、自动无人机和机器人帮助人们完成工作和日常任务的时代，越来越需要发展道德或伦理行为理论。 政策制定者已经在努力解决一些问题。 世界各地的司法管辖区开始制定高速公路法规，考虑到无人驾驶汽车的存在。 该项目的目标是为此类代理和应用程序的可责性、意图和道德责任理论提供基础。 该研究将根据人们做出的道德判断来评估这一理论，并迈出将由此产生的政策应用于实践的第一步。 一个好的理论必须考虑许多相互竞争、有时甚至是冲突的目标之间的权衡。 这表明将涉及概率和效用。 该理论还必须处理反事实，即推理如果情况或行为不同会发生什么。 因果关系问题将揭示主体的行为是否对结果负责，或者该行为是否与结果同时发生。 另一个相关问题是确定意图：即确定代理人在执行某项行为时是否有意获得某个结果。 Pearl 的结构方程框架可以模拟反事实（干预），并已被用作因果关系定义的基础。 在这个项目中，该框架将扩展以捕获可责性和意图的程度。 这些定义是相对于代理人的认知状态给出的，它描述了代理人的信念和偏好。 最初，信念将由概率度量指定，偏好由效用函数指定。 然后，该框架将扩展到考虑信仰和偏好的更多定性表示，考虑常态和典型性问题（例如，捕捉社会惯例），以及具有多个代理的设置（例如，多个通信无人驾驶汽车或机器人），其中出现博弈论问题以及群体责任与个人责任的问题。 在此框架下制定的定义将进行测试，看看它们是否抓住了人们对这些问题的直觉，并将应用于实际感兴趣的情况。 然后，该理论将被完善以考虑这些实验的结果。

项目成果

Reasoning about causal models with infinitely many variables,

推理具有无限多个变量的因果模型，

• 发表时间: 2022
• 期刊: Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence
• 作者: S. Peters;J. Y. Halpern
• 通讯作者: J. Y. Halpern

Book review

书评

• DOI: 10.1016/j.artint.2019.103175
• 发表时间: 2019
• 期刊: Artificial Intelligence
• 影响因子: 14.4
• 作者: Halpern, Joseph Y.

A NOTE ON THE EXISTENCE OF RATIFIABLE ACTS

关于可批准法案的存在的说明

• DOI: 10.1017/s175502031800028x
• 发表时间: 2019
• 期刊: The Review of Symbolic Logic
• 作者: HALPERN, JOSEPH Y.

The evolution of cognitive mechanisms in response to cultural innovations

• DOI: 10.1073/pnas.1620742114
• 发表时间: 2017-07-25
• 期刊: PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
• 影响因子: 11.1
• 作者: Lotem, Arnon;Halpern, Joseph Y.;Kolodny, Oren
• 通讯作者: Kolodny, Oren

Blameworthiness in multi-agent settings

多代理设置中的应责性

• 发表时间: 2019
• 期刊: Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence
• 作者: Friedenberg, Meir;Halpern, Joseph Y.
• 通讯作者: Halpern, Joseph Y.