S&AS:INT:COLLAB:Do the Right Thing: Competing Ethical Frameworks Mediated by Moral Emotions in Human-robot Interaction

基本信息

批准号：
1848974
负责人：
Elizabeth DiSalvo
金额：
$ 50万
依托单位：
Georgia Tech Research Corporation
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2019
资助国家：
美国
起止时间：
2019-02-15 至 2024-01-31
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=1848974&HistoricalAwards=false
关键词：
S&amp INT COLLAB Do Right

项目摘要

Ethical decision-making is complex; and it is especially difficult to incorporate into autonomous systems. This project is focused on creating and testing an architecture for a robot that allows the system to be adaptable and ethical in its decision-making in complex situations. Since these systems may be called upon to adapt to evolving norms and cultural expectations, the development of an architecture that incorporates a range of philosophical theories and perspectives is crucially important. The robot's decisions will therefore be guided by multiple ethical frameworks and a simulated moral emotional state when they are tasked with making an ethical choice. Findings from the project could influence the design of countless types of robots including robot teachers, greeters, therapists, and companions. Thus, this research has the potential to impact large sections of society, including vulnerable populations such as individuals with disabilities that may interact with future robots. The different underlying computational architectures will be expanded to reason in multiple ways according to different ethical frameworks; the selection of the framework and resulting action will depend upon the moral emotional state of the agent. Moral emotions can help to guide decision making when conflicting choices are available as recommended by competing or cooperating ethical frameworks. The robot models the human subject's moral emotional state to choose an ethical action (from a set of competing actions derived from different ethical frameworks) to select an action that best conforms to the human's expectations, existing biases, and the situational context itself. Thus, the researchers will develop an action selection mechanism that recognizes the moral emotional state of the overall situation, and use it as a means for selecting the appropriate ethical action to undertake in the face of conflicting choices. Specifically this research will investigate the appropriateness of the application of other-deception (deception intended to benefit the human being deceived by the robot) dependent upon the subject?s emotional state (e.g., shame, embarrassment, guilt, or empathy) and the specific task context to determine whether to have the robot deceive the subject or not based on these conditions.The plan is to encode ethical frameworks, such as Kantianism, Utilitarianism, and W.D. Ross?s moral duties, that will serve as a basis for a robot?s decision-making. Moral emotions will help guide the robot towards the selection of which ethical framework should take dominance for a particular situation and individuals involved. The approach will be tested in two main scenarios dealing with practical ethical decisions. First, a robot playing a game with a child and the role of other-deception for losing on purpose based on the perceived emotional state of the child. Second, a robot interacting with older adults who are performing tasks such as pill sorting and whether the robot should seek to reduce frustration to facilitate training with a potential trade-off on safety. A key goal is to have the robot reproduce an average human ethical choice and/or a choice that reflects the consensus of ethical experts where available.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

道德决策很复杂；并且很难纳入自主系统。该项目的重点是创建和测试机器人的体系结构，该机器人使系统在复杂情况下的决策中具有适应性和道德。由于可以要求这些系统适应不断发展的规范和文化期望，因此结合各种哲学理论和观点的建筑的发展至关重要。因此，机器人的决定将由多个道德框架和模拟的道德情绪状态指导，而他们的任务是做出道德选择的任务。该项目的发现可能会影响无数类型机器人的设计，包括机器人老师，问候者，治疗师和同伴。因此，这项研究有可能影响社会的大部分地区，包括弱势群体，例如可能与未来机器人相互作用的残疾人。根据不同的道德框架，将通过多种方式扩展不同的基础计算体系结构。框架和最终行动的选择将取决于代理人的道德情绪状态。当通过竞争或合作的道德框架提供相互冲突的选择时，道德情绪可以帮助指导决策。机器人对人类受试者的道德情感状态进行了建模，以选择一种道德行动（从不同的道德框架衍生出的一系列竞争行动），以选择一种最能符合人类期望，现有偏见和情境环境本身的行动。因此，研究人员将开发一种行动选择机制，以认识到整个情况的道德情绪状态，并将其用作选择适当的道德行动的手段，以面对矛盾的选择。具体而言，这项研究将调查其他欺骗的适当性（旨在使人受到机器人所欺骗的人的欺骗）依赖于主题的情感状态（例如，羞耻，羞耻，尴尬，内gui或同情）和特定的任务上下文，以确定机器人是否基于这些条件，并且是基于这些条件的特定任务上下文。 W.D. Ross的道德职责，这将成为机器人决策的基础。道德情绪将有助于指导机器人选择道德框架应在特定情况和所涉及的个人中占主导地位的选择。该方法将在涉及实际道德决策的两种主要情况下进行测试。首先，一个机器人与孩子一起玩游戏，以及基于孩子的情绪状态而在目的中失去其他欺骗的角色。其次，一个机器人与正在执行诸如药丸分类之类的任务的老年人互动，以及机器人是否应该寻求减少挫败感，以促进培训，并在安全方面进行权衡。一个关键的目标是让机器人重现一个普通的人类道德选择和/或选择，该选择反映了可用的道德专家的共识。该奖项反映了NSF的法定任务，并被认为是值得通过基金会的智力优点和更广泛影响的审查标准通过评估来支持的。

项目成果

期刊论文数量（9）

专著数量（0）

科研奖励数量（0）

会议论文数量（0）

专利数量（0）

Metaethical Reflection: The Ethics of Embedding Ethics into Robots

元伦理反思：将伦理嵌入机器人的伦理

DOI：
发表时间：
2022
期刊：
2022 IEEE International Conference on Advanced Robotics and its Social Impacts
影响因子：
0
作者：
Borenstein, J;Arkin, R.C.;Wagner, A.
通讯作者：
Wagner, A.

Case-based Robotic Architecture with Multiple Underlying Ethical Frameworks for Human-Robot Interaction

基于案例的机器人架构，具有用于人机交互的多个底层道德框架

DOI：
发表时间：
2022
期刊：
7th International Conference on Robot Ethics and Standards
影响因子：
0
作者：
Chen, S.;Arkin, R.;Borenstein, J.;Wagner, A.
通讯作者：
Wagner, A.

Competing Ethical Frameworks Mediated by Moral Emotions in HRI: Motivations, Background, and Approach

HRI 中道德情感介导的竞争性道德框架：动机、背景和方法

DOI：
发表时间：
2019
期刊：
Proc. 2019 International Conference on Robot Ethics and Standards
影响因子：
0
作者：
Arkin, R.C.;Borenstein, J.;Wagner, A.
通讯作者：
Wagner, A.

From HHI to HRI: Which Facets of Ethical Decision-Making Should Inform a Robot?

从 HHI 到 HRI：机器人应了解道德决策的哪些方面？

DOI：
发表时间：
2023
期刊：
International Conference on Computer Ethics: Philosophical Enquiry 2023 (CEPE 2023
影响因子：
0
作者：
Borenstein, J.;Melo Cruz, A.;Wagner, A.;Arkin, R.C.
通讯作者：
Arkin, R.C.

Informing a Robot Ethics Architecture through Folk and Expert Morality

通过民间和专家道德塑造机器人伦理架构