S&AS: INT: COLLAB: Do the Right Thing: Competing Ethical Frameworks Mediated by Moral Emotions in Human Robot Interaction

道德决策是复杂的，尤其难以纳入自治系统。该项目的重点是创建和测试机器人的架构，使系统在复杂情况下的决策具有适应性和道德性。由于这些系统可能需要适应不断变化的规范和文化期望，因此开发一个包含一系列哲学理论和观点的架构至关重要。因此，当机器人被要求做出道德选择时，它们的决定将受到多个道德框架和模拟道德情感状态的指导。该项目的发现可能会影响无数类型机器人的设计，包括机器人教师，迎宾员，治疗师和同伴。因此，这项研究有可能影响社会的大部分，包括弱势群体，如可能与未来机器人互动的残疾人。 根据不同的伦理框架，不同的底层计算架构将被扩展为以多种方式进行推理;框架的选择和由此产生的行动将取决于主体的道德情感状态。当竞争或合作道德框架建议存在相互冲突的选择时，道德情感可以帮助指导决策。 机器人模拟人类主体的道德情感状态，以选择一个道德行为（从一组来自不同道德框架的竞争行为中），以选择最符合人类期望、现有偏见和情境背景本身的行为。因此，研究人员将开发一种行为选择机制，该机制认识到整体情况的道德情感状态，并将其用作在面临冲突选择时选择适当道德行为的手段。具体而言，本研究将调查适用于其他欺骗（欺骗旨在造福人类被欺骗的机器人）取决于主题的适当性？的情绪状态（例如，羞耻、尴尬、内疚或同理心）和特定的任务情境，以根据这些条件决定是否让机器人欺骗受试者。该计划是编码伦理框架，如康德主义、功利主义和W.D.罗斯？的道德义务，这将作为一个机器人的基础？的决策。 道德情感将有助于引导机器人选择哪种道德框架应该在特定情况和所涉及的个人中占据主导地位。 将在两个涉及实际道德操守决定的主要情景中对这一方法进行测试。 首先，一个机器人玩游戏的孩子和其他的作用，欺骗失去的目的的基础上感知的情绪状态的儿童。 第二，机器人与正在执行药丸分类等任务的老年人进行交互，以及机器人是否应该寻求减少挫折感，以促进训练，并在安全性上进行潜在的权衡。 一个关键的目标是让机器人重现一个平均的人类道德选择和/或一个反映道德专家共识的选择。这个奖项反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

Ethical decision-making is complex; and it is especially difficult to incorporate into autonomous systems. This project is focused on creating and testing an architecture for a robot that allows the system to be adaptable and ethical in its decision-making in complex situations. Since these systems may be called upon to adapt to evolving norms and cultural expectations, the development of an architecture that incorporates a range of philosophical theories and perspectives is crucially important. The robot's decisions will therefore be guided by multiple ethical frameworks and a simulated moral emotional state when they are tasked with making an ethical choice. Findings from the project could influence the design of countless types of robots including robot teachers, greeters, therapists, and companions. Thus, this research has the potential to impact large sections of society, including vulnerable populations such as individuals with disabilities that may interact with future robots. The different underlying computational architectures will be expanded to reason in multiple ways according to different ethical frameworks; the selection of the framework and resulting action will depend upon the moral emotional state of the agent. Moral emotions can help to guide decision making when conflicting choices are available as recommended by competing or cooperating ethical frameworks. The robot models the human subject's moral emotional state to choose an ethical action (from a set of competing actions derived from different ethical frameworks) to select an action that best conforms to the human's expectations, existing biases, and the situational context itself. Thus, the researchers will develop an action selection mechanism that recognizes the moral emotional state of the overall situation, and use it as a means for selecting the appropriate ethical action to undertake in the face of conflicting choices. Specifically this research will investigate the appropriateness of the application of other-deception (deception intended to benefit the human being deceived by the robot) dependent upon the subject?s emotional state (e.g., shame, embarrassment, guilt, or empathy) and the specific task context to determine whether to have the robot deceive the subject or not based on these conditions.The plan is to encode ethical frameworks, such as Kantianism, Utilitarianism, and W.D. Ross?s moral duties, that will serve as a basis for a robot?s decision-making. Moral emotions will help guide the robot towards the selection of which ethical framework should take dominance for a particular situation and individuals involved. The approach will be tested in two main scenarios dealing with practical ethical decisions. First, a robot playing a game with a child and the role of other-deception for losing on purpose based on the perceived emotional state of the child. Second, a robot interacting with older adults who are performing tasks such as pill sorting and whether the robot should seek to reduce frustration to facilitate training with a potential trade-off on safety. A key goal is to have the robot reproduce an average human ethical choice and/or a choice that reflects the consensus of ethical experts where available.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.