S&AS:INT:COLLAB:Do the Right Thing: Competing Ethical Frameworks Mediated by Moral Emotions in Human-robot Interaction

道德决策是复杂的；特别是很难纳入自治系统。该项目专注于创建和测试机器人的体系结构，使系统在复杂情况下的决策过程中具有适应性和伦理道德。由于这些系统可能会被要求适应不断发展的规范和文化期望，因此发展一种结合了一系列哲学理论和观点的建筑至关重要。因此，当机器人被要求做出伦理选择时，他们的决定将受到多个伦理框架和模拟的道德情感状态的指导。该项目的发现可能会影响无数类型机器人的设计，包括机器人教师、迎宾员、治疗师和同伴。因此，这项研究有可能影响社会的大部分人，包括可能与未来机器人互动的弱势群体，如残疾个人。不同的底层计算体系结构将根据不同的伦理框架以多种方式扩展为推理；框架的选择和结果行动将取决于主体的道德情感状态。当竞争或合作的道德框架建议有相互冲突的选择时，道德情绪可以帮助指导决策。机器人对人类主体的道德情感状态进行建模，以选择一个伦理行动(从一组来自不同伦理框架的相互竞争的行动中)，以选择一个最符合人类期望、现有偏见和情景环境本身的行动。因此，研究人员将开发一种行动选择机制，该机制识别总体情况的道德情绪状态，并将其作为一种手段，在面临冲突的选择时选择适当的道德行动。具体地说，本研究将根据受骗对象--S的情绪状态(如羞耻、尴尬、内疚或移情)和特定的任务情境，来确定是否让机器人基于这些条件欺骗受试对象。本研究将根据受骗对象--S--的情绪状态和特定的任务情境，调查他骗(受骗于机器人)的适当性。计划编码伦理框架，如康德主义、功利主义和W·D-罗斯？S的道德义务，这些将作为机器人-S决策的基础。道德情感将帮助引导机器人选择哪种伦理框架应该在特定情况和涉及的个人中占据主导地位。该方法将在涉及实际伦理决策的两个主要场景中进行测试。首先，机器人与孩子玩游戏，扮演他人的角色--基于孩子感知到的情绪状态故意输掉比赛的欺骗。其次，机器人与正在执行药丸分类等任务的老年人互动，以及机器人是否应该寻求减少挫折感以促进训练，这可能会在安全方面做出权衡。一个关键目标是让机器人再现平均的人类伦理选择和/或反映伦理专家共识的选择(如果有)。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Ethical decision-making is complex; and it is especially difficult to incorporate into autonomous systems. This project is focused on creating and testing an architecture for a robot that allows the system to be adaptable and ethical in its decision-making in complex situations. Since these systems may be called upon to adapt to evolving norms and cultural expectations, the development of an architecture that incorporates a range of philosophical theories and perspectives is crucially important. The robot's decisions will therefore be guided by multiple ethical frameworks and a simulated moral emotional state when they are tasked with making an ethical choice. Findings from the project could influence the design of countless types of robots including robot teachers, greeters, therapists, and companions. Thus, this research has the potential to impact large sections of society, including vulnerable populations such as individuals with disabilities that may interact with future robots. The different underlying computational architectures will be expanded to reason in multiple ways according to different ethical frameworks; the selection of the framework and resulting action will depend upon the moral emotional state of the agent. Moral emotions can help to guide decision making when conflicting choices are available as recommended by competing or cooperating ethical frameworks. The robot models the human subject's moral emotional state to choose an ethical action (from a set of competing actions derived from different ethical frameworks) to select an action that best conforms to the human's expectations, existing biases, and the situational context itself. Thus, the researchers will develop an action selection mechanism that recognizes the moral emotional state of the overall situation, and use it as a means for selecting the appropriate ethical action to undertake in the face of conflicting choices. Specifically this research will investigate the appropriateness of the application of other-deception (deception intended to benefit the human being deceived by the robot) dependent upon the subject?s emotional state (e.g., shame, embarrassment, guilt, or empathy) and the specific task context to determine whether to have the robot deceive the subject or not based on these conditions.The plan is to encode ethical frameworks, such as Kantianism, Utilitarianism, and W.D. Ross?s moral duties, that will serve as a basis for a robot?s decision-making. Moral emotions will help guide the robot towards the selection of which ethical framework should take dominance for a particular situation and individuals involved. The approach will be tested in two main scenarios dealing with practical ethical decisions. First, a robot playing a game with a child and the role of other-deception for losing on purpose based on the perceived emotional state of the child. Second, a robot interacting with older adults who are performing tasks such as pill sorting and whether the robot should seek to reduce frustration to facilitate training with a potential trade-off on safety. A key goal is to have the robot reproduce an average human ethical choice and/or a choice that reflects the consensus of ethical experts where available.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.