S&AS: FND: Norm Processing for Autonomous Social Systems

随着智能系统继续变得更加自主，重要的是向这些系统灌输在人类认知和行为中根深蒂固的社会和道德规范。不遵守这些规范通常会引起人类的社会反应，从简单的指责和谴责，一直到全面的法律后果。考虑到人类对彼此的基本社会期望，他们很可能也会将这些期望扩展并应用于人工代理。因此，智能自治系统需要被赋予计算机制，以确保其道德行为。该项目将开发明确的规范表示和规范符合行为的规划算法，以解决以前方法的缺点，在随机世界中实现明确的、暂时复杂的规范表示，允许系统地处理规范冲突，以最大化代理在任何时刻都能遵守的规范。特别是，显式规范规范将允许在未观察到的状态之间进行泛化。此外，与人类交互的系统做出透明的决策也很重要。为此目的，在自治系统因为不能同时满足所有规范而被迫违反某些规范的情况下，这种方法将能够产生理由。开发的方法和算法将在一个完全自主的清洁机器人上进行演示，该机器人在不同的场景中具有预定义的规范，其中冲突的规范适用，机器人必须确定遵循哪些规范，暂停哪些规范。

As intelligent systems continue to become more autonomous, it is important to imbue such systems with the types of social and moral norms that are deeply ingrained in human cognition and behavior. Failing to abide by these norms typically causes social reactions from humans, from blame and reprimands, in simple cases, all the way to full-fledged legal consequences. Given the fundamental social expectations humans have of each other, it is very likely that they will extend and apply those to artificial agents as well. Hence, intelligent autonomous systems will need to be endowed with computational mechanisms that ensure their ethical behavior.This project will develop explicit norm representations and planning algorithms for norm-conforming behavior that will address shortcomings of previous approaches, enabling explicit, temporally complex norm representations in stochastic worlds that allow for systematic handling of norm conflicts in ways that maximize the norms an agent can obey at any moment in time. In particular, explicit norm specifications will allow for generalization across unobserved states. In addition, it is important for systems interacting with humans to make decisions that are transparent. To that end, the approach will enable the generation of justifications in cases where an autonomous system is forced to violate some norms because not all can be satisfied simultaneously. The approach and algorithms developed will be demonstrated on a fully autonomous cleaning robot with predefined norms in different scenarios, where conflicting norms are applicable and the robot must determine which norms to follow and which to suspend.