S&AS: FND: Norm Processing for Autonomous Social Systems

随着智能系统继续变得更加自主，重要的是向这些系统灌输深深植根于人类认知和行为中的社会和道德规范类型。不遵守这些规范通常会引起人类的社会反应，从指责和斥责，在简单的情况下，一直到全面的法律后果。考虑到人类对彼此的基本社会期望，他们很可能也会将这些期望扩展并应用于人工代理人。因此，智能自治系统将需要被赋予确保其道德行为的计算机制。该项目将为符合规范的行为开发显式规范表示和规划算法，以解决以前方法的缺点，使得能够在随机世界中实现显式的、时间上复杂的规范表示，从而允许系统地处理规范冲突，以最大化主体在任何时刻可以遵守的规范。特别是，明确的规范规范将允许在未观察到的状态下进行泛化。此外，对于与人类交互的系统来说，做出透明的决策也很重要。为此，这种办法将能够在自治系统被迫违反某些规范的情况下产生理由，因为并非所有准则都能同时得到满足。开发的方法和算法将在具有预定义规范的全自主清洁机器人上进行演示，在不同的场景中，冲突的规范适用，机器人必须确定遵循哪些规范和暂停哪些规范。

As intelligent systems continue to become more autonomous, it is important to imbue such systems with the types of social and moral norms that are deeply ingrained in human cognition and behavior. Failing to abide by these norms typically causes social reactions from humans, from blame and reprimands, in simple cases, all the way to full-fledged legal consequences. Given the fundamental social expectations humans have of each other, it is very likely that they will extend and apply those to artificial agents as well. Hence, intelligent autonomous systems will need to be endowed with computational mechanisms that ensure their ethical behavior.This project will develop explicit norm representations and planning algorithms for norm-conforming behavior that will address shortcomings of previous approaches, enabling explicit, temporally complex norm representations in stochastic worlds that allow for systematic handling of norm conflicts in ways that maximize the norms an agent can obey at any moment in time. In particular, explicit norm specifications will allow for generalization across unobserved states. In addition, it is important for systems interacting with humans to make decisions that are transparent. To that end, the approach will enable the generation of justifications in cases where an autonomous system is forced to violate some norms because not all can be satisfied simultaneously. The approach and algorithms developed will be demonstrated on a fully autonomous cleaning robot with predefined norms in different scenarios, where conflicting norms are applicable and the robot must determine which norms to follow and which to suspend.