Collaborative Research: RI: Small: Modeling and Learning Ethical Principles for Embedding into Group Decision Support Systems

日常生活中的许多场景都需要结合群体中个人的主观偏好来做出决策，例如去哪里吃饭，去哪里度假，雇用谁，资助哪些想法，或者采取什么路线。在许多领域，这些主观偏好与道德价值观、伦理原则或适用于决策场景的商业约束相结合，并且通常优先于偏好。 当人工智能系统向我们推荐产品时，以及当我们使用人工智能系统进行群体决策时，都能敏锐地感受到道德价值观与主观偏好之间的潜在冲突。 这项研究旨在通过提供机制来约束人工智能系统可以做出的决策，确保群体决策过程的结果与人类价值观保持一致，从而使人工智能更加负责任。 为了实现构建道德约束的、支持人工智能的群体决策系统的目标，该项目从人类那里获得灵感，人类经常根据来自道德、伦理或商业价值观的一些外部优先事项来约束他们的决策和行动。 该研究项目将通过推进人工智能代理的安全性和鲁棒性方面的最新技术水平，解决目前缺乏将道德嵌入人工智能代理和人工智能支持的群体决策支持系统的原则性，正式方法的问题，鉴于人工智能广泛触及我们的日常生活，这将对社会产生广泛的影响和益处。具体而言，该项目的长期目标是建立数学和机器学习基础，以便将道德准则嵌入人工智能中，用于群体决策系统。 在机器伦理领域，有两种主要的方法：自下而上的方法，专注于数据驱动的机器学习技术，以及自上而下的方法，遵循基于符号和逻辑的形式主义。该项目通过三个具体目标使这两种方法更加接近。(1)建模和评估伦理原则：本项目将扩展社会选择理论和公平分工的原则，使用知识表示和偏好推理文献中的偏好模型。(2)从数据中学习道德原则：该项目将开发新的机器学习框架，以学习个人道德原则，然后将其汇总用于群体决策系统。最后，（3）将伦理原则嵌入群体决策支持系统：该项目将开发新的框架，用于设计基于AI的伦理群体决策机制。 这项研究将建立新的方法，正式和实验统一的方面，自上而下或基于规则的方法与自下而上或基于数据的方法嵌入到群体决策系统的道德。 该项目还将正式制定一个框架，用于跨计算代理团队的道德和约束推理。该奖项反映了NSF的法定使命，并被认为值得通过使用基金会的智力价值和更广泛的影响审查标准进行评估来支持。

Many settings in everyday life require making decisions by combining the subjective preferences of individuals in a group, such as where to go to eat, where to go on vacation, whom to hire, which ideas to fund, or what route to take. In many domains, these subjective preferences are combined with moral values, ethical principles, or business constraints that are applicable to the decision scenario and are often prioritized over the preferences. The potential conflict of moral values with subjective preferences are keenly felt both when AI systems recommend products to us and when we use AI enabled systems to make group decisions. This research seeks to make AI more accountable by providing mechanisms to bound the decisions that AI systems can make, ensuring that the outcomes of the group decision making process aligns with human values. To achieve the goal of building ethically-bounded, AI-enabled group decision making systems, this project takes inspiration from humans, who often constrain their decisions and actions according to a number of exogenous priorities coming from moral, ethical, or business values. This research project will address the current lack of principled, formal approaches for embedding ethics into AI agents and AI enabled group decision support systems by advancing the state of the art in the safety and robustness of AI agents which, given how broadly AI touches our daily lives, will have broad impact and benefit to society.Specifically, the long-term goal of this project is to establish mathematical and machine learning foundations for embedding ethical guidelines into AI for group decision-making systems. Within the machine ethics field there are two main approaches: the bottom-up approach focused on data-driven machine learning techniques and the top-down approach following symbolic and logic-based formalisms. This project brings these two methodologies closer together through three specific aims. (1) Modeling and Evaluating Ethical Principles: this project will extend principles in social choice theory and fair division using preference models from the literature on knowledge representation and preference reasoning. (2) Learning Ethical Principles From Data: this project will develop novel machine-learning frameworks to learn individual ethical principles and then aggregate them for use in group decision making systems. And finally, (3) Embedding Ethical Principles into Group Decision Support Systems: this project will develop novel frameworks for designing AI-based mechanisms for ethical group decision-making. This research will establish novel methods for the formal and experimental unification of aspects of the top-down or rule-based approach with the bottoms-up or data-based approach for embedding ethics into group decision making systems. The project will also formalize a framework for ethical and constrained reasoning across teams of computational agents.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.