Governing AI safety through independent audits
Governing AI safety through independent audits
复制标题
DOI：
10.1038/s42256-021-00370-7
复制
发表时间：
2021-07-01
影响因子：
23.8
通讯作者：
Yeong, Zee Kin
中科院分区：
文献类型：
--
作者：
Falco, Gregory;Shneiderman, Ben;Yeong, Zee Kin
高度自动化的系统正变得无所不在。它们的功能范围从自动驾驶汽车到先进的医疗诊断，并提供许多好处。然而，在备受瞩目的坠机和事故中，保证方面的挑战越来越明显。这些系统的治理对于获得广泛的公众信任至关重要。以前已经提出了治理原则，为自动化系统开发人员提供了理想的指导;然而，考虑到制定和执行原则所需的过高成本和流程，它们的实现通常是不切实际的。这一观点是由一个跨政府组织、行业和学术界的国际多学科团队撰写的，它提出了一种机制，以推动高度自动化系统的广泛保证：独立审计。根据提议，人工智能系统的独立审计将体现三个“AAA”治理原则，即前瞻性风险评估、操作审计跟踪和系统遵守司法要求。人工智能系统的独立审计是应对繁重且无法执行的保证挑战的务实方法。随着高度自动化的系统在社会中变得普遍，需要可执行的治理原则来确保安全部署。该观点提出了一种务实的方法，其中人工智能系统的独立审计是核心。该框架将体现三个AAA治理原则：前瞻性风险评估、操作审计跟踪和系统遵守管辖要求。
Highly automated systems are becoming omnipresent. They range in function from self-driving vehicles to advanced medical diagnostics and afford many benefits. However, there are assurance challenges that have become increasingly visible in high-profile crashes and incidents. Governance of such systems is critical to garner widespread public trust. Governance principles have been previously proposed offering aspirational guidance to automated system developers; however, their implementation is often impractical given the excessive costs and processes required to enact and then enforce the principles. This Perspective, authored by an international and multidisciplinary team across government organizations, industry and academia, proposes a mechanism to drive widespread assurance of highly automated systems: independent audit. As proposed, independent audit of AI systems would embody three 'AAA' governance principles of prospective risk Assessments, operation Audit trails and system Adherence to jurisdictional requirements. Independent audit of AI systems serves as a pragmatic approach to an otherwise burdensome and unenforceable assurance challenge.As highly automated systems become pervasive in society, enforceable governance principles are needed to ensure safe deployment. This Perspective proposes a pragmatic approach where independent audit of AI systems is central. The framework would embody three AAA governance principles: prospective risk Assessments, operation Audit trails and system Adherence to jurisdictional requirements.