FactSheets: Increasing trust in AI services through supplier's declarations of conformity
FactSheets: Increasing trust in AI services through supplier's declarations of conformity
复制标题
DOI：
10.1147/jrd.2019.2942288
复制
发表时间：
2019-07-01
影响因子：
1.3
通讯作者：
Varshney, K. R.
中科院分区：
文献类型：
--
作者：
Arnold, M.;Bellamy, R. K. E.;Varshney, K. R.
准确性是人工智能（AI）服务供应商的一个重要关注点，但准确性之外的考虑因素，如安全性（包括公平性和可解释性）、安全性和来源，也是产生消费者对服务信任的关键因素。许多行业使用透明的、标准化的，但通常不是法律要求的文件，称为供应商的符合性声明（SDoCs），来描述产品的来源以及它所经历的安全和性能测试。sdc可以被认为是多维的情况说明书，它捕获和量化了产品及其开发的各个方面，以使其值得消费者的信任。在本文中，受这一实践的启发，我们提出了FactSheets来帮助增加对人工智能服务的信任。我们设想这些文件将包含由人工智能服务提供商完成的目的、性能、安全、保障和来源信息，以供消费者审查。我们建议在本文的附录中为AI量身定制一套全面的申报项目。
Accuracy is an important concern for suppliers of artificial intelligence (AI) services, but considerations beyond accuracy, such as safety (which includes fairness and explainability), security, and provenance, are also critical elements to engender consumers' trust in a service. Many industries use transparent, standardized, but often not legally required documents called supplier's declarations of conformity (SDoCs) to describe the lineage of a product along with the safety and performance testing it has undergone. SDoCs may be considered multidimensional fact sheets that capture and quantify various aspects of the product and its development to make it worthy of consumers' trust. In this article, inspired by this practice, we propose FactSheets to help increase trust in AI services. We envision such documents to contain purpose, performance, safety, security, and provenance information to be completed by AI service providers for examination by consumers. We suggest a comprehensive set of declaration items tailored to AI in the Appendix of this article.