Effect of Information Presentation on Fairness Perceptions of Machine Learning Predictors

Effect of Information Presentation on Fairness Perceptions of Machine Learning Predictors
复制标题

信息呈现对机器学习预测的公平性感知的影响

DOI:
--
复制
发表时间:
2021
期刊:
International Conference on Human Factors in Computing Systems
影响因子:
--
通讯作者:
M. Skov
M. Skov
中科院分区:
--
文献类型:
--
作者:
Niels van Berkel;Jorge Gonçalves;D. Russo;S. Hosio;M. Skov

文献摘要

参考文献

被引文献

相似文献

基于人工智能的应用程序的普及引发了人们对人工智能行为的公平性和透明度的担忧。因此,计算机科学界呼吁公众参与人工智能系统的设计和评估。评估个体预测者的公平性是开发公平算法的关键一步。在这项研究中,我们评估了两种常见的可视化技术(基于文本和散点图)和结果信息(即地面真相)的显示对预测者感知公平性的影响。我们的研究结果来自一项在线众包研究(N=80),结果表明,所选择的可视化技术显著改变了人们的公平感,并且呈现的情景以及参与者的性别和受教育程度影响了公平感。基于这些结果,我们为未来的工作提出了建议,寻求让非专家参与人工智能公平性评估。
The uptake of artificial intelligence-based applications raises concerns about the fairness and transparency of AI behaviour. Consequently, the Computer Science community calls for the involvement of the general public in the design and evaluation of AI systems. Assessing the fairness of individual predictors is an essential step in the development of equitable algorithms. In this study, we evaluate the effect of two common visualisation techniques (text-based and scatterplot) and the display of the outcome information (i.e., ground-truth) on the perceived fairness of predictors. Our results from an online crowdsourcing study (N = 80) show that the chosen visualisation technique significantly alters people’s fairness perception and that the presented scenario, as well as the participant’s gender and past education, influence perceived fairness. Based on these results we draw recommendations for future work that seeks to involve non-experts in AI fairness evaluations.
DOI: 10.1145/3415224
发表时间: 2020-10
影响因子: --
作者:
Hong Shen;Ángel Alexander Cabrera
通讯作者: Hong Shen;Ángel Alexander Cabrera
DOI: 10.1145/3313831.3376813
发表时间: 2020
期刊: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
影响因子: --
作者:
Wang, Ruotong;Harper, F. Maxwell;Zhu, Haiyi
通讯作者: Zhu, Haiyi
DOI: 10.1073/pnas.1900654116
发表时间: 2019-10-29
影响因子: 11.1
作者:
Murdoch, W. James;Singh, Chandan;Yu, Bin
通讯作者: Yu, Bin
让设计师了解情况:沟通跨多个目标的固有算法权衡
DOI: 10.1145/3357236.3395528
发表时间: 2020
期刊: Proceedings of the 2020 ACM Designing Interactive Systems Conference
影响因子: --
作者:
Yu, Bowen;Yuan, Ye;Terveen, Loren;Wu, Zhiwei Steven;Forlizzi, Jodi;Zhu, Haiyi
通讯作者: Zhu, Haiyi