Understanding Frontline Workers’ and Unhoused Individuals’ Perspectives on AI Used in Homeless Services
Understanding Frontline Workers’ and Unhoused Individuals’ Perspectives on AI Used in Homeless Services
复制标题
DOI：
10.1145/3544548.3580882
复制
发表时间：
2023-03
期刊：
影响因子：
--
通讯作者：
Tzu-Sheng Kuo;Hong Shen;Jisoo Geum;N. Jones;Jason I. Hong;Haiyi Zhu;Kenneth Holstein
中科院分区：
文献类型：
--
作者：
Tzu-Sheng Kuo;Hong Shen;Jisoo Geum;N. Jones;Jason I. Hong;Haiyi Zhu;Kenneth Holstein
近年来，无家可归者服务中越来越多地采用基于人工智能的决策支持系统（ADS），但我们对利益相关者的愿望和围绕其使用的担忧知之甚少。在这项工作中，我们的目标是了解受影响的利益相关者对优先考虑稀缺住房资源的ADS部署的看法。我们采用了AI生命周期漫画板，这是漫画板方法的改编版本，以在AI系统设计的各个组件中引发利益相关者的反馈和设计想法。我们从每天操作ADS的县工作人员、工作直接受ADS影响的服务提供商以及该地区无家可归的个人那里得到了反馈。我们的参与者围绕AI系统的总体目标、特定模型设计选择、数据集选择和部署使用分享了担忧和设计建议。我们的研究结果表明，即使没有人工智能知识，利益相关者也可以对人工智能系统的设计和部署提供具体和关键的反馈，如果他们有权这样做的话。
Recent years have seen growing adoption of AI-based decision-support systems (ADS) in homeless services, yet we know little about stakeholder desires and concerns surrounding their use. In this work, we aim to understand impacted stakeholders’ perspectives on a deployed ADS that prioritizes scarce housing resources. We employed AI lifecycle comicboarding, an adapted version of the comicboarding method, to elicit stakeholder feedback and design ideas across various components of an AI system’s design. We elicited feedback from county workers who operate the ADS daily, service providers whose work is directly impacted by the ADS, and unhoused individuals in the region. Our participants shared concerns and design suggestions around the AI system’s overall objective, specific model design choices, dataset selection, and use in deployment. Our findings demonstrate that stakeholders, even without AI knowledge, can provide specific and critical feedback on an AI system’s design and deployment, if empowered to do so.