CHS: Small: DeepCrowd: A Crowd-assisted Deep Learning-based Disaster Scene Assessment System with Active Human-AI Interactions

CHS：小型：DeepCrowd：一种基于人群辅助、基于深度学习的灾难场景评估系统，具有主动人机交互功能

• 批准号: 2008228
• 负责人: Dong Wang
• 金额: $ 49.98万
• 依托单位: University of Notre Dame
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-01-01 至 2021-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2008228&HistoricalAwards=false
• 关键词: CHS; Small; DeepCrowd; Crowd; assisted

Recent advances in artificial intelligence (AI) have transformed many important domains of modern life such as transportation, finance, education, healthcare, and entertainment. This project addresses application of AI to disaster scene assessment (DSA). For DSA, artificial intelligence can be used to automatically identify damage severity of impacted areas from imagery reports in the aftermath of a disaster such as earthquake, hurricane, or landslides. A key limitation of AI based techniques is the black-box nature of many contemporary models and the consequent lack of interpretability of the results and failures. This project investigates the problem of troubleshooting, tuning, and eventually improving the black-box AI algorithms by integrating human intelligence with machine intelligence through active crowd-AI interactions. The work complements the prevailing AI solutions that primarily focus on AI model design and training sample collection. The results from this project will open up unprecedented opportunities of fully exploring the wisdom from the crowd in various crowd-assisted AI application domains. This project will also provide opportunities for students in STEM and from underrepresented groups to study the interaction between AI and humans. This project develops a DeepCrowd framework that can be used to guide the design, development, and implementation of future crowd-AI applications where the human intelligence obtained from the crowd is tightly integrated with AI deep learning models to significantly improve the system performance over the AI-only or human-only solutions. The project addresses the black-box challenges of AI and the crowdsourcing platform in DeepCrowd using an interdisciplinary approach inspired by techniques from AI, machine learning, estimation theory, and cyber-human interactions. In particular, the research includes i) developing a crowd task generation scheme to effectively query the crowdsourcing platform for feedback; ii) creating a novel adaptive mechanism to incentivize the crowd for timely and accurate response; iii) designing an interactive attention neural network scheme that enables direct interaction between crowd and AI models; and iv) developing a crowd and AI integration engine that effectively incorporates feedback from crowd to alleviate failure scenarios of AI. The resulting DeepCrowd framework is transformative in that it will produce a set of new crowd-AI interaction models and techniques to build novel crowd-assisted AI applications with boosted system performance.This project develops a DeepCrowd framework that can be used to guide the design, development, and implementation of future crowd-AI applications where the human intelligence obtained from the crowd is tightly integrated with AI deep learning models to significantly improve the system performance over the AI-only or human-only solutions. The project addresses the black-box challenges of AI and the crowdsourcing platform in DeepCrowd using an interdisciplinary approach inspired by techniques from AI, machine learning, estimation theory, and cyber-human interactions. In particular, the research includes i) developing a crowd task generation scheme to effectively query the crowdsourcing platform for feedback; ii) creating a novel adaptive mechanism to incentivize the crowd for timely and accurate response; iii) designing an interactive attention neural network scheme that enables direct interaction between crowd and AI models; and iv) developing a crowd and AI integration engine that effectively incorporates feedback from crowd to alleviate failure scenarios of AI. The resulting DeepCrowd framework is transformative in that it will produce a set of new crowd-AI interaction models and techniques to build novel crowd-assisted AI applications with boosted system performance.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

人工智能（AI）的最新进展已经改变了现代生活的许多重要领域，如交通，金融，教育，医疗保健和娱乐。本项目旨在将人工智能应用于灾害现场评估（DSA）。对于DSA，人工智能可用于在地震、飓风或山体滑坡等灾害发生后从图像报告中自动识别受影响地区的损坏严重程度。 基于人工智能的技术的一个关键限制是许多当代模型的黑箱性质以及结果和失败的可解释性。该项目通过主动的人群-AI交互将人类智能与机器智能相结合，研究故障排除、调整并最终改进黑盒AI算法的问题。这项工作补充了主要专注于AI模型设计和训练样本收集的主流AI解决方案。该项目的成果将为在各种人群辅助人工智能应用领域充分挖掘人群智慧提供前所未有的机会。该项目还将为STEM学生和代表性不足的群体提供机会，研究人工智能与人类之间的互动。该项目开发了一个DeepCrowd框架，可用于指导未来人群AI应用程序的设计，开发和实施，其中从人群中获得的人类智能与AI深度学习模型紧密集成，以显着提高系统性能。该项目解决了人工智能和DeepCrowd中众包平台的黑箱挑战，采用跨学科方法，灵感来自人工智能，机器学习，估计理论和网络人类交互技术。具体而言，该研究包括i）开发一种群体任务生成方案，以有效地查询众包平台以获得反馈; ii）创建一种新颖的自适应机制，以激励群体及时准确地响应; iii）设计一种交互式注意力神经网络方案，使群体和AI模型之间能够直接交互;以及iv）开发一个人群和AI集成引擎，该引擎有效地结合了来自人群的反馈，以减轻AI的失败场景。由此产生的DeepCrowd框架是变革性的，因为它将产生一套新的人群-AI交互模型和技术，以构建具有提升系统性能的新颖人群辅助AI应用程序。该项目开发了一个DeepCrowd框架，可用于指导设计，开发，和未来人群的实现-人工智能应用程序，其中从人群中获得的人类智能与人工智能深度学习模型紧密集成，以显着提高人工智能或人类的系统性能。只有解决方案。该项目解决了人工智能和DeepCrowd中众包平台的黑箱挑战，采用跨学科方法，灵感来自人工智能，机器学习，估计理论和网络人类交互技术。具体而言，该研究包括i）开发一种群体任务生成方案，以有效地查询众包平台以获得反馈; ii）创建一种新颖的自适应机制，以激励群体及时准确地响应; iii）设计一种交互式注意力神经网络方案，使群体和AI模型之间能够直接交互;以及iv）开发一个人群和AI集成引擎，该引擎有效地结合了来自人群的反馈，以减轻AI的失败场景。由此产生的DeepCrowd框架是变革性的，因为它将产生一套新的人群-人工智能交互模型和技术，以构建具有提升系统性能的新型人群辅助人工智能应用。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。