CHS: Small: An Optimized Human-Machine Intelligence Framework for Single and Multi-Label Classification Tasks Through Active Learning

该项目的目标是通过主动学习为单标签和多标签分类问题开发一个优化的人机智能框架。重点是基于公民科学的网络人类系统，收集物种观测信息用于生态应用，但研究结果将适用于更广泛的领域。 它将调整现有的几种主动学习技术用于单标签和多标签分类，但在众包的背景下研究它们，特别是考虑到以工人为中心的优化。创新在于系统地描述变量以模拟人为因素，设计适当结合联合收割机系统和以工人为中心的目标的优化模型，并发现创新的解决方案。该项目描述了一个迭代框架，该框架明智地使用人类工人来收集标签，反过来，这些标签又被监督机器算法用来进行智能预测。 该框架通过适当地结合主动学习和人为因素建模策略来合理地选择单标签和多标签分类问题的任务和工人，从而得出其原则。主要的智力贡献是：1。新的以工人为中心的优化模型，通过人为因素建模考虑与工人和任务相关的变量。2.通过主动学习优化单标签分类的人机智能模型。3.通过主动学习优化多标签分类的人机智能模型。4.创新的解决方案，用于人为因素估计，单标签和多标签任务的任务分配。5.在公民科学领域的真实的世界部署和严格的评估。该项目可能会影响多个学科和领域的专家，如自然学家，生态学家，保护生物学家和公民科学家的作品。该奖项反映了NSF的法定使命，并已被认为是值得通过使用基金会的智力价值和更广泛的影响审查标准进行评估的支持。

The goal of this project is to develop an optimized human-machine intelligence framework for single and multi-label classification problems through active learning. The focus is on citizen science based cyber-human systems that collect species observation information for ecological applications, but the findings will apply more broadly. It will adapt several existing active learning techniques for single and multi-label classification, but study them in the context of crowdsourcing, especially considering worker-centric optimization. The innovations lie in systematically characterizing variables to model human factors, designing optimization models that appropriately combine system and worker-centric goals, and discovering innovative solutions. The project describes an iterative framework that judiciously employs human workers to collect labels, which, in turn, are used by the supervised machine algorithms to make intelligent predictions. The framework derives its principles by appropriately combining active learning and human factors modeling strategies to judiciously select tasks and workers for single and multi-labels classification problems. The key intellectual contributions are: 1. Novel worker-centric optimization models considering variables pertinent to workers and tasks through human factors modeling. 2. Optimized human-machine intelligence models for single-label classification through active learning. 3. Optimized human-machine intelligence models for multi-labels classification through active learning. 4. Innovative solutions for human factors estimation, task assignment for single and multi-labels tasks. 5. Real world deployment and rigorous evaluation in the citizen science domain. The project is likely to impact multiple disciplines and domain experts, such as the works of naturalists, ecologists, conservation biologists and citizen scientists.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.