CRII: CHS: Techniques for Helping Domain Experts Understand and Improve Models Underlying Intelligent Systems

CRII：CHS：帮助领域专家理解和改进智能系统底层模型的技术

• 批准号: 1850183
• 负责人: Xiang Chen
• 金额: $ 17.5万
• 依托单位: University of California-Los Angeles
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-02-15 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1850183&HistoricalAwards=false
• 关键词: CRII; CHS; Techniques; Helping; Domain

A number of computing systems include intelligent components, employing algorithms or computational models that process data and make decisions or recommendations based on the data. These models often function as 'black boxes': their internal mechanisms are often not visible to their users, and when they are, they are usually in a form that requires training in computer science to understand and modify them. They underlie many socially useful functions, ranging from risk scoring to autonomous vehicles, which makes it important for their users -- who are often experts in the specific domain of use, but not in computing -- to be able to use and improve the models. This project's goal is to develop techniques that will help human users who are not trained computer scientists interact with these models using concepts and interaction techniques based on the specific domain and problem at hand rather than the underlying algorithms. This will lead to scientific advances in the broader area of explainable artificial intelligence, as well as increasing the transparency and usefulness of intelligent systems that affect everyday life. The project will also support a number of course development and outreach activities and develop freely available toolkits for other researchers and developers to use. The long-term goal of this project is to computationally generate visualizations to reveal how intelligent systems work to non-computing knowledge workers. To progress toward this goal, the project team will focus on three major research activities. First, they will conduct a bottom-up, four-pass analysis of literature spanning multiple research communities (Artificial Intelligence, Machine Learning, Computer Science Education, Human-Computer Interaction, and Visualization) to summarize key design dimensions of visualizing intelligent systems. Second, they will collect empirical evidence of how these systems are currently used and understood in the medical domain by observing how medical professionals interact with data and make sense of domain-specific intelligent systems. Third, based on the first two activities, they will develop computational methods to illustrate how these systems work by visualizing how user-sampled data is transformed into final results, while providing controls for domain experts to interact with the model.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

许多计算系统包括智能组件，采用算法或计算模型来处理数据并根据数据做出决策或建议。 这些模型通常充当“黑匣子”：它们的内部机制通常是用户看不见的，当它们的内部机制通常以计算机科学培训以了解和修改它们的形式。 它们是许多具有社会有用的功能的基础，从风险评分到自动驾驶汽车，这使得对其用户的重要性 - 他们通常是特定使用领域的专家，但在计算方面却没有 - 能够使用和改进模型。 该项目的目标是开发技术，这些技术将帮助未经培训的计算机科学家使用概念和互动技术基于特定领域和当前的问题而不是基础算法进行互动。 这将导致可解释的人工智能更广泛领域的科学进步，并提高影响日常生活的智能系统的透明度和实用性。 该项目还将支持许多课程开发和推广活动，并为其他研究人员和开发人员提供免费的工具包。该项目的长期目标是在计算上产生可视化，以揭示智能系统如何用于非计算知识工作者。为了朝着这一目标迈进，项目团队将专注于三个主要的研究活动。 首先，他们将对多个研究社区（人工智能，机器学习，计算机科学教育，人类计算机互动和可视化）进行自下而上的四次分析，以总结可视化智能系统的关键设计维度。 其次，他们将通过观察医学专业人员如何与数据互动并理解特定领域的智能系统，以收集有关这些系统当前如何使用和理解这些系统的经验证据。 第三，根据前两项活动，他们将开发计算方法来说明这些系统如何通过可视化用户采样的数据如何转化为最终结果，同时为领域专家提供控制权以与模型进行互动的控制。该奖项反映了NSF的法定任务，并通过使用基金会的知识优点和广泛的影响来评估NSF的法定任务。