BIGDATA: Small: DA: Collaborative Research: From Data to Users: Providing Interpretable and Verifiable Explanations in Data Mining

数据挖掘的成果遍及我们生活的方方面面。我们有推荐的书籍和电影；我们的保险有差别定价；筛查潜在的恐怖威胁；被诊断患有各种疾病；并成为政治广告的目标。通过复杂的算法筛选大量数据集的能力导致了具有令人印象深刻的预测能力的应用程序。然而，这些工具所能提供的东西与数据挖掘用户真正需要的东西之间仍然存在差距。通常很难解释由学习算法产生的答案，因为它的复杂性和使用大型数据集来构建模型。挖掘的结果通常是“一刀切”的，很难让用户相信结果实际上与他们相关。最后，还有一个重要的验证问题。随着数据挖掘的结果越来越多地影响我们的生活，用户能够验证代表他们做出的决定和影响他们的决定就变得越来越重要。将这些问题联系在一起的共同主题是以用户为中心的视角来看待数据挖掘问题。而不是问“在这堆积如山的数据中可以找到什么模式？”，而是问“这些数据中的什么结构会影响我？”这些问题的出现恰恰是因为我们现在有能力挖掘大量的数据，以及我们可以使用的分析这些数据的复杂方法。在本研究中，pi开发了以用户为中心的数据挖掘的计算框架和关键工具。本研究的中心主题是互动的概念。在机器学习和复杂性理论的基础中，交互已经被用来允许一个（较弱的）实体探测一个更强大的系统，并确定它缺乏直接计算资源的答案。为了使用户能够解释和验证数据挖掘的结果，从用户与强大的算法交互的角度，以及从客户端与访问大数据的计算源交互的角度来看，pi使用正式的交互机制。该项目的目标是为以用户为中心的数据挖掘开发一个计算框架，使现有用户能够根据自己的需求定制数据分析，并促进在现有的新领域使用数据挖掘。该团队提出了交互机制，该机制从学习过程的结果开始，通过与用户的交互，产生用有意义的特征来表达的解释，利用主动学习、特征选择、以及领域适应。2. 局部性：相关的答案。在这里，重点是提供更多取决于用户的信息。这是通过一种新的当地稳定观念来实现的。3. 可验证性：您可以检查的答案。该团队提出了一个框架，用于验证计算能力较弱的用户对计算密集型数据挖掘的验证，其思想来自交互式证明理论和流算法。用于分析患者医疗数据的工具已经变得更加复杂，个人医疗档案在诊断和治疗中发挥着更重要的作用。本研究通过三个核心原语（分类、回归和聚类）考察了以用户为中心的数据挖掘，并研究了解释结果、提供局部解释和验证数据挖掘结果的三个问题。首先，研究借鉴了主动学习、特征选择和领域自适应的思想，通过与用户的交互构建可解释的结果。其次，它引入了局部稳定性概念，作为验证特定用户预测的一种方式。最后，通过借鉴交互式证明理论和流算法的思想，开发了一个通用框架，用于验证计算能力较弱的用户的分析。

The fruits of data mining pervade every aspect of our lives. We have books and movies recommended; we are given differential pricing for insurance; screened for potential terror threats; diagnosed with various diseases; and targeted for political advertising. The ability to sift through massive data sets with sophisticated algorithms has resulted in applications with impressive predictive power. And yet there is still a gap between what such tools can deliver, and what the users of data mining really need. It is often hard to interpret the answers produced by a learning algorithm, due to its sophistication and the use of large data sets to build models. The results of mining are often "one-size-fits-all", and convincing a user that results are actually relevant to them is difficult. Finally, there is the important problem of validation. As the results of data mining affect more and more of our lives, the more crucial it is that the user be able to validate decisions made on their behalf and that affect them. The common theme tying these issues together is a user-centric perspective on the problems of data mining. Rather than asking "What patterns can be found in this mountain of data?" this work instead asks "What structures in this data affect me?" These issues arise precisely because of the vast amounts of data we now have the ability to mine, and the sophisticated methods at our disposal to analyze this data. In this research, the PIs develop a computational framework and key tools for user-centric data mining. A central theme in this research is the idea of interaction. In both machine learning and in the foundations of complexity theory, interaction has been used to allow a (weaker) entity to probe a much more powerful system and determine answers that it lacks the resources to compute directly itself. The PIs use formal interaction mechanisms both from the perspective of a user interacting with a powerful algorithm, as well as a client interacting with a computing source with access to large data, in order to enable the user to interpret and validate the results of data mining. The goal of this project is to develop a computational framework for user-centric data mining that enables existing users to tailor data analysis to their needs and facilitates the use of data mining in new areas where existing The team proposes interactive mechanisms that start with the results of a learning process and, via interaction with the user, produce an explanation expressed in terms of meaningful features, drawing on ideas from active learning, feature selection, and domain adaptation. 2. Locality: Answers that are relevant. Here, the focus is on providing information that depends more on a user?s local neighborhood, achieved via a new local notion of stability. 3. Verifiability: Answers you can check. The team proposes a framework for the validation of computationally-intensive data mining by the computationally-weak user, with ideas from interactive proof theory and stream algorithms. Tools for analyzing patient medical data have become more sophisticated and individual medical profiles play a far more significant role in diagnosis and treatment.The research examines user-centric data mining via three core primitives (classification, regression and clustering), and studies the three problems of interpreting results, providing local explanations, and validating the results of data mining. Firstly, the research draws on ideas from active learning, feature selection and domain adaptation to build interpretable results via interaction with users. Secondly, it introduces local notions of stability as a way of validating predictions for a specific user. Finally, it develops a general framework for validation of an analysis by a computationally-weak user, by drawing on ideas from the theory of interactive proofs and streaming algorithms.