BIGDATA: Small: DA: Collaborative Research: From Data To Users: Providing Interpretable and Verifiable Explanations in Data Mining

数据挖掘的成果渗透到我们生活的方方面面。 我们有书籍和电影的推荐;我们有不同的保险定价;筛选潜在的恐怖威胁;诊断出各种疾病;并成为政治广告的目标。通过复杂的算法筛选大量数据集的能力已经产生了具有令人印象深刻的预测能力的应用程序。 然而，在这些工具所能提供的与数据挖掘用户真正需要的之间仍然存在差距。由于学习算法的复杂性和使用大数据集来构建模型，通常很难解释学习算法产生的答案。挖掘的结果往往是"一刀切"的，很难让用户相信结果实际上与他们相关。 最后，还有一个重要的验证问题。随着数据挖掘的结果越来越多地影响我们的生活，用户能够验证代表他们做出的影响他们的决策就变得越来越重要。将这些问题联系在一起的共同主题是以用户为中心的数据挖掘问题的观点。而不是问"在这堆积如山的数据中可以找到什么模式？这项工作，而不是问"什么结构，在这个数据影响我？" "这些问题的出现正是因为我们现在有能力挖掘大量的数据，以及我们可以使用复杂的方法来分析这些数据。在这项研究中，PI开发了以用户为中心的数据挖掘的计算框架和关键工具。本研究的一个中心主题是互动的概念。在机器学习和复杂性理论的基础中，交互被用来允许一个（较弱的）实体探测一个更强大的系统，并确定它缺乏资源直接计算的答案。PI使用正式的交互机制，从用户与强大的算法交互的角度来看，以及客户端与访问大量数据的计算源交互，以便使用户能够解释和验证数据挖掘的结果。该项目的目标是为以用户为中心的数据挖掘开发一个计算框架，使现有的用户能够根据他们的需求定制数据分析，并促进在新的领域使用数据挖掘，在这些领域，现有的团队提出了互动机制，从学习过程的结果开始，通过与用户的互动，产生以有意义的特征表示的解释，从主动学习、特征选择和领域适应中汲取思想。2.局部性：相关的答案。在这里，重点是提供更多依赖于用户的信息？的局部邻域，通过一个新的局部稳定的概念。3.可验证性：您可以检查的答案。该团队提出了一个框架，用于验证计算密集型数据挖掘的计算薄弱的用户，从交互式证明理论和流算法的想法。分析病人医疗数据的工具越来越复杂，个人的医疗档案在诊断和治疗中发挥着越来越重要的作用，本研究探讨了以用户为中心的数据挖掘通过三个核心原语（分类，回归和聚类），并研究了解释结果，提供本地解释，并验证数据挖掘结果的三个问题。首先，该研究借鉴了主动学习，特征选择和领域适应的思想，通过与用户的交互来构建可解释的结果。其次，它引入了稳定性的局部概念，作为验证特定用户预测的一种方式。最后，它开发了一个通用的框架，用于验证计算能力弱的用户的分析，通过借鉴交互式证明理论和流算法的思想。

The fruits of data mining pervade every aspect of our lives. We have books and movies recommended; we are given differential pricing for insurance; screened for potential terror threats; diagnosed with various diseases; and targeted for political advertising. The ability to sift through massive data sets with sophisticated algorithms has resulted in applications with impressive predictive power. And yet there is still a gap between what such tools can deliver, and what the users of data mining really need. It is often hard to interpret the answers produced by a learning algorithm, due to its sophistication and the use of large data sets to build models. The results of mining are often "one-size-fits-all", and convincing a user that results are actually relevant to them is difficult. Finally, there is the important problem of validation. As the results of data mining affect more and more of our lives, the more crucial it is that the user be able to validate decisions made on their behalf and that affect them. The common theme tying these issues together is a user-centric perspective on the problems of data mining. Rather than asking "What patterns can be found in this mountain of data?" this work instead asks "What structures in this data affect me?" These issues arise precisely because of the vast amounts of data we now have the ability to mine, and the sophisticated methods at our disposal to analyze this data. In this research, the PIs develop a computational framework and key tools for user-centric data mining. A central theme in this research is the idea of interaction. In both machine learning and in the foundations of complexity theory, interaction has been used to allow a (weaker) entity to probe a much more powerful system and determine answers that it lacks the resources to compute directly itself. The PIs use formal interaction mechanisms both from the perspective of a user interacting with a powerful algorithm, as well as a client interacting with a computing source with access to large data, in order to enable the user to interpret and validate the results of data mining. The goal of this project is to develop a computational framework for user-centric data mining that enables existing users to tailor data analysis to their needs and facilitates the use of data mining in new areas where existing The team proposes interactive mechanisms that start with the results of a learning process and, via interaction with the user, produce an explanation expressed in terms of meaningful features, drawing on ideas from active learning, feature selection, and domain adaptation. 2. Locality: Answers that are relevant. Here, the focus is on providing information that depends more on a user?s local neighborhood, achieved via a new local notion of stability. 3. Verifiability: Answers you can check. The team proposes a framework for the validation of computationally-intensive data mining by the computationally-weak user, with ideas from interactive proof theory and stream algorithms. Tools for analyzing patient medical data have become more sophisticated and individual medical profiles play a far more significant role in diagnosis and treatment.The research examines user-centric data mining via three core primitives (classification, regression and clustering), and studies the three problems of interpreting results, providing local explanations, and validating the results of data mining. Firstly, the research draws on ideas from active learning, feature selection and domain adaptation to build interpretable results via interaction with users. Secondly, it introduces local notions of stability as a way of validating predictions for a specific user. Finally, it develops a general framework for validation of an analysis by a computationally-weak user, by drawing on ideas from the theory of interactive proofs and streaming algorithms.