III: Large: Discovering Complex Anomalous Patterns

许多最有趣和最有价值的发现都不是来自于对单个记录的评估，而是来自于识别一组以某种有趣的方式异常的记录。它们合在一起可能表明疾病爆发或新的犯罪活动模式的出现。人们可以将模式发现视为数据分析算法和具有该领域专业知识的人类用户之间的交互过程。这项研究将开发一个综合框架的概率方法与用户在检测，表征，解释和学习异常模式的记录组进行交互。重点是在许多情况下，数据（和概率模式被发现）是不适合使用其他现有的技术，如图挖掘或频繁集。所提出的方法将搜索记录的任意子集，并评估它们与已知的、可能非常复杂的概率模式的对应关系，或者它们在各种学习的统计模型下与基线数据匹配的失败。这些方法将帮助用户理解和建模所发现的、以前未知的异常，以便在将来遇到时能够识别为已知模式。智力MeritThis协作团队的研究人员将开发，实施和评估一个通用的，全面的，广泛适用的概率框架模式发现。拟议的工作将解决这些具有挑战性和重要的研究问题：-如何可以机器学习的概念，如classi #64257;阳离子和异常检测被推广到考虑组的记录，而不是单个记录？- 检测算法如何同时检测和区分已知和当前未知的模式类型？ - 算法如何向用户清楚地解释发现了什么模式以及为什么？- 算法如何通过用户的反馈学习新的模式类型？从海量数据集中的记录组中检测、表征、解释和学习模式的能力将为推进从数据中发现知识提供一种质的新方法。更广泛的影响虽然这些算法的应用是无数的，开发和测试将优先考虑在重症监护室（ICU）和飞机维修的病人护理领域。通过该团队现有的合作，该算法还将在项目期间用于其他领域，包括食品安全，天文学天空调查的科学发现以及犯罪活动地理热点的检测。总之，这些应用程序将证明方法的价值在广泛的领域和任务。关键词：异常模式;模式发现;概率模型;增量学习。

Many of the most interesting and valuable discoveries that can be made from data arise not from the evaluation of single records, but from identifying a set of records that are anomalous in some interesting way. Together they may indicate for example the emergence of a disease outbreak or new patterns of criminal activity. One can view pattern discovery as an interactive process between data analysis algorithms and human users who have expertise in the domain. This research will develop an integrated framework of probabilistic methods to interact with the user in detecting, characterizing, explaining, and learning anomalous patterns over groups of records. The focus is on the many situations where the data (and the probabilistic patterns to be discovered) are not appropriate for using other existing techniques, such as graph mining or frequent sets. The proposed methods will search over arbitrary subsets of records and evaluate their correspondence to known, potentially very complex, probabilistic patterns, or their failure to match baseline data under various learned statistical models. These methods will assist the user in understanding and modeling the discovered, previously unknown anomalies to be identifiable as a known pattern when encountered in the future. Intellectual MeritThis collaborative team of researchers will develop, implement, and evaluate a general, comprehensive, and widely applicable probabilistic framework for pattern discovery. The proposed work will address these challenging and important research questions: - How can machine learning concepts such as classification and anomaly detection be generalized to consider groups of records rather than single records? - How can a detection algorithm simultaneously detect and differentiate between known and currently unknown pattern types? - How can an algorithm explain clearly to a user what pattern was found and why? - How can an algorithm learn new pattern types through feedback from a user?The ability to detect, characterize, explain, and learn patterns from groups of records in massive datasets will provide a qualitatively new approach for advancing discovery of knowledge from data. Broader ImpactAlthough the applications for these algorithms are innumerable, development and testing will be prioritized in the areas of patient care in the intensive care unit (ICU) and aircraft fleet maintenance. Through the team's existing collaborations, the algorithms will also be used during the project in other areas including food safety, scientific discovery in astronomy sky surveys, and detection of geographic hot-spots of criminal activity. Together, these applications will demonstrate the methods' value across a wide spectrum of domains and tasks. Key Words: anomalous patterns; pattern discovery; probabilistic models; incremental learning.