AIS: Learning from Initially Labeled Nonstationary Streaming Data

本研究的目的是开发一种新的框架，用于分析大量流数据，其中数据特征随时间变化，并且所有新数据都是未标记和非结构化的。所提出的工作将是开创性的分析流非平稳和未标记的数据，同时消除不切实际的假设和现有方法所做的简化。该方法使用小的初始训练数据来标记当前未标记的新数据，在该数据周围创建包络并缩小包络以确定数据的核心支持区域。从该区域提取样本作为未来的训练数据，迭代标记新传入的未标记漂移数据。一旦初始化，这种方法就不需要标记数据，并且可以无限期地跟踪数据分布的变化。主要的智力价值是一个新的框架，解决了可以说是最具挑战性的学习问题之一，通过机器学习和计算几何尝试的战略集成来完成。通过该框架的正式开发将获得重要的基础知识，这将使许多现实世界的应用受益，目前在现有方法下没有得到适当的解决。更广泛的影响：拟议的框架有望使我们更接近真正的自适应和智能（类脑）学习，并允许对从上述场景中提取的数据进行适当的分析，这些场景的应用包括网络入侵、网络安全、网络使用分析、自然语言处理、异常检测、气候变化和能源需求分析。该项目的教育部分将形成综合研究和学习社区，吸引本科生进入这个领域。

The objective of this research is to develop a novel framework for analysis of large volumes of streaming data, where data characteristics change over time, and all new data are unlabeled and unstructured. The proposed work will be seminal for analyzing streaming nonstationary and unlabeled data while removing the unrealistic assumptions and simplifications made by existing approaches. The proposed approach uses small initial training data to label the currently unlabeled new data, creates an envelope around this data and shrinks the envelope to determine the core support region of the data. Samples are extracted from this region to serve as future training data to iteratively label the new incoming unlabeled drifting data. Once initialized, this approach never needs labeled data, and can indefinitely track the changes in data distribution. The primary intellectual merit is a new framework, addressing arguably one of the most challenging learning problems, accomplished by strategic integration of machine learning and computational geome-try. Significant fundamental knowledge will be obtained through formal development of this framework, which will then benefit many real-world applications, currently not properly addressed under existing ap-proaches. Broader Impacts: The proposed framework promises to bring us closer to truly adaptive and intelligent (brain-like) learning, and allow proper analysis of data drawn from aforementioned scenarios, whose ap-plications include network intrusion, cyber security, web-usage analysis, natural language processing, anomaly detection, climate change and energy demand analysis. Project's educational component will form Integrated Research and Learning Communities, drawing undergraduate students to whom this field has been mostly inaccessible.