Collaborative Research: AIS: Incremental Learning from Unbalanced Data in Nonstationary Environments

合作研究：AIS：非平稳环境中不平衡数据的增量学习

• 批准号: 0926170
• 负责人: Nitesh Chawla
• 金额: $ 16.49万
• 依托单位: University of Notre Dame
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-09-01 至 2013-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0926170&HistoricalAwards=false
• 关键词: Collaborative; Research; AIS; Incremental; Learning

"This award is funded under the American Recovery and Reinvestment Act of 2009 (Public Law 111-5)"The ultimate goal of computational intelligence has long been emulating brain-like-intelligence by discovering and learning patterns from data. However, in related research, the data have been assumed to be generated by an underlying fixed physical process. Recently, new algorithms have emerged that can accommodate new data, or data with unbalanced distributions. However, learning from a non-stationary environment, where the underlying process that generates the data changes over time, has received less attention, whereas the problem of learning in a non-stationary environment that incrementally provides unbalanced data has received hardly any attention. Since the brain can and routinely does learn in such settings, the need for a general framework for learning from ? and adapting to ? a nonstationary environment that introduces unbalanced data can be hardly overstated. Spam detection, epidemiological studies, or analysis of climate change, are just a few examples of such scenarios. Given such a scenario of unbalanced data, the goal of this project is to develop a general framework that would recognize if and when there has been a change, learn novel content, reinforce existing knowledge that is still relevant, and forget what may no longer be relevant. Our hypothesis is that learning from unbalanced and nonstationary data can be achieved by strategic use of i.) data regeneration through local extrapolation ? to help balance the unbalanced dataset ? combined with ii.) an incrementally generated ensemble of experts model that use dynamically assigned weights to emulate short and long term memory properties of the brain ? to help track the changing environments.

该奖项是根据2009年美国复苏和再投资法案（公法111-5）资助的。然而，在相关的研究中，数据被假定为由一个潜在的固定物理过程产生。最近，出现了新的算法，可以适应新的数据，或具有不平衡分布的数据。然而，从非平稳环境中学习，其中生成数据的底层过程随时间而变化，受到的关注较少，而在增量提供不平衡数据的非平稳环境中学习的问题几乎没有受到任何关注。既然大脑可以并且经常在这样的环境中学习，那么需要一个通用的学习框架吗？和适应？引入不平衡数据的非平稳环境几乎不可能被夸大。垃圾邮件检测、流行病学研究或气候变化分析只是此类情况的几个例子。鉴于这种不平衡数据的情况，本项目的目标是开发一个通用框架，该框架将识别是否以及何时发生变化，学习新内容，加强仍然相关的现有知识，并忘记可能不再相关的内容。我们的假设是，从不平衡和非平稳数据中学习可以通过策略性地使用i来实现。通过局部外推法重新生成数据？来帮助平衡不平衡的数据集与二）。一个增量生成的专家模型，使用动态分配的权重来模拟大脑的短期和长期记忆特性？来帮助追踪不断变化的环境。